VPTS CSV

VPTS CSV is a community developed data exchange format for biological signals detected by weather radars. VPTS (vertical profile time series) express the density, speed and direction of biological signals such as birds, bats and insects within a weather radar volume, grouped into altitude layers (height) and measured over time (datetime).

VPTS CSV is a tabular format (rows and columns), allowing data to be expressed as CSV files. Columns/fields are defined below using Table Schema properties. The format aims to be simple rather than comprehensive, containing the most important information, rather than all the available metadata.

VPTS CSV is maintained at https://github.com/enram/vpts-csv.

Example

radar,datetime,height,u,v,w,ff,dd,sd_vvp,gap,eta,dens,dbz,dbz_all,n,n_dbz,n_all,n_dbz_all,rcs,sd_vvp_threshold,vcp,radar_latitude,radar_longitude,radar_height,radar_wavelength,source_file
KBGM,2016-09-01T00:02:00Z,0,,,,,,,TRUE,,,,,0,0,0,0,11,2,,42.19972,-75.98472,519,10.6,s3://noaa-nexrad-level2/2016/09/01/KBGM/KBGM20160901_000212_V06
KBGM,2016-09-01T00:02:00Z,200,,,,,,,TRUE,,,,,0,0,0,0,11,2,,42.19972,-75.98472,519,10.6,s3://noaa-nexrad-level2/2016/09/01/KBGM/KBGM20160901_000212_V06
KBGM,2016-09-01T00:02:00Z,400,,,,,,2.81,TRUE,30.8,2.8000000000000003,1.54,3.77,326,356,22485,28416,11,2,,42.19972,-75.98472,519,10.6,s3://noaa-nexrad-level2/2016/09/01/KBGM/KBGM20160901_000212_V06
KBGM,2016-09-01T00:02:00Z,600,4.14,3.84,12.17,5.65,47.2,2.8,FALSE,46.9,4.263636363636364,3.36,0.5,9006,13442,65947,104455,11,2,,42.19972,-75.98472,519,10.6,s3://noaa-nexrad-level2/2016/09/01/KBGM/KBGM20160901_000212_V06

Requirements

The key words MUST, MUST NOT, REQUIRED, SHALL, SHALL NOT, SHOULD, SHOULD NOT, RECOMMENDED, MAY, and OPTIONAL in this document are to be interpreted as described in RFC 2119.

  • Data MUST include the names of the fields (e.g. as a header row).
  • Data MUST refer to fields using the names defined below.
  • Data MUST at least include the required fields (indicated with * below).
  • Data MUST use this CSV dialect when expressed as CSV. See CSV dialect documentation.
  • nodata values SHOULD be expressed as empty values.
  • undetect values SHOULD be expressed as NaN.
  • Field values SHOULD match the data types as defined below.
  • Field values SHOULD meet the constraints as defined below, except for NaN and empty values.
  • Data SHOULD be ordered by datetime, height and source_file within a radar.
  • Data SHOULD have the same heights for all datetimes of a radar.
  • Fields SHOULD be organized in the order presented below.

Fields

Source: https://github.com/enram/vpts-csv/blob/main/vpts-csv-table-schema.json

Name Definition Type Example
radar *

Radar identifier.

Constraints
  • required: true
string

KBGM

datetime *

Nominal date and time of the measurement, as an ISO 8601 formatted string in UTC.

Constraints
  • required: true
datetime

2016-09-01T00:02:00Z

height *

Lower bound of the altitude bin in m above sea level.

Constraints
  • required: true
  • minimum: -200
  • maximum: 25000
Also known as: HGHT, bin_lower
integer

600

u

Ground speed component west to east in m/s.

Constraints
  • minimum: -100
  • maximum: 100
number

4.14

v

Ground speed component south to north in m/s.

Constraints
  • minimum: -100
  • maximum: 100
number

3.84

w

Vertical speed in m/s.

number

12.17

ff

Horizontal ground speed in m/s.

Constraints
  • minimum: 0
  • maximum: 100
Also known as: speed
number

5.65

dd

Ground speed direction in degrees clockwise from north.

Constraints
  • minimum: 0
  • maximum: 360
Also known as: direction
number

47.2

sd_vvp

VVP radial velocity standard deviation in m/s.

Constraints
  • minimum: 0
  • maximum: 100
Also known as: rmse
number

2.8

gap

Angular data gap detected.

boolean

FALSE

eta

Animal reflectivity in cm^2/km^3.

Constraints
  • minimum: 0
  • maximum: Inf
Also known as: linear_eta
number

46.9

dens

Animal density in animals/km^3.

Constraints
  • minimum: 0
  • maximum: Inf
number

4.263636363636364

dbz

Animal reflectivity factor in dBZ.

Constraints
  • minimum: -Inf
  • maximum: 100
number

3.36

dbz_all

Total reflectivity factor (bio + meteo scattering) in dBZ.

Constraints
  • minimum: -Inf
  • maximum: 100
Also known as: DBZH
number

0.5

n

Number of data points used for the ground speed estimates (quantities u, v, w, ff, dd).

Constraints
  • minimum: 0
integer

9006

n_dbz

Number of data points used for reflectivity-based estimates (quantities dbz, eta, dens).

Constraints
  • minimum: 0
integer

13442

n_all

Number of data points used for the radial velocity standard deviation estimate (quantity sd_vvp).

Constraints
  • minimum: 0
integer

65947

n_dbz_all

Number of data points used for the total reflectivity estimate (quantity dbz_all).

Constraints
  • minimum: 0
Also known as: nbins
integer

104455

rcs

Radar cross section per bird in cm^2.

Constraints
  • minimum: 1e-15
  • maximum: Inf
number

11

sd_vvp_threshold

Lower threshold in radial velocity standard deviation (profile quantity sd_vvp) in m/s. Biological signals with sd_vvp < sd_vvp_threshold are set to zero. Defaults to 2 m/s for C-band radars and 1 m/s for S-band radars if not specified.

Constraints
  • minimum: 0
  • maximum: 100
number

2

vcp

Volume coverage pattern, unitless. Documented on Wikipedia for NEXRAD.

Also known as: scan_strategy
integer
radar_latitude *

Latitude of the radar location in decimal degrees, using the WGS84 datum. Constant for all records from the same radar.

Constraints
  • required: true
  • minimum: -90
  • maximum: 90
number

42.19972

radar_longitude *

Longitude of the radar location in decimal degrees, using the WGS84 datum. Constant for all records from the same radar.

Constraints
  • required: true
  • minimum: -180
  • maximum: 180
number

-75.98472

radar_height *

Height of the center of the radar antenna in m above sea level. Constant for all records from the same radar.

Constraints
  • required: true
  • minimum: -200
  • maximum: 9000
integer

519

radar_wavelength *

Wavelength of the radar in cm. Constant for all records from the same radar. Most C-band radars operate at approximately 5.3 cm wavelength, most S-band radars at 10.6 cm.

Constraints
  • required: true
  • minimum: 0.1
  • maximum: 100
number

10.6

source_file

URL or path to the source file from which the data were derived.

Constraints
  • pattern: ^(?=^[^./~])(^((?!\.{2}).)*$).*$
string

s3://noaa-nexrad-level2/2016/09/01/KBGM/KBGM20160901_000212_V06