|
This article only applies to time series data
This article is only relevant when working with time series data, not when working with movement data. You can read more about the differences between the two in this article. |
When working with time series data, you have 2 kind of files:
Geometry files which define:
The id of each measurement device or area
The location of the device or the covered area
Additional properties of each device or area
Data files containing the actual measurements. Each record contains:
The id of the device or area to which the measurement belongs
The timestamp at which the measurement was taken
The actual measurement(s)
Uploading your time series files is a multistep process:
Create a data set: a data set is the resource in which the platform saves your data
Define the properties of your geometry files: the platform needs to know which property represents the id of the measurement device or area, and which of the other properties you are interested in.
Upload your geometry files: before you can upload any of the measurement files, you need to upload your files so that the platform knows the locations of the measurements.
Define the structure of your measurement files: just like for your files, the platform needs to know the structure of your measurement files. For example where the timestamps and id values are stored and which other properties/measurements are important.
Upload your measurement files: now that the platform has all the information, you can start uploading your measurement files and the platform engine will process it.
|
New to data uploads ? Follow the tutorial !
There is a tutorial available where you go through the whole process of uploading your time series data to the platform. That is the best starting point for people trying to upload data for the first time. The article you are currently reading and the articles it refers to provide more in-depth information compared to the tutorial, but they won’t guide you through the whole process. |
The platform supports the following file formats for time series data sets:
Geometry files: .geojson files.
Measurement data files: .csv and .parquet files.
Before you can upload your data to a data set containing time series data, you need to create an empty data set. How to do this is explained in this article.
The platform needs to know the property that represents the id of the measurement device or area in the geometry files you are going to upload, as well as any other properties you’re interested in.
The geometry files only contain data, but don’t tell you anything about the properties in that data. They don’t specify:
Which property represents the id
Which properties are relevant for you
Which properties contain information that can be ignored
You will have to provide this information so that the platform knows how to interpret those geometry files. This is explained in the Configure data properties article.
Once the properties of your geometry files are configured, uploading the files is as straightforward as drag-and-dropping them onto a widget.
The upload geometry and time series data files article provides more details on this.
The platform needs to know the structure of the measurement files you are going to upload.
Those files only contain data, but don’t tell you anything about the format of the data. They don’t specify:
Which column contains the id of the measurement device
Which column contains the timestamp
Which columns contain properties you are interested in
Which columns contain information that can be ignored
CSV files don’t even contain information about how the data is stored: are it numbers or are it strings ?
…
You will have to provide this information so that the platform knows how to interpret the data in the measurement files. This is explained in the Configure data properties article.
Once everything is configured, uploading data is as straightforward as drag-and-dropping your measurement files onto a widget. The data upload will start, and when the platform has received the files it will start processing them.
The upload GeoJSON and time series data files article provides more details on this.