Mar 28, 2021
Data flow automation - Yes! But how?
A TU Dresden research group approached the Service Center Research Data for support in automating their data archive. The research group dedicates its activities to the analysis of local creeks in Dresden and continuously collects sensor data on the water quality.
The sensor data is continually generated on-site by a small measuring computer and automatically copied to the TU Dresden Datashare and a virtual machine in the Enterprise Cloud of the Centre for Information Services and High Performance Computing (ZIH) at fixed intervals.
A time series database was installed on the virtual machine and configured accordingly. The highlight: the researchers can use this database to retrieve the sensor data in "real time" via a web browser. And not only that: if required, the researchers can also use graphics to display the sensor data or have it processed automatically by configurable scripts.
The basis for this technical set-up was a data management concept that the Service Center Research Data developed in close coordination with the research group. The concept includes the folder structure for storing the measurement data, the synchronized transfer of the measurement data to the time series database as well as options for processing the data.
Do you also work with continuous measurement series or time series analyses? Or do you sometimes just wish for a little more automation in your data collection and storage?
You are very welcome to get in touch with us. Feel free to contact us by e-mail via Service Center Research Data or book an appointment appointment.