Data

DB4IoT can store and analyze data from many different sources. Data can be streamed into DB4IoT in real time or uploaded through files. Moonshadow is constantly testing file formats and compatibility with software solutions that generate data. Please contact Moonshadow if you want to have DB4IoT tested with a specific file format or software solution.

DB4IoT data requirements:

Our preference (though not a requirement) is to receive a flat file CSV where every record includes:

  • VehicleID (Primary Key)
    Preferably as an Integer in a single field. We can work with Varchars or other data types if needed. We can combine multiple fields in a pre-processing step if needed.
  • Timestamp
    Ideally as a Unix Timestamp UTC Integer in a single field so we don’t need to convert time zones or combine fields. Use a decimal if the data is sub-second. If the data is in a time-zone specific format please let us know what time zone it was generated in as we will need to convert it. If the data is in a time-zone format we’d (really) like all data to be in a single time zone.
  • Latitude/Longitude
    We need to know what projection you are using. We use a Mercator Projection EPSG 4269. This is the projectionthatisusedbyOpenStreetMaps,BingMapsandGoogleMaps. Ifyouuseadifferentprojection please let us know which one it is, as we will need to convert it.
  • Additional Data Fields
    Please provide a data dictionary and data types. Data fields that don’t comply with the specified data type (text in a numeric column, for instance) are disregarded. The other fields in the record are imported. If you know the value range and the precision (decimal point) of a field please let us know. This will help us make the database smaller and faster. Please let us know if you have data values that have a special meaning (-9999 means NULL, for instance) in one or more columns.

We also distinguish between static fields that don’t usually change (car model, for instance) and dynamic fields that change frequently (speed, for instance). It is good to know which columns are static and which are dynamic but we can usually guess from the data and the data dictionary.
Download the PDF

DB4IoT is compatible with data from many software solutions and file formats, including:

Software Solutions:

  • INIT
    INIT is a major solution provider for ITS technologies and world market leader for ITS solutions in public transportation.The INIT system sends some data in real time but retains most of the data in log files on each bus. We have deployed DB4IoT with tens of thousands of daily bus log files including hundreds of millions of movement records that were parsed and stored in DB4IoT. We have also deployed datafeeds with INIT data that were first uploaded to a database application of a transit customer and then exported to DB4IoT.
    www.initse.com
  • Aimsun

    DB4IoT Visualizes Aimsun Micro Models.Moonshadow Mobile and Transport Simulation Systems (TSS) cooperated on testing. TSS provided Moonshadow with a microscopic model for the city of Granada, Spain. The model contained the movement data of 17,000 of vehicles 10 times per second for a one-hour period, for a total of five million records. DB4IoT can visualize the model.Aimsun is traffic modeling software from Transportation Simulation Systems (TSS) that allows you to model anything from a single bus lane to an entire region. Aimsun stands out for the exceptionally high speed of its simulations and for fusing travel demand modeling, static and dynamic traffic assignment with mesoscopic, microscopic and hybrid simulation – all within a single software application. Aimsun customers can create large micro-scale models based on the movement of individual vehicles, bicycles and pedestrians. The movement data from these models can be exported as an FZP file.
  • Caliper

    Caliper provided us with a TransModeler simulation model with 150 million records. Db4IoT can generate images multiple times per second from this model.TransModeler is a powerful and versatile traffic simulation package applicable to a wide array of traffic planning and modeling tasks. TransModeler can simulate all kinds of road networks, from freeways to downtown areas, and can analyze wide area multimodal networks in great detail and with high fidelity. You can model and visualize the behavior of complex traffic systems in a 2-dimensional or 3-dimensional GIS environment to illustrate and evaluate traffic flow dynamics, traffic signal and ITS operations, and overall network performance.
    www.caliper.com

File Formats:

  • CSV
  • FZP
  • GTFS Realtime

Send us a sample of your data to get started.