Smoke Sensor Data Migration



Introducing the Smoke Sensor Data Migration

1. Check raw data

Since the time intervals are in nanoseconds, it seems necessary to set new time values at 1-second intervals.

2. Set the Preprocessing Plan

  • Data reorganization.
    • Make new time values at 1-second intervals.
    • Convert to the format: Name, Time, Value & Convert to UTC time.

Data reorganization

  • Make new time values at 1-second intervals.
  • Convert to the format: Name, Time, Value & Convert to UTC time.

Once the data frame is restructured as shown in the image below, it will be ready for upload to Machbase Neo.

3. Data Upload

Finally, the data can be uploaded to Machbase Neo using the command below.

machbase-neo shell import --input ./datahub-2025-3-Smoke.csv.gz --compress gzip --header --method append --timeformat ns smoke

Check the entire code.

datahub/dataset/2025/03.Smoke Sensor Data/conv/convert.py at main · machbase/datahub
All Industrial IoT DataHub with data visualization and AI source - machbase/datahub

4. Check the results after uploading

Output when executing the following code in the Machbase Neo internal shell.

select * from v$smoke_stat;

※ Subsequent link to the AI training process: Smoke Sensor Data

Back to Top