India Air Quality Data Migration
Introducing the India Air Quality Data Migration
1. Check raw data
The handling of missing values and file merging seems necessary.

2. Set the Preprocessing Plan
- Handling missing values using Linear Interpolation.
- Convert to the format: Name, Time, Value & Convert to UTC time.
Handling missing values using Linear Interpolation
Remove the missing values at the beginning and end, and fill the remaining missing values using linear interpolation.
Convert to the format: Name, Time, Value & Convert to UTC time
Once the data frame is restructured as shown in the image below, it will be ready for upload to Machbase Neo.

3. Data Upload
Finally, the data can be uploaded to Machbase Neo using the command below.
machbase-neo shell import --input ./datahub-2024-13-India-Air-Quality.csv.gz --compress gzip --header --method append --timeformat ns india_air_quality
Check the entire code.
datahub/dataset/2024/13.India Air Quality/conv/convert.py at main · machbase/datahub
All Industrial IoT DataHub with data visualization and AI source - machbase/datahub
4. Check the results after uploading

Output when executing the following code in the Machbase Neo internal shell.
select * from v$india_air_quality_stat;
※ Subsequent link to the AI training process: India Air Quality Data