Electricity Transformer Data Migration
Introducing the Electricity Transformer Data Migration
1. Check raw data
All four different files based on region and time unit are in the format shown in the image below.

2. Set the Preprocessing Plan
Transforming and merging each of the files.
- Convert to the format: Name, Time, Value.
- Convert to UTC time.
Convert to the format: Name, Time, Value
Convert to UTC time
Once the data frame is restructured as shown in the image below, it will be ready for upload to Machbase Neo.

3. Data Upload
Finally, the data can be uploaded to Machbase Neo using the command below.
machbase-neo shell import --input ./datahub-2024-06-elec-transformer.csv.gz --compress gzip --header --method append --timeformat ns elec_trans
Check the entire code.
datahub/dataset/2024/06.Electricity Transformer Dataset (ETDataset)/conv/convert.py at main · machbase/datahub
All Industrial IoT DataHub with data visualization and AI source - machbase/datahub
4. Check the results after uploading

Output when executing the following code in the Machbase Neo internal shell.
select * from v$elec_trans_stat;
※ Subsequent link to the AI training process: Electricity Transformer Data