Skip to content

Importing data into Integrated Data Lake

The "Time Series Import" service allows the authorized users to import the historical IoT time series data to Integrated Data Lake. This enables an on-demand time series upload for analytics and machine learning tools.

Procedure

To import IoT time series data into Integrated Data Lake, follow these steps:

  1. Click the "Time Series Import" tab.
  2. Select the Time Series Import icon.

    The "Import Task Details" screen appears.

    Import Time series data

  3. Enter the "Destination Path" and the "Task Name".

  4. Expand the "Date/time Range" option to set the date and time.
  5. Click "Date/Time Range" to select the date and time range and click "Set".
  6. Expand the "Assets/Aspects" option to select the assets and corresponding aspects.

    Assets-Aspects

    Note

    You can click refresh icon to refresh the asset list.

  7. Select tenant or subtenant to get the respective assets from the "Assets" list and corresponding aspects from the "Aspects" list.

  8. Click "Preview & Save".

    Import Time Series Data Preview

  9. Click "Save".

  10. The "Import Task Details" status "Success" screen appears.

    Import Task Details

  11. Click "Refresh Task" button to get the latest status of the import task.

    Click "Delete Task" button to delete the task from the "Task Schedule" pane.

Note

  • Integrated Data Lake application will not allow the user to import the duplicate data based on "Date/Time Range", "Assets" and "Aspects" information. The application will provide the information about the existing bulk imports with the "Asset ID".
  • A user is not allowed to select more than 3 months data to import.
  • The Time Series data (parquet files) transferred to cold storage (typically within 7 days) and will be available in the Data Lake.
  • There is a change in the namespace of the Time Series data imported into Integrated Data Lake.

Result

The historical IoT time series data will be imported to Integrated Data Lake and success status will be displayed with the number of file count.

Any questions left?

Ask the community


Except where otherwise noted, content on this site is licensed under the MindSphere Development License Agreement.


Last update: May 11, 2022