Integrated Data Lake Direct Connection¶

Integrated Data Lake Direct Connection is a specialized solution that uses Amazon Athena to query your IDL data. It enables you to connect to your IDL parquet data without creating a data source first in BI Data. This potentially enables much larger sources of data, though you should design your query to select only the data that you need in your visualization in order to ensure good performance.

To publish a data source for IDL folder entities, follow these steps:

1. Create an Athena data schema from your folder of parquet data. The support team would advise on the API request parameters to partition your data.

2. Create the API key and secret key using the appropriate API call. Please discuss with the support team. You will need to regenerate a new secret key every month.

3. Open the "Insights Hub Business Intelligence" application.

4. To create a new datasource, select "New" and click "Published Data Source" from the dropdown menu.

5. Select "Connectors" and click "Amazon Athena".

6. Enter the details in the "General" tab:

   • Enter the Server as received from customer support.
   • Enter the S3 Staging Directory
   • In the Authentication section, select "Username and Password" and enter the Access Key ID and Secret Access Key
   • Click "Sign In".

   

7. To edit the data source, refer to Tableau.

8. To publish the data source, click "Publish As".

9. Enter the "Name" and enable the checkbox of "Embed credentials".

   

10. Click "Publish".