DataOS Power BI Connector

The DataOS connector is engineered to facilitate integration between the DataOS platform and Power BI. It provides an additional interface for accessing data from DataOS and leveraging Power BI's visualization and dashboarding capabilities.

This connector uses the Minerva query engine to channel data from DataOS into Power BI for exploration and analysis. Initially, users need to configure the connection settings. These settings enable Power BI to establish a secure and reliable connection to DataOS.

With the connector set up, users can start designing queries within Power BI. When a query is submitted from Power BI, the DataOS connector acts as an intermediary and sends it to the Minerva cluster for processing. Minerva then performs distributed SQL queries across connected data sources, potentially spanning multiple data lakes, databases, or external data services and returns the results to the connector. The selection of the appropriate Minerva cluster is automated and guided by a predefined criterion, which factors in sources(query origins), priority, and alphabetical order. In scenarios where these criteria are not applicable, a default cluster is designated for query execution.

End users have the capability to execute queries on any data source, provided a corresponding depot is established or a connector configuration is done for the data source to access it as a ‘catalog’ within the selected Minerva cluster. Additionally, it supports the execution of Lens queries within Power BI.

The DataOs connector functions in alignment with existing data and access policies. Users can confidently explore and analyze data from DataOS within Power BI, adhering to access policy decisions and data governance through data policy decisions such as masking and filtering of data.

Prerequisites

• Contact your customer success representative to obtain the connector installer file.
• DataOS API key is required to authenticate and access DataOS from the Power BI interface. To learn more about generating an API key/token, refer to Create API Key.

The following section contains further information about configuring this connector to retrieve and analyze data from DataOS within Power BI Desktop.

Installation of DataOS connector

1. Run the connector installer file.

   

   Connector installer
   

   Tableau visualization

2. Click the Next button to proceed.

3. Choose a destination folder for the connector installation and click Next.

   

   Selecting folder for installation

4. Click Install to begin connector installation.

   

   Connector installation process

5. Once the installation is complete, click the Finish button to exit the installer.

6. Open Power BI Desktop and navigate to Get Data > More. You should now see DataOS listed as an available data source.

   

   Data sources

Access data from DataOS on Power BI

Once DataOS appears as a data source in Power BI Desktop, data from DataOS can be accessed. There are two methods to retrieve datasets from DataOS:

Select tables from DataOS data lake

1. Open Power BI Desktop and select Get Data > More.

2. Choose ‘DataOS’ from the list of available data sources.

   

   DataOS as data source

3. A pop-up appears. Fill in the required and optional fields to establish communication with your DataOS environment.

4. Basic connection information such as the URL of the DataOS instance, including the port used. Ask the DataOS administrator for this information. It is essential to provide the URL with tcp for TCP/IP connection.

5. Configure the following optional information, such as specific catalog, user, etc.

6. Leave the Custom SQL Query field blank.

7. Click "OK" to scan all objects and retrieve schema and tables within the selected catalog(s).

   

   Connect with DataOS

8. Enter your Username and Password (APIKEY) and proceed.

   

   Credentials to connect

9. Choose a table from the available list of catalogs and schemas. You'll be able to preview the data.

   

   Catalogs and schemas

10. Click the 'Load' option to import the data. Subsequently, you can explore and craft visualizations within Power BI using the loaded data.

Fetch the result of a specific query

1. Open Power BI Desktop and select Get Data > More.
2. Select ‘DataOS’ from the available data sources.
3. Provide connection information. Ask the DataOS administrator for the DataOS URL and port.

4. In the Custom SQL Query field, enter the desired query (or a Lens Query) and fill in the other mandatory fields.

   

   Query to get the result data

5. Enter your Username and Password (APIKEY) and press Enter.

6. The result of that query will be fetched instead of the catalog and table views and loaded into Power BI. Click on ‘Load’ to view the data.

   

   Query result

Once you have retrieved the data from DataOS into Power BI, you can create your dashboard(s) according to your business requirements.