Configure Power BI Data Source for Lineage Collection

IMPORTANT: Enabling Lineage requires the following permissions:

This article explains how to configure Microsoft Power BI Cloud Data Source for Lineage collection. This configuration is required for enabling BI Optimizer in Metric Insights.

Before proceeding, ensure that all prerequisites are met and that initial configuration has been completed based on your selected authentication type. Then, grant Tenant.Read.All permission in Azure Portal, return to Metric Insights to enable metadata collection and configure the Power BI Cloud Data Source, and sync metadata.

NOTE: We recommend configuring Log Analytics for Lineage to improve the precision of Lineage metadata collection. With Log Analytics enabled, Lineage returns more accurate data on columns and tables from which the Reports are derived. In case Log Analytics is disabled, the metadata returned from the Power BI available in Lineage may contain duplicates, such as extra tables and columns.

1. Grant Tenant.Read.All Permission

Access Azure App's Overview page > API Permissions > [Add a permission] > Delegated permissions > Tenant.Read.All

2. Enable Metadata Collection in Metric Insights

Access Admin > System > System Variables

  1. Enter ENABLE_METADATA_COLLECTION in the search field.
  2. Click the gear icon.
  3. Assigned Value: Y.
  4. [Save], then [Commit Changes]

NOTE: See Setting System Variables for information on System Variables configuration.

3. Configure Power BI Cloud Data Source in Metric Insights

3.1. Create a Microsoft Power BI Cloud Data Source

See Establish Connectivity to Microsoft Power BI Cloud for instructions on creating a new Microsoft Power BI Cloud Data Source.

3.2. Configure Auth Parameters

Proceed with the Data Source parameters configuration based on the selected Auth Type:

Service Principal

  1. Auth Type: Service Principal
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Client Secret: Enter the Client Secret of the previously configured Azure App.
  4. Server: https://app.powerbi.com
  5. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App
    • To find this value, open the Azure App > Overview tab

Password

  1. Auth Type: Password
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Server: https://app.powerbi.com
  4. Username, Plugin Password: Enter the credentials of a Fabric Administrator user

OAuth

  1. Auth Type: OAuth
  2. Application ID: Enter the Application ID of the previously configured Azure App.
  3. Server: https://app.powerbi.com
  4. Directory (tenant) Id: Enter Directory (tenant) Id of the previously configured Azure App
    • To find this value, open the Azure App > Overview tab
  5. [Get Token], enter credentials of a Fabric Administrator in the pop-up window

3.3. Configure Other Data Source Parameters

See parameter configuration details specific to your MI version:

v7.1.1

 


Parameter NameValue
1Scope: Collect as admintrue
2Scope: Types to collect
DASHBOARD, TILE, SEMANTIC_MODEL, TABLE, REPORT
3Scope: Workspace Filter
Use this filter to narrow down the search output
4OleDB: Collect Data from OleDBtrue
5OleDB: Use old table IDfalse
6Power BI Premium: Collect media using APItrue

Prior to v7.1.1


Parameter NameValue
1Collect objects as admintrue
2Power BI Premium: Collect media using APItrue
3Object types to collectDASHBOARD, TILE, SEMANTIC_MODEL, TABLE, REPORT
4Old table IDfalse
5OleDB Datatrue
6Workspace FilterUse this filter to narrow down the search output

3.4. Configure Object List Refresh

3.4.1. Manually Refresh Object List

Access Source Objects tab

  1. [Refresh list]
  2. Once the list is refreshed, the Log Analytics object is displayed.

3.4.2. Add Object List Refresh Trigger

Adding an Object List Refresh Trigger allows to automatically refresh the Object List at the configured time interval.

  1. Generate Object List: automatically.
  2. Object List Refresh Trigger: Select a daily Trigger.

3.5. Sync Metadata

Access Metadata tab

  1. [Sync Metadata]