2023.1 OCF Connectors¶
The tables below provide information on databases, BI tools, and file systems supported with OCF connectors. Click the connector name to go to the corresponding documentation page. For some of the connectors, where the link is not currently available, documentation will be added soon.
RDBMS Connectors¶
Connectors |
Supported Version |
Metadata Extraction (MDE) |
Table Sampling |
Profiling |
Query Log Ingestion (QLI) |
Table Level Lineage |
Column Level Lineage |
Compose |
|---|---|---|---|---|---|---|---|---|
Engine versions 2, 3 |
|
|
|
|
|
|
|
|
Amazon Redshift |
latest |
|
|
|
|
|
|
|
Amazon Redshift Spectrum |
latest |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
12.0.2000.8 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.x |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS |
|
|
|
|
|
|
|
|
Databricks on Google Cloud |
9.1 LTS, 10.4 LTS, 11.3 LTS |
|
|
|
|
* |
|
|
10.4 LTS, 11.x, 12.x Platforms: AWS, Azure |
|
|
|
|
** |
** |
|
|
10.4 LTS |
|
|
|
|
|
|
|
|
10.5, 11.1, 11.5 |
|
|
|
|
|
|
|
|
8 |
|
|
|
|
|
|
|
|
EMR Presto |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
5, 6.3, 6.9, 6.22 |
|
|
|
|
|
|
|
|
Hive 2 on CDH |
CDH 6.2, 6.3 |
|
|
|
|
|
|
|
Hive 2 on EMR |
EMR 5.x |
|
|
|
|
|
|
|
Hive 2 on MapR |
MapR 6.1.x |
|
|
|
|
|
|
|
Hive 3 on CDH |
HDP 3.1.4 |
|
|
|
|
|
|
|
Hive 3 on EMR |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
Hive 3 on CDP |
CDP 7.1.3, 7.1.7 |
|
|
|
|
|
|
|
Hive 3 on Azure HDInsight |
4.0 |
|
|
|
|
|
|
|
CDH - 6.3 |
|
|
|
|
|
|
|
|
7.1.3, 7.1.7 |
|
|
|
|
|
|
|
|
Oracle 12.1c, 19c DB2 10.x, 11.1 SQL Server 2017, 2019 |
|
|
|
|
|
|
|
|
MySQL |
5.7, 8.0 |
|
|
|
|
|
|
|
MySQL RDS |
5.7, 8.0 |
|
|
|
|
|
|
|
Oracle |
19c |
|
|
|
|
|
|
|
Oracle RDS |
19c |
|
|
|
|
|
|
|
PostgreSQL |
11.4, 11.5, 12, 13, 14.1, 14.5, 15.1 |
|
|
|
|
|
|
|
PostgreSQL RDS |
11.4, 11.5, 12, 13, 14.1, 14.5 |
|
|
|
|
|
|
|
PostgreSQL Enterprise |
11, 12, 13, 14.1 |
|
|
|
|
|
|
|
ASE 16.0 |
|
|
|
|
|
|
|
|
n/a |
|
|
|
|
** |
|
|
|
n/a |
|
|
|
|
** |
|
|
|
2.0 |
|
|
|
|
|
|
|
|
16 |
|
|
|
|
|
|
|
|
SAS Base |
9.4 |
|
|
|
|
* |
|
|
SingleStore (former MemSQL) |
7.8.9 |
|
|
|
|
* |
|
|
latest |
|
|
|
|
|
|
|
|
SQL Server |
2014, 2016, 2017, 2019, 2022 |
|
|
|
|
|
|
|
SQL Server RDS |
2014, 2016, 2017, 2019 |
|
|
|
|
|
|
|
SQL Server on Azure VM |
2017, 2019, 2022 |
|
|
|
|
|
|
|
Starburst Enterprise (Trino) |
380-e LTS |
|
|
|
|
*** |
|
|
16.10, 16.20, 17.05 |
|
|
|
|
|
|
|
|
11.1.x, 12.0.1 |
|
|
|
|
|
|
|
|
* Lineage is calculated based on queries ingested from Compose.
** Lineage is calculated using direct lineage extraction.
*** Extraction of view SQL during MDE is not supported. Lineage information is generated from DDL queries ingested during QLI and DDL queries run in Compose.
BI Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Lineage |
Column Level Lineage |
Access Rules |
SSL |
|---|---|---|---|---|---|---|
Cloud - latest, On-prem - 22.x, 23.x |
|
|
|
|
|
|
latest |
|
|
|
|
|
|
Power BI Pro and Premium versions |
|
* |
|
|
|
|
Feb 2022 and earlier versions |
|
|
|
|
|
|
4.2 |
|
|
|
|
|
|
2016, 2017, 2019 |
|
|
|
|
|
|
|
(Tableau Server and Tableau Online) |
Server: 2021.3, 2021.4, 2022.1, 2022.3 Online - latest |
|
|
|
|
|
* Full Lineage support for Power BI objects, such as reports, tiles, and dashboards. Limited lineage support for datasource and dataset.
File System Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Schema Extraction |
Sampling |
Authentication Methods |
|---|---|---|---|---|---|
latest |
|
* |
** |
Basic, STS |
|
latest |
|
|
|
Basic, SAS |
* Schema extraction is supported only for CSV and Parquet files
** File sampling is supported only for CSV and Parquet files
SSO with Compose¶
Database Type |
Azure AD |
AD FS |
OKTA |
PingFederate |
One Login |
Auth0 |
Snowflake IdP |
|---|---|---|---|---|---|---|---|
Amazon Redshift |
|
|
|
|
|
|
n/a |
Databricks on AWS |
|
|
|
|
|
|
n/a |
Azure Databricks |
|
|
|
|
|
|
n/a |
Azure Synapse Analysis |
|
|
|
|
|
|
n/a |
Azure SQL (SQL DB) |
|
|
|
|
|
|
n/a |
Databricks Unity Catalog (Azure) |
|
|
|
|
|
|
n/a |
Snowflake |
|
|
|
|
|
|
|
What is Different Compared to 2022.4?¶
This table contains the changes compared to the previous release.
Change |
Description |
|---|---|
Added support for new OCF connectors |
Added Amazon Redshift Spectrum, EMR Presto, Databricks on GCP, SSRS, Impala on CDP, Starburst Enterprise (Trino) |
PostgreSQL EC2 |
Added support for version 15.1 |
PostgreSQL RDS |
Added support for version 14.5 |
Vertica |
Added support for version 12.0.1 |
SQLServer EC2 |
Added support for version 2022 |
SQLServer On Azure VM |
Added support for version 2022 |
Greenplum |
Added support for version 6.22 |
Tableau Server |
Added support for version 2022.3 |
Hive 3 on EMR |
Added support for version 6.9 |
Amazon Athena |
Added support for Engine Version 3 |
Databricks on AWS |
Added support for Version 11.x |
Column-level lineage (CLL) |
Added CLL support for Databricks AWS, Databricks Azure, Azure Government Cloud, PostgreSQL (EC2, RDS and Enterprise), Tableau Server and Tableau Online |
Feature support |
Added QLI support for MySQL RDS, SQL Server RDS, Oracle RDS |
Feature support |
Added Sampling support for Databricks Unity Catalog, Azure Blob Storage |
Feature support |
Added Compose support for Databricks Unity Catalog |
SSO Compose |
Updated SSO Compose support for Databricks Unity Catalog (Azure) |
Change Log¶
This table contains corrections and updates made between major releases.
Date |
Change |
|---|---|
07/06/23 |
A correction to lineage support for Starburst Enterprise. Currently, extraction of view SQL during MDE is not supported. |
19/05/23 |
Added table-level lineage support for SAP BW and SAP ECC connector. |
05/16/23 |
|
06/06/23 |
Added support for Databricks Unity Catalog version 12.x |