2024.1 OCF Connectors¶
The tables below provide information on databases, BI tools, and file systems supported with OCF connectors. Click the connector name to go to the corresponding documentation page. For some of the connectors, where the link is not currently available, documentation will be added soon.
RDBMS Connectors¶
Connectors |
Supported Version |
Metadata Extraction (MDE) |
Table Sampling |
Profiling |
Query Log Ingestion (QLI) |
Table Level Lineage |
Column Level Lineage |
Compose |
|---|---|---|---|---|---|---|---|---|
Engine versions 2, 3 |
|
|
|
|
|
|
|
|
Amazon Redshift Provisioned |
latest |
|
|
|
|
|
|
|
Amazon Redshift Provisioned with Spectrum |
latest |
|
|
|
|
|
|
|
Amazon Redshift Serverless |
latest |
|
|
|
|
|
|
|
Amazon Redshift Serverless with Spectrum |
latest |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
Snowflake: 8.30.1 Oracle: 19c SQL Server: 2019 Azure SQL DB: 12.0.2000.8 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
12.0.2000.8 |
|
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
Databricks OCF Connector |
||||||||
9.1 LTS, 10.4 LTS, 11.x, 12.x, 13.3 LTS |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.x, 12.x |
|
|
|
|
|
|
|
|
9.1 LTS, 10.4 LTS, 11.3 LTS, 12.x, 13.3 LTS |
|
|
|
|
* |
|
|
|
Databricks Unity Catalog on AWS |
10.4 LTS, 11.x, 12.x |
|
|
|
|
** |
** |
|
Databricks Unity Catalog on Azure |
10.4 LTS, 11.x, 12.x |
|
|
|
|
** |
** |
|
Databricks Unity Catalog on GCP |
13.3, 14.3 |
|
|
|
|
** |
** |
|
10.4 LTS, 11.x, 12.x |
|
|
|
|
|
|
|
|
10.5, 11.1, 11.5 |
|
|
|
|
|
|
|
|
8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
6.0 and later |
|
|
|
|
|
|
|
|
EMR Presto |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
6.22 |
|
|
|
|
|
|
|
|
Hive 2 on CDH |
CDH 6.2, 6.3 |
|
|
|
|
|
|
|
Hive 2 on EMR |
EMR 5.x |
|
|
|
|
|
|
|
Hive 2 on MapR |
MapR 6.1.x |
|
|
|
|
|
|
|
Hive 3 on CDH |
HDP 3.1.4 |
|
|
|
|
|
|
|
Hive 3 on EMR |
EMR 6.0, 6.1, 6.2, 6.4, 6.9 |
|
|
|
|
|
|
|
Hive 3 on CDP |
CDP 7.1.3, 7.1.7 |
|
|
|
|
|
|
|
Hive 3 on Azure HDInsight |
4.0, 5.0 |
|
|
|
|
|
|
|
CDH - 6.3 |
|
|
|
|
|
|
|
|
7.1.3, 7.1.7 |
|
|
|
|
|
|
|
|
Oracle: 19c SQL Server: 2022 Informatica PowerCenter Version: Oracle repo 10.5.4 SQL Server repo 10.5.4 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2.6 to 5.0 MongoDB Atlas, MongoDB Compass |
|
|
|
|
|
|
|
|
MySQL |
8.0 |
|
|
|
|
|
|
|
MySQL RDS |
8.0 |
|
|
|
|
|
|
|
Oracle |
19c |
|
|
|
|
|
|
|
Oracle RDS |
19c |
|
|
|
|
|
|
|
Oracle E-Business Suite |
EBS 12.2.12 Oracle 19c |
|
|
|
|
|
|
|
PostgreSQL |
12, 13, 14.1, 14.5, 15.1 |
|
|
|
|
|
|
|
PostgreSQL RDS |
12, 13, 14.1, 14.5 |
|
|
|
|
|
|
|
PostgreSQL Enterprise |
12, 13, 14.1 |
|
|
|
|
|
|
|
latest |
|
|
|
|
|
|
|
|
ASE 16.0 |
|
|
|
|
|
|
|
|
n/a |
|
|
|
|
** |
|
|
|
n/a |
|
|
|
|
** |
|
|
|
2.0 |
|
|
|
|
|
|
|
|
16 |
|
|
|
|
|
|
|
|
SAS Base |
9.4 |
|
|
|
|
* |
|
|
|
|
|
|
|
|
|
||
SingleStore (former MemSQL) |
7.8.9 |
|
|
|
|
* |
|
|
latest |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
||
SQL Server |
2014, 2016, 2017, 2019, 2022 |
|
|
|
|
|
|
|
SQL Server RDS |
2014, 2016, 2017, 2019 |
|
|
|
|
|
|
|
SQL Server on Azure VM |
2017, 2019, 2022 |
|
|
|
|
|
|
|
Starburst Enterprise (Trino) |
413-e LTS on AWS |
|
|
|
|
*** |
|
|
|
|
|
|
|
|
|
||
16.10, 16.20, 17.05, 17.20 |
|
|
|
|
|
|
|
|
7.0.6 and later |
|
|
|
|
|
|
|
|
Version 12, 14 |
|
|
|
|
|
|
|
|
11.1.x, 12.0.1 |
|
|
|
|
|
|
|
|
* Lineage is calculated based on queries ingested from Compose.
** Lineage is calculated using direct lineage extraction.
*** Extraction of view SQL during MDE is not supported. Lineage information is generated from DDL queries ingested during QLI and DDL queries run in Compose.
BI Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Lineage |
Column Level Lineage |
Access Rules |
SSL |
|---|---|---|---|---|---|---|
Cloud - latest, On-prem - 22.x, 23.x, 24.10 |
|
|
|
|
|
|
Cloud - latest On-prem - 11.3.10, 11.4.06 |
|
|
|
|
|
|
latest |
|
|
|
|
|
|
Power BI Pro and Premium versions |
|
* |
|
|
|
|
Feb 2022 and earlier versions |
|
|
|
|
|
|
4.2, 4.3 |
|
|
|
|
|
|
2016, 2017, 2019 |
|
|
|
|
|
|
|
(Tableau Server and Tableau Online) |
Server: 2021.3, 2021.4, 2022.1, 2022.3, 2023.1 Online - latest |
|
|
|
|
|
* Lineage for Dataflows is supported for Alation versions 2023.3.3 or higher.
File System Connectors¶
Connectors |
Supported Version |
Metadata Extraction |
Schema Extraction |
Sampling |
Authentication Methods |
|---|---|---|---|---|---|
latest |
|
* |
** |
Basic, STS |
|
latest |
|
|
|
Basic, SAS |
|
CDH - 6.2, 6.3 CDP - 7.1.3, 7.1.7 |
|
|
|
Basic, SSL, Kerberos |
* Schema extraction is supported only for CSV and Parquet files
** File sampling is supported only for CSV and Parquet files
SSO with Compose¶
Database Type |
Azure AD |
AD FS |
OKTA |
PingFederate |
One Login |
Auth0 |
Snowflake IdP |
Databricks IdP |
|---|---|---|---|---|---|---|---|---|
Amazon Redshift |
|
|
|
|
|
|
n/a |
n/a |
Databricks on AWS |
|
|
|
|
|
|
n/a |
|
Azure Databricks |
|
|
|
|
|
|
n/a |
n/a |
Azure Synapse Analysis |
|
|
|
|
|
|
n/a |
n/a |
Azure SQL (SQL DB) |
|
|
|
|
|
|
n/a |
n/a |
Databricks Unity Catalog (Azure) |
|
|
|
|
|
|
n/a |
|
Databricks Unity Catalog (AWS) |
n/a |
|
|
|
|
|
n/a |
|
Snowflake |
|
|
|
|
|
|
|
n/a |
What is Different Compared to 2023.3?¶
This table contains the changes compared to the previous release.
Change |
Description |
|---|---|
Databricks on GCP |
Added support for version 13.3 LTS |
Databricks on AWS |
Added support for version 13.3 LTS |
Oracle E-Business Suite |
Added support for version 12.2.12 |
Teradata |
Added support for version 17.20 |
Change Log¶
This table contains corrections and updates made between major releases.
Date |
Change |
|---|---|
13/05/24 |
Added Salesforce, Kafka, DynamoDB and Elasticsearch connectors |
03/06/24 |
Added Azure CosmosDB, ServiceNow, Talend and SSAS connectors |
12/06/24 |
Added MongoDB, TIBCO Data Virtualization, and TIBCO Spotfire connectors |
17/07/24 |
|
06/08/24 |
|
23/08/24 |
Added new version support for Looker and MicroStrategy connectors |
28/08/24 |
Added Azure Data Factory (ADF) OCF conector |