Azure Databricks OCF Connector Release Notes

Alation Cloud Service Applies to Alation Cloud Service instances of Alation

Customer Managed Applies to customer-managed instances of Alation

October 01, 2024

Azure Databricks OCF Connector: Version 2.0.7

Fixed Issues

Queries with Multipart Object Names Fail To Generate Lineage

Queries with multipart object names (catalog.schema.table) fails to generate lineage after QLI.

The issue is now resolved. (AL-152839)

Note

This fix is applicable only for table-based QLI.

March 27, 2024

Azure Databricks OCF Connector: Version 2.0.6

Fixed Issues

Bulk Sampling Fails for Column Data Types timestamp_NTZ, Void, and Interval

For example, for Azure Databricks data source, sampling fails with the following error for column data type timestamp_NTZ:

The connector was provided with a list of columns to profile from a table, however the schema of the returned result set did not match those columns.

Now, the connector allows bulk sampling to proceed by skipping tables with timestamp_ntz, void, and interval issues. (AL-146049)

December 27, 2023

Azure Databricks OCF Connector: Version 2.0.5

Fixed Issues

Azure Databricks OCF Connector Misses Processing the Last Query

Azure Databricks runs queries on different threads. These queries are logged into log files that are processed by the OCF connector. Howevetr, while processing, the connector misses processing the last query. This results in missing lineage from the catalog.

With this fix, the missing lineage from the last query is now generated for the Azure Databricks OCF connector.

December 20, 2023

Azure Databricks OCF Connector: Version 2.0.4

Fixed Issues

QLI Extraction Fails to Ingest Queries

QLI extraction for Azure Databricks OCF connector fails with NA_LOCATION_INFO error and does not return any query statement to ingest.

You can now successfully run the QLI extraction.