Azure Databricks OCF Connector Release Notes¶
Alation Cloud Service Applies to Alation Cloud Service instances of Alation
Customer Managed Applies to customer-managed instances of Alation
October 16, 2024¶
Azure Databricks OCF Connector: Version 2.0.8¶
Fixed Issues¶
Queries with Multipart Object Name Fail to Appear in QLI Query History¶
Queries with multipart object names (catalog.schema.table) do not appear in the query history.
The issue is resolved. QLI processes are now updated to remove the catalog name (hive_metastore) from each query while using file-based QLI. (AL-174378)
October 01, 2024¶
Azure Databricks OCF Connector: Version 2.0.7¶
Fixed Issues¶
Queries with Multipart Object Names Fail To Generate Lineage¶
Queries with multipart object names (catalog.schema.table) fails to generate lineage after QLI.
The issue is now resolved. (AL-152839)
Note
This fix is applicable only for table-based QLI.
March 27, 2024¶
Azure Databricks OCF Connector: Version 2.0.6¶
Fixed Issues¶
Bulk Sampling Fails for Column Data Types timestamp_NTZ, Void, and Interval¶
For example, for Azure Databricks data source, sampling fails with the following error for column data type timestamp_NTZ:
The connector was provided with a list of columns to profile from a table, however the schema of the returned result set did not match those columns.
Now, the connector allows bulk sampling to proceed by skipping tables with timestamp_ntz, void, and interval issues. (AL-146049)
December 27, 2023¶
Azure Databricks OCF Connector: Version 2.0.5¶
Fixed Issues¶
Azure Databricks OCF Connector Misses Processing the Last Query¶
Azure Databricks runs queries on different threads. These queries are logged into log files that are processed by the OCF connector. Howevetr, while processing, the connector misses processing the last query. This results in missing lineage from the catalog.
With this fix, the missing lineage from the last query is now generated for the Azure Databricks OCF connector.
December 20, 2023¶
Azure Databricks OCF Connector: Version 2.0.4¶
Fixed Issues¶
QLI Extraction Fails to Ingest Queries¶
QLI extraction for Azure Databricks OCF connector fails with NA_LOCATION_INFO error and does not return any query statement to ingest.
You can now successfully run the QLI extraction.