Databricks on AWS OCF Connector Release Notes¶
Alation Cloud Service Applies to Alation Cloud Service instances of Alation
Customer Managed Applies to customer-managed instances of Alation
February 28, 2024¶
Databricks on AWS OCF Connector: Version 2.1.10¶
Fixed Issues¶
Data Sampling Fails Due to Void Data Type¶
Bulk data sampling fails when the Databricks on AWS OCF connector encounters a column with void data type.
Now, the connector skips the column with void data type and continues with bulk data sampling and does not error out.
Note
The root cause for this issue is in the Databricks driver that the Databricks on AWS OCF connector uses. Once Databricks on AWS resolves the issue in the driver, you will start viewing the column values in profiling or sampling.
January 31, 2024¶
Databricks on AWS OCF Connector: Version 2.1.9¶
Enhancements¶
Databricks Driver Upgrade¶
The Databricks driver for the OCF connector is upgraded to the latest version 2.6.34.
January 17, 2024¶
Databricks on AWS OCF Connector: Version 2.1.8¶
Fixed Issues¶
Longer Execution Time for Sampling and Profiling Queries
In AWS Databricks, row count takes longer to execute for custom Sampling queries for views with large tables.
January 03, 2024¶
Databricks on AWS OCF Connector: Version 2.1.7¶
Fixed Issues¶
QLI Fails with Partial Success Status¶
QLI for AWS Databricks OCF connector fails with a Partial Success status and the following status message: No queries were found to ingest, making the QLI feature unusable.
December 13, 2023¶
Databricks on AWS OCF Connector: Version 2.1.6¶
Compatible Alation Version - 2023.1 or higher
Enhancements¶
Dynamic Profiling and Dynamic Sampling Uses Respective Database Credentials¶
Dynamic profiling and sampling for Databricks on AWS OCF connector now use the credentials the user provides for their respective databases when retrieving table samples and column profiles for specific tables and columns.
November 22, 2023¶
Databricks on AWS OCF Connector: Version 2.1.4¶
Compatible Alation version: 2023.1 or higher
Fixed Issues¶
Query Log Ingestion Fails for AWS OCF Connector¶
The Query Log Ingestion (QLI) Preview and ingestion fails due to the Log4j library upgrade after successful datasource connection and metadata extraction.
Preview Error:
QLI Preview failed: The connector responded with the following error message: NA_LOCATION_INFO.
QLI Error:
No queries were found to Ingest.
This issue is resolved.