Conditional Catalog Sets

Alation Cloud Service Applies to Alation Cloud Service instances of Alation

Customer Managed Applies to customer-managed instances of Alation

You can use conditional catalog sets to group data objects based on conditional rules which you specify when creating the set.

Grouping similar or identical data objects under a conditional catalog set allows you to bulk-curate the catalog fields on all the data objects by applying changes directly to the set and not to each specific object. The changes you make using the catalog set are shared  to all the catalog set members. Bulk-editing using a catalog set helps achieve curation consistency and saves you time and effort.

Creating a Conditional Catalog Set

You need a Catalog or Server Admin admin role to be able to create catalog sets and bulk-edit field values of catalog set members.

To create a conditional set,

  1. On the main toolbar, click Curate then click Catalog Sets. You will be navigated to the Catalog Sets page:

../../_images/Cond_Sets1.png

Note

The Curate menu will only be visible to a user if:

Standard Users wearing the Data Governor/Curator hat can only view the existing catalog sets. If the Curate menu is not available, catalog sets can be accessed using the page URL: <your_alation.com> /catalog_sets/.

Alternatively, you can click the Admin Settings icon on the upper-right of your Alation page to navigate to the Admin Settings page:

../../_images/Screen_Shot_2018-10-16_at_2.17.18_PM.png
  1. In the Catalog Admin section, click Catalog Sets to open the Catalog Sets page:

../../_images/Cond_Sets2.png

3. On the Catalog Sets page, on the upper-right, click the add icon:

../../_images/Screen_Shot_2019-09-04_at_8.28.36_PM.png
  1. On the New Catalog Set page that opens, provide a Title for your new set.

../../_images/Cond_Sets3.png
  1. By default, the Conditional type of catalog set is pre-selected:

../../_images/Cond_Sets_4.png
  1. On the Overview & Rules tab, under Conditional, select the Member Data Object Type. This parameter specifies the type of data objects that you want to group in this set. The choice is:

  • Schemas

  • Tables

  • Columns

The number of other settings to specify will depend on the selected data object type. You will notice that the list of parameters changes depending on your choice of the object type:

../../_images/Select_Otype.png
  1. If you have chosen Schemas as the Member Data Object Type, then under Catalog Set Members’ Visibility, select the Hide schemas and their children from Catalog and Search checkbox if you want the schemas and their child objects in this catalog set to be undiscoverable by other catalog users when they browse and search the catalog. Leave this checkbox clear if visibility of the catalog members is of no concern.

Note that the Visibility setting is available on the Schema level only but will not be present for Table or Column level. It can only be applied to a schema and all of this child objects, but cannot be selectively applied to some tables and columns.

  1. Continue to define your set by specifying the conditions for its members:

  • + Include Objects Where Set of rules to include data objects into the set.

  • - Exclude Objects Where Set of rules to exclude data objects from the set.

Both the include and exclude rules have identical conditions:

  • Data Source is A data source condition (this is available from V R6 (5.10.x)).

  • Schema/Table/Column name: the data object name condition:

  • exactly matches

  • starts with

  • ends with

  • matches regex

The data source and data object name conditions are joined with AND logic.

Membership Rules:

../../_images/Screen_Shot_2019-10-11_at_6.04.38_PM.png
  1. If you want to group data objects from specific data sources, select one or multiple data sources for the Data Source is condition, which is available from V R6 (5.10.x). If you want to group data objects across all data sources in your catalog, leave the data sources condition empty.

To select a data source, hover over the catalog set page to reveal the add icon next to Data Source is condition:

../../_images/Screen_Shot_2019-09-05_at_9.26.25_AM.png

Click it to open the data source quick filter. Find and select the data source from the list of available data sources.

Note

Due to a known issue, the already selected data sources are not currently filtered out from the list of data sources in the quick search filter. If you select a data source but then open the search filter and search for it again, it will still be present in the list of available data sources.

Selecting Data Sources:

../../_images/Screen_Shot_2019-10-11_at_6.10.48_PM.png
  1. Proceed to specify the data object name conditions by selecting the required pattern and typing in the expression for matching:

../../_images/Screen_Shot_2019-10-11_at_6.12.57_PM.png
  1. At the bottom, on the right, click Save to save your new conditional catalog set. You will land on the catalog page of this set that displays the list of catalog set members that match the conditions you have specified in the set membership rules:

../../_images/Screen_Shot_2019-10-11_at_6.17.14_PM.png

Now you can bulk-edit the fields on the catalog set members.

Updating a Conditional Catalog Set

You can change a conditional catalog set by changing the catalog set rules.

Important

The Member Data Object Type and Catalog Set Members’ Visibility cannot be changed.

To edit a conditional catalog set,

1. Open the page of this set and in the Membership Rules section, click Edit. The catalog set settings page will open:

../../_images/Editing1.png
  1. Change the Catalog Set Rules as necessary. If you change the rules, the list of matching data objects is likely to change. Click Preview on the bottom-right to view the updated list of data objects that fit the updated condition.

  2. Click Save to save the changes when you are satisfied with the result.

Deleting a Catalog Set

You need the role of the Catalog or Server Admin to be able to delete catalog sets. To delete a catalog set, open its catalog page and click the delete icon on the upper right:

../../_images/Screen_Shot_2018-10-16_at_2.31.35_PM.png

Confirm deletion. The catalog set will be deleted. The field values previously propagated from this set will be cleared from the data objects previously grouped in this set.

Using Regex in Catalog Sets

In Catalog Sets you can use Regex patterns to locate data. This section lists some of the more useful patterns.

OR Logic: Approximate Matching

Use the pipe symbol | to separate the expressions: <term>|<term>. This will approximately match the terms.

Example: drg|ssn

../../_images/Cond_Sets5.png

OR Logic: Exact Matching

Use the following format: ^<term>$|^<term>$, for example: ^drg$|^ssn$:

../../_images/Cond_Sets6.png