Interface DataQualityGlueTable.Builder

  • Method Details

    • databaseName

      DataQualityGlueTable.Builder databaseName(String databaseName)

      A database name in the Glue Data Catalog.

      Parameters:
      databaseName - A database name in the Glue Data Catalog.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • tableName

      DataQualityGlueTable.Builder tableName(String tableName)

      A table name in the Glue Data Catalog.

      Parameters:
      tableName - A table name in the Glue Data Catalog.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • catalogId

      DataQualityGlueTable.Builder catalogId(String catalogId)

      A unique identifier for the Glue Data Catalog.

      Parameters:
      catalogId - A unique identifier for the Glue Data Catalog.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • connectionName

      DataQualityGlueTable.Builder connectionName(String connectionName)

      The name of the connection to the Glue Data Catalog.

      Parameters:
      connectionName - The name of the connection to the Glue Data Catalog.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • additionalOptions

      DataQualityGlueTable.Builder additionalOptions(Map<String,String> additionalOptions)

      Additional options for the table. Currently there are two keys supported:

      • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

      • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

      Parameters:
      additionalOptions - Additional options for the table. Currently there are two keys supported:

      • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

      • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • preProcessingQuery

      DataQualityGlueTable.Builder preProcessingQuery(String preProcessingQuery)

      SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.

      Parameters:
      preProcessingQuery - SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.