Interface S3HudiCatalogTarget.Builder

  • Method Details

    • name

      The name of the data target.

      Parameters:
      name - The name of the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      The nodes that are inputs to the data target.

      Parameters:
      inputs - The nodes that are inputs to the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      The nodes that are inputs to the data target.

      Parameters:
      inputs - The nodes that are inputs to the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3HudiCatalogTarget.Builder partitionKeys(Collection<? extends Collection<String>> partitionKeys)

      Specifies native partitioning using a sequence of keys.

      Parameters:
      partitionKeys - Specifies native partitioning using a sequence of keys.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3HudiCatalogTarget.Builder partitionKeys(Collection<String>... partitionKeys)

      Specifies native partitioning using a sequence of keys.

      Parameters:
      partitionKeys - Specifies native partitioning using a sequence of keys.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • table

      The name of the table in the database to write to.

      Parameters:
      table - The name of the table in the database to write to.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • database

      S3HudiCatalogTarget.Builder database(String database)

      The name of the database to write to.

      Parameters:
      database - The name of the database to write to.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • additionalOptions

      S3HudiCatalogTarget.Builder additionalOptions(Map<String,String> additionalOptions)

      Specifies additional connection options for the connector.

      Parameters:
      additionalOptions - Specifies additional connection options for the connector.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      S3HudiCatalogTarget.Builder schemaChangePolicy(CatalogSchemaChangePolicy schemaChangePolicy)

      A policy that specifies update behavior for the crawler.

      Parameters:
      schemaChangePolicy - A policy that specifies update behavior for the crawler.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      default S3HudiCatalogTarget.Builder schemaChangePolicy(Consumer<CatalogSchemaChangePolicy.Builder> schemaChangePolicy)

      A policy that specifies update behavior for the crawler.

      This is a convenience method that creates an instance of the CatalogSchemaChangePolicy.Builder avoiding the need to create one manually via CatalogSchemaChangePolicy.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to schemaChangePolicy(CatalogSchemaChangePolicy).

      Parameters:
      schemaChangePolicy - a consumer that will call methods on CatalogSchemaChangePolicy.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • autoDataQuality

      S3HudiCatalogTarget.Builder autoDataQuality(AutoDataQuality autoDataQuality)

      Specifies whether to automatically enable data quality evaluation for the S3 Hudi catalog target. When set to true, data quality checks are performed automatically during the write operation.

      Parameters:
      autoDataQuality - Specifies whether to automatically enable data quality evaluation for the S3 Hudi catalog target. When set to true, data quality checks are performed automatically during the write operation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • autoDataQuality

      default S3HudiCatalogTarget.Builder autoDataQuality(Consumer<AutoDataQuality.Builder> autoDataQuality)

      Specifies whether to automatically enable data quality evaluation for the S3 Hudi catalog target. When set to true, data quality checks are performed automatically during the write operation.

      This is a convenience method that creates an instance of the AutoDataQuality.Builder avoiding the need to create one manually via AutoDataQuality.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to autoDataQuality(AutoDataQuality).

      Parameters:
      autoDataQuality - a consumer that will call methods on AutoDataQuality.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • outputSchemas

      S3HudiCatalogTarget.Builder outputSchemas(Collection<GlueSchema> outputSchemas)

      Specifies the data schema for the S3 Hudi catalog target.

      Parameters:
      outputSchemas - Specifies the data schema for the S3 Hudi catalog target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputSchemas

      S3HudiCatalogTarget.Builder outputSchemas(GlueSchema... outputSchemas)

      Specifies the data schema for the S3 Hudi catalog target.

      Parameters:
      outputSchemas - Specifies the data schema for the S3 Hudi catalog target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputSchemas

      S3HudiCatalogTarget.Builder outputSchemas(Consumer<GlueSchema.Builder>... outputSchemas)

      Specifies the data schema for the S3 Hudi catalog target.

      This is a convenience method that creates an instance of the GlueSchema.Builder avoiding the need to create one manually via GlueSchema.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to outputSchemas(List<GlueSchema>).

      Parameters:
      outputSchemas - a consumer that will call methods on GlueSchema.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: