Interface S3DeltaDirectTarget.Builder

  • Method Details

    • name

      The name of the data target.

      Parameters:
      name - The name of the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      The nodes that are inputs to the data target.

      Parameters:
      inputs - The nodes that are inputs to the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputs

      The nodes that are inputs to the data target.

      Parameters:
      inputs - The nodes that are inputs to the data target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3DeltaDirectTarget.Builder partitionKeys(Collection<? extends Collection<String>> partitionKeys)

      Specifies native partitioning using a sequence of keys.

      Parameters:
      partitionKeys - Specifies native partitioning using a sequence of keys.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • partitionKeys

      S3DeltaDirectTarget.Builder partitionKeys(Collection<String>... partitionKeys)

      Specifies native partitioning using a sequence of keys.

      Parameters:
      partitionKeys - Specifies native partitioning using a sequence of keys.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • path

      The Amazon S3 path of your Delta Lake data source to write to.

      Parameters:
      path - The Amazon S3 path of your Delta Lake data source to write to.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • compression

      S3DeltaDirectTarget.Builder compression(String compression)

      Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

      Parameters:
      compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • compression

      Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

      Parameters:
      compression - Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • numberTargetPartitions

      S3DeltaDirectTarget.Builder numberTargetPartitions(String numberTargetPartitions)

      Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.

      Parameters:
      numberTargetPartitions - Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • format

      Specifies the data output format for the target.

      Parameters:
      format - Specifies the data output format for the target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • format

      Specifies the data output format for the target.

      Parameters:
      format - Specifies the data output format for the target.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • additionalOptions

      S3DeltaDirectTarget.Builder additionalOptions(Map<String,String> additionalOptions)

      Specifies additional connection options for the connector.

      Parameters:
      additionalOptions - Specifies additional connection options for the connector.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      S3DeltaDirectTarget.Builder schemaChangePolicy(DirectSchemaChangePolicy schemaChangePolicy)

      A policy that specifies update behavior for the crawler.

      Parameters:
      schemaChangePolicy - A policy that specifies update behavior for the crawler.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaChangePolicy

      default S3DeltaDirectTarget.Builder schemaChangePolicy(Consumer<DirectSchemaChangePolicy.Builder> schemaChangePolicy)

      A policy that specifies update behavior for the crawler.

      This is a convenience method that creates an instance of the DirectSchemaChangePolicy.Builder avoiding the need to create one manually via DirectSchemaChangePolicy.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to schemaChangePolicy(DirectSchemaChangePolicy).

      Parameters:
      schemaChangePolicy - a consumer that will call methods on DirectSchemaChangePolicy.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • autoDataQuality

      S3DeltaDirectTarget.Builder autoDataQuality(AutoDataQuality autoDataQuality)

      Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

      Parameters:
      autoDataQuality - Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • autoDataQuality

      default S3DeltaDirectTarget.Builder autoDataQuality(Consumer<AutoDataQuality.Builder> autoDataQuality)

      Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

      This is a convenience method that creates an instance of the AutoDataQuality.Builder avoiding the need to create one manually via AutoDataQuality.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to autoDataQuality(AutoDataQuality).

      Parameters:
      autoDataQuality - a consumer that will call methods on AutoDataQuality.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: