S3IcebergDirectTarget

Provides additional configuration options for customizing the Iceberg table behavior.

Specifies configuration options for automatic data quality evaluation in Glue jobs. This structure enables automated data quality checks and monitoring during ETL operations, helping to ensure data integrity and reliability without manual intervention.

Specifies the compression codec used for Iceberg table files in S3.

Specifies the file format used for storing Iceberg table data (e.g., Parquet, ORC).

Defines the single input source that provides data to this Iceberg target.

Specifies the unique identifier for the Iceberg target node in your data pipeline.

Sets the number of target partitions for distributing Iceberg table files across S3.

Specifies the data schema for the S3 Iceberg direct target.

Specifies the columns used to partition the Iceberg table data in S3.

Defines the S3 location where the Iceberg table data will be stored.

Defines how schema changes are handled when writing data to the Iceberg table.