Interface StorageDescriptor.Builder

  • Method Details

    • columns

      A list of the Columns in the table.

      Parameters:
      columns - A list of the Columns in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • columns

      StorageDescriptor.Builder columns(Column... columns)

      A list of the Columns in the table.

      Parameters:
      columns - A list of the Columns in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • columns

      A list of the Columns in the table.

      This is a convenience method that creates an instance of the Column.Builder avoiding the need to create one manually via Column.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to columns(List<Column>).

      Parameters:
      columns - a consumer that will call methods on Column.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • location

      StorageDescriptor.Builder location(String location)

      The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.

      Parameters:
      location - The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • additionalLocations

      StorageDescriptor.Builder additionalLocations(Collection<String> additionalLocations)

      A list of locations that point to the path where a Delta table is located.

      Parameters:
      additionalLocations - A list of locations that point to the path where a Delta table is located.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • additionalLocations

      StorageDescriptor.Builder additionalLocations(String... additionalLocations)

      A list of locations that point to the path where a Delta table is located.

      Parameters:
      additionalLocations - A list of locations that point to the path where a Delta table is located.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputFormat

      StorageDescriptor.Builder inputFormat(String inputFormat)

      The input format: SequenceFileInputFormat (binary), or TextInputFormat, or a custom format.

      Parameters:
      inputFormat - The input format: SequenceFileInputFormat (binary), or TextInputFormat, or a custom format.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • outputFormat

      StorageDescriptor.Builder outputFormat(String outputFormat)

      The output format: SequenceFileOutputFormat (binary), or IgnoreKeyTextOutputFormat, or a custom format.

      Parameters:
      outputFormat - The output format: SequenceFileOutputFormat (binary), or IgnoreKeyTextOutputFormat, or a custom format.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • compressed

      StorageDescriptor.Builder compressed(Boolean compressed)

      True if the data in the table is compressed, or False if not.

      Parameters:
      compressed - True if the data in the table is compressed, or False if not.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • numberOfBuckets

      StorageDescriptor.Builder numberOfBuckets(Integer numberOfBuckets)

      Must be specified if the table contains any dimension columns.

      Parameters:
      numberOfBuckets - Must be specified if the table contains any dimension columns.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • serdeInfo

      StorageDescriptor.Builder serdeInfo(SerDeInfo serdeInfo)

      The serialization/deserialization (SerDe) information.

      Parameters:
      serdeInfo - The serialization/deserialization (SerDe) information.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • serdeInfo

      default StorageDescriptor.Builder serdeInfo(Consumer<SerDeInfo.Builder> serdeInfo)

      The serialization/deserialization (SerDe) information.

      This is a convenience method that creates an instance of the SerDeInfo.Builder avoiding the need to create one manually via SerDeInfo.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to serdeInfo(SerDeInfo).

      Parameters:
      serdeInfo - a consumer that will call methods on SerDeInfo.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • bucketColumns

      StorageDescriptor.Builder bucketColumns(Collection<String> bucketColumns)

      A list of reducer grouping columns, clustering columns, and bucketing columns in the table.

      Parameters:
      bucketColumns - A list of reducer grouping columns, clustering columns, and bucketing columns in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • bucketColumns

      StorageDescriptor.Builder bucketColumns(String... bucketColumns)

      A list of reducer grouping columns, clustering columns, and bucketing columns in the table.

      Parameters:
      bucketColumns - A list of reducer grouping columns, clustering columns, and bucketing columns in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • sortColumns

      StorageDescriptor.Builder sortColumns(Collection<Order> sortColumns)

      A list specifying the sort order of each bucket in the table.

      Parameters:
      sortColumns - A list specifying the sort order of each bucket in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • sortColumns

      StorageDescriptor.Builder sortColumns(Order... sortColumns)

      A list specifying the sort order of each bucket in the table.

      Parameters:
      sortColumns - A list specifying the sort order of each bucket in the table.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • sortColumns

      StorageDescriptor.Builder sortColumns(Consumer<Order.Builder>... sortColumns)

      A list specifying the sort order of each bucket in the table.

      This is a convenience method that creates an instance of the Order.Builder avoiding the need to create one manually via Order.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to sortColumns(List<Order>).

      Parameters:
      sortColumns - a consumer that will call methods on Order.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • parameters

      StorageDescriptor.Builder parameters(Map<String,String> parameters)

      The user-supplied properties in key-value form.

      Parameters:
      parameters - The user-supplied properties in key-value form.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • skewedInfo

      StorageDescriptor.Builder skewedInfo(SkewedInfo skewedInfo)

      The information about values that appear frequently in a column (skewed values).

      Parameters:
      skewedInfo - The information about values that appear frequently in a column (skewed values).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • skewedInfo

      default StorageDescriptor.Builder skewedInfo(Consumer<SkewedInfo.Builder> skewedInfo)

      The information about values that appear frequently in a column (skewed values).

      This is a convenience method that creates an instance of the SkewedInfo.Builder avoiding the need to create one manually via SkewedInfo.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to skewedInfo(SkewedInfo).

      Parameters:
      skewedInfo - a consumer that will call methods on SkewedInfo.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also:
    • storedAsSubDirectories

      StorageDescriptor.Builder storedAsSubDirectories(Boolean storedAsSubDirectories)

      True if the table data is stored in subdirectories, or False if not.

      Parameters:
      storedAsSubDirectories - True if the table data is stored in subdirectories, or False if not.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaReference

      StorageDescriptor.Builder schemaReference(SchemaReference schemaReference)

      An object that references a schema stored in the Glue Schema Registry.

      When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

      Parameters:
      schemaReference - An object that references a schema stored in the Glue Schema Registry.

      When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • schemaReference

      default StorageDescriptor.Builder schemaReference(Consumer<SchemaReference.Builder> schemaReference)

      An object that references a schema stored in the Glue Schema Registry.

      When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

      This is a convenience method that creates an instance of the SchemaReference.Builder avoiding the need to create one manually via SchemaReference.builder().

      When the Consumer completes, SdkBuilder.build() is called immediately and its result is passed to schemaReference(SchemaReference).

      Parameters:
      schemaReference - a consumer that will call methods on SchemaReference.Builder
      Returns:
      Returns a reference to this object so that method calls can be chained together.
      See Also: