software.amazon.awssdk.services.firehose.model

Class ParquetSerDe

java.lang.Object

software.amazon.awssdk.services.firehose.model.ParquetSerDe

All Implemented Interfaces:

Serializable, SdkPojo, ToCopyableBuilder<ParquetSerDe.Builder,ParquetSerDe>

@Generated(value="software.amazon.awssdk:codegen")
public final class ParquetSerDe
extends Object
implements SdkPojo, Serializable, ToCopyableBuilder<ParquetSerDe.Builder,ParquetSerDe>

A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	ParquetSerDe.Builder

Method Summary

Modifier and Type	Method and Description
Integer	blockSizeBytes() The Hadoop Distributed File System (HDFS) block size.
static ParquetSerDe.Builder	builder()
ParquetCompression	compression() The compression code to use over data blocks.
String	compressionAsString() The compression code to use over data blocks.
Boolean	enableDictionaryCompression() Indicates whether to enable dictionary compression.
boolean	equals(Object obj)
<T> Optional<T>	getValueForField(String fieldName, Class<T> clazz)
int	hashCode()
Integer	maxPaddingBytes() The maximum amount of padding to apply.
Integer	pageSizeBytes() The Parquet page size.
List<SdkField<?>>	sdkFields()
static Class<? extends ParquetSerDe.Builder>	serializableBuilderClass()
ParquetSerDe.Builder	toBuilder() Take this object and create a builder that contains all of the current property values of this object.
String	toString()
ParquetWriterVersion	writerVersion() Indicates the version of row format to output.
String	writerVersionAsString() Indicates the version of row format to output.

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder

copy

Method Detail

blockSizeBytes

public Integer blockSizeBytes()

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Returns:

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

pageSizeBytes

public Integer pageSizeBytes()

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

Returns:

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

compression

public ParquetCompression compression()

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ration is more important than speed.

If the service returns an enum value that is not available in the current SDK version, compression will return ParquetCompression.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from compressionAsString().

Returns:

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ration is more important than speed.

See Also:

ParquetCompression

compressionAsString

public String compressionAsString()

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ration is more important than speed.

If the service returns an enum value that is not available in the current SDK version, compression will return ParquetCompression.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from compressionAsString().

Returns:

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ration is more important than speed.

See Also:

ParquetCompression

enableDictionaryCompression

public Boolean enableDictionaryCompression()

Indicates whether to enable dictionary compression.

Returns:

Indicates whether to enable dictionary compression.

maxPaddingBytes

public Integer maxPaddingBytes()

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

Returns:

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

writerVersion

public ParquetWriterVersion writerVersion()

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

If the service returns an enum value that is not available in the current SDK version, writerVersion will return ParquetWriterVersion.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from writerVersionAsString().

Returns:

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

See Also:

ParquetWriterVersion

writerVersionAsString

public String writerVersionAsString()

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

If the service returns an enum value that is not available in the current SDK version, writerVersion will return ParquetWriterVersion.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from writerVersionAsString().

Returns:

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

See Also:

ParquetWriterVersion

toBuilder

public ParquetSerDe.Builder toBuilder()

Description copied from interface: ToCopyableBuilder

Take this object and create a builder that contains all of the current property values of this object.

Specified by:

toBuilder in interface ToCopyableBuilder<ParquetSerDe.Builder,ParquetSerDe>

Returns:

a builder for type T

builder

public static ParquetSerDe.Builder builder()

serializableBuilderClass

public static Class<? extends ParquetSerDe.Builder> serializableBuilderClass()

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

toString

public String toString()

Overrides:

toString in class Object

getValueForField

public <T> Optional<T> getValueForField(String fieldName,
                                        Class<T> clazz)

sdkFields

public List<SdkField<?>> sdkFields()

Specified by:

sdkFields in interface SdkPojo

Returns:

List of SdkField in this POJO. May be empty list but should never be null.