Class Channel
- All Implemented Interfaces:
Serializable,SdkPojo,ToCopyableBuilder<Channel.Builder,Channel>
A channel is a named input source that training algorithms can consume.
- See Also:
-
Nested Class Summary
Nested Classes -
Method Summary
Modifier and TypeMethodDescriptionstatic Channel.Builderbuilder()final StringThe name of the channel.final CompressionTypeIf training data is compressed, the compression type.final StringIf training data is compressed, the compression type.final StringThe MIME type of the data.final DataSourceThe location of the channel data.final booleanfinal booleanequalsBySdkFields(Object obj) Indicates whether some other object is "equal to" this one by SDK fields.final <T> Optional<T> getValueForField(String fieldName, Class<T> clazz) final inthashCode()final TrainingInputMode(Optional) The input mode to use for the data channel in a training job.final String(Optional) The input mode to use for the data channel in a training job.final RecordWrapperfinal Stringstatic Class<? extends Channel.Builder> final ShuffleConfigA configuration for a shuffle option for input data in a channel.Take this object and create a builder that contains all of the current property values of this object.final StringtoString()Returns a string representation of this object.Methods inherited from interface software.amazon.awssdk.utils.builder.ToCopyableBuilder
copy
-
Method Details
-
channelName
-
dataSource
The location of the channel data.
- Returns:
- The location of the channel data.
-
contentType
-
compressionType
If training data is compressed, the compression type. The default value is
None.CompressionTypeis used only in Pipe input mode. In File mode, leave this field unset or set it to None.If the service returns an enum value that is not available in the current SDK version,
compressionTypewill returnCompressionType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available fromcompressionTypeAsString().- Returns:
- If training data is compressed, the compression type. The default value is
None.CompressionTypeis used only in Pipe input mode. In File mode, leave this field unset or set it to None. - See Also:
-
compressionTypeAsString
If training data is compressed, the compression type. The default value is
None.CompressionTypeis used only in Pipe input mode. In File mode, leave this field unset or set it to None.If the service returns an enum value that is not available in the current SDK version,
compressionTypewill returnCompressionType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available fromcompressionTypeAsString().- Returns:
- If training data is compressed, the compression type. The default value is
None.CompressionTypeis used only in Pipe input mode. In File mode, leave this field unset or set it to None. - See Also:
-
recordWrapperType
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
If the service returns an enum value that is not available in the current SDK version,
recordWrapperTypewill returnRecordWrapper.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available fromrecordWrapperTypeAsString().- Returns:
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
- See Also:
-
recordWrapperTypeAsString
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
If the service returns an enum value that is not available in the current SDK version,
recordWrapperTypewill returnRecordWrapper.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available fromrecordWrapperTypeAsString().- Returns:
Specify RecordIO as the value when input data is in raw format but the training algorithm requires the RecordIO format. In this case, SageMaker wraps each individual S3 object in a RecordIO record. If the input data is already in RecordIO format, you don't need to set this attribute. For more information, see Create a Dataset Using RecordIO.
In File mode, leave this field unset or set it to None.
- See Also:
-
inputMode
(Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode, SageMaker uses the value set forTrainingInputMode. Use this parameter to override theTrainingInputModesetting in a AlgorithmSpecification request when you have a channel that needs a different input mode from the training job's general setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory to a Docker volume, useFileinput mode. To stream data directly from Amazon S3 to the container, choosePipeinput mode.To use a model for incremental training, choose
Fileinput model.If the service returns an enum value that is not available in the current SDK version,
inputModewill returnTrainingInputMode.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available frominputModeAsString().- Returns:
- (Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode, SageMaker uses the value set forTrainingInputMode. Use this parameter to override theTrainingInputModesetting in a AlgorithmSpecification request when you have a channel that needs a different input mode from the training job's general setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory to a Docker volume, useFileinput mode. To stream data directly from Amazon S3 to the container, choosePipeinput mode.To use a model for incremental training, choose
Fileinput model. - See Also:
-
inputModeAsString
(Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode, SageMaker uses the value set forTrainingInputMode. Use this parameter to override theTrainingInputModesetting in a AlgorithmSpecification request when you have a channel that needs a different input mode from the training job's general setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory to a Docker volume, useFileinput mode. To stream data directly from Amazon S3 to the container, choosePipeinput mode.To use a model for incremental training, choose
Fileinput model.If the service returns an enum value that is not available in the current SDK version,
inputModewill returnTrainingInputMode.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available frominputModeAsString().- Returns:
- (Optional) The input mode to use for the data channel in a training job. If you don't set a value for
InputMode, SageMaker uses the value set forTrainingInputMode. Use this parameter to override theTrainingInputModesetting in a AlgorithmSpecification request when you have a channel that needs a different input mode from the training job's general setting. To download the data from Amazon Simple Storage Service (Amazon S3) to the provisioned ML storage volume, and mount the directory to a Docker volume, useFileinput mode. To stream data directly from Amazon S3 to the container, choosePipeinput mode.To use a model for incremental training, choose
Fileinput model. - See Also:
-
shuffleConfig
A configuration for a shuffle option for input data in a channel. If you use
S3PrefixforS3DataType, this shuffles the results of the S3 key prefix matches. If you useManifestFile, the order of the S3 object references in theManifestFileis shuffled. If you useAugmentedManifestFile, the order of the JSON lines in theAugmentedManifestFileis shuffled. The shuffling order is determined using theSeedvalue.For Pipe input mode, shuffling is done at the start of every epoch. With large datasets this ensures that the order of the training data is different for each epoch, it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig is combined with
S3DataDistributionTypeofShardedByS3Key, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.- Returns:
- A configuration for a shuffle option for input data in a channel. If you use
S3PrefixforS3DataType, this shuffles the results of the S3 key prefix matches. If you useManifestFile, the order of the S3 object references in theManifestFileis shuffled. If you useAugmentedManifestFile, the order of the JSON lines in theAugmentedManifestFileis shuffled. The shuffling order is determined using theSeedvalue.For Pipe input mode, shuffling is done at the start of every epoch. With large datasets this ensures that the order of the training data is different for each epoch, it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig is combined with
S3DataDistributionTypeofShardedByS3Key, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.
-
toBuilder
Description copied from interface:ToCopyableBuilderTake this object and create a builder that contains all of the current property values of this object.- Specified by:
toBuilderin interfaceToCopyableBuilder<Channel.Builder,Channel> - Returns:
- a builder for type T
-
builder
-
serializableBuilderClass
-
hashCode
-
equals
-
equalsBySdkFields
Description copied from interface:SdkPojoIndicates whether some other object is "equal to" this one by SDK fields. An SDK field is a modeled, non-inherited field in anSdkPojoclass, and is generated based on a service model.If an
SdkPojoclass does not have any inherited fields,equalsBySdkFieldsandequalsare essentially the same.- Specified by:
equalsBySdkFieldsin interfaceSdkPojo- Parameters:
obj- the object to be compared with- Returns:
- true if the other object equals to this object by sdk fields, false otherwise.
-
toString
-
getValueForField
-
sdkFields
-