AWS SDK for C++  1.9.132
AWS SDK for C++
Public Member Functions | List of all members
Aws::SageMaker::Model::ShuffleConfig Class Reference

#include <ShuffleConfig.h>

Public Member Functions

 ShuffleConfig ()
 
 ShuffleConfig (Aws::Utils::Json::JsonView jsonValue)
 
ShuffleConfigoperator= (Aws::Utils::Json::JsonView jsonValue)
 
Aws::Utils::Json::JsonValue Jsonize () const
 
long long GetSeed () const
 
bool SeedHasBeenSet () const
 
void SetSeed (long long value)
 
ShuffleConfigWithSeed (long long value)
 

Detailed Description

A configuration for a shuffle option for input data in a channel. If you use S3Prefix for S3DataType, the results of the S3 key prefix matches are shuffled. If you use ManifestFile, the order of the S3 object references in the ManifestFile is shuffled. If you use AugmentedManifestFile, the order of the JSON lines in the AugmentedManifestFile is shuffled. The shuffling order is determined using the Seed value.

For Pipe input mode, when ShuffleConfig is specified shuffling is done at the start of every epoch. With large datasets, this ensures that the order of the training data is different for each epoch, and it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig is combined with S3DataDistributionType of ShardedByS3Key, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.

See Also:

AWS API Reference

Definition at line 43 of file ShuffleConfig.h.

Constructor & Destructor Documentation

◆ ShuffleConfig() [1/2]

Aws::SageMaker::Model::ShuffleConfig::ShuffleConfig ( )

◆ ShuffleConfig() [2/2]

Aws::SageMaker::Model::ShuffleConfig::ShuffleConfig ( Aws::Utils::Json::JsonView  jsonValue)

Member Function Documentation

◆ GetSeed()

long long Aws::SageMaker::Model::ShuffleConfig::GetSeed ( ) const
inline

Determines the shuffling order in ShuffleConfig value.

Definition at line 55 of file ShuffleConfig.h.

◆ Jsonize()

Aws::Utils::Json::JsonValue Aws::SageMaker::Model::ShuffleConfig::Jsonize ( ) const

◆ operator=()

ShuffleConfig& Aws::SageMaker::Model::ShuffleConfig::operator= ( Aws::Utils::Json::JsonView  jsonValue)

◆ SeedHasBeenSet()

bool Aws::SageMaker::Model::ShuffleConfig::SeedHasBeenSet ( ) const
inline

Determines the shuffling order in ShuffleConfig value.

Definition at line 60 of file ShuffleConfig.h.

◆ SetSeed()

void Aws::SageMaker::Model::ShuffleConfig::SetSeed ( long long  value)
inline

Determines the shuffling order in ShuffleConfig value.

Definition at line 65 of file ShuffleConfig.h.

◆ WithSeed()

ShuffleConfig& Aws::SageMaker::Model::ShuffleConfig::WithSeed ( long long  value)
inline

Determines the shuffling order in ShuffleConfig value.

Definition at line 70 of file ShuffleConfig.h.


The documentation for this class was generated from the following file: