NAME

Paws::SageMaker::ShuffleConfig

USAGE

This class represents one of two things:

Arguments in a call to a service

Use the attributes of this class as arguments to methods. You shouldn't make instances of this class. Each attribute should be used as a named argument in the calls that expect this type of object.

As an example, if Att1 is expected to be a Paws::SageMaker::ShuffleConfig object:

  $service_obj->Method(Att1 => { Seed => $value, ..., Seed => $value  });

Results returned from an API call

Use accessors for each attribute. If Att1 is expected to be an Paws::SageMaker::ShuffleConfig object:

  $result = $service_obj->Method(...);
  $result->Att1->Seed

DESCRIPTION

A configuration for a shuffle option for input data in a channel. If you use "S3Prefix" for "S3DataType", the results of the S3 key prefix matches are shuffled. If you use "ManifestFile", the order of the S3 object references in the "ManifestFile" is shuffled. If you use "AugmentedManifestFile", the order of the JSON lines in the "AugmentedManifestFile" is shuffled. The shuffling order is determined using the "Seed" value.

For Pipe input mode, when "ShuffleConfig" is specified shuffling is done at the start of every epoch. With large datasets, this ensures that the order of the training data is different for each epoch, and it helps reduce bias and possible overfitting. In a multi-node training job when "ShuffleConfig" is combined with "S3DataDistributionType" of "ShardedByS3Key", the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.

ATTRIBUTES

SEE ALSO

This class forms part of Paws, describing an object used in Paws::SageMaker

BUGS and CONTRIBUTIONS

The source code is located here: <https://github.com/pplu/aws-sdk-perl>

Please report bugs to: <https://github.com/pplu/aws-sdk-perl/issues>