NAME

Paws::SageMaker::CreateProcessingJob - Arguments for method CreateProcessingJob on Paws::SageMaker

DESCRIPTION

This class represents the parameters used for calling the method CreateProcessingJob on the Amazon SageMaker Service service. Use the attributes of this class as arguments to method CreateProcessingJob.

You shouldn't make instances of this class. Each attribute should be used as a named argument in the call to CreateProcessingJob.

SYNOPSIS

    my $api.sagemaker = Paws->service('SageMaker');
    my $CreateProcessingJobResponse = $api . sagemaker->CreateProcessingJob(
      AppSpecification => {
        ImageUri           => 'MyImageUri',    # max: 255
        ContainerArguments => [
          'MyContainerArgument', ...           # max: 256
        ],    # min: 1, max: 100; OPTIONAL
        ContainerEntrypoint => [
          'MyContainerEntrypointString', ...    # max: 256
        ],    # min: 1, max: 100; OPTIONAL
      },
      ProcessingJobName   => 'MyProcessingJobName',
      ProcessingResources => {
        ClusterConfig => {
          InstanceCount => 1,                # min: 1, max: 100
          InstanceType  => 'ml.t3.medium'
          , # values: ml.t3.medium, ml.t3.large, ml.t3.xlarge, ml.t3.2xlarge, ml.m4.xlarge, ml.m4.2xlarge, ml.m4.4xlarge, ml.m4.10xlarge, ml.m4.16xlarge, ml.c4.xlarge, ml.c4.2xlarge, ml.c4.4xlarge, ml.c4.8xlarge, ml.p2.xlarge, ml.p2.8xlarge, ml.p2.16xlarge, ml.p3.2xlarge, ml.p3.8xlarge, ml.p3.16xlarge, ml.c5.xlarge, ml.c5.2xlarge, ml.c5.4xlarge, ml.c5.9xlarge, ml.c5.18xlarge, ml.m5.large, ml.m5.xlarge, ml.m5.2xlarge, ml.m5.4xlarge, ml.m5.12xlarge, ml.m5.24xlarge, ml.r5.large, ml.r5.xlarge, ml.r5.2xlarge, ml.r5.4xlarge, ml.r5.8xlarge, ml.r5.12xlarge, ml.r5.16xlarge, ml.r5.24xlarge, ml.g4dn.xlarge, ml.g4dn.2xlarge, ml.g4dn.4xlarge, ml.g4dn.8xlarge, ml.g4dn.12xlarge, ml.g4dn.16xlarge
          VolumeSizeInGB => 1,               # min: 1, max: 16384
          VolumeKmsKeyId => 'MyKmsKeyId',    # max: 2048; OPTIONAL
        },
      },
      RoleArn     => 'MyRoleArn',
      Environment => {
        'MyProcessingEnvironmentKey' =>
          'MyProcessingEnvironmentValue',    # key: max: 256, value: max: 256
      },    # OPTIONAL
      ExperimentConfig => {
        ExperimentName => 'MyExperimentEntityName', # min: 1, max: 120; OPTIONAL
        TrialComponentDisplayName =>
          'MyExperimentEntityName',                 # min: 1, max: 120; OPTIONAL
        TrialName => 'MyExperimentEntityName',      # min: 1, max: 120; OPTIONAL
      },    # OPTIONAL
      NetworkConfig => {
        EnableInterContainerTrafficEncryption => 1,    # OPTIONAL
        EnableNetworkIsolation                => 1,    # OPTIONAL
        VpcConfig                             => {
          SecurityGroupIds => [
            'MySecurityGroupId', ...                   # max: 32
          ],    # min: 1, max: 5
          Subnets => [
            'MySubnetId', ...    # max: 32
          ],    # min: 1, max: 16
        },    # OPTIONAL
      },    # OPTIONAL
      ProcessingInputs => [
        {
          InputName         => 'MyString',
          AppManaged        => 1,            # OPTIONAL
          DatasetDefinition => {
            AthenaDatasetDefinition => {
              Catalog      => 'MyAthenaCatalog',     # min: 1, max: 256
              Database     => 'MyAthenaDatabase',    # min: 1, max: 255
              OutputFormat =>
                'PARQUET',    # values: PARQUET, ORC, AVRO, JSON, TEXTFILE
              OutputS3Uri       => 'MyS3Uri',              # max: 1024
              QueryString       => 'MyAthenaQueryString',  # min: 1, max: 4096
              KmsKeyId          => 'MyKmsKeyId',           # max: 2048; OPTIONAL
              OutputCompression =>
                'GZIP',    # values: GZIP, SNAPPY, ZLIB; OPTIONAL
              WorkGroup => 'MyAthenaWorkGroup',    # min: 1, max: 128; OPTIONAL
            },    # OPTIONAL
            DataDistributionType => 'FullyReplicated'
            ,     # values: FullyReplicated, ShardedByS3Key; OPTIONAL
            InputMode => 'Pipe',                  # values: Pipe, File; OPTIONAL
            LocalPath => 'MyProcessingLocalPath', # max: 256; OPTIONAL
            RedshiftDatasetDefinition => {
              ClusterId      => 'MyRedshiftClusterId',    # min: 1, max: 63
              ClusterRoleArn => 'MyRoleArn',              # min: 20, max: 2048
              Database       => 'MyRedshiftDatabase',     # min: 1, max: 64
              DbUser         => 'MyRedshiftUserName',     # min: 1, max: 128
              OutputFormat   => 'PARQUET',                # values: PARQUET, CSV
              OutputS3Uri    => 'MyS3Uri',                # max: 1024
              QueryString    => 'MyRedshiftQueryString',  # min: 1, max: 4096
              KmsKeyId       => 'MyKmsKeyId',             # max: 2048; OPTIONAL
              OutputCompression =>
                'None',    # values: None, GZIP, BZIP2, ZSTD, SNAPPY; OPTIONAL
            },    # OPTIONAL
          },    # OPTIONAL
          S3Input => {
            S3DataType => 'ManifestFile',    # values: ManifestFile, S3Prefix
            S3Uri      => 'MyS3Uri',         # max: 1024
            LocalPath  => 'MyProcessingLocalPath',    # max: 256; OPTIONAL
            S3CompressionType      => 'None',    # values: None, Gzip; OPTIONAL
            S3DataDistributionType => 'FullyReplicated'
            ,    # values: FullyReplicated, ShardedByS3Key; OPTIONAL
            S3InputMode => 'Pipe',    # values: Pipe, File; OPTIONAL
          },    # OPTIONAL
        },
        ...
      ],    # OPTIONAL
      ProcessingOutputConfig => {
        Outputs => [
          {
            OutputName         => 'MyString',
            AppManaged         => 1,            # OPTIONAL
            FeatureStoreOutput => {
              FeatureGroupName => 'MyFeatureGroupName',    # min: 1, max: 64
            },    # OPTIONAL
            S3Output => {
              LocalPath    => 'MyProcessingLocalPath',    # max: 256; OPTIONAL
              S3UploadMode => 'Continuous',    # values: Continuous, EndOfJob
              S3Uri        => 'MyS3Uri',       # max: 1024
            },    # OPTIONAL
          },
          ...
        ],    # max: 10
        KmsKeyId => 'MyKmsKeyId',    # max: 2048; OPTIONAL
      },    # OPTIONAL
      StoppingCondition => {
        MaxRuntimeInSeconds => 1,    # min: 1, max: 604800
      },    # OPTIONAL
      Tags => [
        {
          Key   => 'MyTagKey',      # min: 1, max: 128
          Value => 'MyTagValue',    # max: 256
        },
        ...
      ],    # OPTIONAL
    );
    # Results:
    my $ProcessingJobArn = $CreateProcessingJobResponse->ProcessingJobArn;
    # Returns a L<Paws::SageMaker::CreateProcessingJobResponse> object.

Values for attributes that are native types (Int, String, Float, etc) can passed as-is (scalar values). Values for complex Types (objects) can be passed as a HashRef. The keys and values of the hashref will be used to instance the underlying object. For the AWS API documentation, see <https://docs.aws.amazon.com/goto/WebAPI/api.sagemaker/CreateProcessingJob>

ATTRIBUTES

SEE ALSO

This class forms part of Paws, documenting arguments for method CreateProcessingJob in Paws::SageMaker

BUGS and CONTRIBUTIONS

The source code is located here: <https://github.com/pplu/aws-sdk-perl>

Please report bugs to: <https://github.com/pplu/aws-sdk-perl/issues>