Interface CreateSessionRequest.Builder
- All Superinterfaces:
AwsRequest.Builder
,Buildable
,CopyableBuilder<CreateSessionRequest.Builder,
,CreateSessionRequest> GlueRequest.Builder
,SdkBuilder<CreateSessionRequest.Builder,
,CreateSessionRequest> SdkPojo
,SdkRequest.Builder
- Enclosing class:
CreateSessionRequest
-
Method Summary
Modifier and TypeMethodDescriptiondefault CreateSessionRequest.Builder
command
(Consumer<SessionCommand.Builder> command) TheSessionCommand
that runs the job.command
(SessionCommand command) TheSessionCommand
that runs the job.default CreateSessionRequest.Builder
connections
(Consumer<ConnectionsList.Builder> connections) The number of connections to use for the session.connections
(ConnectionsList connections) The number of connections to use for the session.defaultArguments
(Map<String, String> defaultArguments) A map array of key-value pairs.description
(String description) The description of the session.glueVersion
(String glueVersion) The Glue version determines the versions of Apache Spark and Python that Glue supports.The ID of the session request.idleTimeout
(Integer idleTimeout) The number of minutes when idle before session times out.maxCapacity
(Double maxCapacity) The number of Glue data processing units (DPUs) that can be allocated when the job runs.numberOfWorkers
(Integer numberOfWorkers) The number of workers of a definedWorkerType
to use for the session.overrideConfiguration
(Consumer<AwsRequestOverrideConfiguration.Builder> builderConsumer) Add an optional request override configuration.overrideConfiguration
(AwsRequestOverrideConfiguration overrideConfiguration) Add an optional request override configuration.requestOrigin
(String requestOrigin) The origin of the request.The IAM Role ARNsecurityConfiguration
(String securityConfiguration) The name of the SecurityConfiguration structure to be used with the sessionThe map of key value pairs (tags) belonging to the session.The number of minutes before session times out.workerType
(String workerType) The type of predefined worker that is allocated when a job runs.workerType
(WorkerType workerType) The type of predefined worker that is allocated when a job runs.Methods inherited from interface software.amazon.awssdk.awscore.AwsRequest.Builder
overrideConfiguration
Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy
Methods inherited from interface software.amazon.awssdk.services.glue.model.GlueRequest.Builder
build
Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build
Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFields
-
Method Details
-
id
The ID of the session request.
- Parameters:
id
- The ID of the session request.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
description
The description of the session.
- Parameters:
description
- The description of the session.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
role
The IAM Role ARN
- Parameters:
role
- The IAM Role ARN- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
command
The
SessionCommand
that runs the job.- Parameters:
command
- TheSessionCommand
that runs the job.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
command
The
This is a convenience method that creates an instance of theSessionCommand
that runs the job.SessionCommand.Builder
avoiding the need to create one manually viaSessionCommand.builder()
.When the
Consumer
completes,SdkBuilder.build()
is called immediately and its result is passed tocommand(SessionCommand)
.- Parameters:
command
- a consumer that will call methods onSessionCommand.Builder
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
timeout
The number of minutes before session times out. Default for Spark ETL jobs is 48 hours (2880 minutes), the maximum session lifetime for this job type. Consult the documentation for other job types.
- Parameters:
timeout
- The number of minutes before session times out. Default for Spark ETL jobs is 48 hours (2880 minutes), the maximum session lifetime for this job type. Consult the documentation for other job types.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
idleTimeout
The number of minutes when idle before session times out. Default for Spark ETL jobs is value of Timeout. Consult the documentation for other job types.
- Parameters:
idleTimeout
- The number of minutes when idle before session times out. Default for Spark ETL jobs is value of Timeout. Consult the documentation for other job types.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
defaultArguments
A map array of key-value pairs. Max is 75 pairs.
- Parameters:
defaultArguments
- A map array of key-value pairs. Max is 75 pairs.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
connections
The number of connections to use for the session.
- Parameters:
connections
- The number of connections to use for the session.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
connections
The number of connections to use for the session.
This is a convenience method that creates an instance of theConnectionsList.Builder
avoiding the need to create one manually viaConnectionsList.builder()
.When the
Consumer
completes,SdkBuilder.build()
is called immediately and its result is passed toconnections(ConnectionsList)
.- Parameters:
connections
- a consumer that will call methods onConnectionsList.Builder
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
maxCapacity
The number of Glue data processing units (DPUs) that can be allocated when the job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB memory.
- Parameters:
maxCapacity
- The number of Glue data processing units (DPUs) that can be allocated when the job runs. A DPU is a relative measure of processing power that consists of 4 vCPUs of compute capacity and 16 GB memory.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
numberOfWorkers
The number of workers of a defined
WorkerType
to use for the session.- Parameters:
numberOfWorkers
- The number of workers of a definedWorkerType
to use for the session.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
workerType
The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, or G.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.
-
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.4X
worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm). -
For the
G.8X
worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for theG.4X
worker type. -
For the
Z.2X
worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.
- Parameters:
workerType
- The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, or G.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.-
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.4X
worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm). -
For the
G.8X
worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for theG.4X
worker type. -
For the
Z.2X
worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.
-
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
-
workerType
The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, or G.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.
-
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.4X
worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm). -
For the
G.8X
worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for theG.4X
worker type. -
For the
Z.2X
worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.
- Parameters:
workerType
- The type of predefined worker that is allocated when a job runs. Accepts a value of G.1X, G.2X, G.4X, or G.8X for Spark jobs. Accepts the value Z.2X for Ray notebooks.-
For the
G.1X
worker type, each worker maps to 1 DPU (4 vCPUs, 16 GB of memory) with 84GB disk (approximately 34GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.2X
worker type, each worker maps to 2 DPU (8 vCPUs, 32 GB of memory) with 128GB disk (approximately 77GB free), and provides 1 executor per worker. We recommend this worker type for workloads such as data transforms, joins, and queries, to offers a scalable and cost effective way to run most jobs. -
For the
G.4X
worker type, each worker maps to 4 DPU (16 vCPUs, 64 GB of memory) with 256GB disk (approximately 235GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs in the following Amazon Web Services Regions: US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), and Europe (Stockholm). -
For the
G.8X
worker type, each worker maps to 8 DPU (32 vCPUs, 128 GB of memory) with 512GB disk (approximately 487GB free), and provides 1 executor per worker. We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for Glue version 3.0 or later Spark ETL jobs, in the same Amazon Web Services Regions as supported for theG.4X
worker type. -
For the
Z.2X
worker type, each worker maps to 2 M-DPU (8vCPUs, 64 GB of memory) with 128 GB disk (approximately 120GB free), and provides up to 8 Ray workers based on the autoscaler.
-
- Returns:
- Returns a reference to this object so that method calls can be chained together.
- See Also:
-
-
securityConfiguration
The name of the SecurityConfiguration structure to be used with the session
- Parameters:
securityConfiguration
- The name of the SecurityConfiguration structure to be used with the session- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
glueVersion
The Glue version determines the versions of Apache Spark and Python that Glue supports. The GlueVersion must be greater than 2.0.
- Parameters:
glueVersion
- The Glue version determines the versions of Apache Spark and Python that Glue supports. The GlueVersion must be greater than 2.0.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
tags
The map of key value pairs (tags) belonging to the session.
- Parameters:
tags
- The map of key value pairs (tags) belonging to the session.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
requestOrigin
The origin of the request.
- Parameters:
requestOrigin
- The origin of the request.- Returns:
- Returns a reference to this object so that method calls can be chained together.
-
overrideConfiguration
CreateSessionRequest.Builder overrideConfiguration(AwsRequestOverrideConfiguration overrideConfiguration) Description copied from interface:AwsRequest.Builder
Add an optional request override configuration.- Specified by:
overrideConfiguration
in interfaceAwsRequest.Builder
- Parameters:
overrideConfiguration
- The override configuration.- Returns:
- This object for method chaining.
-
overrideConfiguration
CreateSessionRequest.Builder overrideConfiguration(Consumer<AwsRequestOverrideConfiguration.Builder> builderConsumer) Description copied from interface:AwsRequest.Builder
Add an optional request override configuration.- Specified by:
overrideConfiguration
in interfaceAwsRequest.Builder
- Parameters:
builderConsumer
- AConsumer
to which an emptyAwsRequestOverrideConfiguration.Builder
will be given.- Returns:
- This object for method chaining.
-