glue/aws.sdk.kotlin.services.glue.model/SparkSql

SparkSql

Specifies a transform where you enter a SQL query using Spark SQL syntax to transform the data. The output is a single DynamicFrame.

Types

Builder

class Builder

Companion

object Companion

Properties

inputs

val inputs: List<String>

The data inputs identified by their node names. You can associate a table name with each input node to use in the SQL query. The name you choose must meet the Spark SQL naming restrictions.

name

val name: String

The name of the transform node.

outputSchemas

val outputSchemas: List<GlueSchema>?

Specifies the data schema for the SparkSQL transform.

sqlAliases

val sqlAliases: List<SqlAlias>

A list of aliases. An alias allows you to specify what name to use in the SQL for a given input. For example, you have a datasource named "MyDataSource". If you specify From as MyDataSource, and Alias as SqlName, then in your SQL you can do:

sqlQuery

val sqlQuery: String

A SQL query that must use Spark SQL syntax and return a single data set.

Functions

copy

inline fun copy(block: SparkSql.Builder.() -> Unit = {}): SparkSql

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String