Crawler

class Crawler

Specifies a crawler program that examines a data source and uses classifiers to try to determine its schema. If successful, the crawler records metadata concerning the data source in the Glue Data Catalog.

Types

Link copied to clipboard
class Builder
Link copied to clipboard
object Companion

Properties

Link copied to clipboard

A list of UTF-8 strings that specify the custom classifiers that are associated with the crawler.

Link copied to clipboard

Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Setting crawler configuration options.

Link copied to clipboard

If the crawler is running, contains the total time elapsed since the last crawl began.

Link copied to clipboard

The name of the SecurityConfiguration structure to be used by this crawler.

Link copied to clipboard

The time that the crawler was created.

Link copied to clipboard

The name of the database in which the crawler's output is stored.

Link copied to clipboard

A description of the crawler.

Link copied to clipboard

Specifies whether the crawler should use Lake Formation credentials for the crawler instead of the IAM role credentials.

Link copied to clipboard

The status of the last crawl, and potentially error information if an error occurred.

Link copied to clipboard

The time that the crawler was last updated.

Link copied to clipboard

A configuration that specifies whether data lineage is enabled for the crawler.

Link copied to clipboard
val name: String?

The name of the crawler.

Link copied to clipboard

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

Link copied to clipboard
val role: String?

The Amazon Resource Name (ARN) of an IAM role that's used to access customer resources, such as Amazon Simple Storage Service (Amazon S3) data.

Link copied to clipboard

For scheduled crawlers, the schedule when the crawler runs.

Link copied to clipboard

The policy that specifies update and delete behaviors for the crawler.

Link copied to clipboard

Indicates whether the crawler is running, or whether a run is pending.

Link copied to clipboard

The prefix added to the names of tables that are created.

Link copied to clipboard

A collection of targets to crawl.

Link copied to clipboard

The version of the crawler.

Functions

Link copied to clipboard
inline fun copy(block: Crawler.Builder.() -> Unit = {}): Crawler
Link copied to clipboard
open operator override fun equals(other: Any?): Boolean
Link copied to clipboard
open override fun hashCode(): Int
Link copied to clipboard
open override fun toString(): String