parameters

Specifies the Lambda function or functions to use for creating the data catalog. This is a mapping whose values depend on the catalog type.

  • For the HIVE data catalog type, use the following syntax. The metadata-function parameter is required. The sdk-version parameter is optional and defaults to the currently supported version.metadata-function=<i>lambda_arn</i>, sdk-version=<i>version_number</i>

  • For the LAMBDA data catalog type, use one of the following sets of required parameters, but not both.

    • If you have one Lambda function that processes metadata and another for reading the actual data, use the following syntax. Both parameters are required.metadata-function=<i>lambda_arn</i>, record-function=<i>lambda_arn</i>

    • If you have a composite Lambda function that processes both metadata and data, use the following syntax to specify your Lambda function.function=<i>lambda_arn</i>

  • The GLUE type takes a catalog ID parameter and is required. The <i>catalog_id</i> is the account ID of the Amazon Web Services account to which the Glue Data Catalog belongs.catalog-id=<i>catalog_id</i>

    • The GLUE data catalog type also applies to the default AwsDataCatalog that already exists in your account, of which you can have only one and cannot modify.