Skip to content

S3GlueParquetTarget

Source code in docs_src/capo_glue/types/s3_glue_parquet_target.py
class S3GlueParquetTarget(TypedDict, closed=True):
    name: "capo_glue.types.node_name.NodeName"
    """<p>The name of the data target.</p>"""
    inputs: "capo_glue.types.one_input.OneInput"
    """<p>The nodes that are inputs to the data target.</p>"""
    partition_keys: NotRequired[
        "capo_glue.types.glue_studio_path_list.GlueStudioPathList"
    ]
    """<p>Specifies native partitioning using a sequence of keys.</p>"""
    path: "capo_glue.types.enclosed_in_string_property.EnclosedInStringProperty"
    """<p>A single Amazon S3 path to write to.</p>"""
    compression: NotRequired[
        "capo_glue.types.parquet_compression_type.ParquetCompressionType"
    ]
    """<p>Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are <code>"gzip"</code> and <code>"bzip"</code>).</p>"""
    number_target_partitions: NotRequired[
        "capo_glue.types.number_target_partitions_string.NumberTargetPartitionsString"
    ]
    """<p>Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.</p>"""
    schema_change_policy: NotRequired[
        "capo_glue.types.direct_schema_change_policy.DirectSchemaChangePolicy"
    ]
    """<p>A policy that specifies update behavior for the crawler.</p>"""
    auto_data_quality: NotRequired["capo_glue.types.auto_data_quality.AutoDataQuality"]
    """<p>Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to <code>true</code>, data quality checks are performed automatically during the write operation.</p>"""

auto_data_quality instance-attribute

auto_data_quality: NotRequired[AutoDataQuality]

Specifies whether to automatically enable data quality evaluation for the S3 Glue Parquet target. When set to true, data quality checks are performed automatically during the write operation.

compression instance-attribute

compression: NotRequired[ParquetCompressionType]

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

inputs instance-attribute

inputs: OneInput

The nodes that are inputs to the data target.

name instance-attribute

name: NodeName

The name of the data target.

number_target_partitions instance-attribute

number_target_partitions: NotRequired[NumberTargetPartitionsString]

Specifies the number of target partitions for Parquet files when writing to Amazon S3 using Glue.

partition_keys instance-attribute

partition_keys: NotRequired[GlueStudioPathList]

Specifies native partitioning using a sequence of keys.

path instance-attribute

A single Amazon S3 path to write to.

schema_change_policy instance-attribute

schema_change_policy: NotRequired[DirectSchemaChangePolicy]

A policy that specifies update behavior for the crawler.