Skip to content

S3DeltaDirectTarget

Source code in docs_src/capo_glue/types/s3_delta_direct_target.py
class S3DeltaDirectTarget(TypedDict, closed=True):
    name: "capo_glue.types.node_name.NodeName"
    """<p>The name of the data target.</p>"""
    inputs: "capo_glue.types.one_input.OneInput"
    """<p>The nodes that are inputs to the data target.</p>"""
    partition_keys: NotRequired[
        "capo_glue.types.glue_studio_path_list.GlueStudioPathList"
    ]
    """<p>Specifies native partitioning using a sequence of keys.</p>"""
    path: "capo_glue.types.enclosed_in_string_property.EnclosedInStringProperty"
    """<p>The Amazon S3 path of your Delta Lake data source to write to.</p>"""
    compression: (
        "capo_glue.types.delta_target_compression_type.DeltaTargetCompressionType"
    )
    """<p>Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are <code>"gzip"</code> and <code>"bzip"</code>).</p>"""
    number_target_partitions: NotRequired[
        "capo_glue.types.number_target_partitions_string.NumberTargetPartitionsString"
    ]
    """<p>Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.</p>"""
    format: "capo_glue.types.target_format.TargetFormat"
    """<p>Specifies the data output format for the target.</p>"""
    additional_options: NotRequired[
        "capo_glue.types.additional_options.AdditionalOptions"
    ]
    """<p>Specifies additional connection options for the connector.</p>"""
    schema_change_policy: NotRequired[
        "capo_glue.types.direct_schema_change_policy.DirectSchemaChangePolicy"
    ]
    """<p>A policy that specifies update behavior for the crawler.</p>"""
    auto_data_quality: NotRequired["capo_glue.types.auto_data_quality.AutoDataQuality"]
    """<p>Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to <code>true</code>, data quality checks are performed automatically during the write operation.</p>"""

additional_options instance-attribute

additional_options: NotRequired[AdditionalOptions]

Specifies additional connection options for the connector.

auto_data_quality instance-attribute

auto_data_quality: NotRequired[AutoDataQuality]

Specifies whether to automatically enable data quality evaluation for the S3 Delta direct target. When set to true, data quality checks are performed automatically during the write operation.

compression instance-attribute

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

format instance-attribute

format: TargetFormat

Specifies the data output format for the target.

inputs instance-attribute

inputs: OneInput

The nodes that are inputs to the data target.

name instance-attribute

name: NodeName

The name of the data target.

number_target_partitions instance-attribute

number_target_partitions: NotRequired[NumberTargetPartitionsString]

Specifies the number of target partitions for distributing Delta Lake dataset files across Amazon S3.

partition_keys instance-attribute

partition_keys: NotRequired[GlueStudioPathList]

Specifies native partitioning using a sequence of keys.

path instance-attribute

The Amazon S3 path of your Delta Lake data source to write to.

schema_change_policy instance-attribute

schema_change_policy: NotRequired[DirectSchemaChangePolicy]

A policy that specifies update behavior for the crawler.