S3HudiDirectTarget
¶
Source code in docs_src/capo_glue/types/s3_hudi_direct_target.py
additional_options
instance-attribute
¶
additional_options: AdditionalOptions
Specifies additional connection options for the connector.
auto_data_quality
instance-attribute
¶
auto_data_quality: NotRequired[AutoDataQuality]
Specifies whether to automatically enable data quality evaluation for the S3 Hudi direct target. When set to true, data quality checks are performed automatically during the write operation.
compression
instance-attribute
¶
compression: HudiTargetCompressionType
Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").
number_target_partitions
instance-attribute
¶
number_target_partitions: NotRequired[NumberTargetPartitionsString]
Specifies the number of target partitions for distributing Hudi dataset files across Amazon S3.
partition_keys
instance-attribute
¶
partition_keys: NotRequired[GlueStudioPathList]
Specifies native partitioning using a sequence of keys.
path
instance-attribute
¶
path: EnclosedInStringProperty
The Amazon S3 path of your Hudi data source to write to.
schema_change_policy
instance-attribute
¶
schema_change_policy: NotRequired[DirectSchemaChangePolicy]
A policy that specifies update behavior for the crawler.