Skip to content

S3Target

Source code in docs_src/capo_glue/types/s3_target.py 
15
16
17
18
19
20
21
22
23
24
25
26
27
class S3Target(TypedDict, closed=True):
    path: NotRequired["capo_glue.types.path.Path"]
    """<p>The path to the Amazon S3 target.</p>"""
    exclusions: NotRequired["capo_glue.types.path_list.PathList"]
    """<p>A list of glob patterns used to exclude from the crawl. For more information, see <a href="https://docs.aws.amazon.com/glue/latest/dg/add-crawler.html">Catalog Tables with a Crawler</a>.</p>"""
    connection_name: NotRequired["capo_glue.types.connection_name.ConnectionName"]
    """<p>The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).</p>"""
    sample_size: NotRequired["capo_glue.types.nullable_integer.NullableInteger"]
    """<p>Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.</p>"""
    event_queue_arn: NotRequired["capo_glue.types.event_queue_arn.EventQueueArn"]
    """<p>A valid Amazon SQS ARN. For example, <code>arn:aws:sqs:region:account:sqs</code>.</p>"""
    dlq_event_queue_arn: NotRequired["capo_glue.types.event_queue_arn.EventQueueArn"]
    """<p>A valid Amazon dead-letter SQS ARN. For example, <code>arn:aws:sqs:region:account:deadLetterQueue</code>.</p>"""

connection_name instance-attribute 

connection_name: NotRequired[ConnectionName]

The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

dlq_event_queue_arn instance-attribute 

dlq_event_queue_arn: NotRequired[EventQueueArn]

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

event_queue_arn instance-attribute 

event_queue_arn: NotRequired[EventQueueArn]

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

exclusions instance-attribute 

exclusions: NotRequired[PathList]

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

path instance-attribute 

path: NotRequired[Path]

The path to the Amazon S3 target.

sample_size instance-attribute 

sample_size: NotRequired[NullableInteger]

Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.