ElasticsearchDestinationConfiguration
¶
Used by
-
AsyncFirehoseClient Operationscreate_delivery_stream -
FirehoseClient Operationscreate_delivery_stream
Source code in docs_src/capo_firehose/types/elasticsearch_destination_configuration.py
buffering_hints
instance-attribute
¶
buffering_hints: NotRequired[ElasticsearchBufferingHints]
The buffering options. If no value is specified, the default values for ElasticsearchBufferingHints are used.
cloud_watch_logging_options
instance-attribute
¶
cloud_watch_logging_options: NotRequired[CloudWatchLoggingOptions]
The Amazon CloudWatch logging options for your Firehose stream.
cluster_endpoint
instance-attribute
¶
cluster_endpoint: NotRequired[ElasticsearchClusterEndpoint]
The endpoint to use when communicating with the cluster. Specify either this ClusterEndpoint or the DomainARN field.
document_id_options
instance-attribute
¶
document_id_options: NotRequired[DocumentIdOptions]
Indicates the method for setting up document ID. The supported methods are Firehose generated document ID and OpenSearch Service generated document ID.
domain_arn
instance-attribute
¶
domain_arn: NotRequired[ElasticsearchDomainARN]
The ARN of the Amazon OpenSearch Service domain. The IAM role must have permissions for DescribeDomain, DescribeDomains, and DescribeDomainConfig after assuming the role specified in RoleARN. For more information, see Amazon Resource Names (ARNs) and Amazon Web Services Service Namespaces.
Specify either ClusterEndpoint or DomainARN.
index_rotation_period
instance-attribute
¶
index_rotation_period: NotRequired[ElasticsearchIndexRotationPeriod]
The Elasticsearch index rotation period. Index rotation appends a timestamp to the IndexName to facilitate the expiration of old data. For more information, see Index Rotation for the Amazon OpenSearch Service Destination. The default value is OneDay.
processing_configuration
instance-attribute
¶
processing_configuration: NotRequired[ProcessingConfiguration]
The data processing configuration.
retry_options
instance-attribute
¶
retry_options: NotRequired[ElasticsearchRetryOptions]
The retry behavior in case Firehose is unable to deliver documents to Amazon OpenSearch Service. The default value is 300 (5 minutes).
role_arn
instance-attribute
¶
role_arn: RoleARN
The Amazon Resource Name (ARN) of the IAM role to be assumed by Firehose for calling the Amazon OpenSearch Service Configuration API and for indexing documents. For more information, see Grant Firehose Access to an Amazon S3 Destination and Amazon Resource Names (ARNs) and Amazon Web Services Service Namespaces.
s3_backup_mode
instance-attribute
¶
s3_backup_mode: NotRequired[ElasticsearchS3BackupMode]
Defines how documents should be delivered to Amazon S3. When it is set to FailedDocumentsOnly, Firehose writes any documents that could not be indexed to the configured Amazon S3 destination, with AmazonOpenSearchService-failed/ appended to the key prefix. When set to AllDocuments, Firehose delivers all incoming records to Amazon S3, and also writes failed documents with AmazonOpenSearchService-failed/ appended to the prefix. For more information, see Amazon S3 Backup for the Amazon OpenSearch Service Destination. Default value is FailedDocumentsOnly.
You can't change this backup mode after you create the Firehose stream.
s3_configuration
instance-attribute
¶
s3_configuration: S3DestinationConfiguration
The configuration for the backup Amazon S3 location.
type_name
instance-attribute
¶
type_name: NotRequired[ElasticsearchTypeName]
The Elasticsearch type name. For Elasticsearch 6.x, there can be only one type per index. If you try to specify a new type for an existing index that already has another type, Firehose returns an error during run time.
For Elasticsearch 7.x, don't specify a TypeName.
vpc_configuration
instance-attribute
¶
vpc_configuration: NotRequired[VpcConfiguration]
The details of the VPC of the Amazon destination.