SnowflakeDestinationConfiguration
¶
Used by
-
AsyncFirehoseClient Operationscreate_delivery_stream -
FirehoseClient Operationscreate_delivery_stream
Source code in docs_src/capo_firehose/types/snowflake_destination_configuration.py
account_url
instance-attribute
¶
account_url: SnowflakeAccountUrl
URL for accessing your Snowflake account. This URL must include your account identifier. Note that the protocol (https://) and port number are optional.
buffering_hints
instance-attribute
¶
buffering_hints: NotRequired[SnowflakeBufferingHints]
Describes the buffering to perform before delivering data to the Snowflake destination. If you do not specify any value, Firehose uses the default values.
cloud_watch_logging_options
instance-attribute
¶
cloud_watch_logging_options: NotRequired[CloudWatchLoggingOptions]
content_column_name
instance-attribute
¶
content_column_name: NotRequired[SnowflakeContentColumnName]
The name of the record content column.
data_loading_option
instance-attribute
¶
data_loading_option: NotRequired[SnowflakeDataLoadingOption]
Choose to load JSON keys mapped to table column names or choose to split the JSON payload where content is mapped to a record content column and source metadata is mapped to a record metadata column.
database
instance-attribute
¶
database: SnowflakeDatabase
All data in Snowflake is maintained in databases.
key_passphrase
instance-attribute
¶
key_passphrase: NotRequired[SnowflakeKeyPassphrase]
Passphrase to decrypt the private key when the key is encrypted. For information, see Using Key Pair Authentication & Key Rotation.
meta_data_column_name
instance-attribute
¶
meta_data_column_name: NotRequired[SnowflakeMetaDataColumnName]
Specify a column name in the table, where the metadata information has to be loaded. When you enable this field, you will see the following column in the snowflake table, which differs based on the source type.
For Direct PUT as source
{ "firehoseDeliveryStreamName" : "streamname", "IngestionTime" : "timestamp" }
For Kinesis Data Stream as source
"kinesisStreamName" : "streamname", "kinesisShardId" : "Id", "kinesisPartitionKey" : "key", "kinesisSequenceNumber" : "1234", "subsequenceNumber" : "2334", "IngestionTime" : "timestamp" }
private_key
instance-attribute
¶
private_key: NotRequired[SnowflakePrivateKey]
The private key used to encrypt your Snowflake client. For information, see Using Key Pair Authentication & Key Rotation.
processing_configuration
instance-attribute
¶
processing_configuration: NotRequired[ProcessingConfiguration]
retry_options
instance-attribute
¶
retry_options: NotRequired[SnowflakeRetryOptions]
The time period where Firehose will retry sending data to the chosen HTTP endpoint.
role_arn
instance-attribute
¶
role_arn: RoleARN
The Amazon Resource Name (ARN) of the Snowflake role
s3_backup_mode
instance-attribute
¶
s3_backup_mode: NotRequired[SnowflakeS3BackupMode]
Choose an S3 backup mode
schema
instance-attribute
¶
schema: SnowflakeSchema
Each database consists of one or more schemas, which are logical groupings of database objects, such as tables and views
secrets_manager_configuration
instance-attribute
¶
secrets_manager_configuration: NotRequired[SecretsManagerConfiguration]
The configuration that defines how you access secrets for Snowflake.
snowflake_role_configuration
instance-attribute
¶
snowflake_role_configuration: NotRequired[SnowflakeRoleConfiguration]
Optionally configure a Snowflake role. Otherwise the default user role will be used.
snowflake_vpc_configuration
instance-attribute
¶
snowflake_vpc_configuration: NotRequired[SnowflakeVpcConfiguration]
The VPCE ID for Firehose to privately connect with Snowflake. The ID format is com.amazonaws.vpce.[region].vpce-svc-<[id]>. For more information, see Amazon PrivateLink & Snowflake
table
instance-attribute
¶
table: SnowflakeTable
All data in Snowflake is stored in database tables, logically structured as collections of columns and rows.
user
instance-attribute
¶
user: NotRequired[SnowflakeUser]
User login name for the Snowflake account.