Skip to content

SnowflakeDestinationConfiguration

Source code in docs_src/capo_firehose/types/snowflake_destination_configuration.py
class SnowflakeDestinationConfiguration(TypedDict, closed=True):
    account_url: "capo_firehose.types.snowflake_account_url.SnowflakeAccountUrl"
    """<p>URL for accessing your Snowflake account. This URL must include your <a href="https://docs.snowflake.com/en/user-guide/admin-account-identifier">account identifier</a>. Note that the protocol (https://) and port number are optional.</p>"""
    private_key: NotRequired[
        "capo_firehose.types.snowflake_private_key.SnowflakePrivateKey"
    ]
    """<p>The private key used to encrypt your Snowflake client. For information, see <a href="https://docs.snowflake.com/en/user-guide/data-load-snowpipe-streaming-configuration#using-key-pair-authentication-key-rotation">Using Key Pair Authentication & Key Rotation</a>.</p>"""
    key_passphrase: NotRequired[
        "capo_firehose.types.snowflake_key_passphrase.SnowflakeKeyPassphrase"
    ]
    """<p>Passphrase to decrypt the private key when the key is encrypted. For information, see <a href="https://docs.snowflake.com/en/user-guide/data-load-snowpipe-streaming-configuration#using-key-pair-authentication-key-rotation">Using Key Pair Authentication & Key Rotation</a>.</p>"""
    user: NotRequired["capo_firehose.types.snowflake_user.SnowflakeUser"]
    """<p>User login name for the Snowflake account.</p>"""
    database: "capo_firehose.types.snowflake_database.SnowflakeDatabase"
    """<p>All data in Snowflake is maintained in databases.</p>"""
    schema: "capo_firehose.types.snowflake_schema.SnowflakeSchema"
    """<p>Each database consists of one or more schemas, which are logical groupings of database objects, such as tables and views</p>"""
    table: "capo_firehose.types.snowflake_table.SnowflakeTable"
    """<p>All data in Snowflake is stored in database tables, logically structured as collections of columns and rows.</p>"""
    snowflake_role_configuration: NotRequired[
        "capo_firehose.types.snowflake_role_configuration.SnowflakeRoleConfiguration"
    ]
    """<p>Optionally configure a Snowflake role. Otherwise the default user role will be used.</p>"""
    data_loading_option: NotRequired[
        "capo_firehose.types.snowflake_data_loading_option.SnowflakeDataLoadingOption"
    ]
    """<p>Choose to load JSON keys mapped to table column names or choose to split the JSON payload where content is mapped to a record content column and source metadata is mapped to a record metadata column.</p>"""
    meta_data_column_name: NotRequired[
        "capo_firehose.types.snowflake_meta_data_column_name.SnowflakeMetaDataColumnName"
    ]
    """<p>Specify a column name in the table, where the metadata information has to be loaded. When you enable this field, you will see the following column in the snowflake table, which differs based on the source type.</p> <p>For Direct PUT as source </p> <p> <code>{ "firehoseDeliveryStreamName" : "streamname", "IngestionTime" : "timestamp" }</code> </p> <p>For Kinesis Data Stream as source </p> <p> <code> "kinesisStreamName" : "streamname", "kinesisShardId" : "Id", "kinesisPartitionKey" : "key", "kinesisSequenceNumber" : "1234", "subsequenceNumber" : "2334", "IngestionTime" : "timestamp" }</code> </p>"""
    content_column_name: NotRequired[
        "capo_firehose.types.snowflake_content_column_name.SnowflakeContentColumnName"
    ]
    """<p>The name of the record content column.</p>"""
    snowflake_vpc_configuration: NotRequired[
        "capo_firehose.types.snowflake_vpc_configuration.SnowflakeVpcConfiguration"
    ]
    """<p>The VPCE ID for Firehose to privately connect with Snowflake. The ID format is com.amazonaws.vpce.[region].vpce-svc-<[id]>. For more information, see <a href="https://docs.snowflake.com/en/user-guide/admin-security-privatelink">Amazon PrivateLink & Snowflake</a> </p>"""
    cloud_watch_logging_options: NotRequired[
        "capo_firehose.types.cloud_watch_logging_options.CloudWatchLoggingOptions"
    ]
    processing_configuration: NotRequired[
        "capo_firehose.types.processing_configuration.ProcessingConfiguration"
    ]
    role_arn: "capo_firehose.types.role_arn.RoleARN"
    """<p>The Amazon Resource Name (ARN) of the Snowflake role</p>"""
    retry_options: NotRequired[
        "capo_firehose.types.snowflake_retry_options.SnowflakeRetryOptions"
    ]
    """<p>The time period where Firehose will retry sending data to the chosen HTTP endpoint.</p>"""
    s3_backup_mode: NotRequired[
        "capo_firehose.types.snowflake_s3_backup_mode.SnowflakeS3BackupMode"
    ]
    """<p>Choose an S3 backup mode</p>"""
    s3_configuration: (
        "capo_firehose.types.s3_destination_configuration.S3DestinationConfiguration"
    )
    secrets_manager_configuration: NotRequired[
        "capo_firehose.types.secrets_manager_configuration.SecretsManagerConfiguration"
    ]
    """<p> The configuration that defines how you access secrets for Snowflake. </p>"""
    buffering_hints: NotRequired[
        "capo_firehose.types.snowflake_buffering_hints.SnowflakeBufferingHints"
    ]
    """<p> Describes the buffering to perform before delivering data to the Snowflake destination. If you do not specify any value, Firehose uses the default values. </p>"""

account_url instance-attribute

account_url: SnowflakeAccountUrl

URL for accessing your Snowflake account. This URL must include your account identifier. Note that the protocol (https://) and port number are optional.

buffering_hints instance-attribute

buffering_hints: NotRequired[SnowflakeBufferingHints]

Describes the buffering to perform before delivering data to the Snowflake destination. If you do not specify any value, Firehose uses the default values.

cloud_watch_logging_options instance-attribute

cloud_watch_logging_options: NotRequired[CloudWatchLoggingOptions]

content_column_name instance-attribute

content_column_name: NotRequired[SnowflakeContentColumnName]

The name of the record content column.

data_loading_option instance-attribute

data_loading_option: NotRequired[SnowflakeDataLoadingOption]

Choose to load JSON keys mapped to table column names or choose to split the JSON payload where content is mapped to a record content column and source metadata is mapped to a record metadata column.

database instance-attribute

All data in Snowflake is maintained in databases.

key_passphrase instance-attribute

key_passphrase: NotRequired[SnowflakeKeyPassphrase]

Passphrase to decrypt the private key when the key is encrypted. For information, see Using Key Pair Authentication & Key Rotation.

meta_data_column_name instance-attribute

meta_data_column_name: NotRequired[SnowflakeMetaDataColumnName]

Specify a column name in the table, where the metadata information has to be loaded. When you enable this field, you will see the following column in the snowflake table, which differs based on the source type.

For Direct PUT as source

{ "firehoseDeliveryStreamName" : "streamname", "IngestionTime" : "timestamp" }

For Kinesis Data Stream as source

"kinesisStreamName" : "streamname", "kinesisShardId" : "Id", "kinesisPartitionKey" : "key", "kinesisSequenceNumber" : "1234", "subsequenceNumber" : "2334", "IngestionTime" : "timestamp" }

private_key instance-attribute

private_key: NotRequired[SnowflakePrivateKey]

The private key used to encrypt your Snowflake client. For information, see Using Key Pair Authentication & Key Rotation.

processing_configuration instance-attribute

processing_configuration: NotRequired[ProcessingConfiguration]

retry_options instance-attribute

retry_options: NotRequired[SnowflakeRetryOptions]

The time period where Firehose will retry sending data to the chosen HTTP endpoint.

role_arn instance-attribute

role_arn: RoleARN

The Amazon Resource Name (ARN) of the Snowflake role

s3_backup_mode instance-attribute

s3_backup_mode: NotRequired[SnowflakeS3BackupMode]

Choose an S3 backup mode

s3_configuration instance-attribute

s3_configuration: S3DestinationConfiguration

schema instance-attribute

Each database consists of one or more schemas, which are logical groupings of database objects, such as tables and views

secrets_manager_configuration instance-attribute

secrets_manager_configuration: NotRequired[SecretsManagerConfiguration]

The configuration that defines how you access secrets for Snowflake.

snowflake_role_configuration instance-attribute

snowflake_role_configuration: NotRequired[SnowflakeRoleConfiguration]

Optionally configure a Snowflake role. Otherwise the default user role will be used.

snowflake_vpc_configuration instance-attribute

snowflake_vpc_configuration: NotRequired[SnowflakeVpcConfiguration]

The VPCE ID for Firehose to privately connect with Snowflake. The ID format is com.amazonaws.vpce.[region].vpce-svc-<[id]>. For more information, see Amazon PrivateLink & Snowflake

table instance-attribute

All data in Snowflake is stored in database tables, logically structured as collections of columns and rows.

user instance-attribute

user: NotRequired[SnowflakeUser]

User login name for the Snowflake account.