Skip to content

KafkaSettings

Source code in docs_src/capo_database_migration_service/types/kafka_settings.py
class KafkaSettings(TypedDict, closed=True):
    broker: NotRequired["capo_database_migration_service.types.string.String"]
    """<p>A comma-separated list of one or more broker locations in your Kafka cluster that host your Kafka instance. Specify each broker location in the form <code> <i>broker-hostname-or-ip</i>:<i>port</i> </code>. For example, <code>"ec2-12-345-678-901.compute-1.amazonaws.com:2345"</code>. For more information and examples of specifying a list of broker locations, see <a href="https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.Kafka.html">Using Apache Kafka as a target for Database Migration Service</a> in the <i>Database Migration Service User Guide</i>. </p>"""
    topic: NotRequired["capo_database_migration_service.types.string.String"]
    """<p>The topic to which you migrate the data. If you don't specify a topic, DMS specifies <code>"kafka-default-topic"</code> as the migration topic.</p>"""
    message_format: NotRequired[
        "capo_database_migration_service.types.message_format_value.MessageFormatValue"
    ]
    """<p>The output format for the records created on the endpoint. The message format is <code>JSON</code> (default) or <code>JSON_UNFORMATTED</code> (a single line with no tab).</p>"""
    include_transaction_details: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Provides detailed transaction information from the source database. This information includes a commit timestamp, a log position, and values for <code>transaction_id</code>, previous <code>transaction_id</code>, and <code>transaction_record_id</code> (the record offset within a transaction). The default is <code>false</code>.</p>"""
    include_partition_value: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Shows the partition value within the Kafka message output unless the partition type is <code>schema-table-type</code>. The default is <code>false</code>.</p>"""
    partition_include_schema_table: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Prefixes schema and table names to partition values, when the partition type is <code>primary-key-type</code>. Doing this increases data distribution among Kafka partitions. For example, suppose that a SysBench schema has thousands of tables and each table has only limited range for a primary key. In this case, the same primary key is sent from thousands of tables to the same partition, which causes throttling. The default is <code>false</code>.</p>"""
    include_table_alter_operations: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Includes any data definition language (DDL) operations that change the table in the control data, such as <code>rename-table</code>, <code>drop-table</code>, <code>add-column</code>, <code>drop-column</code>, and <code>rename-column</code>. The default is <code>false</code>.</p>"""
    include_control_details: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Shows detailed control information for table definition, column definition, and table and column changes in the Kafka message output. The default is <code>false</code>.</p>"""
    message_max_bytes: NotRequired[
        "capo_database_migration_service.types.integer_optional.IntegerOptional"
    ]
    """<p>The maximum size in bytes for records created on the endpoint The default is 1,000,000.</p>"""
    include_null_and_empty: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Include NULL and empty columns for records migrated to the endpoint. The default is <code>false</code>.</p>"""
    security_protocol: NotRequired[
        "capo_database_migration_service.types.kafka_security_protocol.KafkaSecurityProtocol"
    ]
    """<p>Set secure connection to a Kafka target endpoint using Transport Layer Security (TLS). Options include <code>ssl-encryption</code>, <code>ssl-authentication</code>, and <code>sasl-ssl</code>. <code>sasl-ssl</code> requires <code>SaslUsername</code> and <code>SaslPassword</code>.</p>"""
    ssl_client_certificate_arn: NotRequired[
        "capo_database_migration_service.types.string.String"
    ]
    """<p>The Amazon Resource Name (ARN) of the client certificate used to securely connect to a Kafka target endpoint.</p>"""
    ssl_client_key_arn: NotRequired[
        "capo_database_migration_service.types.string.String"
    ]
    """<p>The Amazon Resource Name (ARN) for the client private key used to securely connect to a Kafka target endpoint.</p>"""
    ssl_client_key_password: NotRequired[
        "capo_database_migration_service.types.secret_string.SecretString"
    ]
    """<p> The password for the client private key used to securely connect to a Kafka target endpoint.</p>"""
    ssl_ca_certificate_arn: NotRequired[
        "capo_database_migration_service.types.string.String"
    ]
    """<p> The Amazon Resource Name (ARN) for the private certificate authority (CA) cert that DMS uses to securely connect to your Kafka target endpoint.</p>"""
    sasl_username: NotRequired["capo_database_migration_service.types.string.String"]
    """<p> The secure user name you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.</p>"""
    sasl_password: NotRequired[
        "capo_database_migration_service.types.secret_string.SecretString"
    ]
    """<p>The secure password you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.</p>"""
    no_hex_prefix: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Set this optional parameter to <code>true</code> to avoid adding a '0x' prefix to raw data in hexadecimal format. For example, by default, DMS adds a '0x' prefix to the LOB column type in hexadecimal format moving from an Oracle source to a Kafka target. Use the <code>NoHexPrefix</code> endpoint setting to enable migration of RAW data type columns without adding the '0x' prefix.</p>"""
    sasl_mechanism: NotRequired[
        "capo_database_migration_service.types.kafka_sasl_mechanism.KafkaSaslMechanism"
    ]
    """<p>For SASL/SSL authentication, DMS supports the <code>SCRAM-SHA-512</code> mechanism by default. DMS versions 3.5.0 and later also support the <code>PLAIN</code> mechanism. To use the <code>PLAIN</code> mechanism, set this parameter to <code>PLAIN.</code> </p>"""
    ssl_endpoint_identification_algorithm: NotRequired[
        "capo_database_migration_service.types.kafka_ssl_endpoint_identification_algorithm.KafkaSslEndpointIdentificationAlgorithm"
    ]
    """<p>Sets hostname verification for the certificate. This setting is supported in DMS version 3.5.1 and later. </p>"""
    use_large_integer_value: NotRequired[
        "capo_database_migration_service.types.boolean_optional.BooleanOptional"
    ]
    """<p>Specifies using the large integer value with Kafka.</p>"""

broker instance-attribute

broker: NotRequired[String]

A comma-separated list of one or more broker locations in your Kafka cluster that host your Kafka instance. Specify each broker location in the form broker-hostname-or-ip:port . For example, "ec2-12-345-678-901.compute-1.amazonaws.com:2345". For more information and examples of specifying a list of broker locations, see Using Apache Kafka as a target for Database Migration Service in the Database Migration Service User Guide.

include_control_details instance-attribute

include_control_details: NotRequired[BooleanOptional]

Shows detailed control information for table definition, column definition, and table and column changes in the Kafka message output. The default is false.

include_null_and_empty instance-attribute

include_null_and_empty: NotRequired[BooleanOptional]

Include NULL and empty columns for records migrated to the endpoint. The default is false.

include_partition_value instance-attribute

include_partition_value: NotRequired[BooleanOptional]

Shows the partition value within the Kafka message output unless the partition type is schema-table-type. The default is false.

include_table_alter_operations instance-attribute

include_table_alter_operations: NotRequired[BooleanOptional]

Includes any data definition language (DDL) operations that change the table in the control data, such as rename-table, drop-table, add-column, drop-column, and rename-column. The default is false.

include_transaction_details instance-attribute

include_transaction_details: NotRequired[BooleanOptional]

Provides detailed transaction information from the source database. This information includes a commit timestamp, a log position, and values for transaction_id, previous transaction_id, and transaction_record_id (the record offset within a transaction). The default is false.

message_format instance-attribute

message_format: NotRequired[MessageFormatValue]

The output format for the records created on the endpoint. The message format is JSON (default) or JSON_UNFORMATTED (a single line with no tab).

message_max_bytes instance-attribute

message_max_bytes: NotRequired[IntegerOptional]

The maximum size in bytes for records created on the endpoint The default is 1,000,000.

no_hex_prefix instance-attribute

no_hex_prefix: NotRequired[BooleanOptional]

Set this optional parameter to true to avoid adding a '0x' prefix to raw data in hexadecimal format. For example, by default, DMS adds a '0x' prefix to the LOB column type in hexadecimal format moving from an Oracle source to a Kafka target. Use the NoHexPrefix endpoint setting to enable migration of RAW data type columns without adding the '0x' prefix.

partition_include_schema_table instance-attribute

partition_include_schema_table: NotRequired[BooleanOptional]

Prefixes schema and table names to partition values, when the partition type is primary-key-type. Doing this increases data distribution among Kafka partitions. For example, suppose that a SysBench schema has thousands of tables and each table has only limited range for a primary key. In this case, the same primary key is sent from thousands of tables to the same partition, which causes throttling. The default is false.

sasl_mechanism instance-attribute

sasl_mechanism: NotRequired[KafkaSaslMechanism]

For SASL/SSL authentication, DMS supports the SCRAM-SHA-512 mechanism by default. DMS versions 3.5.0 and later also support the PLAIN mechanism. To use the PLAIN mechanism, set this parameter to PLAIN.

sasl_password instance-attribute

sasl_password: NotRequired[SecretString]

The secure password you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.

sasl_username instance-attribute

sasl_username: NotRequired[String]

The secure user name you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.

security_protocol instance-attribute

security_protocol: NotRequired[KafkaSecurityProtocol]

Set secure connection to a Kafka target endpoint using Transport Layer Security (TLS). Options include ssl-encryption, ssl-authentication, and sasl-ssl. sasl-ssl requires SaslUsername and SaslPassword.

ssl_ca_certificate_arn instance-attribute

ssl_ca_certificate_arn: NotRequired[String]

The Amazon Resource Name (ARN) for the private certificate authority (CA) cert that DMS uses to securely connect to your Kafka target endpoint.

ssl_client_certificate_arn instance-attribute

ssl_client_certificate_arn: NotRequired[String]

The Amazon Resource Name (ARN) of the client certificate used to securely connect to a Kafka target endpoint.

ssl_client_key_arn instance-attribute

ssl_client_key_arn: NotRequired[String]

The Amazon Resource Name (ARN) for the client private key used to securely connect to a Kafka target endpoint.

ssl_client_key_password instance-attribute

ssl_client_key_password: NotRequired[SecretString]

The password for the client private key used to securely connect to a Kafka target endpoint.

ssl_endpoint_identification_algorithm instance-attribute

ssl_endpoint_identification_algorithm: NotRequired[
    KafkaSslEndpointIdentificationAlgorithm
]

Sets hostname verification for the certificate. This setting is supported in DMS version 3.5.1 and later.

topic instance-attribute

topic: NotRequired[String]

The topic to which you migrate the data. If you don't specify a topic, DMS specifies "kafka-default-topic" as the migration topic.

use_large_integer_value instance-attribute

use_large_integer_value: NotRequired[BooleanOptional]

Specifies using the large integer value with Kafka.