KafkaSettings
¶
Used by
Source code in docs_src/capo_database_migration_service/types/kafka_settings.py
broker
instance-attribute
¶
broker: NotRequired[String]
A comma-separated list of one or more broker locations in your Kafka cluster that host your Kafka instance. Specify each broker location in the form broker-hostname-or-ip:port . For example, "ec2-12-345-678-901.compute-1.amazonaws.com:2345". For more information and examples of specifying a list of broker locations, see Using Apache Kafka as a target for Database Migration Service in the Database Migration Service User Guide.
include_control_details
instance-attribute
¶
include_control_details: NotRequired[BooleanOptional]
Shows detailed control information for table definition, column definition, and table and column changes in the Kafka message output. The default is false.
include_null_and_empty
instance-attribute
¶
include_null_and_empty: NotRequired[BooleanOptional]
Include NULL and empty columns for records migrated to the endpoint. The default is false.
include_partition_value
instance-attribute
¶
include_partition_value: NotRequired[BooleanOptional]
Shows the partition value within the Kafka message output unless the partition type is schema-table-type. The default is false.
include_table_alter_operations
instance-attribute
¶
include_table_alter_operations: NotRequired[BooleanOptional]
Includes any data definition language (DDL) operations that change the table in the control data, such as rename-table, drop-table, add-column, drop-column, and rename-column. The default is false.
include_transaction_details
instance-attribute
¶
include_transaction_details: NotRequired[BooleanOptional]
Provides detailed transaction information from the source database. This information includes a commit timestamp, a log position, and values for transaction_id, previous transaction_id, and transaction_record_id (the record offset within a transaction). The default is false.
message_format
instance-attribute
¶
message_format: NotRequired[MessageFormatValue]
The output format for the records created on the endpoint. The message format is JSON (default) or JSON_UNFORMATTED (a single line with no tab).
message_max_bytes
instance-attribute
¶
message_max_bytes: NotRequired[IntegerOptional]
The maximum size in bytes for records created on the endpoint The default is 1,000,000.
no_hex_prefix
instance-attribute
¶
no_hex_prefix: NotRequired[BooleanOptional]
Set this optional parameter to true to avoid adding a '0x' prefix to raw data in hexadecimal format. For example, by default, DMS adds a '0x' prefix to the LOB column type in hexadecimal format moving from an Oracle source to a Kafka target. Use the NoHexPrefix endpoint setting to enable migration of RAW data type columns without adding the '0x' prefix.
partition_include_schema_table
instance-attribute
¶
partition_include_schema_table: NotRequired[BooleanOptional]
Prefixes schema and table names to partition values, when the partition type is primary-key-type. Doing this increases data distribution among Kafka partitions. For example, suppose that a SysBench schema has thousands of tables and each table has only limited range for a primary key. In this case, the same primary key is sent from thousands of tables to the same partition, which causes throttling. The default is false.
sasl_mechanism
instance-attribute
¶
sasl_mechanism: NotRequired[KafkaSaslMechanism]
For SASL/SSL authentication, DMS supports the SCRAM-SHA-512 mechanism by default. DMS versions 3.5.0 and later also support the PLAIN mechanism. To use the PLAIN mechanism, set this parameter to PLAIN.
sasl_password
instance-attribute
¶
sasl_password: NotRequired[SecretString]
The secure password you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.
sasl_username
instance-attribute
¶
sasl_username: NotRequired[String]
The secure user name you created when you first set up your MSK cluster to validate a client identity and make an encrypted connection between server and client using SASL-SSL authentication.
security_protocol
instance-attribute
¶
security_protocol: NotRequired[KafkaSecurityProtocol]
Set secure connection to a Kafka target endpoint using Transport Layer Security (TLS). Options include ssl-encryption, ssl-authentication, and sasl-ssl. sasl-ssl requires SaslUsername and SaslPassword.
ssl_ca_certificate_arn
instance-attribute
¶
ssl_ca_certificate_arn: NotRequired[String]
The Amazon Resource Name (ARN) for the private certificate authority (CA) cert that DMS uses to securely connect to your Kafka target endpoint.
ssl_client_certificate_arn
instance-attribute
¶
ssl_client_certificate_arn: NotRequired[String]
The Amazon Resource Name (ARN) of the client certificate used to securely connect to a Kafka target endpoint.
ssl_client_key_arn
instance-attribute
¶
ssl_client_key_arn: NotRequired[String]
The Amazon Resource Name (ARN) for the client private key used to securely connect to a Kafka target endpoint.
ssl_client_key_password
instance-attribute
¶
ssl_client_key_password: NotRequired[SecretString]
The password for the client private key used to securely connect to a Kafka target endpoint.
ssl_endpoint_identification_algorithm
instance-attribute
¶
ssl_endpoint_identification_algorithm: NotRequired[
KafkaSslEndpointIdentificationAlgorithm
]
Sets hostname verification for the certificate. This setting is supported in DMS version 3.5.1 and later.
topic
instance-attribute
¶
topic: NotRequired[String]
The topic to which you migrate the data. If you don't specify a topic, DMS specifies "kafka-default-topic" as the migration topic.
use_large_integer_value
instance-attribute
¶
use_large_integer_value: NotRequired[BooleanOptional]
Specifies using the large integer value with Kafka.