update_location_hdfs
¶
update_location_hdfs(
location_arn: LocationArn,
*,
config_overrides: Optional[DataSyncClientConfig] = None,
subdirectory: Optional[HdfsSubdirectory] = None,
name_nodes: Optional[HdfsNameNodeList] = None,
block_size: Optional[HdfsBlockSize] = None,
replication_factor: Optional[HdfsReplicationFactor] = None,
kms_key_provider_uri: Optional[KmsKeyProviderUri] = None,
qop_configuration: Optional[QopConfiguration] = None,
authentication_type: Optional[HdfsAuthenticationType] = None,
simple_user: Optional[HdfsUser] = None,
kerberos_principal: Optional[KerberosPrincipal] = None,
kerberos_keytab: Optional[KerberosKeytabFile] = None,
kerberos_krb5_conf: Optional[KerberosKrb5ConfFile] = None,
agent_arns: Optional[AgentArnList] = None,
cmk_secret_config: Optional[CmkSecretConfig] = None,
custom_secret_config: Optional[CustomSecretConfig] = None,
) -> UpdateLocationHdfsResponse
Modifies the following configuration parameters of the Hadoop Distributed File System (HDFS) transfer location that you're using with DataSync.
For more information, see Configuring DataSync transfers with an HDFS cluster.
Parameters:
-
location_arn(LocationArn) –The Amazon Resource Name (ARN) of the source HDFS cluster location.
-
subdirectory(Optional[HdfsSubdirectory], default:None) –A subdirectory in the HDFS cluster. This subdirectory is used to read data from or write data to the HDFS cluster.
-
name_nodes(Optional[HdfsNameNodeList], default:None) –The NameNode that manages the HDFS namespace. The NameNode performs operations such as opening, closing, and renaming files and directories. The NameNode contains the information to map blocks of data to the DataNodes.
The number of NameNodes you can specify depends on the task mode:
-
Enhanced mode – You can specify multiple NameNodes for HDFS High Availability (HA) configurations.
-
Basic mode – You can specify only one NameNode.
-
-
block_size(Optional[HdfsBlockSize], default:None) –The size of the data blocks to write into the HDFS cluster.
-
replication_factor(Optional[HdfsReplicationFactor], default:None) –The number of DataNodes to replicate the data to when writing to the HDFS cluster.
-
kms_key_provider_uri(Optional[KmsKeyProviderUri], default:None) –The URI of the HDFS cluster's Key Management Server (KMS).
-
qop_configuration(Optional[QopConfiguration], default:None) –The Quality of Protection (QOP) configuration specifies the Remote Procedure Call (RPC) and data transfer privacy settings configured on the Hadoop Distributed File System (HDFS) cluster.
-
authentication_type(Optional[HdfsAuthenticationType], default:None) –The type of authentication used to determine the identity of the user.
-
simple_user(Optional[HdfsUser], default:None) –The user name used to identify the client on the host operating system.
-
kerberos_principal(Optional[KerberosPrincipal], default:None) –The Kerberos principal with access to the files and folders on the HDFS cluster.
-
kerberos_keytab(Optional[KerberosKeytabFile], default:None) –The Kerberos key table (keytab) that contains mappings between the defined Kerberos principal and the encrypted keys. You can load the keytab from a file by providing the file's address.
-
kerberos_krb5_conf(Optional[KerberosKrb5ConfFile], default:None) –The
krb5.conffile that contains the Kerberos configuration information. You can load thekrb5.conffile by providing the file's address. If you're using the CLI, it performs the base64 encoding for you. Otherwise, provide the base64-encoded text. -
agent_arns(Optional[AgentArnList], default:None) –The Amazon Resource Names (ARNs) of the DataSync agents that can connect to your HDFS cluster.
-
cmk_secret_config(Optional[CmkSecretConfig], default:None) –Specifies configuration information for a DataSync-managed secret, such as a
KerberosKeytabor set of credentials that DataSync uses to access a specific transfer location, and a customer-managed KMS key. -
custom_secret_config(Optional[CustomSecretConfig], default:None) –Specifies configuration information for a customer-managed secret, such as a
KerberosKeytabor set of credentials that DataSync uses to access a specific transfer location, and a customer-managed Identity and Access Management (IAM) role that provides access to the secret.
Raises:
-
InternalException–This exception is thrown when an error occurs in the DataSync service.
-
InvalidRequestException–This exception is thrown when the client submits a malformed request.
-
UnknownServiceError–The service returned an error code this client does not model.
Source code in docs_src/capo_datasync/_services/data_sync.py
3381 3382 3383 3384 3385 3386 3387 3388 3389 3390 3391 3392 3393 3394 3395 3396 3397 3398 3399 3400 3401 3402 3403 3404 3405 3406 3407 3408 3409 3410 3411 3412 3413 3414 3415 3416 3417 3418 3419 3420 3421 3422 3423 3424 3425 3426 3427 3428 3429 3430 3431 3432 3433 3434 3435 3436 3437 3438 3439 3440 3441 3442 3443 3444 3445 3446 3447 3448 3449 3450 3451 3452 3453 3454 3455 3456 3457 3458 3459 3460 3461 3462 3463 3464 3465 3466 3467 3468 3469 3470 3471 3472 3473 3474 3475 3476 3477 3478 3479 3480 3481 3482 3483 3484 3485 3486 3487 3488 3489 3490 3491 3492 3493 3494 3495 3496 3497 3498 3499 3500 3501 3502 3503 3504 3505 | |