update_location_hdfs
async
¶
update_location_hdfs(
location_arn: LocationArn,
*,
config_overrides: Optional[AsyncDataSyncClientConfig] = None,
subdirectory: Optional[HdfsSubdirectory] = None,
name_nodes: Optional[HdfsNameNodeList] = None,
block_size: Optional[HdfsBlockSize] = None,
replication_factor: Optional[HdfsReplicationFactor] = None,
kms_key_provider_uri: Optional[KmsKeyProviderUri] = None,
qop_configuration: Optional[QopConfiguration] = None,
authentication_type: Optional[HdfsAuthenticationType] = None,
simple_user: Optional[HdfsUser] = None,
kerberos_principal: Optional[KerberosPrincipal] = None,
kerberos_keytab: Optional[KerberosKeytabFile] = None,
kerberos_krb5_conf: Optional[KerberosKrb5ConfFile] = None,
agent_arns: Optional[AgentArnList] = None,
cmk_secret_config: Optional[CmkSecretConfig] = None,
custom_secret_config: Optional[CustomSecretConfig] = None,
) -> UpdateLocationHdfsResponse
Modifies the following configuration parameters of the Hadoop Distributed File System (HDFS) transfer location that you're using with DataSync.
For more information, see Configuring DataSync transfers with an HDFS cluster.
Parameters:
-
location_arn(LocationArn) –The Amazon Resource Name (ARN) of the source HDFS cluster location.
-
subdirectory(Optional[HdfsSubdirectory], default:None) –A subdirectory in the HDFS cluster. This subdirectory is used to read data from or write data to the HDFS cluster.
-
name_nodes(Optional[HdfsNameNodeList], default:None) –The NameNode that manages the HDFS namespace. The NameNode performs operations such as opening, closing, and renaming files and directories. The NameNode contains the information to map blocks of data to the DataNodes.
The number of NameNodes you can specify depends on the task mode:
-
Enhanced mode – You can specify multiple NameNodes for HDFS High Availability (HA) configurations.
-
Basic mode – You can specify only one NameNode.
-
-
block_size(Optional[HdfsBlockSize], default:None) –The size of the data blocks to write into the HDFS cluster.
-
replication_factor(Optional[HdfsReplicationFactor], default:None) –The number of DataNodes to replicate the data to when writing to the HDFS cluster.
-
kms_key_provider_uri(Optional[KmsKeyProviderUri], default:None) –The URI of the HDFS cluster's Key Management Server (KMS).
-
qop_configuration(Optional[QopConfiguration], default:None) –The Quality of Protection (QOP) configuration specifies the Remote Procedure Call (RPC) and data transfer privacy settings configured on the Hadoop Distributed File System (HDFS) cluster.
-
authentication_type(Optional[HdfsAuthenticationType], default:None) –The type of authentication used to determine the identity of the user.
-
simple_user(Optional[HdfsUser], default:None) –The user name used to identify the client on the host operating system.
-
kerberos_principal(Optional[KerberosPrincipal], default:None) –The Kerberos principal with access to the files and folders on the HDFS cluster.
-
kerberos_keytab(Optional[KerberosKeytabFile], default:None) –The Kerberos key table (keytab) that contains mappings between the defined Kerberos principal and the encrypted keys. You can load the keytab from a file by providing the file's address.
-
kerberos_krb5_conf(Optional[KerberosKrb5ConfFile], default:None) –The
krb5.conffile that contains the Kerberos configuration information. You can load thekrb5.conffile by providing the file's address. If you're using the CLI, it performs the base64 encoding for you. Otherwise, provide the base64-encoded text. -
agent_arns(Optional[AgentArnList], default:None) –The Amazon Resource Names (ARNs) of the DataSync agents that can connect to your HDFS cluster.
-
cmk_secret_config(Optional[CmkSecretConfig], default:None) –Specifies configuration information for a DataSync-managed secret, such as a
KerberosKeytabor set of credentials that DataSync uses to access a specific transfer location, and a customer-managed KMS key. -
custom_secret_config(Optional[CustomSecretConfig], default:None) –Specifies configuration information for a customer-managed secret, such as a
KerberosKeytabor set of credentials that DataSync uses to access a specific transfer location, and a customer-managed Identity and Access Management (IAM) role that provides access to the secret.
Raises:
-
InternalException–This exception is thrown when an error occurs in the DataSync service.
-
InvalidRequestException–This exception is thrown when the client submits a malformed request.
-
UnknownServiceError–The service returned an error code this client does not model.
Source code in docs_src/capo_datasync/_services/async_data_sync.py
3425 3426 3427 3428 3429 3430 3431 3432 3433 3434 3435 3436 3437 3438 3439 3440 3441 3442 3443 3444 3445 3446 3447 3448 3449 3450 3451 3452 3453 3454 3455 3456 3457 3458 3459 3460 3461 3462 3463 3464 3465 3466 3467 3468 3469 3470 3471 3472 3473 3474 3475 3476 3477 3478 3479 3480 3481 3482 3483 3484 3485 3486 3487 3488 3489 3490 3491 3492 3493 3494 3495 3496 3497 3498 3499 3500 3501 3502 3503 3504 3505 3506 3507 3508 3509 3510 3511 3512 3513 3514 3515 3516 3517 3518 3519 3520 3521 3522 3523 3524 3525 3526 3527 3528 3529 3530 3531 3532 3533 3534 3535 3536 3537 3538 3539 3540 3541 3542 3543 3544 3545 3546 3547 3548 3549 3550 | |