ClusterInstanceGroupDetails
¶
Source code in docs_src/capo_sagemaker/types/cluster_instance_group_details.py
37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 | |
active_operations
instance-attribute
¶
active_operations: NotRequired[ActiveOperations]
A map indicating active operations currently in progress for the instance group of a SageMaker HyperPod cluster. When there is a scaling operation in progress, this map contains a key Scaling with value 1.
active_software_update_config
instance-attribute
¶
active_software_update_config: NotRequired[DeploymentConfiguration]
auto_patch_config
instance-attribute
¶
auto_patch_config: NotRequired[ClusterAutoPatchConfigDetails]
The auto-patching configuration for the instance group, including the current patching strategy and next scheduled patch date.
capacity_requirements
instance-attribute
¶
capacity_requirements: NotRequired[ClusterCapacityRequirements]
The instance capacity requirements for the instance group.
current_count
instance-attribute
¶
current_count: NotRequired[ClusterNonNegativeInstanceCount]
The number of instances that are currently in the instance group of a SageMaker HyperPod cluster.
current_image_id
instance-attribute
¶
current_image_id: NotRequired[ImageId]
The ID of the Amazon Machine Image (AMI) currently in use by the instance group.
current_image_release_version
instance-attribute
¶
current_image_release_version: NotRequired[ImageReleaseVersion]
The version of the HyperPod-managed AMI currently running on the instance group.
desired_image_id
instance-attribute
¶
desired_image_id: NotRequired[ImageId]
The ID of the Amazon Machine Image (AMI) desired for the instance group.
desired_image_release_version
instance-attribute
¶
desired_image_release_version: NotRequired[ImageReleaseVersion]
The desired version of the HyperPod-managed AMI for the instance group. This may differ from the current version when an update is pending.
execution_role
instance-attribute
¶
execution_role: NotRequired[RoleArn]
The execution role for the instance group to assume.
image_version_status
instance-attribute
¶
image_version_status: NotRequired[ClusterImageVersionStatus]
The status of the image version for the instance group. Indicates whether the instance group is running the latest image version or if an update is available.
instance_group_name
instance-attribute
¶
instance_group_name: NotRequired[ClusterInstanceGroupName]
The name of the instance group of a SageMaker HyperPod cluster.
instance_requirements
instance-attribute
¶
instance_requirements: NotRequired[ClusterInstanceRequirementDetails]
The instance requirements for the instance group, including the current and desired instance types. This field is present for flexible instance groups that support multiple instance types.
instance_storage_configs
instance-attribute
¶
instance_storage_configs: NotRequired[ClusterInstanceStorageConfigs]
The additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.
instance_type
instance-attribute
¶
instance_type: NotRequired[ClusterInstanceType]
The instance type of the instance group of a SageMaker HyperPod cluster.
instance_type_details
instance-attribute
¶
instance_type_details: NotRequired[ClusterInstanceTypeDetails]
Details about the instance types in the instance group, including the count and configuration of each instance type. This field is present for flexible instance groups that support multiple instance types.
kubernetes_config
instance-attribute
¶
kubernetes_config: NotRequired[ClusterKubernetesConfigDetails]
The Kubernetes configuration for the instance group that contains labels and taints to be applied for the nodes in this instance group.
life_cycle_config
instance-attribute
¶
life_cycle_config: NotRequired[ClusterLifeCycleConfig]
Details of LifeCycle configuration for the instance group.
min_count
instance-attribute
¶
min_count: NotRequired[ClusterInstanceCount]
The minimum number of instances that must be available in the instance group of a SageMaker HyperPod cluster before it transitions to InService status.
network_interface
instance-attribute
¶
network_interface: NotRequired[ClusterNetworkInterfaceDetails]
The network interface configuration for the instance group.
on_start_deep_health_checks
instance-attribute
¶
on_start_deep_health_checks: NotRequired[OnStartDeepHealthChecks]
A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.
override_vpc_config
instance-attribute
¶
override_vpc_config: NotRequired[VpcConfig]
The customized Amazon VPC configuration at the instance group level that overrides the default Amazon VPC configuration of the SageMaker HyperPod cluster.
scheduled_update_config
instance-attribute
¶
scheduled_update_config: NotRequired[ScheduledUpdateConfig]
The configuration object of the schedule that SageMaker follows when updating the AMI.
slurm_config
instance-attribute
¶
slurm_config: NotRequired[ClusterSlurmConfigDetails]
The Slurm configuration for the instance group.
software_update_status
instance-attribute
¶
software_update_status: NotRequired[SoftwareUpdateStatus]
Status of the last software udpate request.
Status transitions follow these possible sequences:
-
Pending -> InProgress -> Succeeded
-
Pending -> InProgress -> RollbackInProgress -> RollbackComplete
-
Pending -> InProgress -> RollbackInProgress -> Failed
status
instance-attribute
¶
status: NotRequired[InstanceGroupStatus]
The current status of the cluster instance group.
-
InService: The instance group is active and healthy. -
Creating: The instance group is being provisioned. -
Updating: The instance group is being updated. -
Failed: The instance group has failed to provision or is no longer healthy. -
Degraded: The instance group is degraded, meaning that some instances have failed to provision or are no longer healthy. -
Deleting: The instance group is being deleted.
target_count
instance-attribute
¶
target_count: NotRequired[ClusterInstanceCount]
The number of instances you specified to add to the instance group of a SageMaker HyperPod cluster.
target_state_count
instance-attribute
¶
target_state_count: NotRequired[ClusterInstanceCount]
Represents the number of running nodes using the desired Image ID.
-
During software update operations: This count shows the number of nodes running on the desired Image ID. If a rollback occurs, the current image ID and desired image ID (both included in the describe cluster response) swap values. The TargetStateCount then shows the number of nodes running on the newly designated desired image ID (which was previously the current image ID).
-
During simultaneous scaling and software update operations: This count shows the number of instances running on the desired image ID, including any new instances created as part of the scaling request. New nodes are always created using the desired image ID, so TargetStateCount reflects the total count of nodes running on the desired image ID, even during rollback scenarios.
threads_per_core
instance-attribute
¶
threads_per_core: NotRequired[ClusterThreadsPerCore]
The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
training_plan_arn
instance-attribute
¶
training_plan_arn: NotRequired[TrainingPlanArn]
The Amazon Resource Name (ARN); of the training plan associated with this cluster instance group.
For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see CreateTrainingPlan .
training_plan_status
instance-attribute
¶
training_plan_status: NotRequired[InstanceGroupTrainingPlanStatus]
The current status of the training plan associated with this cluster instance group.