Skip to content

ClusterInstanceGroupDetails

Source code in docs_src/capo_sagemaker/types/cluster_instance_group_details.py
class ClusterInstanceGroupDetails(TypedDict, closed=True):
    current_count: NotRequired[
        "capo_sagemaker.types.cluster_non_negative_instance_count.ClusterNonNegativeInstanceCount"
    ]
    """<p>The number of instances that are currently in the instance group of a SageMaker HyperPod cluster.</p>"""
    target_count: NotRequired[
        "capo_sagemaker.types.cluster_instance_count.ClusterInstanceCount"
    ]
    """<p>The number of instances you specified to add to the instance group of a SageMaker HyperPod cluster.</p>"""
    min_count: NotRequired[
        "capo_sagemaker.types.cluster_instance_count.ClusterInstanceCount"
    ]
    """<p>The minimum number of instances that must be available in the instance group of a SageMaker HyperPod cluster before it transitions to <code>InService</code> status. </p>"""
    instance_group_name: NotRequired[
        "capo_sagemaker.types.cluster_instance_group_name.ClusterInstanceGroupName"
    ]
    """<p>The name of the instance group of a SageMaker HyperPod cluster.</p>"""
    instance_type: NotRequired[
        "capo_sagemaker.types.cluster_instance_type.ClusterInstanceType"
    ]
    """<p>The instance type of the instance group of a SageMaker HyperPod cluster.</p>"""
    instance_requirements: NotRequired[
        "capo_sagemaker.types.cluster_instance_requirement_details.ClusterInstanceRequirementDetails"
    ]
    """<p>The instance requirements for the instance group, including the current and desired instance types. This field is present for flexible instance groups that support multiple instance types.</p>"""
    instance_type_details: NotRequired[
        "capo_sagemaker.types.cluster_instance_type_details.ClusterInstanceTypeDetails"
    ]
    """<p>Details about the instance types in the instance group, including the count and configuration of each instance type. This field is present for flexible instance groups that support multiple instance types.</p>"""
    life_cycle_config: NotRequired[
        "capo_sagemaker.types.cluster_life_cycle_config.ClusterLifeCycleConfig"
    ]
    """<p>Details of LifeCycle configuration for the instance group.</p>"""
    execution_role: NotRequired["capo_sagemaker.types.role_arn.RoleArn"]
    """<p>The execution role for the instance group to assume.</p>"""
    threads_per_core: NotRequired[
        "capo_sagemaker.types.cluster_threads_per_core.ClusterThreadsPerCore"
    ]
    """<p>The number you specified to <code>TreadsPerCore</code> in <code>CreateCluster</code> for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of <a href="https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/cpu-options-supported-instances-values.html">CPU cores and threads per CPU core per instance type</a> in the <i>Amazon Elastic Compute Cloud User Guide</i>.</p>"""
    instance_storage_configs: NotRequired[
        "capo_sagemaker.types.cluster_instance_storage_configs.ClusterInstanceStorageConfigs"
    ]
    """<p>The additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.</p>"""
    on_start_deep_health_checks: NotRequired[
        "capo_sagemaker.types.on_start_deep_health_checks.OnStartDeepHealthChecks"
    ]
    """<p>A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.</p>"""
    status: NotRequired[
        "capo_sagemaker.types.instance_group_status.InstanceGroupStatus"
    ]
    """<p>The current status of the cluster instance group.</p> <ul> <li> <p> <code>InService</code>: The instance group is active and healthy.</p> </li> <li> <p> <code>Creating</code>: The instance group is being provisioned.</p> </li> <li> <p> <code>Updating</code>: The instance group is being updated.</p> </li> <li> <p> <code>Failed</code>: The instance group has failed to provision or is no longer healthy.</p> </li> <li> <p> <code>Degraded</code>: The instance group is degraded, meaning that some instances have failed to provision or are no longer healthy.</p> </li> <li> <p> <code>Deleting</code>: The instance group is being deleted.</p> </li> </ul>"""
    training_plan_arn: NotRequired[
        "capo_sagemaker.types.training_plan_arn.TrainingPlanArn"
    ]
    """<p>The Amazon Resource Name (ARN); of the training plan associated with this cluster instance group.</p> <p>For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see <code> <a href="https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateTrainingPlan.html">CreateTrainingPlan</a> </code>.</p>"""
    training_plan_status: NotRequired[
        "capo_sagemaker.types.instance_group_training_plan_status.InstanceGroupTrainingPlanStatus"
    ]
    """<p>The current status of the training plan associated with this cluster instance group.</p>"""
    override_vpc_config: NotRequired["capo_sagemaker.types.vpc_config.VpcConfig"]
    """<p>The customized Amazon VPC configuration at the instance group level that overrides the default Amazon VPC configuration of the SageMaker HyperPod cluster.</p>"""
    scheduled_update_config: NotRequired[
        "capo_sagemaker.types.scheduled_update_config.ScheduledUpdateConfig"
    ]
    """<p>The configuration object of the schedule that SageMaker follows when updating the AMI.</p>"""
    auto_patch_config: NotRequired[
        "capo_sagemaker.types.cluster_auto_patch_config_details.ClusterAutoPatchConfigDetails"
    ]
    """<p>The auto-patching configuration for the instance group, including the current patching strategy and next scheduled patch date.</p>"""
    current_image_id: NotRequired["capo_sagemaker.types.image_id.ImageId"]
    """<p>The ID of the Amazon Machine Image (AMI) currently in use by the instance group.</p>"""
    desired_image_id: NotRequired["capo_sagemaker.types.image_id.ImageId"]
    """<p>The ID of the Amazon Machine Image (AMI) desired for the instance group.</p>"""
    current_image_release_version: NotRequired[
        "capo_sagemaker.types.image_release_version.ImageReleaseVersion"
    ]
    """<p>The version of the HyperPod-managed AMI currently running on the instance group.</p>"""
    desired_image_release_version: NotRequired[
        "capo_sagemaker.types.image_release_version.ImageReleaseVersion"
    ]
    """<p>The desired version of the HyperPod-managed AMI for the instance group. This may differ from the current version when an update is pending.</p>"""
    image_version_status: NotRequired[
        "capo_sagemaker.types.cluster_image_version_status.ClusterImageVersionStatus"
    ]
    """<p>The status of the image version for the instance group. Indicates whether the instance group is running the latest image version or if an update is available.</p>"""
    active_operations: NotRequired[
        "capo_sagemaker.types.active_operations.ActiveOperations"
    ]
    """<p>A map indicating active operations currently in progress for the instance group of a SageMaker HyperPod cluster. When there is a scaling operation in progress, this map contains a key <code>Scaling</code> with value 1. </p>"""
    kubernetes_config: NotRequired[
        "capo_sagemaker.types.cluster_kubernetes_config_details.ClusterKubernetesConfigDetails"
    ]
    """<p>The Kubernetes configuration for the instance group that contains labels and taints to be applied for the nodes in this instance group. </p>"""
    capacity_requirements: NotRequired[
        "capo_sagemaker.types.cluster_capacity_requirements.ClusterCapacityRequirements"
    ]
    """<p>The instance capacity requirements for the instance group.</p>"""
    target_state_count: NotRequired[
        "capo_sagemaker.types.cluster_instance_count.ClusterInstanceCount"
    ]
    """<p>Represents the number of running nodes using the desired Image ID.</p> <ol> <li> <p> <b>During software update operations:</b> This count shows the number of nodes running on the desired Image ID. If a rollback occurs, the current image ID and desired image ID (both included in the describe cluster response) swap values. The TargetStateCount then shows the number of nodes running on the newly designated desired image ID (which was previously the current image ID).</p> </li> <li> <p> <b>During simultaneous scaling and software update operations:</b> This count shows the number of instances running on the desired image ID, including any new instances created as part of the scaling request. New nodes are always created using the desired image ID, so TargetStateCount reflects the total count of nodes running on the desired image ID, even during rollback scenarios.</p> </li> </ol>"""
    software_update_status: NotRequired[
        "capo_sagemaker.types.software_update_status.SoftwareUpdateStatus"
    ]
    """<p>Status of the last software udpate request.</p> <p>Status transitions follow these possible sequences:</p> <ul> <li> <p>Pending -&gt; InProgress -&gt; Succeeded</p> </li> <li> <p>Pending -&gt; InProgress -&gt; RollbackInProgress -&gt; RollbackComplete</p> </li> <li> <p>Pending -&gt; InProgress -&gt; RollbackInProgress -&gt; Failed</p> </li> </ul>"""
    active_software_update_config: NotRequired[
        "capo_sagemaker.types.deployment_configuration.DeploymentConfiguration"
    ]
    slurm_config: NotRequired[
        "capo_sagemaker.types.cluster_slurm_config_details.ClusterSlurmConfigDetails"
    ]
    """<p>The Slurm configuration for the instance group.</p>"""
    network_interface: NotRequired[
        "capo_sagemaker.types.cluster_network_interface_details.ClusterNetworkInterfaceDetails"
    ]
    """<p>The network interface configuration for the instance group.</p>"""

active_operations instance-attribute

active_operations: NotRequired[ActiveOperations]

A map indicating active operations currently in progress for the instance group of a SageMaker HyperPod cluster. When there is a scaling operation in progress, this map contains a key Scaling with value 1.

active_software_update_config instance-attribute

active_software_update_config: NotRequired[DeploymentConfiguration]

auto_patch_config instance-attribute

auto_patch_config: NotRequired[ClusterAutoPatchConfigDetails]

The auto-patching configuration for the instance group, including the current patching strategy and next scheduled patch date.

capacity_requirements instance-attribute

capacity_requirements: NotRequired[ClusterCapacityRequirements]

The instance capacity requirements for the instance group.

current_count instance-attribute

current_count: NotRequired[ClusterNonNegativeInstanceCount]

The number of instances that are currently in the instance group of a SageMaker HyperPod cluster.

current_image_id instance-attribute

current_image_id: NotRequired[ImageId]

The ID of the Amazon Machine Image (AMI) currently in use by the instance group.

current_image_release_version instance-attribute

current_image_release_version: NotRequired[ImageReleaseVersion]

The version of the HyperPod-managed AMI currently running on the instance group.

desired_image_id instance-attribute

desired_image_id: NotRequired[ImageId]

The ID of the Amazon Machine Image (AMI) desired for the instance group.

desired_image_release_version instance-attribute

desired_image_release_version: NotRequired[ImageReleaseVersion]

The desired version of the HyperPod-managed AMI for the instance group. This may differ from the current version when an update is pending.

execution_role instance-attribute

execution_role: NotRequired[RoleArn]

The execution role for the instance group to assume.

image_version_status instance-attribute

image_version_status: NotRequired[ClusterImageVersionStatus]

The status of the image version for the instance group. Indicates whether the instance group is running the latest image version or if an update is available.

instance_group_name instance-attribute

instance_group_name: NotRequired[ClusterInstanceGroupName]

The name of the instance group of a SageMaker HyperPod cluster.

instance_requirements instance-attribute

instance_requirements: NotRequired[ClusterInstanceRequirementDetails]

The instance requirements for the instance group, including the current and desired instance types. This field is present for flexible instance groups that support multiple instance types.

instance_storage_configs instance-attribute

instance_storage_configs: NotRequired[ClusterInstanceStorageConfigs]

The additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.

instance_type instance-attribute

instance_type: NotRequired[ClusterInstanceType]

The instance type of the instance group of a SageMaker HyperPod cluster.

instance_type_details instance-attribute

instance_type_details: NotRequired[ClusterInstanceTypeDetails]

Details about the instance types in the instance group, including the count and configuration of each instance type. This field is present for flexible instance groups that support multiple instance types.

kubernetes_config instance-attribute

kubernetes_config: NotRequired[ClusterKubernetesConfigDetails]

The Kubernetes configuration for the instance group that contains labels and taints to be applied for the nodes in this instance group.

life_cycle_config instance-attribute

life_cycle_config: NotRequired[ClusterLifeCycleConfig]

Details of LifeCycle configuration for the instance group.

min_count instance-attribute

min_count: NotRequired[ClusterInstanceCount]

The minimum number of instances that must be available in the instance group of a SageMaker HyperPod cluster before it transitions to InService status.

network_interface instance-attribute

network_interface: NotRequired[ClusterNetworkInterfaceDetails]

The network interface configuration for the instance group.

on_start_deep_health_checks instance-attribute

on_start_deep_health_checks: NotRequired[OnStartDeepHealthChecks]

A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.

override_vpc_config instance-attribute

override_vpc_config: NotRequired[VpcConfig]

The customized Amazon VPC configuration at the instance group level that overrides the default Amazon VPC configuration of the SageMaker HyperPod cluster.

scheduled_update_config instance-attribute

scheduled_update_config: NotRequired[ScheduledUpdateConfig]

The configuration object of the schedule that SageMaker follows when updating the AMI.

slurm_config instance-attribute

slurm_config: NotRequired[ClusterSlurmConfigDetails]

The Slurm configuration for the instance group.

software_update_status instance-attribute

software_update_status: NotRequired[SoftwareUpdateStatus]

Status of the last software udpate request.

Status transitions follow these possible sequences:

  • Pending -> InProgress -> Succeeded

  • Pending -> InProgress -> RollbackInProgress -> RollbackComplete

  • Pending -> InProgress -> RollbackInProgress -> Failed

status instance-attribute

status: NotRequired[InstanceGroupStatus]

The current status of the cluster instance group.

  • InService: The instance group is active and healthy.

  • Creating: The instance group is being provisioned.

  • Updating: The instance group is being updated.

  • Failed: The instance group has failed to provision or is no longer healthy.

  • Degraded: The instance group is degraded, meaning that some instances have failed to provision or are no longer healthy.

  • Deleting: The instance group is being deleted.

target_count instance-attribute

target_count: NotRequired[ClusterInstanceCount]

The number of instances you specified to add to the instance group of a SageMaker HyperPod cluster.

target_state_count instance-attribute

target_state_count: NotRequired[ClusterInstanceCount]

Represents the number of running nodes using the desired Image ID.

  1. During software update operations: This count shows the number of nodes running on the desired Image ID. If a rollback occurs, the current image ID and desired image ID (both included in the describe cluster response) swap values. The TargetStateCount then shows the number of nodes running on the newly designated desired image ID (which was previously the current image ID).

  2. During simultaneous scaling and software update operations: This count shows the number of instances running on the desired image ID, including any new instances created as part of the scaling request. New nodes are always created using the desired image ID, so TargetStateCount reflects the total count of nodes running on the desired image ID, even during rollback scenarios.

threads_per_core instance-attribute

threads_per_core: NotRequired[ClusterThreadsPerCore]

The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.

training_plan_arn instance-attribute

training_plan_arn: NotRequired[TrainingPlanArn]

The Amazon Resource Name (ARN); of the training plan associated with this cluster instance group.

For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see CreateTrainingPlan .

training_plan_status instance-attribute

training_plan_status: NotRequired[InstanceGroupTrainingPlanStatus]

The current status of the training plan associated with this cluster instance group.