Skip to content

JobFlowInstancesConfig

Source code in docs_src/capo_emr/types/job_flow_instances_config.py
class JobFlowInstancesConfig(TypedDict, closed=True):
    master_instance_type: NotRequired["capo_emr.types.instance_type.InstanceType"]
    """<p>The Amazon EC2 instance type of the master node.</p>"""
    slave_instance_type: NotRequired["capo_emr.types.instance_type.InstanceType"]
    """<p>The Amazon EC2 instance type of the core and task nodes.</p>"""
    instance_count: NotRequired["capo_emr.types.integer.Integer"]
    """<p>The number of Amazon EC2 instances in the cluster.</p>"""
    instance_groups: NotRequired[
        "capo_emr.types.instance_group_config_list.InstanceGroupConfigList"
    ]
    """<p>Configuration for the instance groups in a cluster.</p>"""
    instance_fleets: NotRequired[
        "capo_emr.types.instance_fleet_config_list.InstanceFleetConfigList"
    ]
    """<note> <p>The instance fleet configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions.</p> </note> <p>Describes the Amazon EC2 instances and instance configurations for clusters that use the instance fleet configuration.</p>"""
    ec2_key_name: NotRequired["capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"]
    """<p>The name of the Amazon EC2 key pair that can be used to connect to the master node using SSH as the user called "hadoop."</p>"""
    placement: NotRequired["capo_emr.types.placement_type.PlacementType"]
    """<p>The Availability Zone in which the cluster runs.</p>"""
    keep_job_flow_alive_when_no_steps: NotRequired["capo_emr.types.boolean.Boolean"]
    """<p>Specifies whether the cluster should remain available after completing all steps. Defaults to <code>false</code>. For more information about configuring cluster termination, see <a href="https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-termination.html">Control Cluster Termination</a> in the <i>EMR Management Guide</i>.</p>"""
    termination_protected: NotRequired["capo_emr.types.boolean.Boolean"]
    """<p>Specifies whether to lock the cluster to prevent the Amazon EC2 instances from being terminated by API call, user intervention, or in the event of a job-flow error.</p>"""
    unhealthy_node_replacement: NotRequired[
        "capo_emr.types.boolean_object.BooleanObject"
    ]
    """<p>Indicates whether Amazon EMR should gracefully replace core nodes that have degraded within the cluster.</p>"""
    hadoop_version: NotRequired[
        "capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"
    ]
    """<p>Applies only to Amazon EMR release versions earlier than 4.0. The Hadoop version for the cluster. Valid inputs are "0.18" (no longer maintained), "0.20" (no longer maintained), "0.20.205" (no longer maintained), "1.0.3", "2.2.0", or "2.4.0". If you do not set this value, the default of 0.18 is used, unless the <code>AmiVersion</code> parameter is set in the RunJobFlow call, in which case the default version of Hadoop for that AMI version is used.</p>"""
    ec2_subnet_id: NotRequired[
        "capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"
    ]
    """<p>Applies to clusters that use the uniform instance group configuration. To launch the cluster in Amazon Virtual Private Cloud (Amazon VPC), set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value and your account supports EC2-Classic, the cluster launches in EC2-Classic.</p>"""
    ec2_subnet_ids: NotRequired[
        "capo_emr.types.xml_string_max_len256_list.XmlStringMaxLen256List"
    ]
    """<p>Applies to clusters that use the instance fleet configuration. When multiple Amazon EC2 subnet IDs are specified, Amazon EMR evaluates them and launches instances in the optimal subnet.</p> <note> <p>The instance fleet configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions.</p> </note>"""
    emr_managed_master_security_group: NotRequired[
        "capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"
    ]
    """<p>The identifier of the Amazon EC2 security group for the master node. If you specify <code>EmrManagedMasterSecurityGroup</code>, you must also specify <code>EmrManagedSlaveSecurityGroup</code>.</p>"""
    emr_managed_slave_security_group: NotRequired[
        "capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"
    ]
    """<p>The identifier of the Amazon EC2 security group for the core and task nodes. If you specify <code>EmrManagedSlaveSecurityGroup</code>, you must also specify <code>EmrManagedMasterSecurityGroup</code>.</p>"""
    service_access_security_group: NotRequired[
        "capo_emr.types.xml_string_max_len256.XmlStringMaxLen256"
    ]
    """<p>The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.</p>"""
    additional_master_security_groups: NotRequired[
        "capo_emr.types.security_groups_list.SecurityGroupsList"
    ]
    """<p>A list of additional Amazon EC2 security group IDs for the master node.</p>"""
    additional_slave_security_groups: NotRequired[
        "capo_emr.types.security_groups_list.SecurityGroupsList"
    ]
    """<p>A list of additional Amazon EC2 security group IDs for the core and task nodes.</p>"""

additional_master_security_groups instance-attribute

additional_master_security_groups: NotRequired[SecurityGroupsList]

A list of additional Amazon EC2 security group IDs for the master node.

additional_slave_security_groups instance-attribute

additional_slave_security_groups: NotRequired[SecurityGroupsList]

A list of additional Amazon EC2 security group IDs for the core and task nodes.

ec2_key_name instance-attribute

ec2_key_name: NotRequired[XmlStringMaxLen256]

The name of the Amazon EC2 key pair that can be used to connect to the master node using SSH as the user called "hadoop."

ec2_subnet_id instance-attribute

ec2_subnet_id: NotRequired[XmlStringMaxLen256]

Applies to clusters that use the uniform instance group configuration. To launch the cluster in Amazon Virtual Private Cloud (Amazon VPC), set this parameter to the identifier of the Amazon VPC subnet where you want the cluster to launch. If you do not specify this value and your account supports EC2-Classic, the cluster launches in EC2-Classic.

ec2_subnet_ids instance-attribute

ec2_subnet_ids: NotRequired[XmlStringMaxLen256List]

Applies to clusters that use the instance fleet configuration. When multiple Amazon EC2 subnet IDs are specified, Amazon EMR evaluates them and launches instances in the optimal subnet.

The instance fleet configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions.

emr_managed_master_security_group instance-attribute

emr_managed_master_security_group: NotRequired[XmlStringMaxLen256]

The identifier of the Amazon EC2 security group for the master node. If you specify EmrManagedMasterSecurityGroup, you must also specify EmrManagedSlaveSecurityGroup.

emr_managed_slave_security_group instance-attribute

emr_managed_slave_security_group: NotRequired[XmlStringMaxLen256]

The identifier of the Amazon EC2 security group for the core and task nodes. If you specify EmrManagedSlaveSecurityGroup, you must also specify EmrManagedMasterSecurityGroup.

hadoop_version instance-attribute

hadoop_version: NotRequired[XmlStringMaxLen256]

Applies only to Amazon EMR release versions earlier than 4.0. The Hadoop version for the cluster. Valid inputs are "0.18" (no longer maintained), "0.20" (no longer maintained), "0.20.205" (no longer maintained), "1.0.3", "2.2.0", or "2.4.0". If you do not set this value, the default of 0.18 is used, unless the AmiVersion parameter is set in the RunJobFlow call, in which case the default version of Hadoop for that AMI version is used.

instance_count instance-attribute

instance_count: NotRequired[Integer]

The number of Amazon EC2 instances in the cluster.

instance_fleets instance-attribute

instance_fleets: NotRequired[InstanceFleetConfigList]

The instance fleet configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions.

Describes the Amazon EC2 instances and instance configurations for clusters that use the instance fleet configuration.

instance_groups instance-attribute

instance_groups: NotRequired[InstanceGroupConfigList]

Configuration for the instance groups in a cluster.

keep_job_flow_alive_when_no_steps instance-attribute

keep_job_flow_alive_when_no_steps: NotRequired[Boolean]

Specifies whether the cluster should remain available after completing all steps. Defaults to false. For more information about configuring cluster termination, see Control Cluster Termination in the EMR Management Guide.

master_instance_type instance-attribute

master_instance_type: NotRequired[InstanceType]

The Amazon EC2 instance type of the master node.

placement instance-attribute

placement: NotRequired[PlacementType]

The Availability Zone in which the cluster runs.

service_access_security_group instance-attribute

service_access_security_group: NotRequired[XmlStringMaxLen256]

The identifier of the Amazon EC2 security group for the Amazon EMR service to access clusters in VPC private subnets.

slave_instance_type instance-attribute

slave_instance_type: NotRequired[InstanceType]

The Amazon EC2 instance type of the core and task nodes.

termination_protected instance-attribute

termination_protected: NotRequired[Boolean]

Specifies whether to lock the cluster to prevent the Amazon EC2 instances from being terminated by API call, user intervention, or in the event of a job-flow error.

unhealthy_node_replacement instance-attribute

unhealthy_node_replacement: NotRequired[BooleanObject]

Indicates whether Amazon EMR should gracefully replace core nodes that have degraded within the cluster.