Skip to content

CreateInferenceComponentInput

Source code in docs_src/capo_sagemaker/types/create_inference_component_input.py
class CreateInferenceComponentInput(TypedDict, closed=True):
    inference_component_name: NotRequired[
        "capo_sagemaker.types.inference_component_name.InferenceComponentName"
    ]
    """<p>A unique name to assign to the inference component.</p>"""
    endpoint_name: NotRequired["capo_sagemaker.types.endpoint_name.EndpointName"]
    """<p>The name of an existing endpoint where you host the inference component.</p>"""
    variant_name: NotRequired["capo_sagemaker.types.variant_name.VariantName"]
    """<p>The name of an existing production variant where you host the inference component.</p>"""
    specification: NotRequired[
        "capo_sagemaker.types.inference_component_specification.InferenceComponentSpecification"
    ]
    """<p>Details about the resources to deploy with this inference component, including the model, container, and compute resources.</p>"""
    specifications: NotRequired[
        "capo_sagemaker.types.inference_component_specification_list.InferenceComponentSpecificationList"
    ]
    """<p>A list of specification objects for the inference component, one per instance type. Use this parameter when you want to deploy a different model or resource configuration for the inference component on each instance type. You can use either this parameter or the singular <code>Specification</code> parameter, but not both.</p>"""
    runtime_config: NotRequired[
        "capo_sagemaker.types.inference_component_runtime_config.InferenceComponentRuntimeConfig"
    ]
    """<p>Runtime settings for a model that is deployed with an inference component.</p>"""
    tags: NotRequired["capo_sagemaker.types.tag_list.TagList"]
    """<p>A list of key-value pairs associated with the model. For more information, see <a href="https://docs.aws.amazon.com/general/latest/gr/aws_tagging.html">Tagging Amazon Web Services resources</a> in the <i>Amazon Web Services General Reference</i>.</p>"""

endpoint_name instance-attribute

endpoint_name: NotRequired[EndpointName]

The name of an existing endpoint where you host the inference component.

inference_component_name instance-attribute

inference_component_name: NotRequired[InferenceComponentName]

A unique name to assign to the inference component.

runtime_config instance-attribute

runtime_config: NotRequired[InferenceComponentRuntimeConfig]

Runtime settings for a model that is deployed with an inference component.

specification instance-attribute

specification: NotRequired[InferenceComponentSpecification]

Details about the resources to deploy with this inference component, including the model, container, and compute resources.

specifications instance-attribute

specifications: NotRequired[InferenceComponentSpecificationList]

A list of specification objects for the inference component, one per instance type. Use this parameter when you want to deploy a different model or resource configuration for the inference component on each instance type. You can use either this parameter or the singular Specification parameter, but not both.

tags instance-attribute

tags: NotRequired[TagList]

A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference.

variant_name instance-attribute

variant_name: NotRequired[VariantName]

The name of an existing production variant where you host the inference component.