CreateInferenceComponentInput
¶
Source code in docs_src/capo_sagemaker/types/create_inference_component_input.py
endpoint_name
instance-attribute
¶
endpoint_name: NotRequired[EndpointName]
The name of an existing endpoint where you host the inference component.
inference_component_name
instance-attribute
¶
inference_component_name: NotRequired[InferenceComponentName]
A unique name to assign to the inference component.
runtime_config
instance-attribute
¶
runtime_config: NotRequired[InferenceComponentRuntimeConfig]
Runtime settings for a model that is deployed with an inference component.
specification
instance-attribute
¶
specification: NotRequired[InferenceComponentSpecification]
Details about the resources to deploy with this inference component, including the model, container, and compute resources.
specifications
instance-attribute
¶
specifications: NotRequired[InferenceComponentSpecificationList]
A list of specification objects for the inference component, one per instance type. Use this parameter when you want to deploy a different model or resource configuration for the inference component on each instance type. You can use either this parameter or the singular Specification parameter, but not both.
tags
instance-attribute
¶
tags: NotRequired[TagList]
A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference.
variant_name
instance-attribute
¶
variant_name: NotRequired[VariantName]
The name of an existing production variant where you host the inference component.