InferenceComponentSpecificationSummary
¶
Source code in docs_src/capo_sagemaker/types/inference_component_specification_summary.py
base_inference_component_name
instance-attribute
¶
base_inference_component_name: NotRequired[InferenceComponentName]
The name of the base inference component that contains this inference component.
compute_resource_requirements
instance-attribute
¶
compute_resource_requirements: NotRequired[
InferenceComponentComputeResourceRequirements
]
The compute resources allocated to run the model, plus any adapter models, that you assign to the inference component.
container
instance-attribute
¶
container: NotRequired[InferenceComponentContainerSpecificationSummary]
Details about the container that provides the runtime environment for the model that is deployed with the inference component.
data_cache_config
instance-attribute
¶
data_cache_config: NotRequired[InferenceComponentDataCacheConfigSummary]
Settings that affect how the inference component caches data.
instance_type
instance-attribute
¶
instance_type: NotRequired[ProductionVariantInstanceType]
The ML compute instance type associated with this inference component specification.
model_name
instance-attribute
¶
model_name: NotRequired[ModelName]
The name of the SageMaker AI model object that is deployed with the inference component.
scheduling_config
instance-attribute
¶
scheduling_config: NotRequired[InferenceComponentSchedulingConfig]
The scheduling configuration that determines how inference component copies are placed across available instances when copies are added or removed.
startup_parameters
instance-attribute
¶
startup_parameters: NotRequired[InferenceComponentStartupParameters]
Settings that take effect while the model container starts up.