Skip to content

InferenceSpecification

Source code in docs_src/capo_sagemaker/types/inference_specification.py
class InferenceSpecification(TypedDict, closed=True):
    containers: NotRequired[
        "capo_sagemaker.types.model_package_container_definition_list.ModelPackageContainerDefinitionList"
    ]
    """<p>The Amazon ECR registry path of the Docker image that contains the inference code.</p>"""
    supported_transform_instance_types: NotRequired[
        "capo_sagemaker.types.transform_instance_types.TransformInstanceTypes"
    ]
    """<p>A list of the instance types on which a transformation job can be run or on which an endpoint can be deployed.</p> <p>This parameter is required for unversioned models, and optional for versioned models.</p>"""
    supported_realtime_inference_instance_types: NotRequired[
        "capo_sagemaker.types.realtime_inference_instance_types.RealtimeInferenceInstanceTypes"
    ]
    """<p>A list of the instance types that are used to generate inferences in real-time.</p> <p>This parameter is required for unversioned models, and optional for versioned models.</p>"""
    supported_content_types: NotRequired[
        "capo_sagemaker.types.content_types.ContentTypes"
    ]
    """<p>The supported MIME types for the input data.</p>"""
    supported_response_mime_types: NotRequired[
        "capo_sagemaker.types.response_mime_types.ResponseMIMETypes"
    ]
    """<p>The supported MIME types for the output data.</p>"""

containers instance-attribute

containers: NotRequired[ModelPackageContainerDefinitionList]

The Amazon ECR registry path of the Docker image that contains the inference code.

supported_content_types instance-attribute

supported_content_types: NotRequired[ContentTypes]

The supported MIME types for the input data.

supported_realtime_inference_instance_types instance-attribute

supported_realtime_inference_instance_types: NotRequired[RealtimeInferenceInstanceTypes]

A list of the instance types that are used to generate inferences in real-time.

This parameter is required for unversioned models, and optional for versioned models.

supported_response_mime_types instance-attribute

supported_response_mime_types: NotRequired[ResponseMIMETypes]

The supported MIME types for the output data.

supported_transform_instance_types instance-attribute

supported_transform_instance_types: NotRequired[TransformInstanceTypes]

A list of the instance types on which a transformation job can be run or on which an endpoint can be deployed.

This parameter is required for unversioned models, and optional for versioned models.