Skip to content

InferenceComponentRuntimeConfig

Used by
Source code in docs_src/capo_sagemaker/types/inference_component_runtime_config.py 
11
12
13
14
15
class InferenceComponentRuntimeConfig(TypedDict, closed=True):
    copy_count: NotRequired[
        "capo_sagemaker.types.inference_component_copy_count.InferenceComponentCopyCount"
    ]
    """<p>The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.</p>"""

copy_count instance-attribute 

copy_count: NotRequired[InferenceComponentCopyCount]

The number of runtime copies of the model container to deploy with the inference component. Each copy can serve inference requests.