Skip to content

InferenceResourceConfig

Used by
Source code in docs_src/capo_cleanroomsml/types/inference_resource_config.py 
13
14
15
16
17
18
19
class InferenceResourceConfig(TypedDict, closed=True):
    instance_type: (
        "capo_cleanroomsml.types.inference_instance_type.InferenceInstanceType"
    )
    """<p>The type of instance that is used to perform model inference.</p>"""
    instance_count: "int"
    """<p>The number of instances to use.</p>"""

instance_count instance-attribute 

instance_count: int

The number of instances to use.

instance_type instance-attribute 

instance_type: InferenceInstanceType

The type of instance that is used to perform model inference.