Skip to content

InferenceAcceleratorInfo

Source code in docs_src/capo_ec2/types/inference_accelerator_info.py 
14
15
16
17
18
19
20
21
22
class InferenceAcceleratorInfo(TypedDict, closed=True):
    accelerators: NotRequired[
        "capo_ec2.types.inference_device_info_list.InferenceDeviceInfoList"
    ]
    """<p>Describes the Inference accelerators for the instance type.</p>"""
    total_inference_memory_in_mi_b: NotRequired[
        "capo_ec2.types.total_inference_memory.totalInferenceMemory"
    ]
    """<p>The total size of the memory for the inference accelerators for the instance type, in MiB.</p>"""

accelerators instance-attribute 

accelerators: NotRequired[InferenceDeviceInfoList]

Describes the Inference accelerators for the instance type.

total_inference_memory_in_mi_b instance-attribute 

total_inference_memory_in_mi_b: NotRequired[totalInferenceMemory]

The total size of the memory for the inference accelerators for the instance type, in MiB.