Skip to content

InferenceDeviceMemoryInfo

Source code in docs_src/capo_ec2/types/inference_device_memory_info.py 
13
14
15
16
17
class InferenceDeviceMemoryInfo(TypedDict, closed=True):
    size_in_mi_b: NotRequired[
        "capo_ec2.types.inference_device_memory_size.InferenceDeviceMemorySize"
    ]
    """<p>The size of the memory available to the inference accelerator, in MiB.</p>"""

size_in_mi_b instance-attribute 

size_in_mi_b: NotRequired[InferenceDeviceMemorySize]

The size of the memory available to the inference accelerator, in MiB.