Skip to content

RecommendationMetrics

Source code in docs_src/capo_sagemaker/types/recommendation_metrics.py 
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
class RecommendationMetrics(TypedDict, closed=True):
    cost_per_hour: NotRequired["capo_sagemaker.types.float.Float"]
    """<p>Defines the cost per hour for the instance. </p>"""
    cost_per_inference: NotRequired["capo_sagemaker.types.float.Float"]
    """<p>Defines the cost per inference for the instance .</p>"""
    max_invocations: NotRequired["capo_sagemaker.types.integer.Integer"]
    """<p>The expected maximum number of requests per minute for the instance.</p>"""
    model_latency: NotRequired["capo_sagemaker.types.integer.Integer"]
    """<p>The expected model latency at maximum invocation per minute for the instance.</p>"""
    cpu_utilization: NotRequired[
        "capo_sagemaker.types.utilization_metric.UtilizationMetric"
    ]
    """<p>The expected CPU utilization at maximum invocations per minute for the instance.</p> <p> <code>NaN</code> indicates that the value is not available.</p>"""
    memory_utilization: NotRequired[
        "capo_sagemaker.types.utilization_metric.UtilizationMetric"
    ]
    """<p>The expected memory utilization at maximum invocations per minute for the instance.</p> <p> <code>NaN</code> indicates that the value is not available.</p>"""
    model_setup_time: NotRequired[
        "capo_sagemaker.types.model_setup_time.ModelSetupTime"
    ]
    """<p>The time it takes to launch new compute resources for a serverless endpoint. The time can vary depending on the model size, how long it takes to download the model, and the start-up time of the container.</p> <p> <code>NaN</code> indicates that the value is not available.</p>"""

cost_per_hour instance-attribute 

cost_per_hour: NotRequired[Float]

Defines the cost per hour for the instance.

cost_per_inference instance-attribute 

cost_per_inference: NotRequired[Float]

Defines the cost per inference for the instance .

cpu_utilization instance-attribute 

cpu_utilization: NotRequired[UtilizationMetric]

The expected CPU utilization at maximum invocations per minute for the instance.

NaN indicates that the value is not available.

max_invocations instance-attribute 

max_invocations: NotRequired[Integer]

The expected maximum number of requests per minute for the instance.

memory_utilization instance-attribute 

memory_utilization: NotRequired[UtilizationMetric]

The expected memory utilization at maximum invocations per minute for the instance.

NaN indicates that the value is not available.

model_latency instance-attribute 

model_latency: NotRequired[Integer]

The expected model latency at maximum invocation per minute for the instance.

model_setup_time instance-attribute 

model_setup_time: NotRequired[ModelSetupTime]

The time it takes to launch new compute resources for a serverless endpoint. The time can vary depending on the model size, how long it takes to download the model, and the start-up time of the container.

NaN indicates that the value is not available.