Skip to content

AIRecommendationConstraint

Source code in docs_src/capo_sagemaker/types/ai_recommendation_constraint.py 
11
12
13
14
15
class AIRecommendationConstraint(TypedDict, closed=True):
    metric: NotRequired[
        "capo_sagemaker.types.ai_recommendation_metric.AIRecommendationMetric"
    ]
    """<p>The performance metric. Valid values are <code>ttft-ms</code> (time to first token in milliseconds), <code>throughput</code>, and <code>cost</code>.</p>"""

metric instance-attribute 

metric: NotRequired[AIRecommendationMetric]

The performance metric. Valid values are ttft-ms (time to first token in milliseconds), throughput, and cost.