Skip to content

AIRecommendationInferenceSpecification

Used by
Source code in docs_src/capo_sagemaker/types/ai_recommendation_inference_specification.py 
11
12
13
14
15
class AIRecommendationInferenceSpecification(TypedDict, closed=True):
    framework: NotRequired[
        "capo_sagemaker.types.ai_recommendation_inference_framework.AIRecommendationInferenceFramework"
    ]
    """<p>The inference framework. Valid values are <code>LMI</code> and <code>VLLM</code>.</p>"""

framework instance-attribute 

framework: NotRequired[AIRecommendationInferenceFramework]

The inference framework. Valid values are LMI and VLLM.