CreateAIRecommendationJobRequest
¶
Source code in docs_src/capo_sagemaker/types/create_ai_recommendation_job_request.py
adapter_source
instance-attribute
¶
adapter_source: NotRequired[AIAdapterSource]
The LoRA adapter source for the recommendation job. Specify either a list of model package ARNs or Amazon S3 URIs for your LoRA adapters. When this parameter is absent, the recommendation job runs without LoRA adapter support.
ai_recommendation_job_name
instance-attribute
¶
ai_recommendation_job_name: NotRequired[AIEntityName]
The name of the AI recommendation job. The name must be unique within your Amazon Web Services account in the current Amazon Web Services Region.
ai_workload_config_identifier
instance-attribute
¶
ai_workload_config_identifier: NotRequired[AIResourceIdentifier]
The name or Amazon Resource Name (ARN) of the AI workload configuration to use for this recommendation job.
compute_spec
instance-attribute
¶
compute_spec: NotRequired[AIRecommendationComputeSpec]
The compute resource specification for the recommendation job. You can specify up to 3 instance types to consider, and optionally provide capacity reservation configuration.
inference_specification
instance-attribute
¶
inference_specification: NotRequired[AIRecommendationInferenceSpecification]
The inference framework configuration. Specify the framework (such as LMI or vLLM) for the recommendation job.
model_source
instance-attribute
¶
model_source: NotRequired[AIModelSource]
The source of the model to optimize. Specify the Amazon S3 location of the model artifacts.
optimize_model
instance-attribute
¶
optimize_model: NotRequired[AIRecommendationAllowOptimization]
Whether to allow model optimization techniques such as quantization, speculative decoding, and kernel tuning. The default is true.
output_config
instance-attribute
¶
output_config: NotRequired[AIRecommendationOutputConfig]
The output configuration for the recommendation job, including the Amazon S3 location for results and an optional model package group where the optimized model is registered.
performance_target
instance-attribute
¶
performance_target: NotRequired[AIRecommendationPerformanceTarget]
The performance targets for the recommendation job. Specify constraints on metrics such as time to first token (ttft-ms), throughput, or cost.