ModelConfiguration
¶
Source code in docs_src/capo_bedrock/types/model_configuration.py
additional_model_request_fields
instance-attribute
¶
additional_model_request_fields: NotRequired[AdditionalModelRequestFields]
Additional model request fields. Use this to pass model-specific parameters that are not included in the standard inference configuration.
inference_config
instance-attribute
¶
inference_config: NotRequired[InferenceConfiguration]
The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.
model_id
instance-attribute
¶
The model to use for optimization. The value depends on the resource that you use:
-
If you use a base model, specify the model ID or its ARN. For a list of model IDs, see Models at a glance in the Amazon Bedrock User Guide.
-
If you use a cross-Region (system-defined) inference profile, specify the inference profile ID or its ARN. For a list of inference profile IDs, see Supported Regions and models for inference profiles in the Amazon Bedrock User Guide.
-
If you use an application inference profile, specify its full ARN, including the account ID and Region.