GenerationConfiguration
¶
Source code in docs_src/capo_bedrock/types/generation_configuration.py
additional_model_request_fields
instance-attribute
¶
additional_model_request_fields: NotRequired[AdditionalModelRequestFields]
Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.
guardrail_configuration
instance-attribute
¶
guardrail_configuration: NotRequired[GuardrailConfiguration]
Contains configuration details for the guardrail.
kb_inference_config
instance-attribute
¶
kb_inference_config: NotRequired[KbInferenceConfig]
Contains configuration details for inference for knowledge base retrieval and response generation.
prompt_template
instance-attribute
¶
prompt_template: NotRequired[PromptTemplate]
Contains the template for the prompt that's sent to the model for response generation.