Skip to content

GenerationConfiguration

Source code in docs_src/capo_bedrock/types/generation_configuration.py
class GenerationConfiguration(TypedDict, closed=True):
    prompt_template: NotRequired["capo_bedrock.types.prompt_template.PromptTemplate"]
    """<p>Contains the template for the prompt that's sent to the model for response generation.</p>"""
    guardrail_configuration: NotRequired[
        "capo_bedrock.types.guardrail_configuration.GuardrailConfiguration"
    ]
    """<p>Contains configuration details for the guardrail.</p>"""
    kb_inference_config: NotRequired[
        "capo_bedrock.types.kb_inference_config.KbInferenceConfig"
    ]
    """<p>Contains configuration details for inference for knowledge base retrieval and response generation.</p>"""
    additional_model_request_fields: NotRequired[
        "capo_bedrock.types.additional_model_request_fields.AdditionalModelRequestFields"
    ]
    """<p>Additional model parameters and corresponding values not included in the <code>textInferenceConfig</code> structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.</p>"""

additional_model_request_fields instance-attribute

additional_model_request_fields: NotRequired[AdditionalModelRequestFields]

Additional model parameters and corresponding values not included in the textInferenceConfig structure for a knowledge base. This allows you to provide custom model parameters specific to the language model being used.

guardrail_configuration instance-attribute

guardrail_configuration: NotRequired[GuardrailConfiguration]

Contains configuration details for the guardrail.

kb_inference_config instance-attribute

kb_inference_config: NotRequired[KbInferenceConfig]

Contains configuration details for inference for knowledge base retrieval and response generation.

prompt_template instance-attribute

prompt_template: NotRequired[PromptTemplate]

Contains the template for the prompt that's sent to the model for response generation.