Skip to content

PromptConfiguration

Source code in docs_src/capo_bedrock_agent/types/prompt_configuration.py
class PromptConfiguration(TypedDict, closed=True):
    prompt_type: NotRequired["capo_bedrock_agent.types.prompt_type.PromptType"]
    """<p>The step in the agent sequence that this prompt configuration applies to.</p>"""
    prompt_creation_mode: NotRequired[
        "capo_bedrock_agent.types.creation_mode.CreationMode"
    ]
    """<p>Specifies whether to override the default prompt template for this <code>promptType</code>. Set this value to <code>OVERRIDDEN</code> to use the prompt that you provide in the <code>basePromptTemplate</code>. If you leave it as <code>DEFAULT</code>, the agent uses a default prompt template.</p>"""
    prompt_state: NotRequired["capo_bedrock_agent.types.prompt_state.PromptState"]
    """<p>Specifies whether to allow the agent to carry out the step specified in the <code>promptType</code>. If you set this value to <code>DISABLED</code>, the agent skips that step. The default state for each <code>promptType</code> is as follows.</p> <ul> <li> <p> <code>PRE_PROCESSING</code> – <code>DISABLED</code> </p> </li> <li> <p> <code>ORCHESTRATION</code> – <code>ENABLED</code> </p> </li> <li> <p> <code>KNOWLEDGE_BASE_RESPONSE_GENERATION</code> – <code>ENABLED</code> </p> </li> <li> <p> <code>POST_PROCESSING</code> – <code>DISABLED</code> </p> </li> </ul>"""
    base_prompt_template: NotRequired[
        "capo_bedrock_agent.types.base_prompt_template.BasePromptTemplate"
    ]
    """<p>Defines the prompt template with which to replace the default prompt template. You can use placeholder variables in the base prompt template to customize the prompt. For more information, see <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-placeholders.html">Prompt template placeholder variables</a>. For more information, see <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/advanced-prompts-configure.html">Configure the prompt templates</a>.</p>"""
    inference_configuration: NotRequired[
        "capo_bedrock_agent.types.inference_configuration.InferenceConfiguration"
    ]
    """<p>Contains inference parameters to use when the agent invokes a foundation model in the part of the agent sequence defined by the <code>promptType</code>. For more information, see <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters.html">Inference parameters for foundation models</a>.</p>"""
    parser_mode: NotRequired["capo_bedrock_agent.types.creation_mode.CreationMode"]
    """<p>Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the <code>promptType</code>. If you set the field as <code>OVERRIDDEN</code>, the <code>overrideLambda</code> field in the <a href="https://docs.aws.amazon.com/bedrock/latest/APIReference/API_agent_PromptOverrideConfiguration.html">PromptOverrideConfiguration</a> must be specified with the ARN of a Lambda function.</p>"""
    foundation_model: NotRequired[
        "capo_bedrock_agent.types.model_identifier.ModelIdentifier"
    ]
    """<p>The agent's foundation model.</p>"""
    additional_model_request_fields: NotRequired["object"]
    """<p>If the Converse or ConverseStream operations support the model, <code>additionalModelRequestFields</code> contains additional inference parameters, beyond the base set of inference parameters in the <code>inferenceConfiguration</code> field. </p> <p>For more information, see <i>Inference request parameters and response fields for foundation models</i> in the Amazon Bedrock user guide.</p>"""

additional_model_request_fields instance-attribute

additional_model_request_fields: NotRequired[object]

If the Converse or ConverseStream operations support the model, additionalModelRequestFields contains additional inference parameters, beyond the base set of inference parameters in the inferenceConfiguration field.

For more information, see Inference request parameters and response fields for foundation models in the Amazon Bedrock user guide.

base_prompt_template instance-attribute

base_prompt_template: NotRequired[BasePromptTemplate]

Defines the prompt template with which to replace the default prompt template. You can use placeholder variables in the base prompt template to customize the prompt. For more information, see Prompt template placeholder variables. For more information, see Configure the prompt templates.

foundation_model instance-attribute

foundation_model: NotRequired[ModelIdentifier]

The agent's foundation model.

inference_configuration instance-attribute

inference_configuration: NotRequired[InferenceConfiguration]

Contains inference parameters to use when the agent invokes a foundation model in the part of the agent sequence defined by the promptType. For more information, see Inference parameters for foundation models.

parser_mode instance-attribute

parser_mode: NotRequired[CreationMode]

Specifies whether to override the default parser Lambda function when parsing the raw foundation model output in the part of the agent sequence defined by the promptType. If you set the field as OVERRIDDEN, the overrideLambda field in the PromptOverrideConfiguration must be specified with the ARN of a Lambda function.

prompt_creation_mode instance-attribute

prompt_creation_mode: NotRequired[CreationMode]

Specifies whether to override the default prompt template for this promptType. Set this value to OVERRIDDEN to use the prompt that you provide in the basePromptTemplate. If you leave it as DEFAULT, the agent uses a default prompt template.

prompt_state instance-attribute

prompt_state: NotRequired[PromptState]

Specifies whether to allow the agent to carry out the step specified in the promptType. If you set this value to DISABLED, the agent skips that step. The default state for each promptType is as follows.

  • PRE_PROCESSING – DISABLED

  • ORCHESTRATION – ENABLED

  • KNOWLEDGE_BASE_RESPONSE_GENERATION – ENABLED

  • POST_PROCESSING – DISABLED

prompt_type instance-attribute

prompt_type: NotRequired[PromptType]

The step in the agent sequence that this prompt configuration applies to.