Skip to content

CreateEvaluationJobRequest

Source code in docs_src/capo_bedrock/types/create_evaluation_job_request.py
class CreateEvaluationJobRequest(TypedDict, closed=True):
    job_name: "capo_bedrock.types.evaluation_job_name.EvaluationJobName"
    """<p>A name for the evaluation job. Names must unique with your Amazon Web Services account, and your account's Amazon Web Services region.</p>"""
    job_description: NotRequired[
        "capo_bedrock.types.evaluation_job_description.EvaluationJobDescription"
    ]
    """<p>A description of the evaluation job.</p>"""
    client_request_token: NotRequired[
        "capo_bedrock.types.idempotency_token.IdempotencyToken"
    ]
    """<p>A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see <a href="https://docs.aws.amazon.com/AWSEC2/latest/APIReference/Run_Instance_Idempotency.html">Ensuring idempotency</a>.</p>"""
    role_arn: "capo_bedrock.types.role_arn.RoleArn"
    """<p>The Amazon Resource Name (ARN) of an IAM service role that Amazon Bedrock can assume to perform tasks on your behalf. To learn more about the required permissions, see <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/model-evaluation-security.html">Required permissions for model evaluations</a>.</p>"""
    customer_encryption_key_id: NotRequired["capo_bedrock.types.kms_key_id.KmsKeyId"]
    """<p>Specify your customer managed encryption key Amazon Resource Name (ARN) that will be used to encrypt your evaluation job.</p>"""
    job_tags: NotRequired["capo_bedrock.types.tag_list.TagList"]
    """<p>Tags to attach to the model evaluation job.</p>"""
    application_type: NotRequired["capo_bedrock.types.application_type.ApplicationType"]
    """<p>Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).</p>"""
    evaluation_config: "capo_bedrock.types.evaluation_config.EvaluationConfig"
    """<p>Contains the configuration details of either an automated or human-based evaluation job.</p>"""
    inference_config: (
        "capo_bedrock.types.evaluation_inference_config.EvaluationInferenceConfig"
    )
    """<p>Contains the configuration details of the inference model for the evaluation job.</p> <p>For model evaluation jobs, automated jobs support a single model or <a href="https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference.html">inference profile</a>, and jobs that use human workers support two models or inference profiles.</p>"""
    output_data_config: (
        "capo_bedrock.types.evaluation_output_data_config.EvaluationOutputDataConfig"
    )
    """<p>Contains the configuration details of the Amazon S3 bucket for storing the results of the evaluation job.</p>"""

application_type instance-attribute

application_type: NotRequired[ApplicationType]

Specifies whether the evaluation job is for evaluating a model or evaluating a knowledge base (retrieval and response generation).

client_request_token instance-attribute

client_request_token: NotRequired[IdempotencyToken]

A unique, case-sensitive identifier to ensure that the API request completes no more than one time. If this token matches a previous request, Amazon Bedrock ignores the request, but does not return an error. For more information, see Ensuring idempotency.

customer_encryption_key_id instance-attribute

customer_encryption_key_id: NotRequired[KmsKeyId]

Specify your customer managed encryption key Amazon Resource Name (ARN) that will be used to encrypt your evaluation job.

evaluation_config instance-attribute

evaluation_config: EvaluationConfig

Contains the configuration details of either an automated or human-based evaluation job.

inference_config instance-attribute

inference_config: EvaluationInferenceConfig

Contains the configuration details of the inference model for the evaluation job.

For model evaluation jobs, automated jobs support a single model or inference profile, and jobs that use human workers support two models or inference profiles.

job_description instance-attribute

job_description: NotRequired[EvaluationJobDescription]

A description of the evaluation job.

job_name instance-attribute

A name for the evaluation job. Names must unique with your Amazon Web Services account, and your account's Amazon Web Services region.

job_tags instance-attribute

job_tags: NotRequired[TagList]

Tags to attach to the model evaluation job.

output_data_config instance-attribute

output_data_config: EvaluationOutputDataConfig

Contains the configuration details of the Amazon S3 bucket for storing the results of the evaluation job.

role_arn instance-attribute

role_arn: RoleArn

The Amazon Resource Name (ARN) of an IAM service role that Amazon Bedrock can assume to perform tasks on your behalf. To learn more about the required permissions, see Required permissions for model evaluations.