Skip to content

HumanEvaluationConfig

Source code in docs_src/capo_bedrock/types/human_evaluation_config.py 
15
16
17
18
19
20
21
22
23
24
25
class HumanEvaluationConfig(TypedDict, closed=True):
    human_workflow_config: NotRequired[
        "capo_bedrock.types.human_workflow_config.HumanWorkflowConfig"
    ]
    """<p>The parameters of the human workflow.</p>"""
    custom_metrics: NotRequired[
        "capo_bedrock.types.human_evaluation_custom_metrics.HumanEvaluationCustomMetrics"
    ]
    """<p>A <code>HumanEvaluationCustomMetric</code> object. It contains the names the metrics, how the metrics are to be evaluated, an optional description.</p>"""
    dataset_metric_configs: "capo_bedrock.types.evaluation_dataset_metric_configs.EvaluationDatasetMetricConfigs"
    """<p>Use to specify the metrics, task, and prompt dataset to be used in your model evaluation job.</p>"""

custom_metrics instance-attribute 

custom_metrics: NotRequired[HumanEvaluationCustomMetrics]

A HumanEvaluationCustomMetric object. It contains the names the metrics, how the metrics are to be evaluated, an optional description.

dataset_metric_configs instance-attribute 

dataset_metric_configs: EvaluationDatasetMetricConfigs

Use to specify the metrics, task, and prompt dataset to be used in your model evaluation job.

human_workflow_config instance-attribute 

human_workflow_config: NotRequired[HumanWorkflowConfig]

The parameters of the human workflow.