Skip to content

EvaluationDataset

Source code in docs_src/capo_bedrock/types/evaluation_dataset.py 
14
15
16
17
18
19
20
class EvaluationDataset(TypedDict, closed=True):
    name: "capo_bedrock.types.evaluation_dataset_name.EvaluationDatasetName"
    """<p>Used to specify supported built-in prompt datasets. Valid values are <code>Builtin.Bold</code>, <code>Builtin.BoolQ</code>, <code>Builtin.NaturalQuestions</code>, <code>Builtin.Gigaword</code>, <code>Builtin.RealToxicityPrompts</code>, <code>Builtin.TriviaQA</code>, <code>Builtin.T-Rex</code>, <code>Builtin.WomensEcommerceClothingReviews</code> and <code>Builtin.Wikitext2</code>.</p>"""
    dataset_location: NotRequired[
        "capo_bedrock.types.evaluation_dataset_location.EvaluationDatasetLocation"
    ]
    """<p>For custom prompt datasets, you must specify the location in Amazon S3 where the prompt dataset is saved.</p>"""

dataset_location instance-attribute 

dataset_location: NotRequired[EvaluationDatasetLocation]

For custom prompt datasets, you must specify the location in Amazon S3 where the prompt dataset is saved.

name instance-attribute 

name: EvaluationDatasetName

Used to specify supported built-in prompt datasets. Valid values are Builtin.Bold, Builtin.BoolQ, Builtin.NaturalQuestions, Builtin.Gigaword, Builtin.RealToxicityPrompts, Builtin.TriviaQA, Builtin.T-Rex, Builtin.WomensEcommerceClothingReviews and Builtin.Wikitext2.