Skip to content

ExecuteSamplingOperationInput

Source code in docs_src/capo_sagemakertrainingsessionruntime/types/execute_sampling_operation_input.py 
12
13
14
15
16
class ExecuteSamplingOperationInput(TypedDict, closed=True):
    training_session_name: "capo_sagemakertrainingsessionruntime.types.training_session_name.TrainingSessionName"
    """<p>The name of the training session to sample from.</p>"""
    operation_config: "capo_sagemakertrainingsessionruntime.types.sample_operation_config.SampleOperationConfig"
    """<p>The configuration for the sample operation. Specify either a sample configuration to generate text or a computeLogprobs configuration to compute token log-probabilities.</p>"""

operation_config instance-attribute 

operation_config: SampleOperationConfig

The configuration for the sample operation. Specify either a sample configuration to generate text or a computeLogprobs configuration to compute token log-probabilities.

training_session_name instance-attribute 

training_session_name: TrainingSessionName

The name of the training session to sample from.