Skip to content

ComputeLogprobsConfig

Source code in docs_src/capo_sagemakertrainingsessionruntime/types/compute_logprobs_config.py
class ComputeLogprobsConfig(TypedDict, closed=True):
    prompt: "capo_sagemakertrainingsessionruntime.types.model_input.ModelInput"
    """<p>The input prompt whose token log-probabilities will be computed.</p>"""
    model_package_arn: NotRequired["str"]
    """<p>The ARN of the model package whose checkpoint this operation should run against. Must be a valid SageMaker model package ARN in the format <code>arn:aws:sagemaker:REGION:ACCOUNT:model-package/PACKAGE_NAME/VERSION</code>. When absent, the operation runs against the session's latest checkpoint.</p>"""

model_package_arn instance-attribute

model_package_arn: NotRequired[str]

The ARN of the model package whose checkpoint this operation should run against. Must be a valid SageMaker model package ARN in the format arn:aws:sagemaker:REGION:ACCOUNT:model-package/PACKAGE_NAME/VERSION. When absent, the operation runs against the session's latest checkpoint.

prompt instance-attribute

prompt: ModelInput

The input prompt whose token log-probabilities will be computed.