ComputeLogprobsConfig
¶
Source code in docs_src/capo_sagemakertrainingsessionruntime/types/compute_logprobs_config.py
model_package_arn
instance-attribute
¶
model_package_arn: NotRequired[str]
The ARN of the model package whose checkpoint this operation should run against. Must be a valid SageMaker model package ARN in the format arn:aws:sagemaker:REGION:ACCOUNT:model-package/PACKAGE_NAME/VERSION. When absent, the operation runs against the session's latest checkpoint.
prompt
instance-attribute
¶
prompt: ModelInput
The input prompt whose token log-probabilities will be computed.