Skip to content

BillableTokenUsage

Source code in docs_src/capo_sagemaker/types/billable_token_usage.py
class BillableTokenUsage(TypedDict, closed=True):
    prefill_token_count: NotRequired["capo_sagemaker.types.java_long.JavaLong"]
    """<p>The number of prefill tokens consumed.</p>"""
    sample_token_count: NotRequired["capo_sagemaker.types.java_long.JavaLong"]
    """<p>The number of sample tokens consumed.</p>"""
    training_token_count: NotRequired["capo_sagemaker.types.java_long.JavaLong"]
    """<p>The number of training tokens consumed.</p>"""

prefill_token_count instance-attribute

prefill_token_count: NotRequired[JavaLong]

The number of prefill tokens consumed.

sample_token_count instance-attribute

sample_token_count: NotRequired[JavaLong]

The number of sample tokens consumed.

training_token_count instance-attribute

training_token_count: NotRequired[JavaLong]

The number of training tokens consumed.