Skip to content

CountTokensRequest

Source code in docs_src/capo_bedrock_runtime/types/count_tokens_request.py 
14
15
16
17
18
class CountTokensRequest(TypedDict, closed=True):
    model_id: "capo_bedrock_runtime.types.foundation_model_version_identifier.FoundationModelVersionIdentifier"
    """<p>The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.</p>"""
    input: "capo_bedrock_runtime.types.count_tokens_input.CountTokensInput"
    """<p>The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an <code>InvokeModel</code> or <code>Converse</code> request:</p> <ul> <li> <p>For <code>InvokeModel</code> requests, provide the request body in the <code>invokeModel</code> field</p> </li> <li> <p>For <code>Converse</code> requests, provide the messages and system content in the <code>converse</code> field</p> </li> </ul> <p>The input format must be compatible with the model specified in the <code>modelId</code> parameter.</p>"""

input instance-attribute 

input: CountTokensInput

The input for which to count tokens. The structure of this parameter depends on whether you're counting tokens for an InvokeModel or Converse request:

  • For InvokeModel requests, provide the request body in the invokeModel field

  • For Converse requests, provide the messages and system content in the converse field

The input format must be compatible with the model specified in the modelId parameter.

model_id instance-attribute 

model_id: FoundationModelVersionIdentifier

The unique identifier or ARN of the foundation model to use for token counting. Each model processes tokens differently, so the token count is specific to the model you specify.