Skip to content

AsyncInferenceConfig

Used by
Source code in docs_src/capo_sagemaker/types/async_inference_config.py 
12
13
14
15
16
17
18
19
20
class AsyncInferenceConfig(TypedDict, closed=True):
    client_config: NotRequired[
        "capo_sagemaker.types.async_inference_client_config.AsyncInferenceClientConfig"
    ]
    """<p>Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.</p>"""
    output_config: NotRequired[
        "capo_sagemaker.types.async_inference_output_config.AsyncInferenceOutputConfig"
    ]
    """<p>Specifies the configuration for asynchronous inference invocation outputs.</p>"""

client_config instance-attribute 

client_config: NotRequired[AsyncInferenceClientConfig]

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

output_config instance-attribute 

output_config: NotRequired[AsyncInferenceOutputConfig]

Specifies the configuration for asynchronous inference invocation outputs.