Skip to content

InferenceExecutionConfig

Used by
Source code in docs_src/capo_sagemaker/types/inference_execution_config.py 
11
12
13
14
15
class InferenceExecutionConfig(TypedDict, closed=True):
    mode: NotRequired[
        "capo_sagemaker.types.inference_execution_mode.InferenceExecutionMode"
    ]
    """<p>How containers in a multi-container are run. The following values are valid.</p> <ul> <li> <p> <code>SERIAL</code> - Containers run as a serial pipeline.</p> </li> <li> <p> <code>DIRECT</code> - Only the individual container that you specify is run.</p> </li> </ul>"""

mode instance-attribute 

mode: NotRequired[InferenceExecutionMode]

How containers in a multi-container are run. The following values are valid.

  • SERIAL - Containers run as a serial pipeline.

  • DIRECT - Only the individual container that you specify is run.