Skip to content

OptimizationConfig module-attribute 

OptimizationConfig: TypeAlias = (
    _OptimizationConfig_ModelQuantizationConfig
    | _OptimizationConfig_ModelCompilationConfig
    | _OptimizationConfig_ModelShardingConfig
    | _OptimizationConfig_ModelSpeculativeDecodingConfig
)

_OptimizationConfig_ModelQuantizationConfig

Used by
Source code in docs_src/capo_sagemaker/types/optimization_config.py 
16
17
18
19
class _OptimizationConfig_ModelQuantizationConfig(TypedDict, closed=True):
    ModelQuantizationConfig: (
        "capo_sagemaker.types.model_quantization_config.ModelQuantizationConfig"
    )

ModelQuantizationConfig instance-attribute 

ModelQuantizationConfig: ModelQuantizationConfig

_OptimizationConfig_ModelCompilationConfig

Used by
Source code in docs_src/capo_sagemaker/types/optimization_config.py 
22
23
24
25
class _OptimizationConfig_ModelCompilationConfig(TypedDict, closed=True):
    ModelCompilationConfig: (
        "capo_sagemaker.types.model_compilation_config.ModelCompilationConfig"
    )

ModelCompilationConfig instance-attribute 

ModelCompilationConfig: ModelCompilationConfig

_OptimizationConfig_ModelShardingConfig

Used by
Source code in docs_src/capo_sagemaker/types/optimization_config.py 
28
29
30
31
class _OptimizationConfig_ModelShardingConfig(TypedDict, closed=True):
    ModelShardingConfig: (
        "capo_sagemaker.types.model_sharding_config.ModelShardingConfig"
    )

ModelShardingConfig instance-attribute 

ModelShardingConfig: ModelShardingConfig

_OptimizationConfig_ModelSpeculativeDecodingConfig

Used by
Source code in docs_src/capo_sagemaker/types/optimization_config.py 
34
35
class _OptimizationConfig_ModelSpeculativeDecodingConfig(TypedDict, closed=True):
    ModelSpeculativeDecodingConfig: "capo_sagemaker.types.model_speculative_decoding_config.ModelSpeculativeDecodingConfig"

ModelSpeculativeDecodingConfig instance-attribute 

ModelSpeculativeDecodingConfig: ModelSpeculativeDecodingConfig