PerformanceConfiguration
¶
Source code in docs_src/capo_bedrock/types/performance_configuration.py
latency
instance-attribute
¶
latency: NotRequired[PerformanceConfigLatency]
Specifies whether to use the latency-optimized or standard version of a model or inference profile.