Skip to content

InferenceComponentDataCacheConfig

Source code in docs_src/capo_sagemaker/types/inference_component_data_cache_config.py 
11
12
13
class InferenceComponentDataCacheConfig(TypedDict, closed=True):
    enable_caching: NotRequired["capo_sagemaker.types.enable_caching.EnableCaching"]
    """<p>Sets whether the endpoint that hosts the inference component caches the model artifacts and container image.</p> <p>With caching enabled, the endpoint caches this data in each instance that it provisions for the inference component. That way, the inference component deploys faster during the auto scaling process. If caching isn't enabled, the inference component takes longer to deploy because of the time it spends downloading the data.</p>"""

enable_caching instance-attribute 

enable_caching: NotRequired[EnableCaching]

Sets whether the endpoint that hosts the inference component caches the model artifacts and container image.

With caching enabled, the endpoint caches this data in each instance that it provisions for the inference component. That way, the inference component deploys faster during the auto scaling process. If caching isn't enabled, the inference component takes longer to deploy because of the time it spends downloading the data.