sagemaker.serve.serverless.serverless_inference_config

sagemaker.serve.serverless.serverless_inference_config#

Backward compatibility shim for sagemaker.serve.serverless.serverless_inference_config

This module has been moved to sagemaker.core.inference_config. This file provides backward compatibility by re-exporting the class from its new location.

DEPRECATED: Import from sagemaker.core.inference_config instead.

class sagemaker.serve.serverless.serverless_inference_config.ServerlessInferenceConfig(memory_size_in_mb: int = 2048, max_concurrency: int = 5, provisioned_concurrency: int | None = None)[source]#

Bases: object

Configuration object for serverless inference endpoints.

This object specifies configuration related to serverless endpoint. Use this configuration when trying to create serverless endpoint and make serverless inference.

Contents