sagemaker.serve.mode.local_container_mode

Module that defines the LocalContainerMode class

Classes

LocalContainerMode(model_server, ...[, ...])

A class that holds methods to deploy model to a container in local environment

class sagemaker.serve.mode.local_container_mode.LocalContainerMode(model_server: ModelServer, inference_spec: Type[InferenceSpec], schema_builder: Type[SchemaBuilder], session: Session, model_path: str | None = None, env_vars: Dict | None = None)

Bases: LocalTorchServe, LocalDJLServing, LocalTritonServer, LocalTgiServing, LocalMultiModelServer, LocalTensorflowServing

A class that holds methods to deploy model to a container in local environment

create_server(image: str, container_timeout_seconds: int, secret_key: str, container_config: Dict, ping_fn=None, env_vars: Dict[str, str] | None = None, model_path: str | None = None, jumpstart: bool = False)

Placeholder docstring

destroy_server()

Placeholder docstring

load(model_path: str | None = None)

Placeholder docstring

prepare()

Placeholder docstring