sagemaker.serve.mode.in_process_mode

sagemaker.serve.mode.in_process_mode#

Module that defines the InProcessMode class

Classes

InProcessMode(model, inference_spec, ...[, ...])

A class that holds methods to deploy model to a container in process environment
class sagemaker.serve.mode.in_process_mode.InProcessMode(model: str | None, inference_spec: InferenceSpec | None, schema_builder: Type[SchemaBuilder], session: Session, model_path: str | None = None, env_vars: Dict | None = None)[source]#

Bases: InProcessServing

A class that holds methods to deploy model to a container in process environment

create_server(ping_fn)[source]#

Creating the fast api server and checking ping health.

destroy_server()[source]#

Placeholder docstring

load(model_path: str | None = None)[source]#

Loads model path, checks that path exists

prepare()[source]#

Prepares the server

Contents