sagemaker.serve.local_resources

Local Model and Endpoint classes for V3 ModelBuilder local mode support.

These classes provide sagemaker-core compatible interfaces for local deployment, wrapping V2 local mode functionality.

Classes

InvokeEndpointOutput(body[, content_type])	Response wrapper to match sagemaker-core Endpoint.invoke() output format.
LocalEndpoint(endpoint_name, ...[, ...])	Local endpoint that mimics sagemaker.core.Endpoint interface.
LocalEndpointConfig(endpoint_config_name, ...)	Local endpoint configuration that mimics sagemaker.core.EndpointConfig interface.

class sagemaker.serve.local_resources.InvokeEndpointOutput(body: bytes, content_type: str = 'application/json')

Bases: object

Response wrapper to match sagemaker-core Endpoint.invoke() output format.

class sagemaker.serve.local_resources.LocalEndpoint(endpoint_name: str, endpoint_config_name: str, local_session=None, local_model=None, in_process_mode=False, local_container_mode_obj=None, in_process_mode_obj=None, model_server=None, secret_key=None, serializer=None, deserializer=None, container_config='auto', **kwargs)

Bases: object

Local endpoint that mimics sagemaker.core.Endpoint interface.

This class wraps V2 LocalSession endpoint functionality to provide a unified interface compatible with sagemaker-core Endpoint resources.

classmethod create(endpoint_name: str, endpoint_config_name: str | None = None, local_model: Model | None = None, local_session=None, in_process_mode=False, local_container_mode_obj=None, in_process_mode_obj=None, model_server=None, secret_key=None, serializer=None, deserializer=None, container_config='auto', **kwargs) → LocalEndpoint

Create and start local endpoint.

delete() → None

Delete local endpoint and cleanup container.

Implementation based on V2 LocalSession.delete_endpoint() Reference: /sagemaker/local/local_session.py:delete_endpoint() This calls _LocalEndpoint.stop() which stops the Docker container

property endpoint_status: str

Get endpoint status.

Implementation based on V2 LocalSession.describe_endpoint() Reference: /sagemaker/local/local_session.py:describe_endpoint()

classmethod get(endpoint_name: str, local_session=None) → LocalEndpoint | None

Get existing local endpoint.

Implementation based on V2 LocalSession.describe_endpoint() Reference: /sagemaker/local/local_session.py:describe_endpoint()

invoke(body: Any, content_type: str = 'application/json', accept: str = 'application/json', **kwargs) → InvokeEndpointOutput

Invoke the local endpoint using model server-specific logic.

refresh() → LocalEndpoint

Refresh endpoint state.

Implementation based on V2 LocalSession.describe_endpoint() Reference: /sagemaker/local/local_session.py:describe_endpoint()

update(endpoint_config_name: str) → None

Update endpoint configuration.

V2 Reference: /sagemaker/local/local_session.py:update_endpoint() Note: V2 raises NotImplementedError for update_endpoint

class sagemaker.serve.local_resources.LocalEndpointConfig(endpoint_config_name: str, production_variants: list, local_session=None, **kwargs)

Bases: object

Local endpoint configuration that mimics sagemaker.core.EndpointConfig interface.

classmethod create(endpoint_config_name: str, production_variants: list, local_session=None, **kwargs) → LocalEndpointConfig

Create local endpoint configuration.

Implementation based on V2 LocalSession.create_endpoint_config() Reference: /sagemaker/local/local_session.py:create_endpoint_config()

delete() → None

Delete local endpoint configuration.

Implementation based on V2 LocalSession.delete_endpoint_config() Reference: /sagemaker/local/local_session.py:delete_endpoint_config()