sagemaker.serve.utils.types

Types used for SageMaker ModelBuilder

Classes

HardwareType(value)	An enum for hardware type
ImageUriOption(value)	Enum type for image uri options
ModelHub(value)	Enum type for model hub source
ModelServer(value)	An enum for model server
SpeculativeDecodingDraftModelSource(value)	Enum type for speculative decoding draft model source

class sagemaker.serve.utils.types.HardwareType(value)

Bases: Enum

An enum for hardware type

CPU = 1

GPU = 2

GRAVITON = 5

INFERENTIA_1 = 3

INFERENTIA_2 = 4

class sagemaker.serve.utils.types.ImageUriOption(value)

Bases: Enum

Enum type for image uri options

CUSTOM_1P_IMAGE = 2

CUSTOM_IMAGE = 1

DEFAULT_IMAGE = 3

class sagemaker.serve.utils.types.ModelHub(value)

Bases: Enum

Enum type for model hub source

HUGGINGFACE = 2

JUMPSTART = 1

class sagemaker.serve.utils.types.ModelServer(value)

Bases: Enum

An enum for model server

DJL_SERVING = 4

MMS = 2

SMD = 8

TEI = 7

TENSORFLOW_SERVING = 3

TGI = 6

TORCHSERVE = 1

TRITON = 5

class sagemaker.serve.utils.types.SpeculativeDecodingDraftModelSource(value)

Bases: Enum

Enum type for speculative decoding draft model source

CUSTOM = 2

SAGEMAKER = 1