sagemaker.serve.utils

Modules

exceptions	Exceptions used across different model builder invocations
hardware_detector	Utilities for detecting available GPUs and Aggregate GPU Memory size of an instance
hf_utils	Utility functions for fetching model information from HuggingFace Hub
lineage_constants	Holds constants used for lineage support
lineage_utils	Holds the util functions used for lineage tracking
local_hardware	Utilites for identifying and analyzing local gpu hardware
logging_agent	Module for pulling logs from container
packaging	Packaging utilities for model serving.
task	Accessors to retrieve task fallback input/output schema
telemetry_logger	Placeholder docstring
types	Types used for SageMaker ModelBuilder
uploader	Upload model artifacts to S3