sagemaker.core.remote_function.core.pipeline_variables

sagemaker.core.remote_function.core.pipeline_variables#

SageMaker remote function data serializer/deserializer.

Functions

convert_pipeline_variables_to_pickleable(...)

Convert pipeline variables to pickleable.

resolve_pipeline_variables(context, ...)

Resolve pipeline variables.

Classes

Context(step_name, execution_id, ...)

Context for an execution.
class sagemaker.core.remote_function.core.pipeline_variables.Context(step_name: str | None = None, execution_id: str | None = None, property_references: ~typing.Dict[str, str] = <factory>, serialize_output_to_json: bool = False, func_step_s3_dir: str | None = None)[source]#

Bases: object

Context for an execution.

execution_id: str = None#
func_step_s3_dir: str = None#
property_references: Dict[str, str]#
serialize_output_to_json: bool = False#
step_name: str = None#
sagemaker.core.remote_function.core.pipeline_variables.convert_pipeline_variables_to_pickleable(func_args: Tuple, func_kwargs: Dict)[source]#

Convert pipeline variables to pickleable.

Parameters:

  • func_args – function args.

  • func_kwargs – function kwargs.

sagemaker.core.remote_function.core.pipeline_variables.resolve_pipeline_variables(context: Context, func_args: Tuple, func_kwargs: Dict, s3_base_uri: str, **settings)[source]#

Resolve pipeline variables.

Parameters:

  • context – context for the execution.

  • func_args – function args.

  • func_kwargs – function kwargs.

  • s3_base_uri – the s3 base uri of the function step that the serialized artifacts will be uploaded to. The s3_base_uri = s3_root_uri + pipeline_name.

  • **settings – settings to pass to the deserialization function.

Contents