sagemaker.mlops.workflow.emr_serverless_step

sagemaker.mlops.workflow.emr_serverless_step#

The step definitions for EMR Serverless workflow.

Classes

EMRServerlessJobConfig(job_driver, ...[, ...])

Config for EMR Serverless job.

EMRServerlessStep(name, display_name, ...[, ...])

EMR Serverless step for workflow with configurable retry policies.
class sagemaker.mlops.workflow.emr_serverless_step.EMRServerlessJobConfig(job_driver: Dict, execution_role_arn: str, configuration_overrides: Dict | None = None, execution_timeout_minutes: int | None = None, name: str | None = None, tags: Dict[str, str] | None = None)[source]#

Bases: object

Config for EMR Serverless job.

to_request(application_id: str | None = None) → Dict[str, Any] | List[Dict[str, Any]][source]#

Convert EMRServerlessJobConfig object to request dict.

class sagemaker.mlops.workflow.emr_serverless_step.EMRServerlessStep(name: str, display_name: str, description: str, job_config: EMRServerlessJobConfig, application_id: str | None = None, application_config: Dict[str, Any] | None = None, depends_on: List[str | Step | StepCollection] | None = None, cache_config: CacheConfig | None = None, retry_policies: List[StepRetryPolicy] | None = None)[source]#

Bases: ConfigurableRetryStep

EMR Serverless step for workflow with configurable retry policies.

property arguments: Dict[str, Any] | List[Dict[str, Any]]#

The arguments dict that is used to call EMR Serverless APIs.

property properties: Dict[str, Any] | List[Dict[str, Any]]#

A Properties object representing the EMR Serverless GetJobRunResponse model.

to_request() → Dict[str, Any] | List[Dict[str, Any]][source]#

Updates the dictionary with cache configuration and retry policies.

Contents