POLICY · CODING · #2501
CDK construct orchestrates SageMaker endpoint auto scaling during updates
AWS describes a reusable AWS CDK construct that replaces native Application Auto Scaling resources with three CloudFormation custom resources to deregister and then re-register auto scaling around SageMaker real-time endpoint updates. The approach (Deregister, Endpoint update, Register Scalable Target, Attach Scaling Policy) uses asynchronous custom-resource handlers, a ConfigHash to force re-invocation, and provider-generated Lambda and Step Functions helpers so endpoint configuration and auto scaling parameters can be updated in a single deployment without manual steps or broken CloudFormation stacks.
KEY POINTS
- AWS describes a reusable AWS CDK construct that replaces native Application Auto Scaling resources with three CloudFormation custom resources to deregister and then re-register auto scaling around SageMaker real-time endpoint updates.
- The approach (Deregister, Endpoint update, Register Scalable Target, Attach Scaling Policy) uses asynchronous custom-resource handlers, a ConfigHash to force re-invocation, and provider-generated Lambda and Step Functions helpers so endpoint configuration and auto scaling parameters can be updated in a single deployment without manual steps or broken CloudFormation stacks.
- This prevents common CloudFormation failures and rollback issues when changing SageMaker endpoint configs while auto scaling targets are registered, improving reliability and automation for ML infra.
WHY IT MATTERS
This prevents common CloudFormation failures and rollback issues when changing SageMaker endpoint configs while auto scaling targets are registered, improving reliability and automation for ML infra.