Amazon SageMaker HyperPod introduces CLI and SDK for AI Workflows

We are excited to announce the general availability of the Amazon SageMaker HyperPod Command Line Interface (CLI) and Software Development Kit (SDK). These tools make it easier for developers and ML practitioners to build, train, and deploy large-scale AI models on SageMaker HyperPod.

SageMaker HyperPod CLI offers a simple, consistent command-line experience for managing HyperPod clusters and quick experimentation. The SDK offers intuitive programmatic access to HyperPod’s distributed training and inference capabilities and enables developers to have granular control over their workload configurations. With these tools, data scientists and ML engineers can easily launch training jobs, deploy scalable inference endpoints, and monitor cluster performance. Using simple commands, customers can access system logs and HyperPod observability dashboards, enabling them to debug issues and accelerate model development. These new developer interfaces enable customers to build and deploy production generative AI models faster on SageMaker HyperPod.

The HyperPod CLI and SDK are available in all AWS commercial regions where SageMaker HyperPod is supported. To get started with the SageMaker HyperPod CLI and SDK, visit the SageMaker HyperPod Developer Guide.