發生什麼事
AWS says SageMaker AI now keeps watch over generative AI inference endpoints by default, tracking latency, GPU utilization, and serving configuration. When it identifies a change that could improve performance or lower costs, it sends a finding through AWS Health (Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints).
Evidence: 🗣 AWS's own statement; not tested by this site.
01Sources
- Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints: AWS, AWS Machine Learning Blog, published 2026-11-19