Briefs · Taipei time (GMT+8)

Alibaba Cloud AI Gateway adds Intelligent Routing to choose a model for each request

一句重點:Callers can leave model selection open: set a preference mode and the gateway picks a model from the available candidates for each request.

發生什麼事

Alibaba Cloud says Intelligent Routing is now available in AI Gateway. The gateway first removes candidates that do not meet requirements such as protocol, tool capabilities, or context length, then selects among the rest according to one of four modes: balanced, cost, low latency, or quality. For a multi-turn conversation that stays on the same task, it keeps using the model selected for the previous turn. For an agent tool-call chain, it selects a model when the task starts and keeps that model throughout.

01Sources

Evidence: 🗣 Official statement; not tested by this site.