InTowards AIbyCikal Merdeka·Jul 25Semantic Router: The AI Traffic ControllerYou have built the chatbot. You have tuned the prompt, chosen the frontier model, and wired everything into production. The responses are…
Engin Yoruker·Jul 24Semantic Routing for Local LLMs with Agent gateway and vLLM Semantic Router on OpenShiftIn the previous articles, we built an AI gateway on OpenShift using agent gateway and local large language models. We secured access with…
ThamizhElango Natarajan·Mar 12The Meta Model: Why Satya Nadella Is Right to Be Excited About vLLM’s Semantic RouterThere’s a telling moment buried in Satya Nadella’s conversation at the Morgan Stanley TMT Conference this month. When asked about model…
TechEon·Jan 14Building a Production-Grade Semantic Router: The Smart Way to Route AI PromptsA beginner’s guide to building an intelligent routing system that automatically directs user queries to the most appropriate AI model — no…