Skip to content
Gopi Krishna Tummala

Tag: mixture-of-experts

All the articles with the tag "mixture-of-experts".

  • Intermediate GenAI Systems
    12 MIN READ

    Qwen3-VL and Mixture of Experts: How a Big Model Runs Like a Small One

    One support team, one screenshot, one model. How a Qwen-style vision-language model reads an image, how a mixture-of-experts layer routes each token to a few experts, how the router and experts are trained without collapsing, and what changes when you deploy it.