User mentions that multi-model use has been a feature request on vLLM for a while.
@jtregunna Makes sense! Would love to see what you will end up using, multi model use has been a feature request on vllm for a while now