Loading request...
User is running a self-hosted project planning tool with a local LLM machine via LM Studio's API. They experience significant concurrency issues when approximately 10 people use it simultaneously, indicating a need for better parallel processing capabilities.
Your timing is amazing. I’ve developed a self hosted project planning tool purely for internal use and I’m using a local dedicated LLM machine for different tasks, and used LM Studio to set up an API easily. However, concurrency is a big problem as there are many moments where there is approximately 10 people using it. I was going to take a look at options for parallel use, and then this video came up in my feed. 🎉