Loading request...
User reports experiencing issues where vLLM stops processing requests, requiring a model relaunch. This is problematic for agent usage and needs to be addressed.
@sudoingX Don’t you have some times an issue with vLLM stoping processing request ? I would need to relaunch the model, which is an issue for agent usage. If you ever had this issue what did you do to fix it ?