Loading request...
Enable the use of a dedicated GPU for vLLM in Unsloth's GRPO trainer, allowing users with multiple GPUs to improve performance.
Unsloth doesn't support multi GPU right now, but the GRPO trainer supports a dedicated device for vLLM out of the box. Unfortunately the way Unsloth is setup makes it non-trivial to enable this. For people with 2+ GPUs it would be very nice if this could be made possible!