Loading request...
User wants a parser that accepts thinking BOS/EOS (Beginning of Sentence/End of Sentence) tokens so they can be easily regexed out, which would help with evaluations.
@teknium @vllm_project that's a pain when it comes to evaluations for me! you have no choice but making a custom parser, build it, the use that build from the source. i wish we had a parser that accepts thinking bos/eos so it can just regex them out easily.