Loading request...
The user requests the ability to use local models as judges for evaluation, in addition to hardcoded models. This would involve endpoint selection and extending existing pipelines, motivated by local development and evaluations.
### 🚀 Feature Additional to the hardcoded models, add support to use local models as judges for evaluation. Can be simplified to require the OpenAI API. Should be basically an endpoint selection, probably the Azure hosted pipeline can be extended to cover this. If already working, add documentation on how this can be done. ### Motivation Local development and evals