Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
A powerful pytest plugin that simplifies testing different forms of parameters through dynamic fixture generation. This plugin is particularly useful for API testing, integration testing, or any ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results