Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
A University of Glasgow-led research project is releasing a free tool to help organizations, policymakers, and the public maximize the benefits of AI applications while identifying their potential ...