Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
This repository archives artifacts (prompts, configs, logs, and scripts) from a series of preprints (more info at https://slashreboot.com) on prompt-induced simulated metacognition and embodiment in ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results