Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...

The company says its just a concept, and doesn't plan to advance the idea.

Since ChatGPT launched in November 2022, it’s proved endlessly useful, with workers all around the world finding innovative ways to apply artificial intelligence every day. Whether it’s ChatGPT ...

Own, don't rent.