Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

LLaVA-Med was initialized with the general-domain LLaVA and then continuously trained in a curriculum learning fashion (first biomedical concept alignment then full-blown instruction-tuning). We ...

OpenAI will make 2026 its year of "practical adoption," the artificial intelligence startup's finance chief said in a blog Sunday. The startup's compute grew from 0.2 GW in 2023 to about 1.9 GW in ...

Sam Altman is like a juggler on a unicycle. Building all-knowing chatbots powered by cutting-edge artificial-intelligence models is too meek an ambition for OpenAI’s boss. To keep his audience rapt, ...

OpenAI released new data Monday showing enterprise usage of its AI tools has surged dramatically over the past year, with ChatGPT message volume growing 8x since November 2024 and workers reporting ...

Figuring out the cost of using OpenAI’s API can feel a bit like trying to guess how much a custom-built computer will cost before you even know what parts you need. There are different models, ...

This voice experience is generated by AI. Learn more. This voice experience is generated by AI. Learn more. A few days ago, on November 26th, right before Thanksgiving, OpenAI, the maker of ChatGPT, ...

A breach at data analytics provider Mixpanel Inc. has compromised the account information of some OpenAI Group PBC users. The ChatGPT developer disclosed the incident on Wednesday. Mixpanel’s namesake ...

OpenAI is notifying some ChatGPT API customers that limited identifying information was exposed following a breach at its third-party analytics provider Mixpanel. Mixpanel offers event analytics that ...

Elon Musk’s AI startup xAI (X.AI) is expected to close a $15B funding round at a $230B pre-money valuation next month, CNBC reported, citing people with knowledge of the matter. The deadline for ...