Confident AI

Confident AI is an open-source evaluation platform for LLMs (language models). It enables companies of all sizes to test and evaluate their LLM implementations and deploy them with confidence. It provides users with 12+ metrics, 17k evaluations, A/B testing, output classification, dataset generation, detailed monitoring, and more.