confident-ai/deepeval
View on GitHub ↗ ★ 19,244 Python
The LLM Evaluation Framework
22 mentions on Hacker News by 10 people: 12 stories, 10 comments · first 2023-08-15 · latest 2026-01-10
20082026
-
Checkout this instead: https://github.com/confident-ai/deepeval Also has native ragas implementation but supports all models.
comment by 3d27 · 2024-03-22 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines -
…we've got more Open Source LLM Evaluation Libraries coming in more often. We're using DeepEval ( https://github.com/confident-ai/deepeval ) currently. How is this different from that?
comment by AndrewCook71 · 2024-03-22 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines -
…well for us because we can evaluate any LLMs, something this library doesn't seem to support ( https://github.com/confident-ai/deepeval ).
comment by pawanapg · 2024-03-21 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines -
…these new models on their local setup in under 10 lines of code. Hope someone finds this useful: https://github.com/confident-ai/deepeval
comment by 3d27 · 2024-03-04 · in Claude 3 model family -
R2R uses deepeval for their evaluation :) https://github.com/confident-ai/deepeval
comment by jipster · 2024-02-29 · in Show HN: R2R – Open-source framework for production-grade RAG -
There's a lot more in the evaluation space, including this one: https://github.com/confident-ai/deepeval
comment by 3d27 · 2024-02-26 · in AI Infrastructure Landscape -
…domain specific subset)! So there are [quite]( https://github.com/microsoft/promptbench ) [a]( https://github.com/confident-ai/deepeval ) [few]( https://github.com/openai/evals ) [frameworks]( https://github.com/EleutherAI/lm-evaluation-har…
comment by renchuw · 2024-02-13 · in Show HN: Faster LLM evaluation with Bayesian optimization -
A link to a reddit post (with no discussion) which links to this repo https://github.com/confident-ai/deepeval
comment by squigz · 2023-12-13 · in I implemented 12+ LLM evaluation metrics so you don't have to -
…to OpenAI enterprise and ensure consistency results - would recommend checking the open source repo https://github.com/confident-ai/deepeval
comment by jacky2wong · 2023-08-29 · in ChatGPT Enterprise -
…or even your own internal framework. The idea is you would use our open source package ( https://github.com/confident-ai/deepeval ) to evaluate LLM outputs using criteria such as factual consistency, relevancy, bias, etc, and be able to…
comment by jipster · 2023-08-25