Hacker GitHub

← All repos

confident-ai/deepeval

View on GitHub ↗ ★ 19,244 Python

The LLM Evaluation Framework

22 mentions on Hacker News by 10 people: 12 stories, 10 comments · first 2023-08-15 · latest 2026-01-10

Mentions per year 22 mentions · busiest year 2023 (12)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 1
    Show HN: Tag driven changelog generator (MDX) with optional LLM summaries
    story by dustfinger · 2026-01-10 · 1 comment
  2. ▲ 1
    Has anyone ever used the Python framework "Deepeval"?
    story by willmarquis · 2025-06-23 · 0 comments
  3. ▲ 117
    Launch HN: Confident AI (YC W25) – Open-source evaluation framework for LLM apps
    story by jeffreyip · 2025-02-20 · 27 comments
  4. Checkout this instead: https://github.com/confident-ai/deepeval Also has native ragas implementation but supports all models.
    comment by 3d27 · 2024-03-22 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines
  5. …we've got more Open Source LLM Evaluation Libraries coming in more often. We're using DeepEval ( https://github.com/confident-ai/deepeval ) currently. How is this different from that?
    comment by AndrewCook71 · 2024-03-22 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines
  6. …well for us because we can evaluate any LLMs, something this library doesn't seem to support ( https://github.com/confident-ai/deepeval ).
    comment by pawanapg · 2024-03-21 · in Show HN: Ragas – Open-source library for evaluating RAG pipelines
  7. …these new models on their local setup in under 10 lines of code. Hope someone finds this useful: https://github.com/confident-ai/deepeval
    comment by 3d27 · 2024-03-04 · in Claude 3 model family
  8. R2R uses deepeval for their evaluation :) https://github.com/confident-ai/deepeval
    comment by jipster · 2024-02-29 · in Show HN: R2R – Open-source framework for production-grade RAG
  9. There's a lot more in the evaluation space, including this one: https://github.com/confident-ai/deepeval
    comment by 3d27 · 2024-02-26 · in AI Infrastructure Landscape
  10. …domain specific subset)! So there are [quite]( https://github.com/microsoft/promptbench ) [a]( https://github.com/confident-ai/deepeval ) [few]( https://github.com/openai/evals ) [frameworks]( https://github.com/EleutherAI/lm-evaluation-har…
    comment by renchuw · 2024-02-13 · in Show HN: Faster LLM evaluation with Bayesian optimization
  11. A link to a reddit post (with no discussion) which links to this repo https://github.com/confident-ai/deepeval
    comment by squigz · 2023-12-13 · in I implemented 12+ LLM evaluation metrics so you don't have to
  12. ▲ 22
    Show HN: I implemented evals metrics for LLMs that runs locally on your machine
    story by 3d27 · 2023-12-11 · 3 comments
  13. ▲ 6
    Show HN: DeepEval – Unit Testing for LLMs (Open Science)
    story by jacky2wong · 2023-10-06 · 0 comments
  14. ▲ 18
    Show HN: DeepEval – Evaluation and Unit Testing for LLMs
    story by jacky2wong · 2023-09-25 · 8 comments
  15. ▲ 2
    DeepEval – Neural Framework for Testing LLMs
    story by jacky2wong · 2023-08-29 · 0 comments
  16. …to OpenAI enterprise and ensure consistency results - would recommend checking the open source repo https://github.com/confident-ai/deepeval
    comment by jacky2wong · 2023-08-29 · in ChatGPT Enterprise
  17. ▲ 2
    Unit Testing for Rag
    story by jacky2wong · 2023-08-28 · 0 comments
  18. ▲ 2
    DeepEval CLI
    story by jacky2wong · 2023-08-27 · 0 comments
  19. …or even your own internal framework. The idea is you would use our open source package ( https://github.com/confident-ai/deepeval ) to evaluate LLM outputs using criteria such as factual consistency, relevancy, bias, etc, and be able to…
    comment by jipster · 2023-08-25
  20. ▲ 79
    DeepEval – Unit Testing for LLMs
    story by jacky2wong · 2023-08-17 · 31 comments
  21. ▲ 2
    DeepEval – PyTest for LLMs
    story by jacky2wong · 2023-08-16 · 1 comment
  22. ▲ 3
    PyTest for LLMs
    story by jacky2wong · 2023-08-15 · 0 comments