uptrain-ai/uptrain
View on GitHub ↗ ★ 2,368 Python
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
10 mentions on Hacker News by 4 people: 8 stories, 2 comments · first 2023-01-25 · latest 2024-09-10
20082026
-
▲ 2
UpTrain is an open-source unified platform to evaluate and improve Gen AI appsstory by mafro · 2024-09-10 · 0 comments
-
…maintainers of UpTrain, and we recently integrated the SPADE framework into our open-source repo ( https://github.com/uptrain-ai/uptrain/ ). The idea is simple: 1. Provide your prompt template 2. We use the SPADE framework to identify…
comment by sourabh03agr · 2024-01-23 · in Integrating Spade: Synthesizing Assertions for LLMs into My OSS Project -
▲ 6
Integrating Spade: Synthesizing Assertions for LLMs into My OSS Projectstory by sourabh03agr · 2024-01-23 · 5 comments
-
▲ 3
Sharing learnings from evaluating Million+ LLM responsesstory by sourabh03agr · 2023-11-01 · 0 comments
-
▲ 12
Show HN: UpTrain (YC W23) – open-source tool to evaluate LLM response qualitystory by sourabh03agr · 2023-08-22 · 0 comments
-
▲ 4
Ask HN: Do we need 100B+ parameters in a large language model?story by sourabh03agr · 2023-04-03 · 1 comment
-
▲ 10
Show HN: UpTrain – A Practical Approach to Finetuning LLMs for Custom Use-Casesstory by vvipgupta · 2023-03-30 · 1 comment
-
…We have illustrated this in some of our examples, such as the human orientation classification: https://github.com/uptrain-ai/uptrain/blob/main/examples/hum...
comment by vvipgupta · 2023-03-08 · in Launch HN: UpTrain (YC W23) – Open-source performance monitoring for ML models -
▲ 138
Launch HN: UpTrain (YC W23) – Open-source performance monitoring for ML modelsstory by vvipgupta · 2023-03-08 · 31 comments
-
▲ 88
Show HN: UpTrain – Open-source ML observability and refinement toolstory by sourabh0394agr · 2023-01-25 · 14 comments