uptrain-ai/uptrain

View on GitHub ↗ ★ 2,368 Python

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

10 mentions on Hacker News by 4 people: 8 stories, 2 comments · first 2023-01-25 · latest 2024-09-10

Mentions per year 10 mentions · busiest year 2023 (7)

20082026

All Stories Comments Newest Top Oldest

…maintainers of UpTrain, and we recently integrated the SPADE framework into our open-source repo ( https://github.com/uptrain-ai/uptrain/ ). The idea is simple: 1. Provide your prompt template 2. We use the SPADE framework to identify…
comment by sourabh03agr · 2024-01-23 · in Integrating Spade: Synthesizing Assertions for LLMs into My OSS Project
…We have illustrated this in some of our examples, such as the human orientation classification: https://github.com/uptrain-ai/uptrain/blob/main/examples/hum...
comment by vvipgupta · 2023-03-08 · in Launch HN: UpTrain (YC W23) – Open-source performance monitoring for ML models