Hacker GitHub

← All repos

ianarawjo/ChainForge

View on GitHub ↗ ★ 3,040 TypeScript

An open-source visual programming environment for battle-testing prompts to LLMs.

15 mentions on Hacker News by 6 people: 6 stories, 9 comments · first 2023-05-23 · latest 2025-03-27

Mentions per year 15 mentions · busiest year 2023 (13)
20082026
AllStoriesComments NewestTopOldest
  1. …promptfoo: https://github.com/promptfoo/promptfoo ChainForge: https://github.com/ianarawjo/ChainForge LocalAI: https://github.com/go-skynet/LocalAI
    comment by westurner · 2024-06-30 · in Chrome is adding `window.ai` – a Gemini Nano AI model right inside the browser
  2. This seems like a sheets implementation of something like ChainForge ( https://github.com/ianarawjo/ChainForge ). It's curious that Anthropic is entering the LLMOps tooling space ---this definitely comes as a surprise to me, as both OpenAI…
    comment by fatso784 · 2023-12-12 · in Claude for Google Sheets
  3. This seems like a sheets implementation of something like ChainForge ( https://github.com/ianarawjo/ChainForge ). It's curious that Anthropic is entering the LLMOps tooling space ---this definitely comes as a surprise to me, as both OpenAI…
    comment by fatso784 · 2023-12-11 · in Anthropic Claude for Google Sheets
  4. …with code, LLM scorers, etc. It also shows model responses side-by-side for the same prompt: https://github.com/ianarawjo/ChainForge
    comment by fatso784 · 2023-09-11 · in Asking 60 LLMs a set of 20 questions
  5. ChainForge has similar functionality for comparing : https://github.com/ianarawjo/ChainForge LocalAI creates a GPT-compatible HTTP API for local LLMs: https://github.com/go-skynet/LocalAI Is it necessary to have an HTTP API for each model…
    comment by westurner · 2023-09-09 · in Asking 60 LLMs a set of 20 questions
  6. …https://github.com/promptfoo/promptfoo Newly added: https://promptlayer.com https://promptable.ai/ https://github.com/ianarawjo/ChainForge https://trywale.com/ https://promptknit.com/ https://promptrefine.com/ https://www.vellum.ai/…
    comment by tikkun · 2023-08-08 · in Show HN: Knit – A Better LLM Playground
  7. …for the parameterised queries, as well as comparisons across models. Thanks for your efforts! 0: https://github.com/ianarawjo/ChainForge
    comment by _puk · 2023-08-07 · in Show HN: ChainForge, a visual tool for prompt engineering and LLM evaluation
  8. …templating, evaluating responses with Python/JS code and LLM scorers, plotting responses, etc ( https://github.com/ianarawjo/ChainForge and a playground at http://chainforge.ai ). One big problem we're seeing in this space is over-trust in…
    comment by fatso784 · 2023-08-01 · in Show HN: PromptTools – open-source tools for evaluating LLMs and vector DBs
  9. …I will make a plug myself --we've been working on a similar 'prompt engineering' tool, ChainForge ( https://github.com/ianarawjo/ChainForge ). It's targeted towards slightly different users and use cases than promptfoo --geared more…
    comment by fatso784 · 2023-07-11 · in GPT-Prompt-Engineer