Hacker GitHub

← All repos

robertvacareanu/llm4regression

View on GitHub ↗ ★ 161 Python

Examining how large language models (LLMs) perform across various synthetic regression tasks when given (input, output) examples in their context, without any parameter update

5 mentions on Hacker News by 2 people: 0 stories, 5 comments · first 2024-04-13 · latest 2024-04-16

Mentions per year 5 mentions · busiest year 2024 (5)
20082026
AllStoriesComments NewestTopOldest
  1. …variables). The models still perform reasonably well. All results can be seen in this heatmap: https://github.com/robertvacareanu/llm4regression/blob/main/...
    comment by rvacareanu · 2024-04-16 · in Your LLM Is a Capable Regressor When Given In-Context Examples
  2. …other metrics, the output of the models and code examples for how to read them are available at: https://github.com/robertvacareanu/llm4regression/tree/main/... For example, slightly adapting the code from the `README.md` for re-creating a…
    comment by rvacareanu · 2024-04-16 · in Your LLM Is a Capable Regressor When Given In-Context Examples
  3. Code is available at: https://github.com/robertvacareanu/llm4regression I also added google colab examples: A small example with GPT-4: https://colab.research.google.com/drive/1Bk9uBCBvzuX00Rex-t1... A small scale eval with GPT-4:…
    comment by rvacareanu · 2024-04-16 · in Your LLM Is a Capable Regressor When Given In-Context Examples
  4. https://github.com/robertvacareanu/llm4regression
    comment by kvee · 2024-04-13 · in Your LLM Is a Capable Regressor When Given In-Context Examples
  5. Chat examples with GPT-4: https://github.com/robertvacareanu/llm4regression/tree/main/... (the experiments used the API though) For example, for Friedman #1, GPT-4 predicts 12.89 while the true value is 11.69 (…
    comment by rvacareanu · 2024-04-13 · in Your LLM Is a Capable Regressor When Given In-Context Examples