Hacker GitHub

← All repos

openai/human-eval

View on GitHub ↗ ★ 3,425 Python

Code for the paper "Evaluating Large Language Models Trained on Code"

3 mentions on Hacker News by 3 people: 0 stories, 3 comments · first 2021-07-08 · latest 2023-08-24

Mentions per year 3 mentions · busiest year 2021 (1)
20082026
AllStoriesComments NewestTopOldest
  1. …their performance on more domain-specific type tasks they might be used for in day-to-day work. [1] https://github.com/openai/human-eval [2] https://github.com/google-research/google-research/tree/mast...
    comment by andrewjl · 2023-08-24 · in Code Llama, a state-of-the-art large language model for coding
  2. …164 programming problems: https://arxiv.org/pdf/2107.03374.pdf (Section 2.2). The dataset is here: https://github.com/openai/human-eval
    comment by p1esk · 2022-07-24 · in A new way to predict when software jobs will become automated
  3. …powerful code generation technologies, covering safety, security, and economics. HumanEval: https://github.com/openai/human-eval
    comment by homarp · 2021-07-08 · in Evaluating Large Language Models Trained on Code (paper about GH copilot model)