Hacker GitHub

← All repos

minosvasilias/godot-dodo

View on GitHub ↗ ★ 576 Python

Finetuning large language models for GDScript generation.

7 mentions on Hacker News by 4 people: 1 story, 6 comments · first 2023-04-23 · latest 2023-08-24

Mentions per year 7 mentions · busiest year 2023 (7)
20082026
AllStoriesComments NewestTopOldest
  1. …was a similar attempt for Godot script trained a few months ago, and its reportedly pretty good: https://github.com/minosvasilias/godot-dodo I think more attempts havent been made because base llama is not that great at coding in general,…
    comment by brucethemoose2 · 2023-08-24 · in Code Llama, a state-of-the-art large language model for coding
  2. This a continuation of previous work done in the godot-dodo project ( https://github.com/minosvasilias/godot-dodo ), which involved finetuning LLaMA models on GitHub-scraped GDScript code. Starcoder performs significantly better than LLaMA…
    comment by minosu · 2023-05-26 · in Godot-Dodo – Finetuning starcoder on single-language instruction data
  3. The wrapping prompt is also used during inference. ( https://github.com/minosvasilias/godot-dodo/blob/f62b90a4622... ) Prompting like this is useful for instruct-finetunes, and similar prompts are used by other projects like…
    comment by minosu · 2023-04-24 · in Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
  4. On this page: https://github.com/minosvasilias/godot-dodo/tree/main/models It seems that some of the GPT syntax errors appear to be because the models were trained for Godot 3, but the tests were conducted against Godot 4, hence the error…
    comment by omoikane · 2023-04-23 · in Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
  5. …is the training dataset that contains instructions and output wrapped by another enclosing prompt ( https://github.com/minosvasilias/godot-dodo/blob/f62b90a4622... ) Why does this even work when during inference this wrapping prompt is…
    comment by the_tli · 2023-04-23 · in Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
  6. …following complex instructions. A comprehensive evaluation comparing all models can be found here: https://github.com/minosvasilias/godot-dodo/tree/main/models
    comment by minosu · 2023-04-23 · in Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
  7. ▲ 132
    Godot-dodo – Finetuning LLaMA on single-language comment:code data pairs
    story by minosu · 2023-04-23 · 28 comments