Hacker GitHub

← All repos

mosaicml/llm-foundry

View on GitHub ↗ ★ 4,460 Python archived

LLM training code for Databricks foundation models

4 mentions on Hacker News by 4 people: 1 story, 3 comments · first 2023-05-05 · latest 2023-12-06

Mentions per year 4 mentions · busiest year 2023 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …it'd cost roughly the same as your quote. Cheaper I think if you're willing to gamble with fp8: https://github.com/mosaicml/llm-foundry/tree/main/scripts/tr... . And fewer hyperparameters to tune as well
    comment by float-trip · 2023-12-06 · in Fine-tuning Mistral 7B on Magic the Gathering Draft
  2. …for your summarization needs. If not, you can finetune it with MPT's code and summarization data. https://github.com/mosaicml/llm-foundry Or train OpenLLaMA 13B with SuperHOT + summarization data using QLORA.
    comment by brucethemoose2 · 2023-07-04 · in Fine Tuning Language Models
  3. The repo for training and finetuning this model is open source here: https://github.com/mosaicml/llm-foundry
    comment by ml_hardware · 2023-05-05 · in MosaicML MPT-7B: A Commercially-Usable LLaMa-Quality Model