Hacker GitHub

← All repos

GoogleCloudPlatform/vertex-ai-samples

View on GitHub ↗ ★ 796 Jupyter Notebook

Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.

5 mentions on Hacker News by 2 people: 1 story, 4 comments · first 2023-08-31 · latest 2024-09-24

Mentions per year 5 mentions · busiest year 2024 (4)
20082026
AllStoriesComments NewestTopOldest
  1. …is done on TPUs. There are good 1p [a] and 3p [b] benchmarks comparing TPUs vs NVIDIA GPUs. [a] - https://github.com/GoogleCloudPlatform/vertex-ai-samples/blo... [b] - https://arxiv.org/pdf/2309.07181
    comment by felarof · 2024-09-24 · in We fine-tuned Llama 405B on AMD GPUs
  2. Check out this benchmark where they did an analysis: https://github.com/GoogleCloudPlatform/vertex-ai-samples/blo... . At the bottom, it shows the calculations around the 30% cost efficiency of TPU vs GPU. Our range of 30-70% is based on…
    comment by felarof · 2024-09-11 · in Show HN: Tune LLaMa3.1 on Google Cloud TPUs
  3. 30% is a conservative estimate (to be precise, we went with this benchmark: https://github.com/GoogleCloudPlatform/vertex-ai-samples/blo... ). However, the actual difference we observe ranges from 30-70%. Also, calculating GPU costs is…
    comment by felarof · 2024-09-11 · in Show HN: Tune LLaMa3.1 on Google Cloud TPUs
  4. Google published this benchmark a year or so ago comparing TPU vs NVIDIA ( https://github.com/GoogleCloudPlatform/vertex-ai-samples/blo... ) Conclusion is at the bottom, but TLDR was TPUs were 33% cheaper (performance per dollar) and JAX…
    comment by felarof · 2024-09-11 · in Show HN: Tune LLaMa3.1 on Google Cloud TPUs
  5. ▲ 17
    Tune PaLM 2 with your own RLHF training data
    story by panarky · 2023-08-31 · 4 comments