Hacker GitHub

← All repos

facebookresearch/xformers

View on GitHub ↗ ★ 10,575 Python

Hackable and optimized Transformers building blocks, supporting a composable construction.

5 mentions on Hacker News by 5 people: 0 stories, 5 comments · first 2022-11-24 · latest 2024-06-17

Mentions per year 5 mentions · busiest year 2022 (2)
20082026
AllStoriesComments NewestTopOldest
  1. …by Meta for the first year of Xformers ( https://github.com/huggingface/diffusers/issues/2234 ) ( https://github.com/facebookresearch/xformers/issues/517#issu... ). This is the developer ecosystem at work. AMD right now is forced to put in…
    comment by cepth · 2024-06-17 · in An interview with AMD CEO Lisa Su about solving hard problems
  2. …xformers. The team replied saying it should happen this week. See the relevant Github issue here: https://github.com/facebookresearch/xformers/issues/795
    comment by hunkins · 2023-07-17 · in FlashAttention-2, 2x faster than FlashAttention
  3. …cluster and research scientists to help you with the preprocessing and model pipelines. [1] https://github.com/facebookresearch/xformers [2] https://lambdalabs.com/service/gpu-cloud edit: these costs are for the 65B parameter model.
    comment by causalmodels · 2023-02-24 · in LLaMA: A foundational, 65B-parameter large language model
  4. …modern transformer models. Flash Attention can currently scale up to 64,000 tokens on an A100. [1] https://github.com/facebookresearch/xformers/blob/main/HOWTO... [2] https://github.com/HazyResearch/flash-attention
    comment by nl · 2022-12-06 · in Turing Machines Are Recurrent Neural Networks (1996)
  5. …docs... to be continued. [1] https://developer.nvidia.com/cuda-downloads?target_os=Linux&... [2] https://github.com/facebookresearch/xformers
    comment by acidburnNSA · 2022-11-24 · in Stable Diffusion 2.0