glassroom/heinsen_sequence

Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)

3 mentions on Hacker News by 2 people: 0 stories, 3 comments · first 2023-12-07 · latest 2023-12-20

Mentions per year 3 mentions · busiest year 2023 (3)

20082026

All Stories Comments Newest Top Oldest

…:, i] * x + deltaB_u[:, :, i] ⋮ with only two calls to the PyTorch API. See the examples here: https://github.com/glassroom/heinsen_sequence/blob/main/READ... .[a] You can then compute all the y's with one einsum, instead of l sequential…
comment by cs702 · 2023-12-20 · in Implementation of Mamba in one file of PyTorch
…against the solution in the arxiv paper. ---- EDIT: ah, good, this is already being discussed here: https://github.com/glassroom/heinsen_sequence/issues/1 And, for reference, I learned this algorithm from Guy Blelloch; see Sec 1.4.1 of…
comment by shwestrick · 2023-12-07 · in Efficient parallelization of an ubiquitous sequential computation
…and it works. Not an expert on this, but I don't think I've ever seen that before. Have you? [a] https://github.com/glassroom/heinsen_sequence
comment by cs702 · 2023-12-07 · in Efficient parallelization of an ubiquitous sequential computation