elixir-broadway/broadway
View on GitHub ↗ ★ 2,692 Elixir
Concurrent and multi-stage data ingestion and data processing with Elixir
4 mentions on Hacker News by 4 people: 0 stories, 4 comments · first 2020-09-07 · latest 2023-11-10
20082026
-
…But it's not the only solution, as you have other tools dedicated to processing, such as Broadway ( https://github.com/dashbitco/broadway ), which handles back-pressure, fault-tolerance, batching etc natively. You also have more simple…
comment by thibaut_barrere · 2023-11-10 · in Switching to Elixir -
…https://hexdocs.pm/gen_stage/GenStage.html and these additional abstactions are built on top of it: - https://github.com/dashbitco/broadway - https://github.com/dashbitco/flow
comment by dugmartin · 2021-12-01 · in Backpressure – the resisted flow of data through software -
Also of note is Broadway ( https://github.com/dashbitco/broadway ) "Comparison to Flow You may also be interested in Flow by Dashbit. Both Broadway and Flow are built on top of GenStage. Flow is a more general abstraction than Broadway…
comment by jeremy_k · 2020-09-12 · in Changelog for Elixir v1.11 -
…such as read from a queue, do some processing and publish to s3, I can recommend Broadway https://github.com/dashbitco/broadway I have seen lots of codebases in lots of languages do this type of task, but aside from maybe spark on the high…
comment by anko · 2020-09-07 · in Elixir Is Erlang, not Ruby