Hacker GitHub

← All repos

redpanda-data/connect

View on GitHub ↗ ★ 8,792 Go

Fancy stream processing made operationally mundane

19 mentions on Hacker News by 9 people: 5 stories, 14 comments · first 2018-05-01 · latest 2025-05-01

Mentions per year 19 mentions · busiest year 2022 (7)
20082026
AllStoriesComments NewestTopOldest
  1. …connect / warpstream bento (depending on your license needs). Both came out of what was benthos. https://github.com/redpanda-data/connect https://github.com/warpstreamlabs/bento
    comment by caust1c · 2025-05-01 · in Fivetran to acquire Census
  2. Its a rust port of Redpanda Connect (benthos), but with less connectors https://github.com/redpanda-data/connect
    comment by rockwotj · 2025-04-29 · in ArkFlow: High-performance Rust stream processing engine
  3. …(formerly benthos) recently added support for Postgres CDC [1] and MySQL is coming soon too [2]. 1: https://github.com/redpanda-data/connect/pull/2917 2: https://github.com/redpanda-data/connect/pull/3014
    comment by rockwotj · 2025-01-03 · in Kuvasz-streamer: open-source CDC for Postgres for low latency replication
  4. …In addition, it is also developed using Go - https://docs.redpanda.com/redpanda-connect/home/ - https://github.com/redpanda-data/connect
    comment by havef · 2024-12-18 · in Show HN: I built an open-source data pipeline tool in Go
  5. …file under the Redpanda Community" appears in the two RCL-licensed connectors as listed on the web site: github.com/redpanda-data/connect/v4@v4.28.0/internal/impl/snowflake/output_snowflake_put.go github.com/redpanda-data/connect/v4@v4.28.0…
    comment by olgeni · 2024-06-01 · in Bento: Open-source fork of the project formerly known as Benthos
  6. …the top. These are all MIT and bit-for-bit identical to the now-proprietary plugins: - Splunk HEC: https://github.com/redpanda-data/connect/blob/e653dc3f8a6eee... - Snowflake: https://github.com/redpanda-data/connect/blob/e653dc3f8a6eee...…
    comment by xyzzy_plugh · 2024-06-01 · in Bento: Open-source fork of the project formerly known as Benthos
  7. …and 3rd party plugins can live in other people's repos and have various licenses, one example being https://github.com/redpanda-data/connect . I'm 100% committed to keep contributing to Benthos as long as it remains free and open source…
    comment by mihaitodor · 2024-05-31 · in Bento: Open-source fork of the project formerly known as Benthos
  8. Benthos just adopted it: https://github.com/benthosdev/benthos/commit/ee0000450413ad3...
    comment by mihaitodor · 2023-08-22 · in Structured logging with slog
  9. Some history here https://github.com/benthosdev/benthos/issues/1184#issuecomme... but the TL; DR version is that the client library has caused a bit of friction in the past. They had several releases where one of its dependencies produced…
    comment by mihaitodor · 2022-11-24 · in Show HN: Benthos Studio – A modern take on Yahoo Pipes
  10. It was called Benthos from the very first commit (Aug 25th, 2015): https://github.com/benthosdev/benthos/commit/e4933adf7c07460... LE: I should've mentioned that the official mascot is called The Benthos Blobfish:…
    comment by mihaitodor · 2022-11-24 · in Show HN: Benthos Studio – A modern take on Yahoo Pipes
  11. …Also, if you'd like to use it outside of Benthos, you can import it as a library: https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/... Since I mentioned importing Bloblang as a library, you can import the entire Benthos…
    comment by mihaitodor · 2022-11-23 · in Show HN: Benthos Studio – A modern take on Yahoo Pipes
  12. Which ones would you need? Happy to add more to Benthos. Feel free to open issues here: https://github.com/benthosdev/benthos/issues
    comment by mihaitodor · 2022-11-23 · in Show HN: Benthos Studio – A modern take on Yahoo Pipes
  13. ▲ 2
    Benthos – stream processing framework written in Golang
    story by mihaitodor · 2022-11-12 · 0 comments
  14. ▲ 3
    Show HN: Benthos v4.0.0
    story by mihaitodor · 2022-04-26 · 0 comments
  15. If anyone would like to contribute to a Go data streaming processor, have a look at https://github.com/benthosdev/benthos . There are a few of us adding bits and pieces to it and there’s a fun community on Discord / Slack:…
    comment by mihaitodor · 2022-04-02 · in Ask HN: Who wants to collaborate? (April 2022)
  16. …again whilst blocking upstream. You might also be interested in running Benthos in streams mode: https://github.com/Jeffail/benthos/tree/master/docs/streams Streams mode lets you run as many isolated stream pipelines as you want in the…
    comment by jeffail · 2018-08-16 · in A dull, resilient stream processor in Go
  17. ▲ 199
    A dull, resilient stream processor in Go
    story by ngaut · 2018-08-16 · 30 comments
  18. ▲ 14
    Benthos: A quick to deploy, easy to monitor stream processor
    story by sansblob · 2018-07-09 · 0 comments
  19. ▲ 1
    Show HN: Benthos, stream multiplexer and processing service
    story by jeffail · 2018-05-01 · 0 comments