Hacker GitHub

← All repos

redpanda-data/connect

View on GitHub ↗ ★ 8,792 Go

Fancy stream processing made operationally mundane

19 mentions on Hacker News by 9 people: 5 stories, 14 comments · first 2018-05-01 · latest 2025-05-01

Mentions per year 19 mentions · busiest year 2022 (7)
20082026
  1. …connect / warpstream bento (depending on your license needs). Both came out of what was benthos. https://github.com/redpanda-data/connect https://github.com/warpstreamlabs/bento
    comment by caust1c · 2025-05-01 · in Fivetran to acquire Census
  2. Its a rust port of Redpanda Connect (benthos), but with less connectors https://github.com/redpanda-data/connect
  3. …(formerly benthos) recently added support for Postgres CDC [1] and MySQL is coming soon too [2]. 1: https://github.com/redpanda-data/connect/pull/2917 2: https://github.com/redpanda-data/connect/pull/3014
  4. …In addition, it is also developed using Go - https://docs.redpanda.com/redpanda-connect/home/ - https://github.com/redpanda-data/connect
  5. …file under the Redpanda Community" appears in the two RCL-licensed connectors as listed on the web site: github.com/redpanda-data/connect/v4@v4.28.0/internal/impl/snowflake/output_snowflake_put.go github.com/redpanda-data/connect/v4@v4.28.0…
  6. …the top. These are all MIT and bit-for-bit identical to the now-proprietary plugins: - Splunk HEC: https://github.com/redpanda-data/connect/blob/e653dc3f8a6eee... - Snowflake: https://github.com/redpanda-data/connect/blob/e653dc3f8a6eee...…
  7. …and 3rd party plugins can live in other people's repos and have various licenses, one example being https://github.com/redpanda-data/connect . I'm 100% committed to keep contributing to Benthos as long as it remains free and open source…
  8. Benthos just adopted it: https://github.com/benthosdev/benthos/commit/ee0000450413ad3...
    comment by mihaitodor · 2023-08-22 · in Structured logging with slog
  9. Some history here https://github.com/benthosdev/benthos/issues/1184#issuecomme... but the TL; DR version is that the client library has caused a bit of friction in the past. They had several releases where one of its dependencies produced…
  10. It was called Benthos from the very first commit (Aug 25th, 2015): https://github.com/benthosdev/benthos/commit/e4933adf7c07460... LE: I should've mentioned that the official mascot is called The Benthos Blobfish:…
  11. …Also, if you'd like to use it outside of Benthos, you can import it as a library: https://pkg.go.dev/github.com/benthosdev/benthos/v4@v4.10.0/... Since I mentioned importing Bloblang as a library, you can import the entire Benthos…
  12. Which ones would you need? Happy to add more to Benthos. Feel free to open issues here: https://github.com/benthosdev/benthos/issues
  13. If anyone would like to contribute to a Go data streaming processor, have a look at https://github.com/benthosdev/benthos . There are a few of us adding bits and pieces to it and there’s a fun community on Discord / Slack:…
  14. …again whilst blocking upstream. You might also be interested in running Benthos in streams mode: https://github.com/Jeffail/benthos/tree/master/docs/streams Streams mode lets you run as many isolated stream pipelines as you want in the…
    comment by jeffail · 2018-08-16 · in A dull, resilient stream processor in Go