Hacker GitHub

← All repos

etcd-io/etcd

View on GitHub ↗ ★ 52,439 Go

Distributed reliable key-value store for the most critical data of a distributed system

110 mentions on Hacker News by 79 people: 9 stories, 101 comments · first 2013-07-31 · latest 2024-11-28

Mentions per year 110 mentions · busiest year 2015 (20)
20082026
AllStoriesComments NewestTopOldest
  1. > https://github.com/etcd-io/etcd/issues/9771 > stale bot marked this as completed (by fucking closing it) Ah, yes, what would a Kubernetes-adjacent project be without a fucking stale bot to close issues willy nilly
    comment by mdaniel · 2024-11-28 · in I Stopped Using Kubernetes. Our DevOps Team Is Happier Than Ever
  2. …warning. It is strongly recommended as the upper limit. https://www.perfectscale.io/blog/etcd-8gb https://github.com/etcd-io/etcd/issues/9771 And yes, I agree not allowing a pluggable replacement is really stupid.
    comment by lenkite · 2024-11-27 · in I Stopped Using Kubernetes. Our DevOps Team Is Happier Than Ever
  3. Look at the code for the watcher client[1] and lease management[2]. [1]: https://github.com/etcd-io/etcd/blob/main/client/v3/watch.go [2]: https://github.com/etcd-io/etcd/blob/main/client/v3/lease.go
    comment by jhgg · 2024-08-08 · in Jepsen: Jetcd 0.8.2
  4. …status unavailable will be retried [6]. Unlike jetcd, the Go client’s retry behavior is safe. [1] https://github.com/etcd-io/etcd/blob/main/client/v3/kv.go#L9... [2] https://github.com/etcd-io/etcd/blob/main/client/v3/retry.go... [3]…
    comment by silverlyra · 2024-08-08 · in Jepsen: Jetcd 0.8.2
  5. …so hard to follow? it's quite literally just the implementation of the GRPC interface [1]. [1] https://github.com/etcd-io/etcd/blob/main/client/v3/kv.go#L3...
    comment by tjungblut · 2024-08-08 · in Jepsen: Jetcd 0.8.2
  6. Thanks! Could you please point me to a reference for (1) etcd/wal actually does do preallocations ( https://github.com/etcd-io/etcd/blob/24e05998c68f481af2bd567... ) Yet to implement max buffer age! Any references for this would be bomb!…
    comment by stym06 · 2024-07-09 · in Show HN: WAL Implementation in Golang
  7. …I miss it or is there no call to os.File.Sync(), i.e. fsync, anywhere? Since you mention etcd/wal: https://github.com/etcd-io/etcd/blob/v3.3.27/wal/wal.go#L671 https://github.com/etcd-io/etcd/blob/v3.3.27/pkg/fileutil/sy...
    comment by eatonphil · 2024-07-08 · in Show HN: WAL Implementation in Golang
  8. This is essentially do-it-yourself etcd. https://github.com/etcd-io/etcd
    comment by siftrics · 2023-05-25 · in Implementing a distributed key-value store on top of implementing Raft in Go
  9. Reminded me of etcd, which is exactly this - Raft-based key-value store written in Go. https://github.com/etcd-io/etcd
    comment by roncesvalles · 2023-05-25 · in Implementing a distributed key-value store on top of implementing Raft in Go
  10. I am not sure neither. But this might overcome the etcd's soft storage limit of 8GB? [1] [1] https://github.com/etcd-io/etcd/issues/9771
    comment by kbumsik · 2023-05-07 · in RedisRaft
  11. …not recommended for production => https://groups.google.com/a/kubernetes.io/g/dev/c/B7gJs88XtQ... https://github.com/etcd-io/etcd/issues/13766#issuecomment-10...
    comment by tuananh · 2022-08-29 · in Acorn: A simple application deployment framework for Kubernetes
  12. ▲ 2
    Etcd v3.5 Data inconsistency postmortem
    story by ngaut · 2022-05-06 · 0 comments
  13. ▲ 1
    Etcd v3.5 data inconsistency postmortem
    story by suhailpatel · 2022-04-25 · 0 comments
  14. …but had transactions with stable snapshots. It was used by https://github.com/blevesearch/bleve , https://github.com/etcd-io/etcd , and number of other projects. These days, https://github.com/dgraph-io/badger is often favored because of…
    comment by Xeoncross · 2022-04-01 · in A database for 2022
  15. …where etcd’s logger was calculating log size and suffering from a performance issue as a result: https://github.com/etcd-io/etcd/issues/12835
    comment by ec109685 · 2021-06-20 · in Designing a better strcpy
  16. …incredible to me that anyone still believes Google has a large say in CNCF projects. [1] https://github.com/etcd-io/etcd/graphs/contributors
    comment by 013a · 2020-07-14 · in Etcd, or, why modern software makes me sad
  17. …and it is not like afterthought long polling. For example, whole etcd API is located at https://github.com/etcd-io/etcd/blob/4c6881ffe4b3bae257c0720... It is pretty straightforward and not too hard to understand the API. Designing APIs…
    comment by sercand · 2020-07-14 · in Etcd, or, why modern software makes me sad
  18. First of all etcd API is still available on a JSON interface. https://github.com/etcd-io/etcd/blob/master/Documentation/de... and some historical discussion here: https://github.com/etcd-io/etcd/issues/1980 Many reasons to switch from JSON…
    comment by alpb · 2020-07-14 · in Etcd, or, why modern software makes me sad
  19. FWIW, CockroachDB uses and co-maintains etcd/raft not hashicorp/raft. https://github.com/etcd-io/etcd/tree/master/raft#raft-librar... Users: - cockroachdb A Scalable, Survivable, Strongly-Consistent SQL Database - dgraph A Scalable,…
    comment by philips · 2020-05-09 · in In Search of an Understandable Consensus Algorithm (2014) [pdf]
  20. Nope. It's because protobufs can't differentiate between nil/unset and a zero value in this field: https://github.com/etcd-io/etcd/blob/53f15caf73b9285d6043009...
    comment by lvh · 2020-01-30 · in Jepsen: Etcd 3.4.3
  21. …be able to cache it's entire working set in memory. https://etcd.io/docs/v3.3.12/dev-guide/limit/ https://github.com/etcd-io/etcd/blob/master/Documentation/op... TiKV, a distributed kv store that can store many terabytes of data, actually…
    comment by gregwebs · 2020-01-30 · in Jepsen: Etcd 3.4.3
  22. …the second sibling txn child uses that something. I've found that implementation is lacking. 0 - https://github.com/etcd-io/etcd/blob/53f15caf73b9285d6043009...
    comment by kodablah · 2020-01-30 · in Jepsen: Etcd 3.4.3
  23. …that use etcd's raft libraries but build more application focused (SQL, graphql, etc) APIs[2]. [1]: https://github.com/etcd-io/etcd/blob/master/Documentation/in... [2]: https://github.com/etcd-io/etcd/tree/master/raft#notable-use...
    comment by philips · 2020-01-30 · in Jepsen: Etcd 3.4.3
  24. ▲ 2
    Etcd 3.4 Released
    story by longdeqidao · 2019-08-30 · 0 comments
  25. It's sort of like a SQL version of etcd, so maybe some of the use cases for etcd would be similar: https://github.com/etcd-io/etcd/blob/master/Documentation/pr...
    comment by tyingq · 2019-08-30 · in Dqlite – High-Availability SQLite
  26. …not sure that we can conclude from your results that go has gc problems when the heap is large. [1] https://github.com/etcd-io/etcd/blob/master/Documentation/op...
    comment by todd8 · 2019-06-18 · in Go Creeping In
  27. …node etcd process into Kubernetes using the embed package instead of introducing sqlite. https://godoc.org/github.com/etcd-io/etcd/embed This is something the Kubernetes community might consider as well.
    comment by philips · 2019-02-27 · in K3s – Lightweight Kubernetes
  28. …node etcd process into Kubernetes using the embed package instead of introducing sqlite. https://godoc.org/github.com/etcd-io/etcd/embed This is something the Kubernetes community might consider as well.
    comment by philips · 2019-02-27 · in K3s – Lightweight Kubernetes
  29. …there are several details to take care of. Edit: There is a great raft implementation in go ( https://github.com/etcd-io/etcd ).
    comment by AlexITC · 2019-01-03 · in Recommendations for a Paxos consensus protocol implementation in Golang
  30. Woah! I would love to get this testimonial in our production users doc! https://github.com/etcd-io/etcd/blob/master/Documentation/pr...
    comment by philips · 2018-12-15 · in Red Hat contributes etcd to the Cloud Native Computing Foundation
  31. …For a sense of all of the projects that use checkout this list we maintain in the project: https://github.com/etcd-io/etcd/blob/master/Documentation/in... Some notable projects include: Kubernetes, Rook, CoreDNS, Uber M3, Trillian, Vitess,…
    comment by philips · 2018-12-14 · in Red Hat contributes etcd to the Cloud Native Computing Foundation
  32. https://github.com/etcd-io/etcd
    comment by YZF · 2018-11-10 · in Nine years of Go
  33. …https://github.com/kubernetes/kubernetes/search?q=%22if+err+... https://github.com/coreos/etcd/search?q=%22return+err%22&uns... https://github.com/influxdata/influxdb/search?q=%22if+err+%2... The reality of Go's error hand
    comment by rco8786 · 2018-08-16 · in Exploring Error Handling Patterns in Go
  34. That is the process: https://github.com/coreos/etcd/blob/master/Documentation/upg... for i in members Replace etcd binary Restart etcd process
    comment by philips · 2018-07-06 · in The Horrors of Upgrading Etcd Beneath Kubernetes
  35. …recommendations are made based on things that have been tested. The documentation is all here: https://github.com/coreos/etcd/tree/master/Documentation/upg... 2) Live etcd v2 API -> etcd v3 API migration for Kubernetes was never a priority…
    comment by philips · 2018-07-06 · in The Horrors of Upgrading Etcd Beneath Kubernetes
  36. …or bdb seem like the obvious alternatives). I was able to find this analysis they did in 2015: https://github.com/coreos/etcd/issues/2646 . On the face of it, it feels like using a more established an well tested database would have been a…
    comment by calpaterson · 2018-02-03 · in Etcd 3.3 – Improvements to stability, performance, and more
  37. …However, it's recommended to migrate the failed node's data first if it's greater than 50MB: https://github.com/coreos/etcd/blob/master/Documentation/op-...
    comment by justingood · 2018-01-19 · in Scaling Kubernetes to 2,500 Nodes
  38. …etcd raft tests in the link below, you probably need to port them to work with your raft library. https://github.com/coreos/etcd/tree/master/raft
    comment by dis-sys · 2017-07-09 · in In Search of an Understandable Consensus Algorithm [pdf]
  39. How about etcd? https://github.com/coreos/etcd
    comment by dansman · 2017-06-01 · in Ask HN: Good Go codebases to read?
  40. There is some overlapping. But we should choose solution wisely :P. Here is a doc [ https://github.com/coreos/etcd/blob/master/Documentation/lea... ] comparing etcd with other systems, including CockroachDB. I work on etcd.
    comment by ideal0227 · 2017-05-20 · in Introducing zetcd
  41. …key replication is useful and we offer it as a userspace external tool called make-mirror[1]. [1] https://github.com/coreos/etcd/blob/master/etcdctl/README.md...
    comment by philips · 2017-05-20 · in Introducing zetcd
  42. …after-thought tool could have just dropped a mapping line in a .gotool file somewhere: $ go get whois etcd github.com/coreos/etcd But no. We need to put that in every freaking file and thus transit from information to noise .
    comment by eternalban · 2017-03-22 · in How I Start: Go (2014)
  43. …few characters. It is a conflation of logical identity (URI) with location (URL). Engineering 101. https://github.com/coreos/etcd/blob/master/lease/leasehttp/h... What could possibly justify having to use that import line in a sibling…
    comment by eternalban · 2017-03-22 · in How I Start: Go (2014)
  44. Etcd used this scheme to provide fast reads but Aphyr demonstrated that it may lead to stale reads https://github.com/coreos/etcd/issues/741 . If you can't afford stale reads then you should ask Etcd to wait for confirmation from the…
    comment by rystsov · 2017-03-17 · in In search of a simple consensus algorithm
  45. …the read value is up-to-date then the living master is necessary. Etcd has a bug related to this - https://github.com/coreos/etcd/issues/741
    comment by rystsov · 2017-03-17 · in In search of a simple consensus algorithm
  46. …a native HTTP API. I suspect you still use v2 API. You need the gateway to make v3 works with HTTP: https://github.com/coreos/etcd/blob/master/Documentation/dev... But that might impact performance quite bit depending on your workload.
    comment by ideal0227 · 2017-03-09 · in Bizur: A Key-Value Consensus Algorithm for Scalable File-Systems
  47. …option which makes reads go through the Raft consensus algorithm archiving linearizability see https://github.com/coreos/etcd/issues/741
    comment by rystsov · 2017-03-09 · in Bizur: A Key-Value Consensus Algorithm for Scalable File-Systems
  48. etcd3 provides a HTTP+JSON API as a gateway: https://github.com/coreos/etcd/blob/master/Documentation/dev... . There are users we know successfully using it. If users are unhappy about the HTTP API, or it is too hard to use, we might…
    comment by ideal0227 · 2017-01-22 · in Announcing etcd 3.1
  49. …optimized for small amounts of data [2] v3 made progress on both of these fronts but see [3][4] [1] https://github.com/coreos/etcd/issues/2647 [2] https://groups.google.com/forum/#!searchin/etcd-dev/store/et... [3]…
    comment by niftich · 2017-01-21 · in Announcing etcd 3.1
  50. …kv store/locking mechanism? If so, what were the pros/cons of each and what lead you to consul? [0] https://github.com/coreos/etcd [1] https://github.com/coreos/etcd/tree/master/client
    comment by slap_shot · 2016-12-28 · in Distributed Locks with Consul and Golang