Hacker GitHub

← All repos

kstenerud/concise-encoding

View on GitHub ↗ ★ 280 ANTLR

The secure data format for a modern world

66 mentions on Hacker News by 5 people: 5 stories, 61 comments · first 2018-06-08 · latest 2024-08-13

Mentions per year 66 mentions · busiest year 2020 (17)
20082026
AllStoriesComments NewestTopOldest
  1. …tps://marketplace.visualstudio.com/items?itemName=ksteneru... The binary format I wanted to describe: https://github.com/kstenerud/concise-encoding/blob/master/cb...
    comment by kstenerud · 2024-08-13 · in What you learn by making a new programming language
  2. …https://github.com/kstenerud/dogma/blob/master/v1/examples/m... - Concise Binary Encoding: https://github.com/kstenerud/concise-encoding/blob/master/cb... - Concise Text Encoding: https://github.com/kstenerud/concise-encoding/blob/master/ct…
    comment by kstenerud · 2024-03-24 · in Interval Parsing Grammars for File Format Parsing (2023) [pdf]
  3. Concise Encoding https://github.com/kstenerud/concise-encoding/ It's a specification for a family of data exchange formats with most complete feature list but little to no recognition
    comment by loa_in_ · 2024-03-08 · in Ask HN: What underrated open source project deserves more recognition?
  4. …a fair bit about timekeeping, because the context of what you're capturing becomes very important: https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2023-11-20 · in datetime.utcnow() is now deprecated
  5. This is basically why I ended up rolling my own text date format for Concise Encoding: - https://github.com/kstenerud/concise-encoding/blob/master/ct... - https://github.com/kstenerud/concise-encoding/blob/master/ce... e.g. 2019-8-5 //…
    comment by kstenerud · 2023-09-01 · in RFC 3339 vs. ISO 8601
  6. …your daytime job to that end. [1] https://dogma-lang.org/ [2] https://concise-encoding.org/ [3] https://github.com/kstenerud/concise-encoding/blob/master/cb... and https://github.com/kstenerud/concise-encoding/blob/master/ct...
    comment by kstenerud · 2023-05-01 · in Facing Imminent Homelessness, Gagoot Developer Seeks Project Funding
  7. …https://preserves.dev/preserves-binary.html Now the CBE formal description looks like this: https://github.com/kstenerud/concise-encoding/blob/master/cb... And the regular documentation looks like this:…
    comment by kstenerud · 2023-02-27 · in Ask HN: Please critique my metalanguage: “Dogma”
  8. …thinking "how hard could it be?" But it worked out and I have a formal description for it now: * https://github.com/kstenerud/concise-encoding/blob/master/cb... * https://github.com/kstenerud/concise-encoding/blob/master/ct... So it's…
    comment by kstenerud · 2023-02-26 · in Ask HN: Please critique my metalanguage: “Dogma”
  9. …taking the time to critique! I actually do have an ANTLR file that is about 90% of the way there ( https://github.com/kstenerud/concise-encoding/tree/master/an... ), so I could use those as a basis... One thing I'm not sure about is how to…
    comment by kstenerud · 2022-11-07 · in Keep ’em coming: Why your first ideas aren’t always the best
  10. …in the next few years as the more sophisticated actors start taking advantage of them. For example https://github.com/kstenerud/concise-encoding/blob/master/ce... There are still a few things to do: - Update enctool (…
    comment by kstenerud · 2022-07-11 · in Working in the software industry, circa 1989
  11. …I was never big on writing, but when I finally tried my hand at a data format specification ( https://github.com/kstenerud/concise-encoding ), I found that I really enjoyed the experience. It's 3000 lines and took me four years and…
    comment by kstenerud · 2022-07-11 · in Working in the software industry, circa 1989
  12. …is a grab bag!), but I'm not sure if removing BIDI could be done without breaking some languages? https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2022-06-19 · in Breaking our Latin-1 assumptions (2017)
  13. …than it looks), but in the end it became so much like herding cats that I had to just settle on https://github.com/kstenerud/concise-encoding/blob/master/ct... Basically allow everything except some separators, most control chars, and some…
    comment by kstenerud · 2022-06-19 · in Breaking our Latin-1 assumptions (2017)
  14. …a separate field in addition to the time field. I even added a write-up about time to the spec: https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2022-05-24 · in Concise Encoding: A secure data format for a modern world
  15. …types ;-) https://concise-encoding.org/ In particular: * How to deal with unrepresentable values: https://github.com/kstenerud/concise-encoding/blob/master/ce... * Mandatory limits and security considerations:…
    comment by kstenerud · 2022-01-24 · in I accidentally used YAML.parse instead of JSON.parse and it worked
  16. …don't have true time zones. It only uses UTC offsets, which are a bad idea for so many reasons. https://github.com/kstenerud/concise-encoding/blob/master/ce... > - Bin + txt: Again, I'm unclear on what you mean here, but ASN.1 has both…
    comment by kstenerud · 2022-01-04 · in Ask HN: Who wants to collaborate?
  17. …concern... There are actually a LOT of them, which I try to cover cover in the security section ( https://github.com/kstenerud/concise-encoding/blob/master/ce... ). The security space is of course wider and more nuanced than this, but I…
    comment by kstenerud · 2022-01-02 · in Ask HN: Who wants to collaborate?
  18. …before embarking on my venture. I listed the things I found important in the comparison matrix: https://github.com/kstenerud/concise-encoding#-compared-to-o... To your points: - Protobufs is not an ad-hoc format, which is a big reason why…
    comment by kstenerud · 2022-01-02 · in Ask HN: Who wants to collaborate?
  19. …I used to develop iOS apps. [1] https://developers.google.com/protocol-buffers/docs/referenc... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3] https://developers.google.com/protocol-buffers/docs/proto3#s... [4]…
    comment by no_circuit · 2022-01-02 · in Ask HN: Who wants to collaborate?
  20. Yes, it's included in the comparison matrix: https://github.com/kstenerud/concise-encoding#-compared-to-o...
    comment by kstenerud · 2022-01-01 · in Ask HN: Who wants to collaborate?
  21. …- Ideas for a schema. - Public outreach, championing online. [1] https://concise-encoding.org/ [2] https://github.com/kstenerud/concise-encoding [3] https://github.com/kstenerud/go-concise-encoding
    comment by kstenerud · 2022-01-01 · in Ask HN: Who wants to collaborate?
  22. …as "legacy formats" [2]. [1] https://en.wikipedia.org/wiki/Decimal64_floating-point_forma... [2] https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2021-12-17 · in Floating point numbers, and why they suck
  23. …format. [1] https://github.com/kstenerud/go-concise-encoding [2] https://concise-encoding.org/ [3] https://github.com/kstenerud/concise-encoding
    comment by kstenerud · 2021-11-20 · in Ask HN: What are you working on this weekend?
  24. …there aren't differences between implementations that can be exploited to compromise your system. https://github.com/kstenerud/concise-encoding/blob/master/ce... - Real type support because coercing everything into strings sucks (and is…
    comment by kstenerud · 2021-11-02 · in Ask HN: What you up to? (Who doesn't want to be hired?)
  25. This is where security and limits comes in: https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2021-10-24 · in RFC 3339 vs. ISO 8601
  26. This is the biggest reason why I had to develop a new time format for Concise Encoding :/ https://github.com/kstenerud/concise-encoding/blob/master/ce... https://github.com/kstenerud/concise-encoding/blob/master/ct... ISO 8601 and RFC 3339…
    comment by kstenerud · 2021-10-24 · in RFC 3339 vs. ISO 8601
  27. …through the beginning byte signature. I've actually put this into Concise Encoding [1] [1] https://github.com/kstenerud/concise-encoding/blob/master/cb...
    comment by kstenerud · 2021-06-25 · in The Base45 Data Encoding
  28. …through the beginning byte signature. I've actually put this into Concise Encoding [1] [1] https://github.com/kstenerud/concise-encoding/blob/master/cb...
    comment by kstenerud · 2021-06-25 · in The Base45 Data Encoding
  29. …in software engineering. [1] https://github.com/kstenerud/compact-time/blob/master/compac... [2] https://github.com/kstenerud/concise-encoding/blob/master/ct... and https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2021-06-08 · in TLS certificates have at least two internal representations of time
  30. …this has influenced my encoding design in [2] [3] [4]. [1] https://en.wikipedia.org/wiki/LEB128 [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3] https://github.com/kstenerud/compact-float/blob/master/compa... [4]…
    comment by kstenerud · 2021-05-08 · in The Byte Order Fiasco
  31. …make the spec easier to read. I use a superset of those keywords to give more precision in meaning: https://github.com/kstenerud/concise-encoding/blob/master/ce...
    comment by kstenerud · 2021-04-03 · in The Norway Problem
  32. …technologies! This is why I've been so anal about consistent decoder behavior in Concise Encoding https://github.com/kstenerud/concise-encoding/blob/master/ce... https://concise-encoding.org/
    comment by kstenerud · 2021-04-03 · in The Norway Problem
  33. …left in the first plane in case something big comes up in the future. You can see the chart here: https://github.com/kstenerud/concise-encoding/blob/master/cb...
    comment by kstenerud · 2021-03-23 · in FastDoubleParser: Java port of Daniel Lemires fast_double_parser
  34. …data bloat the spec and implementations. This is why I rejected iso-8601 and developed my own for https://github.com/kstenerud/concise-encoding/blob/master/ct... Examples: 2019-8-5 : August 5, 2019 -300-12-21 : December 21, 300 BC…
    comment by kstenerud · 2021-02-26 · in ISO 8601: a better date format
  35. …That's simply a limitation of the format. It's part of the reason I developed Concise Encoding: https://github.com/kstenerud/concise-encoding/#example which allows hex float notation when you need to be exact.
    comment by kstenerud · 2020-06-29 · in What Every Computer Scientist Should Know About Floating-Point Arithmetic (1991)
  36. …implementation (in go) is 90% complete, enough to marshal objects except for recursive support. https://github.com/kstenerud/concise-encoding/blob/master/RE...
    comment by kstenerud · 2020-06-21 · in FlexBuffers
  37. …implementation for a parallel binary/text ad-hoc data format in a similar vein to json & xml ( https://github.com/kstenerud/concise-encoding ). This is a precursor technology to an asynchronous, multiplexing request-response protocol I'm…
    comment by kstenerud · 2020-06-01 · in Ask HN: Who wants to be hired? (June 2020)
  38. I'd go fulltime on Concise Encoding ( https://github.com/kstenerud/concise-encoding/#concise-encod... ), a twin binary and text format for ad-hoc data. Progress on the reference implementation is MUCH slower with a day job.
    comment by kstenerud · 2020-05-25 · in Ask HN: What creative project do you pursue when your goal isn't to make money?
  39. …guesswork, no more bugs. [1] https://github.com/kstenerud/compact-time/blob/master/compac... [2] https://github.com/kstenerud/concise-encoding/blob/master/ct...
    comment by kstenerud · 2020-05-17 · in Some views on having your system timezone set to UTC
  40. …needed on a modern system. - Supports recursive data. - Future proof - Fully specified [2] [3] [1] https://github.com/kstenerud/concise-encoding/#concise-encod... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3]…
    comment by kstenerud · 2020-05-14 · in Ask HN: What's your quarantine side project?
  41. …I count 11 "shoulds" in [1] and 7 in [2], and I tried REALLY hard to keep them to a minimum :/ [1] https://github.com/kstenerud/concise-encoding/blob/master/ct... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb...
    comment by kstenerud · 2020-04-05 · in Must, Should, Don't Care: TCP Conformance in the Wild
  42. …up while I'm writing the reference implementation. Getting a spec right is a marathon affair. [1] https://github.com/kstenerud/concise-encoding/blob/master/ct...
    comment by kstenerud · 2020-04-04 · in Things Markdown got wrong
  43. There's a basic comparison here: https://github.com/kstenerud/concise-encoding#comparison-to-...
    comment by kstenerud · 2020-03-22 · in Ask HN: What projects are you working on now?
  44. …in go [2], which is now running faster than the JSON codec in my experimental branch [3]. [1] https://github.com/kstenerud/concise-encoding#concise-encodi... [2] https://github.com/kstenerud/go-cbe [3]…
    comment by kstenerud · 2020-03-21 · in Ask HN: What projects are you working on now?
  45. …and only convert to text when a human is involved. I've put together a quick comparison here: https://github.com/kstenerud/concise-encoding#comparison-to-... Currently, I'm finishing off the go implementation [4], which so far I've managed…
    comment by kstenerud · 2020-03-10 · in MessagePack: like JSON, but fast and small
  46. …a short list here [1]. I also kept a design document which explains the choices I made [2]. [1] https://github.com/kstenerud/concise-encoding#comparison-to-... [2] https://github.com/kstenerud/concise-encoding/blob/master/de...
    comment by kstenerud · 2020-03-03 · in The growth of command-line options, 1979-Present
  47. …would be helpful in so many situations, including serialization for piping between unix tools. https://github.com/kstenerud/concise-encoding#example
    comment by kstenerud · 2020-03-03 · in The growth of command-line options, 1979-Present
  48. …even try to compete in. I just realized that I haven't added Capn'proto to my features matrix: https://github.com/kstenerud/concise-encoding#comparison-to-...
    comment by kstenerud · 2020-03-01 · in OpenAPI v3.1 and JSON Schema 2019-09
  49. …then the layers on top of that should go pretty quickly because I'm not bit bashing anymore. [1] https://github.com/kstenerud/concise-encoding#concise-encodi... [2] https://github.com/kstenerud/streamux/#streamux [3]…
    comment by kstenerud · 2020-03-01 · in OpenAPI v3.1 and JSON Schema 2019-09
  50. …only in my head, but if I've designed the lower layers correctly, it should be pretty thin. [1] https://github.com/kstenerud/concise-encoding [2] https://github.com/kstenerud/compact-float [3] https://github.com/kstenerud/compact-time [4]…
    comment by kstenerud · 2020-01-29 · in Ask HN: What interesting problems are you working on?