kstenerud/concise-encoding on Hacker News

…tps://marketplace.visualstudio.com/items?itemName=ksteneru... The binary format I wanted to describe: https://github.com/kstenerud/concise-encoding/blob/master/cb...

comment by kstenerud · 2024-08-13 · in What you learn by making a new programming language

…https://github.com/kstenerud/dogma/blob/master/v1/examples/m... - Concise Binary Encoding: https://github.com/kstenerud/concise-encoding/blob/master/cb... - Concise Text Encoding: https://github.com/kstenerud/concise-encoding/blob/master/ct…

comment by kstenerud · 2024-03-24 · in Interval Parsing Grammars for File Format Parsing (2023) [pdf]

Concise Encoding https://github.com/kstenerud/concise-encoding/ It's a specification for a family of data exchange formats with most complete feature list but little to no recognition

comment by loa_in_ · 2024-03-08 · in Ask HN: What underrated open source project deserves more recognition?

…a fair bit about timekeeping, because the context of what you're capturing becomes very important: https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2023-11-20 · in datetime.utcnow() is now deprecated

▲ 1

Show HN: Concise Encoding – Last Prerelease

story by kstenerud · 2023-09-27 · 0 comments

This is basically why I ended up rolling my own text date format for Concise Encoding: - https://github.com/kstenerud/concise-encoding/blob/master/ct... - https://github.com/kstenerud/concise-encoding/blob/master/ce... e.g. 2019-8-5 //…

comment by kstenerud · 2023-09-01 · in RFC 3339 vs. ISO 8601

…your daytime job to that end. [1] https://dogma-lang.org/ [2] https://concise-encoding.org/ [3] https://github.com/kstenerud/concise-encoding/blob/master/cb... and https://github.com/kstenerud/concise-encoding/blob/master/ct...

comment by kstenerud · 2023-05-01 · in Facing Imminent Homelessness, Gagoot Developer Seeks Project Funding

…https://preserves.dev/preserves-binary.html Now the CBE formal description looks like this: https://github.com/kstenerud/concise-encoding/blob/master/cb... And the regular documentation looks like this:…

comment by kstenerud · 2023-02-27 · in Ask HN: Please critique my metalanguage: “Dogma”

…thinking "how hard could it be?" But it worked out and I have a formal description for it now: * https://github.com/kstenerud/concise-encoding/blob/master/cb... * https://github.com/kstenerud/concise-encoding/blob/master/ct... So it's…

comment by kstenerud · 2023-02-26 · in Ask HN: Please critique my metalanguage: “Dogma”

▲ 6

Ask HN: Please help me by reviewing KBNF

story by kstenerud · 2022-12-29 · 2 comments

▲ 2

Concise Encoding Design Document

story by heyzk · 2022-11-07 · 0 comments

…taking the time to critique! I actually do have an ANTLR file that is about 90% of the way there ( https://github.com/kstenerud/concise-encoding/tree/master/an... ), so I could use those as a basis... One thing I'm not sure about is how to…

comment by kstenerud · 2022-11-07 · in Keep ’em coming: Why your first ideas aren’t always the best

…in the next few years as the more sophisticated actors start taking advantage of them. For example https://github.com/kstenerud/concise-encoding/blob/master/ce... There are still a few things to do: - Update enctool (…

comment by kstenerud · 2022-07-11 · in Working in the software industry, circa 1989

…I was never big on writing, but when I finally tried my hand at a data format specification ( https://github.com/kstenerud/concise-encoding ), I found that I really enjoyed the experience. It's 3000 lines and took me four years and…

comment by kstenerud · 2022-07-11 · in Working in the software industry, circa 1989

…is a grab bag!), but I'm not sure if removing BIDI could be done without breaking some languages? https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2022-06-19 · in Breaking our Latin-1 assumptions (2017)

…than it looks), but in the end it became so much like herding cats that I had to just settle on https://github.com/kstenerud/concise-encoding/blob/master/ct... Basically allow everything except some separators, most control chars, and some…

comment by kstenerud · 2022-06-19 · in Breaking our Latin-1 assumptions (2017)

…a separate field in addition to the time field. I even added a write-up about time to the spec: https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2022-05-24 · in Concise Encoding: A secure data format for a modern world

…types ;-) https://concise-encoding.org/ In particular: * How to deal with unrepresentable values: https://github.com/kstenerud/concise-encoding/blob/master/ce... * Mandatory limits and security considerations:…

comment by kstenerud · 2022-01-24 · in I accidentally used YAML.parse instead of JSON.parse and it worked

…don't have true time zones. It only uses UTC offsets, which are a bad idea for so many reasons. https://github.com/kstenerud/concise-encoding/blob/master/ce... > - Bin + txt: Again, I'm unclear on what you mean here, but ASN.1 has both…

comment by kstenerud · 2022-01-04 · in Ask HN: Who wants to collaborate?

…concern... There are actually a LOT of them, which I try to cover cover in the security section ( https://github.com/kstenerud/concise-encoding/blob/master/ce... ). The security space is of course wider and more nuanced than this, but I…

comment by kstenerud · 2022-01-02 · in Ask HN: Who wants to collaborate?

…before embarking on my venture. I listed the things I found important in the comparison matrix: https://github.com/kstenerud/concise-encoding#-compared-to-o... To your points: - Protobufs is not an ad-hoc format, which is a big reason why…

comment by kstenerud · 2022-01-02 · in Ask HN: Who wants to collaborate?

…I used to develop iOS apps. [1] https://developers.google.com/protocol-buffers/docs/referenc... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3] https://developers.google.com/protocol-buffers/docs/proto3#s... [4]…

comment by no_circuit · 2022-01-02 · in Ask HN: Who wants to collaborate?

Yes, it's included in the comparison matrix: https://github.com/kstenerud/concise-encoding#-compared-to-o...

comment by kstenerud · 2022-01-01 · in Ask HN: Who wants to collaborate?

…- Ideas for a schema. - Public outreach, championing online. [1] https://concise-encoding.org/ [2] https://github.com/kstenerud/concise-encoding [3] https://github.com/kstenerud/go-concise-encoding

comment by kstenerud · 2022-01-01 · in Ask HN: Who wants to collaborate?

…as "legacy formats" [2]. [1] https://en.wikipedia.org/wiki/Decimal64_floating-point_forma... [2] https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2021-12-17 · in Floating point numbers, and why they suck

…format. [1] https://github.com/kstenerud/go-concise-encoding [2] https://concise-encoding.org/ [3] https://github.com/kstenerud/concise-encoding

comment by kstenerud · 2021-11-20 · in Ask HN: What are you working on this weekend?

…there aren't differences between implementations that can be exploited to compromise your system. https://github.com/kstenerud/concise-encoding/blob/master/ce... - Real type support because coercing everything into strings sucks (and is…

comment by kstenerud · 2021-11-02 · in Ask HN: What you up to? (Who doesn't want to be hired?)

This is where security and limits comes in: https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2021-10-24 · in RFC 3339 vs. ISO 8601

This is the biggest reason why I had to develop a new time format for Concise Encoding :/ https://github.com/kstenerud/concise-encoding/blob/master/ce... https://github.com/kstenerud/concise-encoding/blob/master/ct... ISO 8601 and RFC 3339…

comment by kstenerud · 2021-10-24 · in RFC 3339 vs. ISO 8601

…through the beginning byte signature. I've actually put this into Concise Encoding [1] [1] https://github.com/kstenerud/concise-encoding/blob/master/cb...

comment by kstenerud · 2021-06-25 · in The Base45 Data Encoding

…through the beginning byte signature. I've actually put this into Concise Encoding [1] [1] https://github.com/kstenerud/concise-encoding/blob/master/cb...

comment by kstenerud · 2021-06-25 · in The Base45 Data Encoding

…in software engineering. [1] https://github.com/kstenerud/compact-time/blob/master/compac... [2] https://github.com/kstenerud/concise-encoding/blob/master/ct... and https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2021-06-08 · in TLS certificates have at least two internal representations of time

…this has influenced my encoding design in [2] [3] [4]. [1] https://en.wikipedia.org/wiki/LEB128 [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3] https://github.com/kstenerud/compact-float/blob/master/compa... [4]…

comment by kstenerud · 2021-05-08 · in The Byte Order Fiasco

…make the spec easier to read. I use a superset of those keywords to give more precision in meaning: https://github.com/kstenerud/concise-encoding/blob/master/ce...

comment by kstenerud · 2021-04-03 · in The Norway Problem

…technologies! This is why I've been so anal about consistent decoder behavior in Concise Encoding https://github.com/kstenerud/concise-encoding/blob/master/ce... https://concise-encoding.org/

comment by kstenerud · 2021-04-03 · in The Norway Problem

…left in the first plane in case something big comes up in the future. You can see the chart here: https://github.com/kstenerud/concise-encoding/blob/master/cb...

comment by kstenerud · 2021-03-23 · in FastDoubleParser: Java port of Daniel Lemires fast_double_parser

…data bloat the spec and implementations. This is why I rejected iso-8601 and developed my own for https://github.com/kstenerud/concise-encoding/blob/master/ct... Examples: 2019-8-5 : August 5, 2019 -300-12-21 : December 21, 300 BC…

comment by kstenerud · 2021-02-26 · in ISO 8601: a better date format

▲ 2

Ask HN: Advice on building technical spec landing page?

story by kstenerud · 2020-07-19 · 0 comments

…That's simply a limitation of the format. It's part of the reason I developed Concise Encoding: https://github.com/kstenerud/concise-encoding/#example which allows hex float notation when you need to be exact.

comment by kstenerud · 2020-06-29 · in What Every Computer Scientist Should Know About Floating-Point Arithmetic (1991)

…implementation (in go) is 90% complete, enough to marshal objects except for recursive support. https://github.com/kstenerud/concise-encoding/blob/master/RE...

comment by kstenerud · 2020-06-21 · in FlexBuffers

…implementation for a parallel binary/text ad-hoc data format in a similar vein to json & xml ( https://github.com/kstenerud/concise-encoding ). This is a precursor technology to an asynchronous, multiplexing request-response protocol I'm…

comment by kstenerud · 2020-06-01 · in Ask HN: Who wants to be hired? (June 2020)

I'd go fulltime on Concise Encoding ( https://github.com/kstenerud/concise-encoding/#concise-encod... ), a twin binary and text format for ad-hoc data. Progress on the reference implementation is MUCH slower with a day job.

comment by kstenerud · 2020-05-25 · in Ask HN: What creative project do you pursue when your goal isn't to make money?

…guesswork, no more bugs. [1] https://github.com/kstenerud/compact-time/blob/master/compac... [2] https://github.com/kstenerud/concise-encoding/blob/master/ct...

comment by kstenerud · 2020-05-17 · in Some views on having your system timezone set to UTC

…needed on a modern system. - Supports recursive data. - Future proof - Fully specified [2] [3] [1] https://github.com/kstenerud/concise-encoding/#concise-encod... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb... [3]…

comment by kstenerud · 2020-05-14 · in Ask HN: What's your quarantine side project?

…I count 11 "shoulds" in [1] and 7 in [2], and I tried REALLY hard to keep them to a minimum :/ [1] https://github.com/kstenerud/concise-encoding/blob/master/ct... [2] https://github.com/kstenerud/concise-encoding/blob/master/cb...

comment by kstenerud · 2020-04-05 · in Must, Should, Don't Care: TCP Conformance in the Wild

…up while I'm writing the reference implementation. Getting a spec right is a marathon affair. [1] https://github.com/kstenerud/concise-encoding/blob/master/ct...

comment by kstenerud · 2020-04-04 · in Things Markdown got wrong

There's a basic comparison here: https://github.com/kstenerud/concise-encoding#comparison-to-...

comment by kstenerud · 2020-03-22 · in Ask HN: What projects are you working on now?

…in go [2], which is now running faster than the JSON codec in my experimental branch [3]. [1] https://github.com/kstenerud/concise-encoding#concise-encodi... [2] https://github.com/kstenerud/go-cbe [3]…

comment by kstenerud · 2020-03-21 · in Ask HN: What projects are you working on now?

…and only convert to text when a human is involved. I've put together a quick comparison here: https://github.com/kstenerud/concise-encoding#comparison-to-... Currently, I'm finishing off the go implementation [4], which so far I've managed…

comment by kstenerud · 2020-03-10 · in MessagePack: like JSON, but fast and small

…a short list here [1]. I also kept a design document which explains the choices I made [2]. [1] https://github.com/kstenerud/concise-encoding#comparison-to-... [2] https://github.com/kstenerud/concise-encoding/blob/master/de...

comment by kstenerud · 2020-03-03 · in The growth of command-line options, 1979-Present