multiprocessio/datastation on Hacker News

…coverage would be collected and dumped into some local file. Here's an example of the build step: https://github.com/multiprocessio/datastation/blob/main/runn... . And here's how I'd analyze coverage after using the binary:…

comment by eatonphil · 2023-03-08 · in Code coverage for Go integration tests

…schemes yourself or you'll move to a system that does that for you like bigquery/snowflake/etc. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-06-13 · in Comparison of Data Lake Table Formats (Iceberg, Hudi and Delta Lake)

▲ 131

Show HN: DataStation – App to easily query, script, and visualize data

story by eatonphil · 2022-05-31 · 31 comments

…data is stored in SQLite. Happy to talk more about it if you want! My email is in my profile. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-05-20 · in Ask HN: What are modern architecture patterns for desktop applications?

…it myself but that process is not documented yet. (Most people use it as a desktop app today.) [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-05-05 · in Windmill.dev

…(similar to Simon's, a lite mode of a data IDE): https://app.datastation.multiprocess.io . My code: https://github.com/multiprocessio/datastation/blob/main/shar... .

comment by eatonphil · 2022-05-04 · in Datasette Lite: a server-side Python web application running in a browser

…I like Go a lot and for most things I'd keep using it still. Just sharing some observations. [0] https://github.com/multiprocessio/datastation [1] https://github.com/multiprocessio/dsq [2] https://github.com/itchio/wharf [3]…

comment by eatonphil · 2022-04-29 · in Lies we tell ourselves to keep using Golang

…number of people take me up on this and merged a number of PRs by first-time OSS contributors. [0] https://github.com/multiprocessio/datastation [1] https://github.com/multiprocessio/datastation/blob/main/GOOD...

comment by eatonphil · 2022-04-15 · in The fastest tool for querying large JSON files is written in Python (benchmark)

…sign the mac build because it's cheap and not insane. Windows signing is expensive and insane. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-04-13 · in Ask HN: Code signing open source windows applications?

…actually use this code. Is there a good tutorial/example somewhere? [0] app.datastation.multiprocess.io [1] github.com/multiprocessio/datastation

comment by eatonphil · 2022-04-07 · in Ruby 3.2 preview 1 with support for WASM compilation

…good first projects if you're interested in OSS data tools and have some Go experience. Check out: https://github.com/multiprocessio/datastation/blob/main/GOOD...

comment by eatonphil · 2022-04-04 · in Ask HN: Who wants to collaborate? (April 2022)

…If I got funding or this becomes sustainable I'd be interesting in building native versions. https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-03-24 · in Ask HN: Why aren't devs making desktop apps any more?

…[2] https://github.com/JoshuaWise/better-sqlite3/pull/778 [3] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-03-22 · in Ask HN: Do you contribute to open source projects?

…qp: Command-line (ND)JSON querying - https://github.com/paybase/qp [0]: https://github.com/multiprocessio/datastation

comment by luckman212 · 2022-03-21 · in Ask HN: Local Tools for Viewing JSON

I've got a lot of good first projects for github.com/multiprocessio/datastation and github.com/multiprocessio/dsq. If you have any experience in Go it will be easy to get you up and running. I've already had a few students and…

comment by eatonphil · 2022-03-19 · in Ask HN: Who is looking for help on a project?

…between Code, Issues, Pull Requests, etc [1]. [0] https://reactjs.org/docs/getting-started.html [1] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-03-17 · in Using hamburger menus? Try sausage links (2019)

…looking for at most 20 hours a week so I can continue working on my company, multiprocess.io. I am building github.com/multiprocessio/datastation and github.com/multiprocessio/dsq in public and they are used by a number of developers. I…

comment by eatonphil · 2022-03-01 · in Ask HN: Freelancer? Seeking freelancer? (March 2022)

…looking for at most 20 hours a week so I can continue working on my company, multiprocess.io. I am building github.com/multiprocessio/datastation and github.com/multiprocessio/dsq in public and they are used by a number of developers. I…

comment by eatonphil · 2022-03-01 · in Ask HN: Who wants to be hired? (March 2022)

…to a BI tool but an improvement on switching between Python scripts, Postman, a SQL GUI and Excel. https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-02-13 · in Ask HN: Tools to visualize data in SQL databases?

…this tool though is that you can script and graph results as well. Always happy for any feedback! https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-02-02 · in Postman Now Supports gRPC

…product to help facilitate the latter [0]. I'm focused on contract engagements at the moment. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-02-01 · in Ask HN: Who wants to be hired? (February 2022)

…have recurring exports and alerts like you're doing. I think you're on the right path. Good luck! https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-01-30 · in Show HN: GravaMetrics – Powerful Dashboards made simple

…UI that you're querying a local copy of the database and that your edits won't affect the original. https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-01-25 · in Store SQLite in Cloudflare Durable Objects

…The data never leaves your machine. Desktop-first is a big deal in devtools for this reason. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2022-01-21 · in Ask HN: Anyone making a living building desktop applications?

…query language) of querying arbitrary files I've got a comparison of some major tools here too. https://github.com/multiprocessio/datastation/tree/main/runn...

comment by eatonphil · 2022-01-09 · in FX: An interactive alternative to jq to process JSON

…app or as a server/web app. There's also a serverless/in-memory web app demo running here [1]. [0] https://github.com/multiprocessio/datastation [1] https://app.datastation.multiprocess.io

comment by eatonphil · 2021-12-30 · in A fast SQLite PWA notebook for CSV files

…running SQL queries against CSV/JSON/Excel/Parquet/etc or just converting those files to JSON. [0] https://github.com/multiprocessio/datastation/tree/main/runn...

comment by eatonphil · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON

▲ 7

Show HN: Run SQL Queries Against JSON, CSV, Excel, Parquet, and More

story by eatonphil · 2021-12-22 · 0 comments

…should be handled for you. The tool I'm building to solve this is open source if you're curious! https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-12-17 · in Using an ETL framework vs. writing yet another ETL script

I'd hate for people to hate on this open-source data IDE. https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-12-08 · in Do you ever avoid submitting something on HN so devs won't ruin it?

…on a work laptop. If you want dashboards and recurring exports you can run a server version of it. https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-12-01 · in Open source Business intelligence platform made with Python

…I see out to find the right combo of fast load time and most pythonic implementation. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-11-30 · in Transcrypt – Python in the Browser

…teammates/peers. That may be the thing that drives me fastest back to full time employment. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-11-30 · in Workers quit jobs in droves to become their own bosses

…(this post) but instead of doing any ETL it's just a smart client for joining data client-side. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-11-11 · in Show HN: Tablum.io – No-Code Self-Service BI/Data Analytics Tool

…your existing systems (databases, logging stack, SalesForce, etc.) on top of an open source IDE ( https://github.com/multiprocessio/datastation ). No need for hard to maintain ETL processes or expensive reporting tools. Examples of the…

comment by eatonphil · 2021-11-01 · in Ask HN: Freelancer? Seeking freelancer? (November 2021)

…probably need to set up a dedicated box with all the right licenses so I can run CI jobs on it. [0] https://github.com/multiprocessio/datastation/blob/master/.g...

comment by eatonphil · 2021-10-12 · in Ask HN: Solo-preneurs, how do you DevOps to save time?

…Julia built in so it's pretty easy to be working with it in automated environments as well. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-10-05 · in New features coming in Julia 1.7

…together a list of regexes for the default log format in each major system. Simple example here: https://github.com/multiprocessio/datastation/blob/master/sh... . I use this in the app to be able to quickly pull info out of access logs for…

comment by eatonphil · 2021-09-23 · in Show HN: Logparser – Alternative to GoAccess Written in Python

…Another similar tool, but maybe more data science focused, is Simon Willison's Datasette [1]. [0] https://github.com/multiprocessio/datastation [1] https://github.com/simonw/datasette

comment by eatonphil · 2021-09-22 · in JupyterLab Desktop App now available

…massages the differences between things like mv and environment variables in Windows, macOS, Linux. https://github.com/multiprocessio/datastation/blob/master/sc... Here's a sample script it can run: yarn setenv UI_ESBUILD_ARGS "--minify"…

comment by eatonphil · 2021-09-10 · in I want a better shell (2019)

…exact same script [3]. The result gets zipped and uploaded to the relevant Github release page. [0] https://github.com/multiprocessio/datastation/blob/master/.g... [1] https://github.com/multiprocessio/datastation/blob/master/de... [2]…

comment by eatonphil · 2021-08-30 · in Building a Desktop Application for Datasette

Very neat! I'm working on a similar open source project, at https://github.com/multiprocessio/datastation . I started out just wanting a way to more easily connect code snippets, SQL, and graphs together. But it's evolved a bit more beyond…

comment by eatonphil · 2021-08-30 · in Building a Desktop Application for Datasette

…results to be permanent. I just wanted an in-memory SQL for joining, filtering, grouping data. [0] https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-08-12 · in A future for SQL on the web

Yep! https://github.com/multiprocessio/datastation

comment by eatonphil · 2021-06-12 · in Show HN: In-browser, open-source data IDE for developers