Hacker GitHub

← All repos

marsupialtail/quokka

View on GitHub ↗ ★ 1,191 Python

Making data lake work for time series

14 mentions on Hacker News by 3 people: 6 stories, 8 comments · first 2022-10-29 · latest 2023-09-08

Mentions per year 14 mentions · busiest year 2023 (12)
20082026
AllStoriesComments NewestTopOldest
  1. …interesting and applicable how quokka schedules distributed queries to outperform Spark https://github.com/marsupialtail/quokka/blob/master/blog/why...
    comment by willvarfar · 2023-09-08 · in How Query Engines Work
  2. Hi Justin, you might be interested in my blog: https://github.com/marsupialtail/quokka/blob/master/blog/bac... advocating a cloud based approach. You don't have to use the system I am building, but it's worth thinking about that design.
    comment by marsupialtail_2 · 2023-06-30 · in Case study: Algorithmic trading with Go
  3. SQL support is very challenging. I work on Quokka ( https://github.com/marsupialtail/quokka ). I support Iceberg reads. Recently we are adding SQL support from just parsing the DuckDB logical plan, though that is very challenging as well.…
    comment by marsupialtail_2 · 2023-06-07 · in Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
  4. Hi -- I am the author of Quokka: https://github.com/marsupialtail/quokka , trying to be distributed Polars. I am trying to go for API compatibility, or at least supporting most of the API. I am not focused on complex data types though.
    comment by marsupialtail_2 · 2023-06-07 · in Daft: A High-Performance Distributed Dataframe Library for Multimodal Data
  5. ▲ 3
    Why your dataframe library needs to understand vector embeddings
    story by marsupialtail_2 · 2023-05-20 · 1 comment
  6. …interested, I wrote a post about fault tolerance strategies of data systems like Spark and Flink: https://github.com/marsupialtail/quokka/blob/master/blog/fau... The key difference here is that these systems don't store data, so fault…
    comment by marsupialtail_2 · 2023-04-17 · in The Inner Workings of Distributed Databases
  7. ▲ 5
    Show HN: Quokka -- Distributed Polars on Ray
    story by marsupialtail_2 · 2023-03-30 · 5 comments
  8. would love to collaborate on an integration with pyquokka ( https://github.com/marsupialtail/quokka ) once I put out a stable release end of this month :-)
    comment by marsupialtail_2 · 2023-03-07 · in Launch HN: DAGWorks – ML platform for data science teams
  9. ▲ 2
    Distributed fault tolerance made simple
    story by marsupialtail_2 · 2023-02-12 · 0 comments
  10. ▲ 7
    Fault tolerance for distributed data systems is really quite simple
    story by marsupialtail_2 · 2023-01-31 · 0 comments
  11. …or so ago. Good stuff. I wanted to add it to dbdb.io but I couldn't find an SVG version of this: https://github.com/marsupialtail/quokka/blob/master/docs/doc... Can you email it to me?
    comment by apavlo · 2023-01-02 · in Databases in 2022: A Year in Review
  12. I am writing a Python based SQL query engine: https://github.com/marsupialtail/quokka . My personal goal is to get Andy Pavlo to mention it in his year-end blogs. I agree with many of the points made in the blog by Andy. Writing a…
    comment by marsupialtail_2 · 2023-01-02 · in Databases in 2022: A Year in Review
  13. ▲ 282
    I wrote a SQL engine in Python
    story by marsupialtail_2 · 2022-12-30 · 73 comments
  14. ▲ 4
    Show HN: Rewriting SparkSQL in Python
    story by marsupialtail_2 · 2022-10-29 · 1 comment