Hacker GitHub

← All repos

fluxninja/aperture

View on GitHub ↗ ★ 732 Go

Rate limiting, caching, and request prioritization for modern workloads

32 mentions on Hacker News by 4 people: 6 stories, 26 comments · first 2022-09-13 · latest 2024-03-01

Mentions per year 32 mentions · busiest year 2023 (18)
20082026
AllStoriesComments NewestTopOldest
  1. …and graceful degradation with request prioritization should check out the Aperture OSS project. https://github.com/fluxninja/aperture
    comment by gillh · 2024-03-01 · in Defcon: Preventing overload with graceful feature degradation (2023)
  2. ▲ 10
    Show HN: Rate limiting, caching and request prioritization for AI apps
    story by gillh · 2024-01-30 · 0 comments
  3. …WFQ scheduler in Aperture: https://docs.fluxninja.com/concepts/scheduler Link to Aperture's GitHub: https://github.com/fluxninja/aperture Would love to hear your thoughts on our approach!
    comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)
  4. Aperture ( https://github.com/fluxninja/aperture ) takes a slightly opinionated take on queue size. Instead of defining queue sizes, you put a timeout on each request which is the amount of time the request is willing to wait in the queue.…
    comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)
  5. …so that no single user can starve others. Would love to hear your thoughts about this project: https://github.com/fluxninja/aperture
    comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)
  6. …in-flight requests. Would love the community here to check us out on GitHub and provide feedback: https://github.com/fluxninja/aperture
    comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)
  7. …involves weighted-fair queueing for request prioritization and load shedding should check out - https://github.com/fluxninja/aperture The overload problem is quite common in generative AI apps, necessitating a sophisticated approach. Even…
    comment by gillh · 2024-01-18 · in Queues don't fix overload (2014)
  8. …work in ATM networks, QoS etc. He is advising us on the project. This is the link to the project: https://github.com/fluxninja/aperture We built a weighted-fair queueing scheduler as well - https://docs.fluxninja.com/concepts/scheduler/load…
    comment by gillh · 2023-08-10 · in Graceful behavior at capacity
  9. You should check out the Aperture flow control system - https://github.com/fluxninja/aperture We built a weighted fair queueing system in the Aperture flow control system to help alleviate the API load pressure -…
    comment by gillh · 2023-08-10 · in Graceful behavior at capacity
  10. …load shedding, controllability (PID control), and so on. We have open-sourced our work at - https://github.com/fluxninja/aperture We also did a Twitter Spaces discussion with Kelsey earlier today - https://twitter.com/kelseyhightower/status…
    comment by gillh · 2023-08-10 · in Graceful behavior at capacity
  11. …load shedding, controllability (PID control), and so on. We have open-sourced our work at - https://github.com/fluxninja/aperture We would love feedback from folks reading this blog post! Disclaimer: I am one of the co-authors of the…
    comment by gillh · 2023-08-07 · in Graceful behavior at capacity
  12. …spam but backed by actual code that provides a reference implementation behind the idea. See: https://github.com/fluxninja/aperture
    comment by gillh · 2023-07-22 · in Adaptive rate limiting is a game-changer
  13. …that precisely tells you how to implement adaptive rate limiting. Just click around a bit: - https://github.com/fluxninja/aperture - https://docs.fluxninja.com/use-cases/adaptive-service-protec... Note: I am one of the authors' of this…
    comment by gillh · 2023-07-22 · in Adaptive rate limiting is a game-changer
  14. …recommends adding a "maxIterations" counter to the "for len(executedComponents) ..." loop here: https://github.com/fluxninja/aperture/blob/26e00ea818c7c28da... HOWEVER - the review has failed to notice the logic using "numExecutedBefore"…
    comment by al2o3cr · 2023-07-14 · in Show HN: Review GitHub PRs with AI/LLMs
  15. Deploy Aperture for runtime protection. https://github.com/fluxninja/aperture
    comment by gillh · 2023-07-01 · in June 25th, 2023 Deno Deploy Postmortem
  16. The need an adaptive protection system like Aperture[0] to mitigate overloads. [0]: https://github.com/fluxninja/aperture
    comment by gillh · 2023-07-01 · in June 25th, 2023 Deno Deploy Postmortem
  17. It’s customized to our policy spec. But you can learn from this and adapt it to your spec. https://github.com/fluxninja/aperture/blob/main/scripts/json...
    comment by gillh · 2023-03-29 · in Jsonnet – The Data Templating Language
  18. …yaml (using aperturectl CLI) or via jsonnet mixin. Relevant links: - Aperture Blueprints (Jsonnet): https://github.com/fluxninja/aperture/tree/main/blueprints - Generated doc example: https://docs.fluxninja.com/development/reference/policie…
    comment by gillh · 2023-03-27 · in Jsonnet – The Data Templating Language
  19. ▲ 45
    Show HN: Aperture – Unified Reliability Management for Microservices
    story by ksohi · 2023-03-16 · 9 comments
  20. …limiting, prioritized load shedding and graceful degradation to mitigate cascading failures. [0] https://github.com/fluxninja/aperture [1] https://docs.fluxninja.com/
    comment by gillh · 2023-03-15
  21. …Blog by DoorDash team - https://doordash.engineering/2023/03/14/failure-mitigation-f... Project - https://github.com/fluxninja/aperture
    comment by gillh · 2023-03-14 · in An experiment in elastically scaling a thread pool using a PID controller
  22. This is exactly what the Aperture project is solving: https://github.com/fluxninja/aperture
    comment by gillh · 2023-03-14 · in An experiment in elastically scaling a thread pool using a PID controller
  23. …network schedulers, control theory (PID controllers) should definitely check it out! [1] [0]: https://github.com/fluxninja/aperture [1]: https://docs.fluxninja.com/
    comment by gillh · 2023-02-19 · in Queues should be empty
  24. …For instance, Aperture[0] open-source flow control system is built on service meshes. [0]: https://github.com/fluxninja/aperture [1]: https://docs.fluxninja.com
    comment by gillh · 2023-02-11 · in Service mesh use cases (2020)
  25. …work at any scale. Open source projects such as Aperture[0] can help tackle some these issues. [0] https://github.com/fluxninja/aperture
    comment by gillh · 2023-01-03 · in Modules, not microservices
  26. ▲ 2
    Show HN: Reliability-as-Code Platform (Aperture)
    story by gillh · 2022-12-16 · 0 comments
  27. The metric and the control circuit is configurable/programmable. [1] https://github.com/fluxninja/aperture/blob/main/blueprints/b...
    comment by gillh · 2022-10-15 · in Queueing Theory
  28. …on a service. 3. Weighted Fair Scheduling of workloads (i.e. APIs) based on their labels. [1] https://github.com/fluxninja/aperture
    comment by gillh · 2022-10-15 · in Queueing Theory
  29. …fair queuing scheduler that prioritizes workloads when concurrency limits are adjusted. [1] https://github.com/fluxninja/aperture
    comment by gillh · 2022-10-15 · in Queueing Theory
  30. ▲ 6
    Show HN: Aperture Open Source Flow Control and Reliability Platform
    story by gillh · 2022-09-15 · 0 comments
  31. ▲ 5
    Show HN: Scale your APIs with Aperture flow control
    story by gillh · 2022-09-14 · 0 comments
  32. ▲ 7
    Show HN: Aperture – Flow Control for Cloud Apps
    story by gillh · 2022-09-13 · 0 comments