fluxninja/aperture on Hacker News

…and graceful degradation with request prioritization should check out the Aperture OSS project. https://github.com/fluxninja/aperture

comment by gillh · 2024-03-01 · in Defcon: Preventing overload with graceful feature degradation (2023)

…WFQ scheduler in Aperture: https://docs.fluxninja.com/concepts/scheduler Link to Aperture's GitHub: https://github.com/fluxninja/aperture Would love to hear your thoughts on our approach!

comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)

Aperture ( https://github.com/fluxninja/aperture ) takes a slightly opinionated take on queue size. Instead of defining queue sizes, you put a timeout on each request which is the amount of time the request is willing to wait in the queue.…

comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)

…so that no single user can starve others. Would love to hear your thoughts about this project: https://github.com/fluxninja/aperture

comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)

…in-flight requests. Would love the community here to check us out on GitHub and provide feedback: https://github.com/fluxninja/aperture

comment by tanveergill · 2024-01-18 · in Queues don't fix overload (2014)

…involves weighted-fair queueing for request prioritization and load shedding should check out - https://github.com/fluxninja/aperture The overload problem is quite common in generative AI apps, necessitating a sophisticated approach. Even…

comment by gillh · 2024-01-18 · in Queues don't fix overload (2014)

…work in ATM networks, QoS etc. He is advising us on the project. This is the link to the project: https://github.com/fluxninja/aperture We built a weighted-fair queueing scheduler as well - https://docs.fluxninja.com/concepts/scheduler/load…

comment by gillh · 2023-08-10 · in Graceful behavior at capacity

You should check out the Aperture flow control system - https://github.com/fluxninja/aperture We built a weighted fair queueing system in the Aperture flow control system to help alleviate the API load pressure -…

comment by gillh · 2023-08-10 · in Graceful behavior at capacity

…load shedding, controllability (PID control), and so on. We have open-sourced our work at - https://github.com/fluxninja/aperture We also did a Twitter Spaces discussion with Kelsey earlier today - https://twitter.com/kelseyhightower/status…

comment by gillh · 2023-08-10 · in Graceful behavior at capacity

…load shedding, controllability (PID control), and so on. We have open-sourced our work at - https://github.com/fluxninja/aperture We would love feedback from folks reading this blog post! Disclaimer: I am one of the co-authors of the…

comment by gillh · 2023-08-07 · in Graceful behavior at capacity

…spam but backed by actual code that provides a reference implementation behind the idea. See: https://github.com/fluxninja/aperture

comment by gillh · 2023-07-22 · in Adaptive rate limiting is a game-changer

…that precisely tells you how to implement adaptive rate limiting. Just click around a bit: - https://github.com/fluxninja/aperture - https://docs.fluxninja.com/use-cases/adaptive-service-protec... Note: I am one of the authors' of this…

comment by gillh · 2023-07-22 · in Adaptive rate limiting is a game-changer

…recommends adding a "maxIterations" counter to the "for len(executedComponents) ..." loop here: https://github.com/fluxninja/aperture/blob/26e00ea818c7c28da... HOWEVER - the review has failed to notice the logic using "numExecutedBefore"…

comment by al2o3cr · 2023-07-14 · in Show HN: Review GitHub PRs with AI/LLMs

Deploy Aperture for runtime protection. https://github.com/fluxninja/aperture

comment by gillh · 2023-07-01 · in June 25th, 2023 Deno Deploy Postmortem

The need an adaptive protection system like Aperture[0] to mitigate overloads. [0]: https://github.com/fluxninja/aperture

comment by gillh · 2023-07-01 · in June 25th, 2023 Deno Deploy Postmortem

It’s customized to our policy spec. But you can learn from this and adapt it to your spec. https://github.com/fluxninja/aperture/blob/main/scripts/json...

comment by gillh · 2023-03-29 · in Jsonnet – The Data Templating Language

…yaml (using aperturectl CLI) or via jsonnet mixin. Relevant links: - Aperture Blueprints (Jsonnet): https://github.com/fluxninja/aperture/tree/main/blueprints - Generated doc example: https://docs.fluxninja.com/development/reference/policie…

comment by gillh · 2023-03-27 · in Jsonnet – The Data Templating Language

…limiting, prioritized load shedding and graceful degradation to mitigate cascading failures. [0] https://github.com/fluxninja/aperture [1] https://docs.fluxninja.com/

comment by gillh · 2023-03-15

…Blog by DoorDash team - https://doordash.engineering/2023/03/14/failure-mitigation-f... Project - https://github.com/fluxninja/aperture

comment by gillh · 2023-03-14 · in An experiment in elastically scaling a thread pool using a PID controller

This is exactly what the Aperture project is solving: https://github.com/fluxninja/aperture

comment by gillh · 2023-03-14 · in An experiment in elastically scaling a thread pool using a PID controller

…network schedulers, control theory (PID controllers) should definitely check it out! [1] [0]: https://github.com/fluxninja/aperture [1]: https://docs.fluxninja.com/

comment by gillh · 2023-02-19 · in Queues should be empty

…For instance, Aperture[0] open-source flow control system is built on service meshes. [0]: https://github.com/fluxninja/aperture [1]: https://docs.fluxninja.com

comment by gillh · 2023-02-11 · in Service mesh use cases (2020)

…work at any scale. Open source projects such as Aperture[0] can help tackle some these issues. [0] https://github.com/fluxninja/aperture

comment by gillh · 2023-01-03 · in Modules, not microservices

The metric and the control circuit is configurable/programmable. [1] https://github.com/fluxninja/aperture/blob/main/blueprints/b...

comment by gillh · 2022-10-15 · in Queueing Theory

…on a service. 3. Weighted Fair Scheduling of workloads (i.e. APIs) based on their labels. [1] https://github.com/fluxninja/aperture

comment by gillh · 2022-10-15 · in Queueing Theory

…fair queuing scheduler that prioritizes workloads when concurrency limits are adjusted. [1] https://github.com/fluxninja/aperture

comment by gillh · 2022-10-15 · in Queueing Theory