closeio/tasktiger
View on GitHub ↗ ★ 1,469 Python
Python task queue using Redis
14 mentions on Hacker News by 10 people: 1 story, 13 comments · first 2015-10-01 · latest 2024-04-19
20082026
-
I've recently looked at tasktiger https://github.com/closeio/tasktiger . It's a simple queue system that helped me understand how workers and schedulers work.
comment by rookie101 · 2024-04-19 · in Ask HN: High quality Python scripts or small libraries to learn from -
Here's the list of my issues: https://github.com/closeio/tasktiger/issues?utf8=%E2%9C%93&q... It came down to I like the features of RabbitMQ: * RabbitMQ scales messages without needing tons of RAM * I don't have to decide between not…
comment by wakatime · 2020-01-03 · in RQ – Simple Job Queues for Python -
…when moving tasks between various stages of processing (queued, active, scheduled, errored). [0] https://github.com/closeio/tasktiger/blob/master/tasktiger/r...
comment by wojcikstefan · 2020-01-03 · in RQ – Simple Job Queues for Python -
> What exactly is fragile about this approach? We've supported scheduled tasks in TaskTiger ( https://github.com/closeio/tasktiger ) via Redis's sorted sets and haven't had any issues. Using sorted sets for scheduled tasks isn't the…
comment by pselbert · 2020-01-03 · in RQ – Simple Job Queues for Python -
…What exactly is fragile about this approach? We've supported scheduled tasks in TaskTiger ( https://github.com/closeio/tasktiger ) via Redis's sorted sets and haven't had any issues.
comment by wojcikstefan · 2020-01-03 · in RQ – Simple Job Queues for Python -
We tried this at WakaTime and it didn't scale well. We also tried https://github.com/closeio/tasktiger but the only ones that work for us are based on RabbitMQ: Celery<4.0 https://github.com/Bogdanp/dramatiq
comment by wakatime · 2020-01-03 · in RQ – Simple Job Queues for Python -
…time debugging Celery's issues instead of working on our core business. Here's some more context: https://github.com/closeio/tasktiger/issues/141#issuecomment... Advanced features like scheduled tasks, unique queues, and task locks have…
comment by wojcikstefan · 2020-01-03 · in RQ – Simple Job Queues for Python -
Shameless plug: Our team at Close has been inspired by RQ when we created TaskTiger – https://github.com/closeio/tasktiger . We’ve been running it in production for a few years now, processing ~4M tasks a day and it’s been a wonderful tool…
comment by wojcikstefan · 2020-01-02 · in RQ – Simple Job Queues for Python -
…and in memory by coleifer (peewee creator). Possible to implement postgres storage layer simply. https://github.com/closeio/tasktiger - flexible redis-based python task queue alternative to celery https://dramatiq.io/ - actor based python…
comment by faizshah · 2019-11-08 · in System design hack: Postgres is a great pub/sub and job server -
…3.x but don't like all the bugs in Celery 4.x, check out these alternative Python task queues: https://github.com/closeio/tasktiger (supports subqueues to prevent users bottlenecking each other) https://github.com/Bogdanp/dramatiq (high…
comment by welder · 2018-08-01 · in Faust: Stream Processing for Python -
I figured I'd add a mention of the task queue we use at close.io: https://github.com/closeio/tasktiger We run several hundred tasktiger workers in production (deployed using Kubernetes) to process the various backend task queues for our…
comment by jtharpla · 2017-11-13 · in Show HN: Dramatiq – An alternative to Celery -
Replaced it with Task Tiger ( https://github.com/closeio/tasktiger )
comment by jokull · 2017-10-18 · in Ask HN: What's been your experience with AWS Lambda? -
See also tasktiger: https://github.com/closeio/tasktiger
comment by philfreo · 2017-06-14 · in Show HN: Your Own Task Queue for Python -
▲ 5
TaskTiger – Python task queue with per-task forks, unique queues and batch tasksstory by thomas-st · 2015-10-01 · 0 comments