534 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ken Hibino	847d724985	Merge pull request #1 from hibiken/feature/simple_rescue ... Rescue dead "In Progress" tasks	2019-11-23 15:15:46 -08:00
Ken Hibino	fd80126a67	Add logic to restore unfinished tasks back into the default queue if ... there are any uncompleted tasks	2019-11-23 15:09:50 -08:00
Ken Hibino	4a327933bd	Use command BRPUSHLPOP to move from queue to in_progress in redis	2019-11-23 08:43:41 -08:00
Ken Hibino	76ceb282a9	Change the direction of list push/pop operations	2019-11-23 08:24:16 -08:00
Ken Hibino	3fa867b190	Remove per task heartbeat	2019-11-23 08:21:32 -08:00
Ken Hibino	2e0af11ca0	Add heartbeat goroutine to write heartbeat data to redis for active ... worker	2019-11-22 06:43:42 -08:00
Ken Hibino	80f477212d	Add ID field to taskMessage	2019-11-22 06:16:43 -08:00
Ken Hibino	67a9e8aa00	Track in-progress tasks with redis SET	2019-11-21 21:45:27 -08:00
Ken Hibino	c84287d7ab	Minor fixes	2019-11-21 20:22:55 -08:00
Ken Hibino	66930970f9	Move retry related logic to its own file	2019-11-20 20:38:49 -08:00
Ken Hibino	3dddcfbb14	Minor cleanup	2019-11-20 20:27:01 -08:00
Ken Hibino	2dd5f2c5ab	Rename manager to processor	2019-11-20 20:10:00 -08:00
Ken Hibino	dd0b0b358c	Add tests for type rdb	2019-11-20 07:01:24 -08:00
Ken Hibino	e9069bfb47	Move client and launcher to its own files	2019-11-19 21:19:46 -08:00
Ken Hibino	85a04cbabb	Extract redis logic to type rdb	2019-11-19 21:08:06 -08:00
Ken Hibino	4c5b6081de	Update todo comments	2019-11-19 07:47:21 -08:00
Ken Hibino	eb6a5032f6	Make Launcher thread safe	2019-11-19 07:46:04 -08:00
Ken Hibino	e238d3835d	Gracefully shutdown all scheduled goroutines on (*Launcher).Stop	2019-11-19 07:38:09 -08:00
Ken Hibino	195fd893be	Extract manager to its own type	2019-11-19 06:52:26 -08:00
Ken Hibino	8d22d1f6fb	Change (*poller).start to use time.Sleep instead of ticker	2019-11-19 06:20:59 -08:00
Ken Hibino	89c54fb47d	Rename Workers to Launcher	2019-11-19 06:19:22 -08:00
Ken Hibino	4485b6e3a9	Extract polling logic to poller type	2019-11-18 21:23:49 -08:00
Ken Hibino	3daef02632	Fix bug around releasing semaphore token	2019-11-18 07:42:26 -08:00
Ken Hibino	c6f482d4f8	Make Run method stateful	2019-11-17 21:21:32 -08:00
Ken Hibino	62db9863fb	Send retry exhausted tasks to "dead" zset	2019-11-17 21:13:41 -08:00
Ken Hibino	6252cc02e0	Implement exponential backoff retry	2019-11-17 18:44:40 -08:00
Ken Hibino	22e2a6f433	Add retry logic	2019-11-17 15:36:33 -08:00
Ken Hibino	e75756937e	Change internal representation of task data written to redis	2019-11-17 13:25:01 -08:00
Ken Hibino	d2d0d1fde5	Change package APIs	2019-11-16 14:45:51 -08:00
Ken Hibino	f4d59bece7	Add support for multiple queues	2019-11-16 08:20:23 -08:00
Ken Hibino	95023bd3b5	Extract a push logic to a function	2019-11-16 08:04:28 -08:00
Ken Hibino	bda718bcaa	Refactor enqueue logic for scheduled tasks	2019-11-16 07:39:42 -08:00
Ken Hibino	e362e0daca	Add workers	2019-11-15 07:21:25 -08:00
Ken Hibino	6d65ebfb35	Initial commit	2019-11-14 21:48:43 -08:00