2
0
mirror of https://github.com/hibiken/asynq.git synced 2024-12-25 23:32:17 +08:00
Commit Graph

277 Commits

Author SHA1 Message Date
Ken Hibino
f3d7d020a4
Merge pull request #25 from hibiken/feature/stats
Record processed and failure daily count
2019-12-26 06:10:13 -08:00
Ken Hibino
fb24d158ae fix: CurrentState without processed/failed data 2019-12-25 21:30:21 -08:00
Ken Hibino
9b87f7c1f1 Show processed/failed count and error rate in asynqmon stats command 2019-12-25 20:29:58 -08:00
Ken Hibino
cde9d41580 Add processed and failed count to Stats 2019-12-25 20:17:00 -08:00
Ken Hibino
6491f46955 Minor cleanup 2019-12-25 20:04:29 -08:00
Ken Hibino
698fdcfcb2 fix: Change max dead tasks count to 100 2019-12-25 19:57:23 -08:00
Ken Hibino
b2161a481d Record processed and failure daily count 2019-12-24 20:05:46 -08:00
Ken Hibino
24481cd2c7
Merge pull request #24 from hibiken/feature/redisinfo
Show basic redis info in stats command
2019-12-22 17:18:38 -08:00
Ken Hibino
ee7a22adef Display redis info in stats command 2019-12-22 14:31:08 -08:00
Ken Hibino
eea919d117 Add RedisInfo method to RDB 2019-12-22 09:09:57 -08:00
Ken Hibino
0f8f266632
Merge pull request #22 from hibiken/refactor/basepkg
Create base internal package
2019-12-22 07:45:13 -08:00
Ken Hibino
3fd248615b Create base internal package 2019-12-22 07:40:25 -08:00
Ken Hibino
5de314400d
Merge pull request #21 from hibiken/feature/retrycount
Allow custom retry count
2019-12-21 10:05:42 -08:00
Ken Hibino
f5b7e0cccd Document options precedence 2019-12-21 10:02:03 -08:00
Ken Hibino
4229073a24 Allow user to define a max retry count for a task 2019-12-21 09:47:45 -08:00
Ken Hibino
fc66aaa47f Update CLI description 2019-12-21 07:01:03 -08:00
Ken Hibino
6df302689c
Merge pull request #18 from hibiken/feature/payload
Better Payload API
2019-12-20 20:21:54 -08:00
Ken Hibino
324a785233 Add Hash method to Payload 2019-12-20 20:14:40 -08:00
Ken Hibino
14ac5f6674 Add Get* methods to Payload type 2019-12-20 16:01:32 -08:00
Ken Hibino
3fd096a90a [ci skip] Update todos 2019-12-18 21:18:13 -08:00
Ken Hibino
bc7991c757
Merge pull request #17 from hibiken/feature/stop
Implement better signal handling
2019-12-18 20:43:40 -08:00
Ken Hibino
8b98b6e5a0 Rename channel name 2019-12-18 18:57:48 -08:00
Ken Hibino
33e9da953d Log warning and info messages when unfinished tasks get aborted 2019-12-18 18:55:08 -08:00
Ken Hibino
b2bc0ef91c [ci skip] Update todos 2019-12-17 20:37:54 -08:00
Ken Hibino
69b46a7f0d Use sync.Once 2019-12-17 20:34:56 -08:00
Ken Hibino
c40e779fdb Modify poller to wait for Time.After channel instead of time.Sleep 2019-12-17 20:13:41 -08:00
Ken Hibino
5ddba8ca98 Unblock processor shutdown process if processor is waiting for semaphore
token
2019-12-17 20:07:17 -08:00
Ken Hibino
24dd78b31c Stop processing more tasks from the queue once TSTP signal is received 2019-12-17 06:18:22 -08:00
Ken Hibino
3e30c5916b Trap and handle TSTP signal 2019-12-17 05:32:31 -08:00
Ken Hibino
911e600c41 Terminate background upon receiving SIGTERM or SIGINT 2019-12-16 20:19:58 -08:00
Ken Hibino
12fc336889
Merge pull request #16 from hibiken/feature/signals
Add timeout to shutdown when TERM signal is received
2019-12-16 06:54:06 -08:00
Ken Hibino
bcaccf1174 [ci skip] Update todos 2019-12-16 06:41:15 -08:00
Ken Hibino
eb3216d354 Fix: Use buffered channel of size 1 to avoid goroutine leaks 2019-12-16 06:40:52 -08:00
Ken Hibino
989b2b6d55 Add timeout to worker goroutines when TERM signal is received
Wait for a certain amount of time to allow for worker goroutines to
finish. If the goroutines don't finish with the timeout duration,
processor will quit the goroutines and restore any unfinished tasks from
the in_progress queue back to the default queue.
2019-12-15 21:00:09 -08:00
Ken Hibino
e5686894d3 Fix: Do not use lua cjson library to encode task to json
Go and Lua json libraries encodes json differently (e.g. order of
key/value) and caused a bug when removing tasks that was previously
encoded by Lua json library and redis was receiving a string generated
by Go json library.
2019-12-15 20:05:56 -08:00
Ken Hibino
442b33a6d2 Remove (*RDB).RetryLater in favor of Retry method 2019-12-15 17:18:43 -08:00
Ken Hibino
d84e8c0ff2 Modify (*RDB).Kill method to atomically move task from in_progress to
dead queue
2019-12-15 17:16:13 -08:00
Ken Hibino
1b1662bb12 Add Retry method to *RDB
(*RDB).Retry method takes a TaskMessage and will atomically moves the
message from in_progress queue to retry queue. Additionally it
increments the Retried counter and assigns the error message to the
message.
2019-12-15 16:15:07 -08:00
Ken Hibino
1857d12cea
Merge pull request #15 from hibiken/refactor/testing
Refactor tests
2019-12-14 13:58:33 -08:00
Ken Hibino
04836194f9 Clean up rdb package tests 2019-12-14 13:43:06 -08:00
Ken Hibino
9410a65338 Rename randomTask test helper to newTaskMessage 2019-12-12 19:45:03 -08:00
Ken Hibino
d2eeaf6ab1 [ci skip] Update todos 2019-12-12 19:05:25 -08:00
Ken Hibino
0620f2f0f7
Merge pull request #14 from hibiken/feature/delall
Add delall command to asynqmon CLI
2019-12-12 19:03:17 -08:00
Ken Hibino
b7870548d3 Add delall command to asynqmon CLI 2019-12-12 07:02:14 -08:00
Ken Hibino
ca31cbf843 Add DeleteAll* methods to rdb 2019-12-12 06:43:42 -08:00
Ken Hibino
9d79861ac0
Merge pull request #13 from hibiken/feature/del
Add del command to asynqmon CLI
2019-12-11 21:14:02 -08:00
Ken Hibino
1a687bbf84 Add del command to asynqmon CLI 2019-12-11 21:03:47 -08:00
Ken Hibino
be746d01a5 Add delete methods to rdb 2019-12-11 20:15:30 -08:00
Ken Hibino
193d27d93d
Merge pull request #12 from hibiken/feature/shorter_id
Use rs/xid package for more compact string representation of task IDs
2019-12-11 07:49:59 -08:00
Ken Hibino
edcd70b221 Replace google/uuid package with rs/xid for more compact id 2019-12-11 07:41:38 -08:00