Ken Hibino
7b1770da96
Minor code cleanup
2020-06-29 06:11:47 -07:00
Ken Hibino
e2c5882368
Use int64 type for Timeout and Deadline in TaskMessage
2020-06-29 06:11:47 -07:00
Ken Hibino
9699d196e5
Add recoverer
2020-06-29 06:11:47 -07:00
Ken Hibino
1c5f7a791b
Add RDB.ListDeadlineExceeded
2020-06-29 06:11:47 -07:00
Ken Hibino
88d94a2a9d
Update RDB.Requeue to remove message from deadlines set
2020-06-29 06:11:47 -07:00
Ken Hibino
7433b94aac
Update RDB.Dequeue to return deadline as time.Time
2020-06-29 06:11:47 -07:00
Ken Hibino
08ac7793ab
Update RDB.Kill to remove message from deadlines set
2020-06-29 06:11:47 -07:00
Ken Hibino
02b653df72
Update RDB.Retry to remove message from deadlines set
2020-06-29 06:11:47 -07:00
Ken Hibino
bee784c052
Update RDB.Done to remove message from deadlines set
2020-06-29 06:11:47 -07:00
Ken Hibino
4ea58052f8
Update RDB.Dequeue to return message and deadline
2020-06-29 06:11:47 -07:00
Ken Hibino
5afb4861a5
Add task message to deadlines set on dequeue
...
Updated dequeueCmd to decode the message and compute its deadline and add
the message to the Deadline set.
2020-06-29 06:11:47 -07:00
Ken Hibino
7f30fa2bb6
Fix requeue logic in processor
2020-06-13 06:22:32 -07:00
Ken Hibino
06c4a1c7f8
Limit the number of tasks moved by CheckAndEnqueue to prevent a long
...
running script
2020-06-08 06:06:18 -07:00
Ken Hibino
363cfedb49
Update Dequeue operation to skip paused queues
2020-06-08 06:06:18 -07:00
Ken Hibino
a38f628f3b
Refactor server state management
2020-05-31 06:41:19 -07:00
Ken Hibino
aafd8a5b74
Rename internal ProcessState to ServerState
2020-04-19 08:51:17 -07:00
Ken Hibino
c33dd447ac
Allow client to enqueue a task with unique option
...
Changes:
- Added Unique option for clients
- Require go v.13 or above (to use new errors wrapping functions)
- Fixed adding queue key to all-queues set (asynq:queues) when scheduling.
2020-03-21 11:40:40 -07:00
Bo-Yi Wu
30b68728d4
chore(lint): fix from gofmt -s
2020-03-13 20:01:39 -07:00
Ken Hibino
37c6c73d9b
Add test for cancelation pubsub
2020-02-22 15:16:24 -08:00
Ken Hibino
5775a5818d
Update WriteProcessState to write both ProcessInfo and WorkerInfo to
...
redis
2020-02-22 08:56:51 -08:00
Ken Hibino
830020eb39
Add ProcessState type to base package
2020-02-22 08:56:51 -08:00
Ken Hibino
d33ca98648
Use int as priority value type.
...
Do not use unsigned int for merely non-negative quantities as it
complicates simple arithmetic.
2020-02-13 06:23:51 -08:00
Ken Hibino
d9327cf24b
Avoid creating script struct on every rdb method invocation
2020-02-09 09:34:41 -08:00
Ken Hibino
96f06ac89b
Add ps command to asynqmon
2020-02-02 20:56:33 -08:00
Ken Hibino
d03fa34eaf
Add hearbeater
2020-02-01 09:35:49 -08:00
Ken Hibino
6fbaa2ed6c
(fix): RestoreUnfinished to select correct queue
2020-01-26 16:05:46 -08:00
Ken Hibino
166497748b
(fix): Requeue to select correct queue
2020-01-26 16:05:46 -08:00
Ken Hibino
cb2ebf18ac
[performance] Skip the overhead of json decoding when scheduling to one
...
queue
2020-01-14 20:46:47 -08:00
Ken Hibino
97316d6766
Fix flaky tests
...
Some tests were failing due to mismatch in Score in ZSetEntry.
Changed ZSetEntry Score to float64 type so that we can use
cmpopts.EquateApprox to allow for margin when comparing.
2020-01-11 10:09:15 -08:00
Ken Hibino
67f381269a
Maintain a set of queue names in redis set
2020-01-11 10:09:15 -08:00
Ken Hibino
53d0902808
Change RDB.Dequeue to query multiple queues
2020-01-07 21:55:18 -08:00
Ken Hibino
28d698c24e
Update CheckAndEnqueue to enqueue tasks to specified queue
2020-01-07 21:55:18 -08:00
Ken Hibino
f3a23b9b12
Make Task type immutable
...
This change makes it impossible to mutate payload within Handler or
RetryDelayFunc.
2020-01-05 09:55:39 -08:00
Ken Hibino
c62833540c
Add license comment to all src files
2020-01-02 18:13:16 -08:00
Ken Hibino
b7c0c5d3aa
Handle mutated task in RDB's Done, Retry, Kill methods
...
It is possible that user mutates the task's payload in Handler
(Although doc says the task in handler is read-only). Prevent
ending up in an inconsistent state by handling the case where
user mutates the task.
2019-12-31 08:24:03 -08:00
Ken Hibino
807729d36a
Create internal asynqtest package for test helpers
2019-12-29 10:05:02 -08:00
Ken Hibino
49d6ab5df0
Clean up rdb package
2019-12-29 10:05:02 -08:00
Ken Hibino
4ceb49cfd1
Minor improvements
2019-12-28 06:41:39 -08:00
Ken Hibino
5b98b8eb62
Add KillRetryTask, KillScheduledTask methods to RDB
2019-12-27 15:17:45 -08:00
Ken Hibino
b2161a481d
Record processed and failure daily count
2019-12-24 20:05:46 -08:00
Ken Hibino
3fd248615b
Create base internal package
2019-12-22 07:40:25 -08:00
Ken Hibino
33e9da953d
Log warning and info messages when unfinished tasks get aborted
2019-12-18 18:55:08 -08:00
Ken Hibino
5ddba8ca98
Unblock processor shutdown process if processor is waiting for semaphore
...
token
2019-12-17 20:07:17 -08:00
Ken Hibino
442b33a6d2
Remove (*RDB).RetryLater in favor of Retry method
2019-12-15 17:18:43 -08:00
Ken Hibino
d84e8c0ff2
Modify (*RDB).Kill method to atomically move task from in_progress to
...
dead queue
2019-12-15 17:16:13 -08:00
Ken Hibino
1b1662bb12
Add Retry method to *RDB
...
(*RDB).Retry method takes a TaskMessage and will atomically moves the
message from in_progress queue to retry queue. Additionally it
increments the Retried counter and assigns the error message to the
message.
2019-12-15 16:15:07 -08:00
Ken Hibino
04836194f9
Clean up rdb package tests
2019-12-14 13:43:06 -08:00
Ken Hibino
9410a65338
Rename randomTask test helper to newTaskMessage
2019-12-12 19:45:03 -08:00
Ken Hibino
edcd70b221
Replace google/uuid package with rs/xid for more compact id
2019-12-11 07:41:38 -08:00
Ken Hibino
680a2cf3df
Add methods to rdb.RDB to enqueues a task from scheduled, retry, dead
...
queues
2019-12-08 14:12:02 -08:00
