77 Commits

Author	SHA1	Message	Date
lion.zhao	81bb52b08c	processor: log detail err in markAsDone func	2020-06-10 05:57:31 -07:00
Ken Hibino	06c4a1c7f8	Limit the number of tasks moved by CheckAndEnqueue to prevent a long ... running script	2020-06-08 06:06:18 -07:00
Ken Hibino	363cfedb49	Update Dequeue operation to skip paused queues	2020-06-08 06:06:18 -07:00
Ken Hibino	a38f628f3b	Refactor server state management	2020-05-31 06:41:19 -07:00
Ken Hibino	23f46dde52	Add helper functions to extract task metadata from context	2020-05-29 05:40:42 -07:00
lihe	39188fe930	remove typo and redundant code	2020-05-22 05:11:54 -07:00
Ken Hibino	4492ed9255	Change internal constructor signatures. ... Created "params" type to avoid positional arguments. Personally it feels more explicit and reads better.	2020-05-17 13:25:24 -07:00
Ken Hibino	60cbf8dc5a	Minor code cleanup	2020-05-16 08:00:35 -07:00
Ken Hibino	fb38086590	Clean up log messages ... Moved development purpose log messages to DEBUG level.	2020-05-16 08:00:35 -07:00
Ken Hibino	b63476ddc8	Simplify Logger interface	2020-05-16 08:00:35 -07:00
Ken Hibino	24f2b64c6c	Make sure to invoke CancelFunc in all cases	2020-05-03 15:58:23 -07:00
Ken Hibino	7c7f8e5f30	Move Broker interface to base package	2020-04-19 08:51:17 -07:00
Ken Hibino	f8a94fb839	Define broker interface	2020-04-19 08:51:17 -07:00
Ken Hibino	4df372b369	Allow user to configure shutdown timeout	2020-04-19 08:51:17 -07:00
Ken Hibino	aafd8a5b74	Rename internal ProcessState to ServerState	2020-04-19 08:51:17 -07:00
Ken Hibino	b14c73809e	Refactor server state	2020-04-19 08:51:17 -07:00
Ken Hibino	0bc6eba021	Allow custom logger to be used in Background	2020-03-12 08:40:37 -07:00
Ken Hibino	d664d68fa4	Extract out log package	2020-03-09 07:17:52 -07:00
Ken Hibino	3c722386b0	Add Deadline option when enqueuing tasks ... Deadline option sets the deadline for the given task's context deadline.	2020-03-08 17:12:42 -07:00
Ken Hibino	a4e4c0b1d5	Call error handler when task was not processed successfully	2020-02-29 22:09:13 -08:00
Ken Hibino	e3c9aae8c7	Include worker stats to ProcessState	2020-02-22 08:56:51 -08:00
Ken Hibino	830020eb39	Add ProcessState type to base package	2020-02-22 08:56:51 -08:00
Ken Hibino	3d9a222bb3	Use sync.WaitGroup for shutdown	2020-02-16 18:22:59 -08:00
Ken Hibino	2bcaea52ce	Make heartbeater goroutine a monitor goroutine for process info.	2020-02-16 18:22:59 -08:00
Ken Hibino	d33ca98648	Use int as priority value type. ... Do not use unsigned int for merely non-negative quantities as it complicates simple arithmetic.	2020-02-13 06:23:51 -08:00
Ken Hibino	6685827147	Add redis pubsub subscriber for cancelation	2020-02-13 06:23:51 -08:00
Ken Hibino	39459b4412	Allow user to specify timeout per task	2020-02-13 06:23:51 -08:00
Ken Hibino	6e14062325	Send cancellation signal to all in-progress handlers on shutdown	2020-02-13 06:23:51 -08:00
Ken Hibino	1b41c721b4	Change Handler interface to take context.Context	2020-02-13 06:23:51 -08:00
Ken Hibino	d9327cf24b	Avoid creating script struct on every rdb method invocation	2020-02-09 09:34:41 -08:00
Ken Hibino	96f06ac89b	Add ps command to asynqmon	2020-02-02 20:56:33 -08:00
Ken Hibino	44c657bec6	Rate limit error logs	2020-01-22 06:36:18 -08:00
Ken Hibino	db8e9d05c3	Add custom logger	2020-01-22 06:02:53 -08:00
Ken Hibino	c29200b1fc	Add syncer to retry failed redis commands	2020-01-18 15:07:15 -08:00
Ken Hibino	5a6f737589	[performance] Use BRPOPLPUSH if one queue is used	2020-01-14 20:46:47 -08:00
Ken Hibino	874d8e8843	Add RDB.RemoveQueue method	2020-01-14 06:02:00 -08:00
Ken Hibino	84eef4ed0b	Add strict-priority option	2020-01-12 18:39:57 -08:00
Ken Hibino	390eb13149	Remove stale field in processor struct	2020-01-11 10:09:15 -08:00
Ken Hibino	8d9a2d1313	Update processor to query queues based on priority	2020-01-07 21:55:18 -08:00
Ken Hibino	53d0902808	Change RDB.Dequeue to query multiple queues	2020-01-07 21:55:18 -08:00
Ken Hibino	03cb6eef09	Add Queues field to Config	2020-01-07 21:55:18 -08:00
Ken Hibino	f3a23b9b12	Make Task type immutable ... This change makes it impossible to mutate payload within Handler or RetryDelayFunc.	2020-01-05 09:55:39 -08:00
Ken Hibino	c62833540c	Add license comment to all src files	2020-01-02 18:13:16 -08:00
Ken Hibino	ade97befbc	Minor cleanup	2019-12-30 07:14:49 -08:00
Ken Hibino	22b21df884	Allow user to specify retry delay duration	2019-12-30 07:14:49 -08:00
Ken Hibino	6491f46955	Minor cleanup	2019-12-25 20:04:29 -08:00
Ken Hibino	3fd248615b	Create base internal package	2019-12-22 07:40:25 -08:00
Ken Hibino	8b98b6e5a0	Rename channel name	2019-12-18 18:57:48 -08:00
Ken Hibino	33e9da953d	Log warning and info messages when unfinished tasks get aborted	2019-12-18 18:55:08 -08:00
Ken Hibino	69b46a7f0d	Use sync.Once	2019-12-17 20:34:56 -08:00