261 Commits

Author	SHA1	Message	Date
Erwan Leboucher	5c723f597e	Correct the error message to cancel an active tasks	2022-04-13 06:08:46 -07:00
Ken Hibino	de139cc18e	Update RDB.RunTask to schedule aggregating task	2022-04-11 16:55:43 -07:00
Ken Hibino	74db013ab9	Add RDB.RunAllAggregatingTasks	2022-04-11 16:55:43 -07:00
Ken Hibino	725105ca03	Update RDB.ArchiveTask to archive aggregating task	2022-04-11 16:55:43 -07:00
Ken Hibino	d8f31e45f1	Add RDB.ArchiveAllAggregatingTasks	2022-04-11 16:55:43 -07:00
Ken Hibino	9023cbf4be	Update RDB.DeleteTask to handle aggregating task	2022-04-11 16:55:43 -07:00
Ken Hibino	9279c09125	Add RDB.DeleteAllAggregatingTasks	2022-04-11 16:55:43 -07:00
Ken Hibino	bc27126670	Fix memory usage lua script	2022-04-11 16:55:43 -07:00
Ken Hibino	0cfa7f47ba	Fix memory_usage lua script	2022-04-11 16:55:43 -07:00
Ken Hibino	71bd8f0535	Add RDB.ListAggregating	2022-04-11 16:55:43 -07:00
Ken Hibino	4c8432e0ce	Add Inspector.Groups method	2022-04-11 16:55:43 -07:00
Ken Hibino	e939b5d166	Rename asynqtest package to testutil	2022-04-11 16:55:43 -07:00
Ken Hibino	1acd62c760	Move test helpers to asynqtest package	2022-04-11 16:55:43 -07:00
Ken Hibino	0149396bae	Add RDB.GroupStats for inspecting groups	2022-04-11 16:55:43 -07:00
Ken Hibino	47af17cfb4	Fix RDB.CurrentStats to report the correct queue size	2022-04-11 16:55:43 -07:00
Ken Hibino	eb064c2bab	Fix AggregationCheck with unlimited size to clear group name from ... all-groups set	2022-04-11 16:55:43 -07:00
Ken Hibino	652939dd3a	Update memory usage redis lua script to account for groups	2022-04-11 16:55:43 -07:00
Ken Hibino	efe3c74037	Show number of groups and aggregating task count in QueueInfo	2022-04-11 16:55:43 -07:00
Ken Hibino	74d2eea4e0	Clear group if aggregation set empties the group	2022-04-11 16:55:43 -07:00
Ken Hibino	60a4dc1401	Add test for DeleteAggregationSet error case	2022-04-11 16:55:43 -07:00
Ken Hibino	4b716780ef	Rewrite test for DeleteAggregationSet function with a new pattern	2022-04-11 16:55:43 -07:00
Ken Hibino	e63f41fb24	Fix DeleteAggregationSet	2022-04-11 16:55:43 -07:00
Ken Hibino	1c388baf06	Implement RDB.ReclaimStaleAggregationSets	2022-04-11 16:55:43 -07:00
Ken Hibino	47a66231b3	Store aggregation set *key* in all aggreationsets zset	2022-04-11 16:55:43 -07:00
Ken Hibino	3551d3334c	Use zset for aggregation set to preserve score	2022-04-11 16:55:43 -07:00
Ken Hibino	8b16ede8bc	Declare ReclaimStaleAggregationSets	2022-04-11 16:55:43 -07:00
Ken Hibino	888b5590fb	Make GroupMaxSize and GroupMaxDelay config optional	2022-04-11 16:55:43 -07:00
Ken Hibino	4b35eb0e1a	Fix RDB.AggregationCheck when run against an empty group	2022-04-11 16:55:43 -07:00
Ken Hibino	b29fe58434	Implement RDB.ListGroups	2022-04-11 16:55:43 -07:00
Ken Hibino	7849b1114c	Implement RDB.DeleteAggregationSet	2022-04-11 16:55:43 -07:00
Ken Hibino	99c00bffeb	Implement RDB.AggregationCheck	2022-04-11 16:55:43 -07:00
Ken Hibino	d841dc2f8d	Add initial implementation of aggregator	2022-04-11 16:55:43 -07:00
Ken Hibino	ed69667e86	Update ForwardIfReady test with group	2022-04-11 16:55:43 -07:00
Ken Hibino	61854ea1dc	Update RDB.ForwardIfReady to forward to group if groupKey is specified	2022-04-11 16:55:43 -07:00
Ken Hibino	8b582899ad	Add RDB.AddToGroup and RDB.AddToGroupUnique methods	2022-04-11 16:55:43 -07:00
ashang	3f4f0c1daa	Use explicit types for limit constants	2022-03-29 06:30:10 -07:00
Ken Hibino	7e5efb0e30	Drop GT option from RDB.ExtendLease ... GT option in ZAdd is supported for redis v6.2.0 or above. This Change fixes redis version compatibility (currently v4.0+)	2022-02-20 06:20:38 -08:00
Ken Hibino	d4006894ad	Remove base.DeadlinesKey	2022-02-19 06:15:44 -08:00
Ken Hibino	59927509d8	Remove timeout and deadline fields under task key	2022-02-19 06:15:44 -08:00
Ken Hibino	dfae8638e1	Update RDB methods to work with lease	2022-02-19 06:15:44 -08:00
Ken Hibino	87dc392c7f	Add RDB.ExtendLease method	2022-02-19 06:15:44 -08:00
Ken Hibino	bc2f1986d7	Update ListDeadlineExceeded to ListLeaseExpired	2022-02-19 06:15:44 -08:00
Ken Hibino	b8cb579407	Update RDB methods to use lease instead of deadlines set	2022-02-19 06:15:44 -08:00
Ken Hibino	d865d89900	Update RDB.Dequeue to insert task ID to lease set	2022-02-19 06:15:44 -08:00
Ken Hibino	aa26f3819e	Fix flaky tests	2022-01-05 09:07:42 -08:00
Ken Hibino	8dfabfccb3	Fix build	2021-12-19 07:06:37 -08:00
Ken Hibino	1ddb2f7bce	Use math.MaxInt64 instead of custom const	2021-12-19 06:58:12 -08:00
Ken Hibino	82d18e3d91	Record total tasks processed/failed	2021-12-16 16:53:02 -08:00
Ken Hibino	157e97e72e	Update changelog	2021-12-11 10:29:43 -08:00
Ken Hibino	22e6c9d297	Delete "pending_since" under task-key when state changes to active	2021-12-11 10:29:43 -08:00