254 Commits

Author	SHA1	Message	Date
Ken Hibino	4a86d42fd7	Add RDB.DeleteAllAggregatingTasks	2022-03-27 15:52:46 -07:00
Ken Hibino	36ddadcc3a	Fix memory usage lua script	2022-03-26 14:33:03 -07:00
Ken Hibino	3d918f3986	Fix memory_usage lua script	2022-03-23 16:21:45 -07:00
Ken Hibino	a278e31710	Add RDB.ListAggregating	2022-03-22 06:52:03 -07:00
Ken Hibino	ba709fd4c4	Add Inspector.Groups method	2022-03-22 06:52:03 -07:00
Ken Hibino	c28293b3b7	Rename asynqtest package to testutil	2022-03-22 06:52:03 -07:00
Ken Hibino	ba3eafaf94	Move test helpers to asynqtest package	2022-03-22 06:52:03 -07:00
Ken Hibino	471c4ff1ed	Add RDB.GroupStats for inspecting groups	2022-03-22 06:52:03 -07:00
Ken Hibino	1a513a529b	Fix RDB.CurrentStats to report the correct queue size	2022-03-22 06:52:03 -07:00
Ken Hibino	bfd0980d7a	Fix AggregationCheck with unlimited size to clear group name from ... all-groups set	2022-03-22 06:52:03 -07:00
Ken Hibino	1998ca80ea	Update memory usage redis lua script to account for groups	2022-03-22 06:52:03 -07:00
Ken Hibino	7fa02db7ff	Show number of groups and aggregating task count in QueueInfo	2022-03-22 06:52:03 -07:00
Ken Hibino	6bdce095dd	Clear group if aggregation set empties the group	2022-03-22 06:52:03 -07:00
Ken Hibino	d43eb5a447	Add test for DeleteAggregationSet error case	2022-03-22 06:52:03 -07:00
Ken Hibino	ae7b20634c	Rewrite test for DeleteAggregationSet function with a new pattern	2022-03-22 06:52:03 -07:00
Ken Hibino	4d797f55d8	Fix DeleteAggregationSet	2022-03-22 06:52:03 -07:00
Ken Hibino	979fcfd2e9	Implement RDB.ReclaimStaleAggregationSets	2022-03-22 06:52:03 -07:00
Ken Hibino	574de97db3	Store aggregation set *key* in all aggreationsets zset	2022-03-22 06:52:03 -07:00
Ken Hibino	26bf13485b	Use zset for aggregation set to preserve score	2022-03-22 06:52:03 -07:00
Ken Hibino	df85894c5c	Declare ReclaimStaleAggregationSets	2022-03-22 06:52:03 -07:00
Ken Hibino	167c8678f5	Make GroupMaxSize and GroupMaxDelay config optional	2022-03-22 06:52:03 -07:00
Ken Hibino	d164bdcdb6	Fix RDB.AggregationCheck when run against an empty group	2022-03-22 06:52:03 -07:00
Ken Hibino	bc89901b3e	Implement RDB.ListGroups	2022-03-22 06:52:02 -07:00
Ken Hibino	d0907657f8	Implement RDB.DeleteAggregationSet	2022-03-22 06:52:02 -07:00
Ken Hibino	bcb8e2b452	Implement RDB.AggregationCheck	2022-03-22 06:52:02 -07:00
Ken Hibino	af9ac9aa71	Add initial implementation of aggregator	2022-03-22 06:52:02 -07:00
Ken Hibino	39cf648c02	Update ForwardIfReady test with group	2022-03-22 06:52:02 -07:00
Ken Hibino	17e9725287	Update RDB.ForwardIfReady to forward to group if groupKey is specified	2022-03-22 06:52:02 -07:00
Ken Hibino	278b2d7431	Add RDB.AddToGroup and RDB.AddToGroupUnique methods	2022-03-22 06:52:02 -07:00
Ken Hibino	7e5efb0e30	Drop GT option from RDB.ExtendLease ... GT option in ZAdd is supported for redis v6.2.0 or above. This Change fixes redis version compatibility (currently v4.0+)	2022-02-20 06:20:38 -08:00
Ken Hibino	d4006894ad	Remove base.DeadlinesKey	2022-02-19 06:15:44 -08:00
Ken Hibino	59927509d8	Remove timeout and deadline fields under task key	2022-02-19 06:15:44 -08:00
Ken Hibino	dfae8638e1	Update RDB methods to work with lease	2022-02-19 06:15:44 -08:00
Ken Hibino	87dc392c7f	Add RDB.ExtendLease method	2022-02-19 06:15:44 -08:00
Ken Hibino	bc2f1986d7	Update ListDeadlineExceeded to ListLeaseExpired	2022-02-19 06:15:44 -08:00
Ken Hibino	b8cb579407	Update RDB methods to use lease instead of deadlines set	2022-02-19 06:15:44 -08:00
Ken Hibino	d865d89900	Update RDB.Dequeue to insert task ID to lease set	2022-02-19 06:15:44 -08:00
Ken Hibino	aa26f3819e	Fix flaky tests	2022-01-05 09:07:42 -08:00
Ken Hibino	8dfabfccb3	Fix build	2021-12-19 07:06:37 -08:00
Ken Hibino	1ddb2f7bce	Use math.MaxInt64 instead of custom const	2021-12-19 06:58:12 -08:00
Ken Hibino	82d18e3d91	Record total tasks processed/failed	2021-12-16 16:53:02 -08:00
Ken Hibino	157e97e72e	Update changelog	2021-12-11 10:29:43 -08:00
Ken Hibino	22e6c9d297	Delete "pending_since" under task-key when state changes to active	2021-12-11 10:29:43 -08:00
Ken Hibino	99a6750656	Add Latency field to QueueInfo	2021-12-11 10:29:43 -08:00
Ken Hibino	e7c1c3ad6f	Use clock in RDB	2021-12-11 10:29:43 -08:00
Ken Hibino	6e7106c8f2	Record time when task moved to pending state	2021-12-11 10:29:43 -08:00
Ken Hibino	9f2c321e98	Add EnqueueContext method to Client	2021-11-15 16:34:26 -08:00
Ken Hibino	f4ddac4dcc	Introduce Task Results ... * Added Retention Option to specify retention TTL for tasks * Added ResultWriter as a client interface to write result data for the associated task	2021-11-06 15:18:42 -07:00
Ken Hibino	4638405cbd	Fix flaky test	2021-11-06 15:18:42 -07:00
Ken Hibino	dbdd9c6d5f	Update RDB Enqueue and Schedule methods to check for task ID conflict	2021-11-06 15:18:42 -07:00