799 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ken Hibino	0e2e3cedab	Update RDB.ArchiveTask to archive aggregating task	2022-03-28 06:59:57 -07:00
Ken Hibino	082fbb7ffc	Add RDB.ArchiveAllAggregatingTasks	2022-03-28 06:29:44 -07:00
Ken Hibino	edca226858	Update RDB.DeleteTask to handle aggregating task	2022-03-27 16:25:03 -07:00
Ken Hibino	4a86d42fd7	Add RDB.DeleteAllAggregatingTasks	2022-03-27 15:52:46 -07:00
Ken Hibino	36ddadcc3a	Fix memory usage lua script	2022-03-26 14:33:03 -07:00
Ken Hibino	3d918f3986	Fix memory_usage lua script	2022-03-23 16:21:45 -07:00
Ken Hibino	1647dee155	Update go.mod with replace directive	2022-03-22 06:52:03 -07:00
Ken Hibino	6579e44710	Add Inspector.ListAggregatingTasks	2022-03-22 06:52:03 -07:00
Ken Hibino	a278e31710	Add RDB.ListAggregating	2022-03-22 06:52:03 -07:00
Ken Hibino	ba709fd4c4	Add Inspector.Groups method	2022-03-22 06:52:03 -07:00
Ken Hibino	c28293b3b7	Rename asynqtest package to testutil	2022-03-22 06:52:03 -07:00
Ken Hibino	ba3eafaf94	Move test helpers to asynqtest package	2022-03-22 06:52:03 -07:00
Ken Hibino	471c4ff1ed	Add RDB.GroupStats for inspecting groups	2022-03-22 06:52:03 -07:00
Ken Hibino	cf1979ced9	Add Group field to TaskInfo struct	2022-03-22 06:52:03 -07:00
Ken Hibino	1e8756a52d	(cli): Update queue inspect cmd to show # of groups and aggregating tasks	2022-03-22 06:52:03 -07:00
Ken Hibino	1a513a529b	Fix RDB.CurrentStats to report the correct queue size	2022-03-22 06:52:03 -07:00
Ken Hibino	bfd0980d7a	Fix AggregationCheck with unlimited size to clear group name from ... all-groups set	2022-03-22 06:52:03 -07:00
Ken Hibino	1998ca80ea	Update memory usage redis lua script to account for groups	2022-03-22 06:52:03 -07:00
Ken Hibino	7fa02db7ff	Show number of groups and aggregating task count in QueueInfo	2022-03-22 06:52:03 -07:00
Ken Hibino	6bdce095dd	Clear group if aggregation set empties the group	2022-03-22 06:52:03 -07:00
Ken Hibino	d43eb5a447	Add test for DeleteAggregationSet error case	2022-03-22 06:52:03 -07:00
Ken Hibino	ae7b20634c	Rewrite test for DeleteAggregationSet function with a new pattern	2022-03-22 06:52:03 -07:00
Ken Hibino	4d797f55d8	Fix DeleteAggregationSet	2022-03-22 06:52:03 -07:00
Ken Hibino	979fcfd2e9	Implement RDB.ReclaimStaleAggregationSets	2022-03-22 06:52:03 -07:00
Ken Hibino	574de97db3	Store aggregation set *key* in all aggreationsets zset	2022-03-22 06:52:03 -07:00
Ken Hibino	26bf13485b	Use zset for aggregation set to preserve score	2022-03-22 06:52:03 -07:00
Ken Hibino	df85894c5c	Declare ReclaimStaleAggregationSets	2022-03-22 06:52:03 -07:00
Ken Hibino	1f23b66e60	Add aggregator test	2022-03-22 06:52:03 -07:00
Ken Hibino	7860506e1e	Fix client to return error when nil task is passed	2022-03-22 06:52:03 -07:00
Ken Hibino	167c8678f5	Make GroupMaxSize and GroupMaxDelay config optional	2022-03-22 06:52:03 -07:00
Ken Hibino	084fbbda0e	Run aggregator on the server	2022-03-22 06:52:03 -07:00
Ken Hibino	d164bdcdb6	Fix RDB.AggregationCheck when run against an empty group	2022-03-22 06:52:03 -07:00
Ken Hibino	bc89901b3e	Implement RDB.ListGroups	2022-03-22 06:52:02 -07:00
Ken Hibino	d0907657f8	Implement RDB.DeleteAggregationSet	2022-03-22 06:52:02 -07:00
Ken Hibino	bcb8e2b452	Implement RDB.AggregationCheck	2022-03-22 06:52:02 -07:00
Ken Hibino	00f1c8ecf3	Check for aggregation at an interval <= gracePeriod	2022-03-22 06:52:02 -07:00
Ken Hibino	af9ac9aa71	Add initial implementation of aggregator	2022-03-22 06:52:02 -07:00
Ken Hibino	68f0be934e	Update client dependency to base.Broker	2022-03-22 06:52:02 -07:00
Ken Hibino	4418143729	Add TaskMessageBuilder type as a test helper	2022-03-22 06:52:02 -07:00
Ken Hibino	15619fc890	Update forwarder to use time.Timer	2022-03-22 06:52:02 -07:00
Ken Hibino	39cf648c02	Update ForwardIfReady test with group	2022-03-22 06:52:02 -07:00
Ken Hibino	19229645ff	Update client to store groupKey under TaskMessage	2022-03-22 06:52:02 -07:00
Ken Hibino	47acff3684	Add GroupKey field to TaskMessage	2022-03-22 06:52:02 -07:00
Ken Hibino	17e9725287	Update RDB.ForwardIfReady to forward to group if groupKey is specified	2022-03-22 06:52:02 -07:00
Ken Hibino	a88f6498af	Update Client to add task to group if Group option is specified	2022-03-22 06:52:02 -07:00
Ken Hibino	278b2d7431	Add RDB.AddToGroup and RDB.AddToGroupUnique methods	2022-03-22 06:52:02 -07:00
Ken Hibino	19f127b30e	Add helper functions to generate group key	2022-03-22 06:52:02 -07:00
Ken Hibino	976f76fe5e	Add Group task option	2022-03-22 06:52:02 -07:00
Ken Hibino	91a62214d6	Add group related configuration options	2022-03-22 06:52:02 -07:00
Ken Hibino	f94a65dc9f	Add go1.18 to build workflow matrix	2022-03-22 06:51:28 -07:00