Pior Bastida
3dbda60333
Improve performance of enqueueing tasks ( #946 )
...
* Improve performance of enqueueing tasks
Add an in-memory cache to keep track of all the queues. Use this cache
to avoid sending an SADD since after the first call, that extra network
call isn't necessary.
The cache will expire every 10 secs so for cases where the queue is
deleted from asynq:queues set, it can be added again next time a task is
enqueued to it.
* Use sync.Map to simplify the conditional SADD
* Cleanup queuePublished in RemoveQueue
---------
Co-authored-by: Yousif <753751+yousifh@users.noreply.github.com>
2024-10-30 08:25:35 +03:00
Pior Bastida
03f4799712
Run golangci-lint in CI ( #927 )
...
* Setup golangci-lint in CI and local-dev
* Fix linting error or locally disable linter
2024-10-26 08:48:12 +03:00
Harrison Miller
0dc670d7d8
Archived tasks that are trimmed from the set are deleted ( #743 )
...
* fixed trimmed archive tasks not being deleted.
* improved test case.
* changed ZRANGEBYSCORE to ZRANGE with BYSCORE option.
---------
Co-authored-by: Harrison <harrison@Harrisons-MacBook-Pro.local>
Co-authored-by: Harrison Miller <harrison.miller@MBP-Harrison-Miller-M2.local>
2024-10-19 09:18:09 +03:00
Tedja
d04888e748
feature: configurable janitor interval and deletion batch size ( #715 )
...
* feature: configurable janitor interval and deletion batch size
* warn user when they set a big number of janitor batch size
* Update CHANGELOG.md
---------
Co-authored-by: Agung Hariadi Tedja <agung.tedja@kumparan.com>
2024-05-06 14:11:52 +08:00
camcui
b35b559d40
chore: fix function names in comment
...
Signed-off-by: camcui <cuishua@sina.cn>
2024-04-12 13:54:08 +08:00
yeqown
1e0bf88bf3
fix: listLeaseExpiredCmd doesn't ignore possibly empty value of task in lua script
2023-12-10 09:47:55 -08:00
yeqown
d0041c55a3
fix(274): ignore empty data to append to msgs
...
fix issue 274
2023-12-10 09:47:55 -08:00
guoguangwu
e4b8663154
chore: unnecessary use of fmt.Sprintf
2023-07-07 20:45:42 -07:00
Phước Trung
c72bfef094
fix unit test
...
Signed-off-by: Mohammed Sohail <sohailsameja@gmail.com>
2023-04-17 22:30:33 -07:00
Emanuel Bennici
0275df8df4
Update redis/go-redis to v9
...
Version v9 implements the support for Redis v7 and has some
other improvements.
2023-04-17 22:30:33 -07:00
cui fliter
cc777ebdaa
fix some typos
...
Signed-off-by: cui fliter <imcusg@gmail.com>
2023-01-05 20:03:02 -08:00
Ken Hibino
bafed907e9
Fix redis script error
2023-01-02 14:53:45 -08:00
Erwan Leboucher
5c723f597e
Correct the error message to cancel an active tasks
2022-04-13 06:08:46 -07:00
Ken Hibino
de139cc18e
Update RDB.RunTask to schedule aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
74db013ab9
Add RDB.RunAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
725105ca03
Update RDB.ArchiveTask to archive aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
d8f31e45f1
Add RDB.ArchiveAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
9023cbf4be
Update RDB.DeleteTask to handle aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
9279c09125
Add RDB.DeleteAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
bc27126670
Fix memory usage lua script
2022-04-11 16:55:43 -07:00
Ken Hibino
0cfa7f47ba
Fix memory_usage lua script
2022-04-11 16:55:43 -07:00
Ken Hibino
71bd8f0535
Add RDB.ListAggregating
2022-04-11 16:55:43 -07:00
Ken Hibino
4c8432e0ce
Add Inspector.Groups method
2022-04-11 16:55:43 -07:00
Ken Hibino
e939b5d166
Rename asynqtest package to testutil
2022-04-11 16:55:43 -07:00
Ken Hibino
1acd62c760
Move test helpers to asynqtest package
2022-04-11 16:55:43 -07:00
Ken Hibino
0149396bae
Add RDB.GroupStats for inspecting groups
2022-04-11 16:55:43 -07:00
Ken Hibino
47af17cfb4
Fix RDB.CurrentStats to report the correct queue size
2022-04-11 16:55:43 -07:00
Ken Hibino
eb064c2bab
Fix AggregationCheck with unlimited size to clear group name from
...
all-groups set
2022-04-11 16:55:43 -07:00
Ken Hibino
652939dd3a
Update memory usage redis lua script to account for groups
2022-04-11 16:55:43 -07:00
Ken Hibino
efe3c74037
Show number of groups and aggregating task count in QueueInfo
2022-04-11 16:55:43 -07:00
Ken Hibino
74d2eea4e0
Clear group if aggregation set empties the group
2022-04-11 16:55:43 -07:00
Ken Hibino
60a4dc1401
Add test for DeleteAggregationSet error case
2022-04-11 16:55:43 -07:00
Ken Hibino
4b716780ef
Rewrite test for DeleteAggregationSet function with a new pattern
2022-04-11 16:55:43 -07:00
Ken Hibino
e63f41fb24
Fix DeleteAggregationSet
2022-04-11 16:55:43 -07:00
Ken Hibino
1c388baf06
Implement RDB.ReclaimStaleAggregationSets
2022-04-11 16:55:43 -07:00
Ken Hibino
47a66231b3
Store aggregation set *key* in all aggreationsets zset
2022-04-11 16:55:43 -07:00
Ken Hibino
3551d3334c
Use zset for aggregation set to preserve score
2022-04-11 16:55:43 -07:00
Ken Hibino
8b16ede8bc
Declare ReclaimStaleAggregationSets
2022-04-11 16:55:43 -07:00
Ken Hibino
888b5590fb
Make GroupMaxSize and GroupMaxDelay config optional
2022-04-11 16:55:43 -07:00
Ken Hibino
4b35eb0e1a
Fix RDB.AggregationCheck when run against an empty group
2022-04-11 16:55:43 -07:00
Ken Hibino
b29fe58434
Implement RDB.ListGroups
2022-04-11 16:55:43 -07:00
Ken Hibino
7849b1114c
Implement RDB.DeleteAggregationSet
2022-04-11 16:55:43 -07:00
Ken Hibino
99c00bffeb
Implement RDB.AggregationCheck
2022-04-11 16:55:43 -07:00
Ken Hibino
d841dc2f8d
Add initial implementation of aggregator
2022-04-11 16:55:43 -07:00
Ken Hibino
ed69667e86
Update ForwardIfReady test with group
2022-04-11 16:55:43 -07:00
Ken Hibino
61854ea1dc
Update RDB.ForwardIfReady to forward to group if groupKey is specified
2022-04-11 16:55:43 -07:00
Ken Hibino
8b582899ad
Add RDB.AddToGroup and RDB.AddToGroupUnique methods
2022-04-11 16:55:43 -07:00
ashang
3f4f0c1daa
Use explicit types for limit constants
2022-03-29 06:30:10 -07:00
Ken Hibino
7e5efb0e30
Drop GT option from RDB.ExtendLease
...
GT option in ZAdd is supported for redis v6.2.0 or above.
This Change fixes redis version compatibility (currently v4.0+)
2022-02-20 06:20:38 -08:00
Ken Hibino
d4006894ad
Remove base.DeadlinesKey
2022-02-19 06:15:44 -08:00
