Pior Bastida
3dbda60333
Improve performance of enqueueing tasks ( #946 )
...
* Improve performance of enqueueing tasks
Add an in-memory cache to keep track of all the queues. Use this cache
to avoid sending an SADD since after the first call, that extra network
call isn't necessary.
The cache will expire every 10 secs so for cases where the queue is
deleted from asynq:queues set, it can be added again next time a task is
enqueued to it.
* Use sync.Map to simplify the conditional SADD
* Cleanup queuePublished in RemoveQueue
---------
Co-authored-by: Yousif <753751+yousifh@users.noreply.github.com>
2024-10-30 08:25:35 +03:00
Ahmed Radwan
e70de721b8
remove deprecated protobuf ptypes ( #942 )
...
* remove deprecated protobuf ptypes
* tidy compiled proto and go mod
* bump protobuf
2024-10-29 09:21:27 +03:00
Pior Bastida
03f4799712
Run golangci-lint in CI ( #927 )
...
* Setup golangci-lint in CI and local-dev
* Fix linting error or locally disable linter
2024-10-26 08:48:12 +03:00
Harrison Miller
0dc670d7d8
Archived tasks that are trimmed from the set are deleted ( #743 )
...
* fixed trimmed archive tasks not being deleted.
* improved test case.
* changed ZRANGEBYSCORE to ZRANGE with BYSCORE option.
---------
Co-authored-by: Harrison <harrison@Harrisons-MacBook-Pro.local>
Co-authored-by: Harrison Miller <harrison.miller@MBP-Harrison-Miller-M2.local>
2024-10-19 09:18:09 +03:00
Tedja
d04888e748
feature: configurable janitor interval and deletion batch size ( #715 )
...
* feature: configurable janitor interval and deletion batch size
* warn user when they set a big number of janitor batch size
* Update CHANGELOG.md
---------
Co-authored-by: Agung Hariadi Tedja <agung.tedja@kumparan.com>
2024-05-06 14:11:52 +08:00
camcui
b35b559d40
chore: fix function names in comment
...
Signed-off-by: camcui <cuishua@sina.cn>
2024-04-12 13:54:08 +08:00
yeqown
1e0bf88bf3
fix: listLeaseExpiredCmd doesn't ignore possibly empty value of task in lua script
2023-12-10 09:47:55 -08:00
yeqown
d0041c55a3
fix(274): ignore empty data to append to msgs
...
fix issue 274
2023-12-10 09:47:55 -08:00
Trịnh Đức Bảo Linh(Kevin)
551b0c7119
feat (add): panic error handling ( #491 )
...
* closes #487
2023-07-20 21:33:39 +08:00
guoguangwu
e4b8663154
chore: unnecessary use of fmt.Sprintf
2023-07-07 20:45:42 -07:00
Ken Hibino
fde294be32
v0.24.1
2023-05-01 06:48:07 -07:00
Phước Trung
c72bfef094
fix unit test
...
Signed-off-by: Mohammed Sohail <sohailsameja@gmail.com>
2023-04-17 22:30:33 -07:00
Emanuel Bennici
0275df8df4
Update redis/go-redis to v9
...
Version v9 implements the support for Redis v7 and has some
other improvements.
2023-04-17 22:30:33 -07:00
cui fliter
cc777ebdaa
fix some typos
...
Signed-off-by: cui fliter <imcusg@gmail.com>
2023-01-05 20:03:02 -08:00
Ken Hibino
783071c47f
v0.24.0
2023-01-02 14:55:33 -08:00
Ken Hibino
bafed907e9
Fix redis script error
2023-01-02 14:53:45 -08:00
Trịnh Đức Bảo Linh
30d409371b
Fix comment typos
2022-05-16 21:14:15 -07:00
Erwan Leboucher
5c723f597e
Correct the error message to cancel an active tasks
2022-04-13 06:08:46 -07:00
Ken Hibino
245d4fe663
v0.23.0
2022-04-11 16:57:33 -07:00
Ken Hibino
de139cc18e
Update RDB.RunTask to schedule aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
74db013ab9
Add RDB.RunAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
725105ca03
Update RDB.ArchiveTask to archive aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
d8f31e45f1
Add RDB.ArchiveAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
9023cbf4be
Update RDB.DeleteTask to handle aggregating task
2022-04-11 16:55:43 -07:00
Ken Hibino
9279c09125
Add RDB.DeleteAllAggregatingTasks
2022-04-11 16:55:43 -07:00
Ken Hibino
bc27126670
Fix memory usage lua script
2022-04-11 16:55:43 -07:00
Ken Hibino
0cfa7f47ba
Fix memory_usage lua script
2022-04-11 16:55:43 -07:00
Ken Hibino
71bd8f0535
Add RDB.ListAggregating
2022-04-11 16:55:43 -07:00
Ken Hibino
4c8432e0ce
Add Inspector.Groups method
2022-04-11 16:55:43 -07:00
Ken Hibino
e939b5d166
Rename asynqtest package to testutil
2022-04-11 16:55:43 -07:00
Ken Hibino
1acd62c760
Move test helpers to asynqtest package
2022-04-11 16:55:43 -07:00
Ken Hibino
0149396bae
Add RDB.GroupStats for inspecting groups
2022-04-11 16:55:43 -07:00
Ken Hibino
47af17cfb4
Fix RDB.CurrentStats to report the correct queue size
2022-04-11 16:55:43 -07:00
Ken Hibino
eb064c2bab
Fix AggregationCheck with unlimited size to clear group name from
...
all-groups set
2022-04-11 16:55:43 -07:00
Ken Hibino
652939dd3a
Update memory usage redis lua script to account for groups
2022-04-11 16:55:43 -07:00
Ken Hibino
efe3c74037
Show number of groups and aggregating task count in QueueInfo
2022-04-11 16:55:43 -07:00
Ken Hibino
74d2eea4e0
Clear group if aggregation set empties the group
2022-04-11 16:55:43 -07:00
Ken Hibino
60a4dc1401
Add test for DeleteAggregationSet error case
2022-04-11 16:55:43 -07:00
Ken Hibino
4b716780ef
Rewrite test for DeleteAggregationSet function with a new pattern
2022-04-11 16:55:43 -07:00
Ken Hibino
e63f41fb24
Fix DeleteAggregationSet
2022-04-11 16:55:43 -07:00
Ken Hibino
1c388baf06
Implement RDB.ReclaimStaleAggregationSets
2022-04-11 16:55:43 -07:00
Ken Hibino
47a66231b3
Store aggregation set *key* in all aggreationsets zset
2022-04-11 16:55:43 -07:00
Ken Hibino
3551d3334c
Use zset for aggregation set to preserve score
2022-04-11 16:55:43 -07:00
Ken Hibino
8b16ede8bc
Declare ReclaimStaleAggregationSets
2022-04-11 16:55:43 -07:00
Ken Hibino
562506c7ba
Fix client to return error when nil task is passed
2022-04-11 16:55:43 -07:00
Ken Hibino
888b5590fb
Make GroupMaxSize and GroupMaxDelay config optional
2022-04-11 16:55:43 -07:00
Ken Hibino
4b35eb0e1a
Fix RDB.AggregationCheck when run against an empty group
2022-04-11 16:55:43 -07:00
Ken Hibino
b29fe58434
Implement RDB.ListGroups
2022-04-11 16:55:43 -07:00
Ken Hibino
7849b1114c
Implement RDB.DeleteAggregationSet
2022-04-11 16:55:43 -07:00
Ken Hibino
99c00bffeb
Implement RDB.AggregationCheck
2022-04-11 16:55:43 -07:00
