Pior Bastida
3dbda60333
Improve performance of enqueueing tasks ( #946 )
...
* Improve performance of enqueueing tasks
Add an in-memory cache to keep track of all the queues. Use this cache
to avoid sending an SADD since after the first call, that extra network
call isn't necessary.
The cache will expire every 10 secs so for cases where the queue is
deleted from asynq:queues set, it can be added again next time a task is
enqueued to it.
* Use sync.Map to simplify the conditional SADD
* Cleanup queuePublished in RemoveQueue
---------
Co-authored-by: Yousif <753751+yousifh@users.noreply.github.com>
2024-10-30 08:25:35 +03:00
dependabot[bot]
02c6dae7eb
Bump golang.org/x/time from 0.3.0 to 0.7.0 ( #948 )
...
Bumps [golang.org/x/time](https://github.com/golang/time ) from 0.3.0 to 0.7.0.
- [Commits](https://github.com/golang/time/compare/v0.3.0...v0.7.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/time
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-29 10:12:44 +03:00
dependabot[bot]
5cfcb71139
Bump github.com/spf13/cast from 1.5.1 to 1.7.0 ( #938 )
...
Bumps [github.com/spf13/cast](https://github.com/spf13/cast ) from 1.5.1 to 1.7.0.
- [Release notes](https://github.com/spf13/cast/releases )
- [Commits](https://github.com/spf13/cast/compare/v1.5.1...v1.7.0 )
---
updated-dependencies:
- dependency-name: github.com/spf13/cast
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-29 09:59:38 +03:00
dependabot[bot]
c78e7b0ccd
Bump golang.org/x/sys from 0.16.0 to 0.26.0 ( #933 )
...
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.16.0 to 0.26.0.
- [Commits](https://github.com/golang/sys/compare/v0.16.0...v0.26.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-29 09:59:20 +03:00
dependabot[bot]
b4db174032
Bump github.com/redis/go-redis/v9 from 9.4.0 to 9.7.0 ( #935 )
...
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis ) from 9.4.0 to 9.7.0.
- [Release notes](https://github.com/redis/go-redis/releases )
- [Changelog](https://github.com/redis/go-redis/blob/master/CHANGELOG.md )
- [Commits](https://github.com/redis/go-redis/compare/v9.4.0...v9.7.0 )
---
updated-dependencies:
- dependency-name: github.com/redis/go-redis/v9
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-29 09:25:57 +03:00
dependabot[bot]
39f1d8c3e6
Bump github.com/fatih/color from 1.9.0 to 1.18.0 in /tools ( #941 )
...
Bumps [github.com/fatih/color](https://github.com/fatih/color ) from 1.9.0 to 1.18.0.
- [Release notes](https://github.com/fatih/color/releases )
- [Commits](https://github.com/fatih/color/compare/v1.9.0...v1.18.0 )
---
updated-dependencies:
- dependency-name: github.com/fatih/color
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-29 09:24:06 +03:00
Ahmed Radwan
e70de721b8
remove deprecated protobuf ptypes ( #942 )
...
* remove deprecated protobuf ptypes
* tidy compiled proto and go mod
* bump protobuf
2024-10-29 09:21:27 +03:00
Mohamed Sohail
6c06ad7e45
Revert "Bump golang.org/x/time from 0.3.0 to 0.7.0" ( #947 )
2024-10-29 09:20:45 +03:00
Mohamed Sohail
a676d3d2fa
Merge pull request #937 from hibiken/dependabot/go_modules/golang.org/x/time-0.7.0
...
Bump golang.org/x/time from 0.3.0 to 0.7.0
2024-10-29 09:18:06 +03:00
Mohamed Sohail
ef0d32965f
Merge pull request #945 from Shopify/fix-test-default-port
...
Update tests to use the configured Redis address
2024-10-29 08:45:33 +03:00
Mohamed Sohail
f16f9ac440
Merge pull request #944 from Shopify/randv2
...
Use math/rand/v2
2024-10-29 08:42:38 +03:00
Pior Bastida
63f7cb7b17
Use math/rand/v2
2024-10-28 18:39:54 +01:00
Pior Bastida
04b3a3475d
Update tests to use the configured Redis address
2024-10-28 12:48:56 +01:00
Marcus Boorstin
013190b824
Add task enqueue command to cli ( #918 )
2024-10-26 13:04:54 +03:00
Skwol
1e102a5392
Need to support redis sentinel username. ( #924 )
2024-10-26 13:04:21 +03:00
dependabot[bot]
e1a8a366a6
Bump golang.org/x/time from 0.3.0 to 0.7.0
...
Bumps [golang.org/x/time](https://github.com/golang/time ) from 0.3.0 to 0.7.0.
- [Commits](https://github.com/golang/time/compare/v0.3.0...v0.7.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/time
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-10-26 05:49:43 +00:00
Pior Bastida
c8c8adfaa6
Configure dependabot to update Github Actions ( #928 )
2024-10-26 08:48:41 +03:00
Pior Bastida
03f4799712
Run golangci-lint in CI ( #927 )
...
* Setup golangci-lint in CI and local-dev
* Fix linting error or locally disable linter
2024-10-26 08:48:12 +03:00
Pior Bastida
3f4e211a3b
Call all context cancelFunc in processor ( #926 )
2024-10-26 08:39:13 +03:00
Pior Bastida
0655c569f5
Bump to Go 1.22 and 1.23 ( #925 )
2024-10-26 08:33:58 +03:00
Pior Bastida
95a0768ae0
Add jitter on the processor fetch backoff sleep ( #868 )
2024-10-19 10:46:48 +03:00
Mohammed Sohail
f4b56498f2
docs: small fix on semantics
2024-10-19 10:07:17 +03:00
kanzihuang
ae478d5b22
feat: revoke the task to modify task parameters and enqueue new task with the same task id ( #882 )
2024-10-19 10:06:12 +03:00
kanzihuang
ff7ef48463
fix: possible inconsistent scores between ProcessIn and ProcessAt ( #876 )
2024-10-19 09:45:18 +03:00
Patrick Barnum
b1e13893ff
[RFC] Adds Ping() to client/scheduler/server ( #585 )
...
* [RFC] Adds Ping() to client/scheduler/server
* Checks for scheduler state closed
2024-10-19 09:44:06 +03:00
Harrison Miller
0dc670d7d8
Archived tasks that are trimmed from the set are deleted ( #743 )
...
* fixed trimmed archive tasks not being deleted.
* improved test case.
* changed ZRANGEBYSCORE to ZRANGE with BYSCORE option.
---------
Co-authored-by: Harrison <harrison@Harrisons-MacBook-Pro.local>
Co-authored-by: Harrison Miller <harrison.miller@MBP-Harrison-Miller-M2.local>
2024-10-19 09:18:09 +03:00
Mohammed Sohail
461d922616
docs: apply recommendaded updates
...
* additionally, we log an erro in the case the redis client cannot shutdown in the scheduler
2024-10-19 09:05:17 +03:00
Mohammed Sohail
5daa3c52ed
Merge remote-tracking branch 'jerbob92-fork/feature/implement-reusing-redis-client' into develop
2024-10-19 08:58:39 +03:00
Tedja
d04888e748
feature: configurable janitor interval and deletion batch size ( #715 )
...
* feature: configurable janitor interval and deletion batch size
* warn user when they set a big number of janitor batch size
* Update CHANGELOG.md
---------
Co-authored-by: Agung Hariadi Tedja <agung.tedja@kumparan.com>
2024-05-06 14:11:52 +08:00
Trịnh Đức Bảo Linh(Kevin)
174008843d
feat(*): correct panic error ( #758 )
...
* error panic handling
* updated CHANGELOG.md file
* correct msg panic error (#5 )
* correct msg panic error
2024-05-06 13:46:19 +08:00
Mohamed Sohail 天命
2b632b93d5
chore: fix function names in comment (pull request #860 from camcui/master)
...
chore: fix function names in comment
2024-04-23 00:56:52 +08:00
camcui
b35b559d40
chore: fix function names in comment
...
Signed-off-by: camcui <cuishua@sina.cn>
2024-04-12 13:54:08 +08:00
Mohamed Sohail
8df0bfa583
Merge pull request #843 from mrusme/fix-bsd
...
Fix go:build for BSD
2024-03-15 13:32:19 +08:00
mrusme
b25d10b61d
Fixed go:build for BSD
2024-03-14 20:26:33 +05:00
crazyoptimist
38f7499b71
fix(typo): delete-all to deleteall ( #827 )
...
* typo: delete-all to deleteall
* docs: update tools/asynq/README.md
* fix archiveall runall
---------
Co-authored-by: Mohamed Sohail <sohailsameja@gmail.com>
2024-02-23 09:17:12 +03:00
dependabot[bot]
0a73fc6201
Bump go.uber.org/goleak from 1.1.12 to 1.3.0 ( #770 )
...
Bumps [go.uber.org/goleak](https://github.com/uber-go/goleak ) from 1.1.12 to 1.3.0.
- [Release notes](https://github.com/uber-go/goleak/releases )
- [Changelog](https://github.com/uber-go/goleak/blob/master/CHANGELOG.md )
- [Commits](https://github.com/uber-go/goleak/compare/v1.1.12...v1.3.0 )
---
updated-dependencies:
- dependency-name: go.uber.org/goleak
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 10:37:18 +03:00
dependabot[bot]
1a11a33b4f
Bump github.com/google/uuid from 1.3.0 to 1.6.0 ( #810 )
...
Bumps [github.com/google/uuid](https://github.com/google/uuid ) from 1.3.0 to 1.6.0.
- [Release notes](https://github.com/google/uuid/releases )
- [Changelog](https://github.com/google/uuid/blob/master/CHANGELOG.md )
- [Commits](https://github.com/google/uuid/compare/v1.3.0...v1.6.0 )
---
updated-dependencies:
- dependency-name: github.com/google/uuid
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 10:35:55 +03:00
dependabot[bot]
f0888df813
Bump github.com/google/go-cmp from 0.5.9 to 0.6.0 ( #767 )
...
Bumps [github.com/google/go-cmp](https://github.com/google/go-cmp ) from 0.5.9 to 0.6.0.
- [Release notes](https://github.com/google/go-cmp/releases )
- [Commits](https://github.com/google/go-cmp/compare/v0.5.9...v0.6.0 )
---
updated-dependencies:
- dependency-name: github.com/google/go-cmp
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 10:33:57 +03:00
dependabot[bot]
c2dd648a51
Bump github.com/redis/go-redis/v9 from 9.0.3 to 9.4.0 ( #809 )
...
Bumps [github.com/redis/go-redis/v9](https://github.com/redis/go-redis ) from 9.0.3 to 9.4.0.
- [Release notes](https://github.com/redis/go-redis/releases )
- [Changelog](https://github.com/redis/go-redis/blob/master/CHANGELOG.md )
- [Commits](https://github.com/redis/go-redis/compare/v9.0.3...v9.4.0 )
---
updated-dependencies:
- dependency-name: github.com/redis/go-redis/v9
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 10:33:16 +03:00
Andrii Buriachevskyi
a3cca853a0
docs: include version in CLI package installation ( #802 )
...
go install github.com/hibiken/asynq/tools/asynq@latest
2024-01-29 09:46:47 +03:00
dependabot[bot]
83df622a92
Bump golang.org/x/sys from 0.0.0-20211216021012-1d35b9e2eb4e to 0.16.0 ( #807 )
...
Bumps [golang.org/x/sys](https://github.com/golang/sys ) from 0.0.0-20211216021012-1d35b9e2eb4e to 0.16.0.
- [Commits](https://github.com/golang/sys/commits/v0.16.0 )
---
updated-dependencies:
- dependency-name: golang.org/x/sys
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-29 09:42:38 +03:00
krhubert
fdbf54eb04
Update docs
2023-12-10 09:49:43 -08:00
Hubert Krauze
16ec43cbca
Add option to configure task check interval
2023-12-10 09:49:43 -08:00
yeqown
1e0bf88bf3
fix: listLeaseExpiredCmd doesn't ignore possibly empty value of task in lua script
2023-12-10 09:47:55 -08:00
yeqown
d0041c55a3
fix(274): ignore empty data to append to msgs
...
fix issue 274
2023-12-10 09:47:55 -08:00
Mohammed Sohail
7ef0511f35
ci: upgrade benchstat actions, go version -> 1.21.x
...
* closes #759
Squashed commit of the following:
commit 3d94ee14aeaf9a868dbeed4b65f90ccdda1f08d6
Author: Mohammed Sohail <sohailsameja@gmail.com>
Date: Thu Dec 7 11:49:07 2023 +0300
ci: upgrade benchstat actions, go version -> 1.21.x
commit 129e225311
2023-12-10 09:46:45 -08:00
Mohammed Sohail
1ec90810db
chore: Update redis to v9 in x/go.mod ( #795 )
...
Squashed commit of the following:
commit 6e3656db222a3f9347ee4806ef065a1b9b01a214
Author: Mohammed Sohail <sohailsameja@gmail.com>
Date: Thu Dec 7 11:12:41 2023 +0300
pkg(x): go version update -> 1.20
commit 2931df370811227804cb
2023-12-10 09:46:45 -08:00
Mohammed Sohail
90188a093d
ci: upgrade actions, lock redis version
2023-12-10 09:46:45 -08:00
Mohammed Sohail
e05f0b7196
ci/docs: update go versions
...
Squashed commit of the following:
commit de18fe9839714d62bb75
2023-12-10 09:46:45 -08:00
Mohammed Sohail
c1096a0fae
pkg: go version update -> 1.20
2023-12-10 09:46:45 -08:00
