2020-01-06 01:06:23 +08:00
# Asynq
2020-01-21 07:17:41 +08:00
[![Build Status ](https://travis-ci.com/hibiken/asynq.svg?token=paqzfpSkF4p23s5Ux39b&branch=master )](https://travis-ci.com/hibiken/asynq)
[![License: MIT ](https://img.shields.io/badge/license-MIT-green.svg )](https://opensource.org/licenses/MIT)
[![Go Report Card ](https://goreportcard.com/badge/github.com/hibiken/asynq )](https://goreportcard.com/report/github.com/hibiken/asynq)
[![GoDoc ](https://godoc.org/github.com/hibiken/asynq?status.svg )](https://godoc.org/github.com/hibiken/asynq)
[![Gitter chat ](https://badges.gitter.im/go-asynq/gitter.svg )](https://gitter.im/go-asynq/community)
2020-02-20 13:37:54 +08:00
[![codecov ](https://codecov.io/gh/hibiken/asynq/branch/master/graph/badge.svg )](https://codecov.io/gh/hibiken/asynq)
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
Asynq is a simple Go library for queueing tasks and processing them in the background with workers.
It is backed by Redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.
2020-01-15 13:19:06 +08:00
2020-01-23 22:33:34 +08:00
**Important Note**: Current major version is zero (v0.x.x) to accomodate rapid development and fast iteration while getting early feedback from users. The public API could change without a major version update before v1.0.0 release.
2019-12-28 08:26:11 +08:00
2020-01-30 13:23:40 +08:00
![Gif ](/docs/assets/demo.gif )
2020-01-19 12:31:22 +08:00
2019-12-01 01:38:46 +08:00
## Installation
2020-01-27 11:58:48 +08:00
To install `asynq` library, run the following command:
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
```sh
2020-01-15 13:19:06 +08:00
go get -u github.com/hibiken/asynq
2019-12-01 01:38:46 +08:00
```
2020-02-06 13:58:05 +08:00
## Quickstart
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
First, make sure you are running a Redis server locally.
2020-01-23 22:33:34 +08:00
```sh
2020-02-07 22:45:36 +08:00
$ redis-server
2020-01-23 22:33:34 +08:00
```
2020-01-27 11:58:48 +08:00
To create and schedule tasks, use `Client` and provide a task and when to process the task.
2020-01-15 13:19:06 +08:00
```go
2020-01-27 11:58:48 +08:00
func main() {
r := & asynq.RedisClientOpt{
2020-02-24 07:40:04 +08:00
Addr: "127.0.0.1:6379",
2020-01-27 11:58:48 +08:00
}
2020-01-15 13:19:06 +08:00
2020-01-27 11:58:48 +08:00
client := asynq.NewClient(r)
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
// Create a task with task type and payload
t1 := asynq.NewTask("send_welcome_email", map[string]interface{}{"user_id": 42})
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
t2 := asynq.NewTask("send_reminder_email", map[string]interface{}{"user_id": 42})
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
// Process immediately
2020-02-24 07:40:04 +08:00
err := client.Enqueue(t1)
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
// Process 24 hrs later
2020-02-24 07:40:04 +08:00
err = client.EnqueueIn(24*time.Hour, t2)
// Process at specified time.
t := time.Date(2020, time.March, 6, 10, 0, 0, 0, time.UTC)
err = client.EnqueueAt(t, t2)
// Pass options to specify processing behavior for a given task.
//
// MaxRetry specifies the maximum number of times this task will be retried (Default is 25).
// Queue specifies which queue to enqueue this task to (Default is "default").
// Timeout specifies the the timeout for the task's context (Default is no timeout).
err = client.Enqueue(t1, asynq.MaxRetry(10), asynq.Queue("critical"), asynq.Timeout(time.Minute))
2020-01-23 22:33:34 +08:00
}
```
2020-01-27 11:58:48 +08:00
To start the background workers, use `Background` and provide your `Handler` to process the tasks.
2019-12-01 01:38:46 +08:00
```go
func main() {
2020-01-27 11:58:48 +08:00
r := & asynq.RedisClientOpt{
2020-02-24 07:40:04 +08:00
Addr: "127.0.0.1:6379",
2020-01-21 07:17:41 +08:00
}
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
bg := asynq.NewBackground(r, & asynq.Config{
// Specify how many concurrent workers to use
2020-01-15 13:19:06 +08:00
Concurrency: 10,
2020-02-24 07:40:04 +08:00
// Optionally specify multiple queues with different priority.
2020-02-13 14:23:25 +08:00
Queues: map[string]int{
2020-01-27 11:58:48 +08:00
"critical": 6,
"default": 3,
"low": 1,
},
// See the godoc for other configuration options
2019-12-30 08:55:51 +08:00
})
2019-12-01 01:38:46 +08:00
2019-12-28 08:26:11 +08:00
bg.Run(handler)
2019-12-01 01:38:46 +08:00
}
2019-12-28 08:26:11 +08:00
```
2020-01-27 11:58:48 +08:00
`Handler` is an interface with one method `ProcessTask` with the following signature.
2019-12-01 01:38:46 +08:00
2019-12-28 08:26:11 +08:00
```go
// ProcessTask should return nil if the processing of a task
// is successful.
//
// If ProcessTask return a non-nil error or panics, the task
2020-01-27 11:58:48 +08:00
// will be retried after delay.
2019-12-28 08:26:11 +08:00
type Handler interface {
2020-02-12 13:59:46 +08:00
ProcessTask(context.Context, *asynq.Task) error
2019-12-28 08:26:11 +08:00
}
```
2020-01-27 11:58:48 +08:00
For a more detailed walk-through of the library, see our [Getting Started Guide ](https://github.com/hibiken/asynq/wiki/Getting-Started ).
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
To Learn more about `asynq` features and APIs, see our [Wiki pages ](https://github.com/hibiken/asynq/wiki ) and [godoc ](https://godoc.org/github.com/hibiken/asynq ).
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
## Requirements
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
| Dependency | Version |
| -------------------------- | ------- |
| [Redis ](https://redis.io/ ) | v2.8+ |
| [Go ](https://golang.org/ ) | v1.12+ |
2020-01-21 07:17:41 +08:00
2020-01-23 22:33:34 +08:00
## Command Line Tool
2020-01-15 13:19:06 +08:00
2020-01-23 22:33:34 +08:00
Asynq ships with a command line tool to inspect the state of queues and tasks.
2020-01-19 12:31:22 +08:00
2020-01-23 22:33:34 +08:00
To install, run the following command:
2020-01-19 12:31:22 +08:00
2020-02-07 22:45:36 +08:00
```sh
go get -u github.com/hibiken/asynq/tools/asynqmon
```
2020-01-19 12:31:22 +08:00
2020-01-23 22:33:34 +08:00
For details on how to use the tool, refer to the tool's [README ](/tools/asynqmon/README.md ).
2020-01-15 13:19:06 +08:00
2020-02-09 01:34:14 +08:00
## Contributing
We are open to, and grateful for, any contributions (Github issues/pull-requests, feedback on Gitter channel, etc) made by the community.
Please see the [Contribution Guide ](/CONTRIBUTING.md ) before contributing.
2020-01-06 01:06:23 +08:00
## Acknowledgements
- [Sidekiq ](https://github.com/mperham/sidekiq ) : Many of the design ideas are taken from sidekiq and its Web UI
2020-02-24 12:43:24 +08:00
- [RQ ](https://github.com/rq/rq ) : Client APIs are inspired by rq library.
2020-01-06 01:06:23 +08:00
- [Cobra ](https://github.com/spf13/cobra ) : Asynqmon CLI is built with cobra
2019-12-28 08:26:11 +08:00
## License
Asynq is released under the MIT license. See [LICENSE ](https://github.com/hibiken/asynq/blob/master/LICENSE ).