2
0
mirror of https://github.com/hibiken/asynq.git synced 2024-12-25 23:32:17 +08:00
asynq/README.md

138 lines
4.6 KiB
Markdown
Raw Normal View History

2020-01-06 01:06:23 +08:00
# Asynq
2020-01-21 07:17:41 +08:00
[![Build Status](https://travis-ci.com/hibiken/asynq.svg?token=paqzfpSkF4p23s5Ux39b&branch=master)](https://travis-ci.com/hibiken/asynq)
[![License: MIT](https://img.shields.io/badge/license-MIT-green.svg)](https://opensource.org/licenses/MIT)
[![Go Report Card](https://goreportcard.com/badge/github.com/hibiken/asynq)](https://goreportcard.com/report/github.com/hibiken/asynq)
[![GoDoc](https://godoc.org/github.com/hibiken/asynq?status.svg)](https://godoc.org/github.com/hibiken/asynq)
[![Gitter chat](https://badges.gitter.im/go-asynq/gitter.svg)](https://gitter.im/go-asynq/community)
2020-02-20 13:37:54 +08:00
[![codecov](https://codecov.io/gh/hibiken/asynq/branch/master/graph/badge.svg)](https://codecov.io/gh/hibiken/asynq)
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
Asynq is a simple Go library for queueing tasks and processing them in the background with workers.
It is backed by Redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.
2020-01-23 22:33:34 +08:00
**Important Note**: Current major version is zero (v0.x.x) to accomodate rapid development and fast iteration while getting early feedback from users. The public API could change without a major version update before v1.0.0 release.
2019-12-28 08:26:11 +08:00
2020-01-30 13:23:40 +08:00
![Gif](/docs/assets/demo.gif)
2020-01-19 12:31:22 +08:00
2019-12-01 01:38:46 +08:00
## Installation
2020-01-27 11:58:48 +08:00
To install `asynq` library, run the following command:
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
```sh
go get -u github.com/hibiken/asynq
2019-12-01 01:38:46 +08:00
```
2020-02-06 13:58:05 +08:00
## Quickstart
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
First, make sure you are running a Redis server locally.
2020-01-23 22:33:34 +08:00
```sh
2020-02-07 22:45:36 +08:00
$ redis-server
2020-01-23 22:33:34 +08:00
```
2020-01-27 11:58:48 +08:00
To create and schedule tasks, use `Client` and provide a task and when to process the task.
```go
2020-01-27 11:58:48 +08:00
func main() {
r := &asynq.RedisClientOpt{
Addr: "localhost:6379",
}
2020-01-27 11:58:48 +08:00
client := asynq.NewClient(r)
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
// Create a task with task type and payload
t1 := asynq.NewTask("send_welcome_email", map[string]interface{}{"user_id": 42})
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
t2 := asynq.NewTask("send_reminder_email", map[string]interface{}{"user_id": 42})
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
// Process immediately
err := client.Schedule(t1, time.Now())
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
// Process 24 hrs later
err = client.Schedule(t2, time.Now().Add(24 * time.Hour))
// If processing fails, retry up to 10 times (Default is 25)
err = client.Schedule(t1, time.Now(), asynq.Retry(10))
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
// Use custom queue called "critical"
err = client.Schedule(t1, time.Now(), asynq.Queue("critical"))
2020-02-12 13:59:46 +08:00
// Use timeout to specify how long a task may run (Default is no limit)
err = client.Schedule(t1, time.Now(), asynq.Timeout(30 * time.Second))
2020-01-23 22:33:34 +08:00
}
```
2020-01-27 11:58:48 +08:00
To start the background workers, use `Background` and provide your `Handler` to process the tasks.
2019-12-01 01:38:46 +08:00
```go
func main() {
2020-01-27 11:58:48 +08:00
r := &asynq.RedisClientOpt{
Addr: "localhost:6379",
2020-01-21 07:17:41 +08:00
}
2019-12-01 01:38:46 +08:00
2020-01-27 11:58:48 +08:00
bg := asynq.NewBackground(r, &asynq.Config{
// Specify how many concurrent workers to use
Concurrency: 10,
// You can optionally create multiple queues with different priority.
Queues: map[string]int{
2020-01-27 11:58:48 +08:00
"critical": 6,
"default": 3,
"low": 1,
},
// See the godoc for other configuration options
})
2019-12-01 01:38:46 +08:00
2019-12-28 08:26:11 +08:00
bg.Run(handler)
2019-12-01 01:38:46 +08:00
}
2019-12-28 08:26:11 +08:00
```
2020-01-27 11:58:48 +08:00
`Handler` is an interface with one method `ProcessTask` with the following signature.
2019-12-01 01:38:46 +08:00
2019-12-28 08:26:11 +08:00
```go
// ProcessTask should return nil if the processing of a task
// is successful.
//
// If ProcessTask return a non-nil error or panics, the task
2020-01-27 11:58:48 +08:00
// will be retried after delay.
2019-12-28 08:26:11 +08:00
type Handler interface {
2020-02-12 13:59:46 +08:00
ProcessTask(context.Context, *asynq.Task) error
2019-12-28 08:26:11 +08:00
}
```
2020-01-27 11:58:48 +08:00
For a more detailed walk-through of the library, see our [Getting Started Guide](https://github.com/hibiken/asynq/wiki/Getting-Started).
2020-01-23 22:33:34 +08:00
2020-01-27 11:58:48 +08:00
To Learn more about `asynq` features and APIs, see our [Wiki pages](https://github.com/hibiken/asynq/wiki) and [godoc](https://godoc.org/github.com/hibiken/asynq).
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
## Requirements
2020-01-21 07:17:41 +08:00
2020-01-27 11:58:48 +08:00
| Dependency | Version |
| -------------------------- | ------- |
| [Redis](https://redis.io/) | v2.8+ |
| [Go](https://golang.org/) | v1.12+ |
2020-01-21 07:17:41 +08:00
2020-01-23 22:33:34 +08:00
## Command Line Tool
2020-01-23 22:33:34 +08:00
Asynq ships with a command line tool to inspect the state of queues and tasks.
2020-01-19 12:31:22 +08:00
2020-01-23 22:33:34 +08:00
To install, run the following command:
2020-01-19 12:31:22 +08:00
2020-02-07 22:45:36 +08:00
```sh
go get -u github.com/hibiken/asynq/tools/asynqmon
```
2020-01-19 12:31:22 +08:00
2020-01-23 22:33:34 +08:00
For details on how to use the tool, refer to the tool's [README](/tools/asynqmon/README.md).
2020-02-09 01:34:14 +08:00
## Contributing
We are open to, and grateful for, any contributions (Github issues/pull-requests, feedback on Gitter channel, etc) made by the community.
Please see the [Contribution Guide](/CONTRIBUTING.md) before contributing.
2020-01-06 01:06:23 +08:00
## Acknowledgements
- [Sidekiq](https://github.com/mperham/sidekiq) : Many of the design ideas are taken from sidekiq and its Web UI
- [Cobra](https://github.com/spf13/cobra) : Asynqmon CLI is built with cobra
2019-12-28 08:26:11 +08:00
## License
Asynq is released under the MIT license. See [LICENSE](https://github.com/hibiken/asynq/blob/master/LICENSE).