55 Resources
Golang background-worker Libraries
Worker pool library with auto-scaling, backpressure, and easy composability of pools into pipelines
workerpool Worker pool library with auto-scaling, backpressure, and easy composability of pools into pipelines. Uses Go 1.18 generics. Notable differe
Tasqueue is a simple, lightweight distributed job/worker implementation in Go
Tasqueue Tasqueue is a simple, lightweight distributed job/worker implementation in Go Concepts tasqueue.Broker is a generic interface that provides m
Batch processing library for Go supports generics & values returning
Aggregator Aggregator is a batch processing library for Go supports returning values. You can group up and process batch of tasks with keys in a singl
Work pool channlege - An url hash retriever worker pool for getting hash digest for a collection of urls
Code challenge The aim of this project is to provide an url hash retriever worke
Worker - A Golang library that provides worker pools
Worker A Golang library that provides worker pools. Usage See *_test.go files. T
Goworkers - Zero dependency Golang worker pool
Golang Worker Pool Zero dependency golang goroutines pool library. It is useful
Drain-my-spot - Service draining the k8s worker node in case of spot instances related event occurrence
drain-my-spot Service draining the k8s worker node in case of spot instances rel
Golang Implementation of Worker Pool/ Thread Pool
Golang Implementation of Worker Pool/ Thread Pool
A TCP Library use worker pool to improve performance and protect your server
A TCP Library use worker pool to improve performance and protect your server
Language-agnostic persistent background job server
Faktory At a high level, Faktory is a work server. It is the repository for background jobs within your application. Jobs have a type and a set of arg
Go-async - Worker pool (fan-in/fan-out)
Worker pool (fan-in/fan-out) func main() { pool := worker.NewPool(2) ctx := co
Toolkit - Collection of useful patterns
toolkit Introduction These patterns can you use to solve common problems when designing an application or system. Requirements golang =1.11.x - The G
Snowflake algorithm generation worker Id sequence
sequence snowflake algorithm generation worker Id sequence 使用雪花算法生成ID,生成100万个只需要
Chalk is a Go Package which can be used for making terminal output more vibrant with text colors, text styles and background colors.
Chalk Chalk is a Go Package which can be used for making terminal output more vibrant with text colors, text styles and background colors. Documentati
a Framework for creating microservices using technologies and design patterns of Erlang/OTP in Golang
Technologies and design patterns of Erlang/OTP have been proven over the years. Now in Golang. Up to x5 times faster than original Erlang/OTP in terms
Golang query-able job queue
ᛉ Bifröst - a queryable in-process worker queue Package bifrost contains functionality to create an in-process job queue with a configurable number of
A worker pool implementation for Go
WorkerGo WorkerGo is an MIT licensed worker pool implementation that can be used in any Go program to handle tasks with workers. WorkerGo is heavily i
High performance, type safe, concurrency limiting worker pool package for golang!
GOWP Package gowp (Go Worker-Pool) provides concurrency limiting, error propagation, and Context cancellation for a group of workers/goroutines. Featu
Simple in-memory job queue for Golang using worker-based dispatching
artifex Simple in-memory job queue for Golang using worker-based dispatching Documentation here: https://godoc.org/github.com/mborders/artifex Cron jo
Support variable parameters task send worker
go-worker-pool Support variable parameters task send worker 调用方式 go get github.com/214200196/gwp/v1 import ( "fmt" "github.com/214200196/gwp/v1" "
A Go library for terminal background color detection
go-termbg A Go library for terminal background color detection. The detected color is provided by RGB or theme ( dark or light ). Based on https://git
Tiny library to handle background jobs.
bgjob Tiny library to handle background jobs. Use PostgreSQL to organize job queues. Highly inspired by gue Features Durable job storage At-least-ones
Deadly simple worker pool
go-worker-pool Deadly simple worker pool Usage package main import ( "errors" workerpool "github.com/zelenin/go-worker-pool" "log" "time" ) func
Go lang concurrency with channels and worker pools using sync.Pools.
Go Concurrency Go lang concurrency with channels and worker pools using sync.Pools. Concurrency Concurrency is an ability of a program to do multiple
Worker-Pool written in GO
go-workerpool Worker-Pool written in GO Installation go get github.com/agungsid/go-workerpool Usage package main type SampleSeeder struct{} func (s
Go worker library
gorkers Examples Quickstart Multiple Go Workers Passing Fields Getting Started Import import ( "github.com/guilhem/gorkers" ) Create a worker func
painless task queue manager for shell commands with an intuitive cli interface (execute shell commands in distributed cloud-native queue manager).
EXEQ DOCS STILL IN PROGRESS. Execute shell commands in queues via cli or http interface. Features Simple intuitive tiny cli app. Modular queue backend
YTask is an asynchronous task queue for handling distributed jobs in golang
YTask is an asynchronous task queue for handling distributed jobs in golang
a Framework for creating microservices using technologies and design patterns of Erlang/OTP in Golang
Technologies and design patterns of Erlang/OTP have been proven over the years. Now in Golang. Up to x5 times faster than original Erlang/OTP in terms
Simple, efficient background processing for Golang backed by RabbitMQ and Redis
Table of Contents How to Use Motivation Requirements Features Examples Setup Config Client/Server Task Worker/Task Hander Register The Handlers Send t
Kubei is a flexible Kubernetes runtime scanner, scanning images of worker and Kubernetes nodes providing accurate vulnerabilities assessment, for more information checkout:
Kubei is a vulnerabilities scanning and CIS Docker benchmark tool that allows users to get an accurate and immediate risk assessment of their kubernet
Worker failover support for PostgreSQL Citus extension using pg_auto_failover.
citus-failover Worker failover support for citus community version using pg_auto_failover. What is this? This is a simple service to monitor changes i
Gowl is a process management and process monitoring tool at once. An infinite worker pool gives you the ability to control the pool and processes and monitor their status.
Gowl is a process management and process monitoring tool at once. An infinite worker pool gives you the ability to control the pool and processes and monitor their status.
Job worker service that provides an API to run arbitrary Linux processes.
Job Scheduler Summary Prototype job worker service that provides an API to run arbitrary Linux processes. Overview Library The library (Worker) is a r
A lightweight job scheduler based on priority queue with timeout, retry, replica, context cancellation and easy semantics for job chaining. Build for golang web apps.
Table of Contents Introduction What is RIO? Concern An asynchronous job processor Easy management of these goroutines and chaining them Introduction W
Asynq: simple, reliable, and efficient distributed task queue in Go
Asynq: simple, reliable, and efficient distributed task queue in Go
a Framework for creating mesh networks using technologies and design patterns of Erlang/OTP in Golang
Ergo Framework Implementation of Erlang/OTP in Golang. Up to x5 times faster than original Erlang/OTP. The easiest drop-in replacement for your hot no
Efficient and reliable background processing for Go
CurlyQ CurlyQ provides a simple, easy-to-use interface for performing background processing in Go. It supports scheduled jobs, job deduplication, and
Distributed Task Scheduling System|分布式定时任务调度平台
Crocodile Distributed Task Scheduling System English | 中文 Introduction A distributed task scheduling system based on Golang that supports http request
NSQProxy是NSQ和Worker之间的中间件,根据配置负责消息转发。
NSQProxy NSQProxy是Golang开发的NSQ和Worker之间的中间件,根据数据库配置,负责消息转发。NSQProxy启动后,接受NSQD队列内容,然后通过HTTP/FastCGI/CBNSQ等协议转发给Worker机执行。在唱吧内部使用2年,高效稳定的处理着每日数十亿条消息。
Go worker pool
description This is a generic worker pool for the Go language. It's useful when you want to limit the number of goroutines running in parallel. instal
Asynq: simple, reliable, and efficient distributed task queue in Go
Asynq Overview Asynq is a Go library for queueing tasks and processing them asynchronously with workers. It's backed by Redis and is designed to be sc
An opinionated productive web framework that helps scaling business easier.
appy An opinionated productive web framework that helps scaling business easier, i.e. focus on monolith first, only move to microservices with GRPC la
A persistent and flexible background jobs library for go.
Jobs Development Status Jobs is no longer being actively developed. I will still try my best to respond to issues and pull requests, but in general yo
Concurrency limiting goroutine pool
workerpool Concurrency limiting goroutine pool. Limits the concurrency of task execution, not the number of tasks queued. Never blocks submitting task
Go simple async worker pool
👨🔧 worker-pool Go simple async worker pool. 📖 ABOUT Worker pool is a software design pattern for achieving concurrency of task execution. Maintain
Minimalistic and High-performance goroutine worker pool written in Go
pond Minimalistic and High-performance goroutine worker pool written in Go Motivation This library is meant to provide a simple way to limit concurren
errgroup with goroutine worker limits
neilotoole/errgroup neilotoole/errgroup is a drop-in alternative to Go's wonderful sync/errgroup but limited to N goroutines. This is useful for inter
Unlimited job queue for go, using a pool of concurrent workers processing the job queue entries
kyoo: A Go library providing an unlimited job queue and concurrent worker pools About kyoo is the phonetic transcription of the word queue. It provide
golang worker pool , Concurrency limiting goroutine pool
golang worker pool 中文说明 Concurrency limiting goroutine pool. Limits the concurrency of task execution, not the number of tasks queued. Never blocks su
goworker is a Go-based background worker that runs 10 to 100,000* times faster than Ruby-based workers.
goworker goworker is a Resque-compatible, Go-based background worker. It allows you to push jobs into a queue using an expressive language like Ruby w
👷 Library for safely running groups of workers concurrently or consecutively that require input and output through channels
Examples Quickstart Multiple Go Workers Passing Fields Getting Started Pull in the dependency go get github.com/catmullet/go-workers Add the import to
Simple in-memory job queue for Golang using worker-based dispatching
artifex Simple in-memory job queue for Golang using worker-based dispatching Documentation here: https://godoc.org/github.com/mborders/artifex Cron jo
🐜🐜🐜 ants is a high-performance and low-cost goroutine pool in Go, inspired by fasthttp./ ants 是一个高性能且低损耗的 goroutine 池。
A goroutine pool for Go English | 🇨🇳 中文 📖 Introduction Library ants implements a goroutine pool with fixed capacity, managing and recycling a massi