321 Resources
Golang distributed Libraries
OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads
OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development platform built upon OpenAIOS for enterprises to develop and deploy AI applications for production.
Frisbee is a Kubernetes-native platform for exploring, testing, and benchmarking distributed applications.
Why Frisbee ? Frisbee is a next generation platform designed to unify chaos testing and perfomance benchmarking. We address the key pain points develo
A Distributed Content Licensing Framework (DCLF) using Hyperledger Fabric permissioned blockchain.
A Distributed Content Licensing Framework (DCLF) using Hyperledger Fabric permissioned blockchain.
TinySQL is a course designed to teach you how to implement a distributed relational database in Go
TinySQL TinySQL is a course designed to teach you how to implement a distributed relational database in Go. TinySQL is also the name of the simplifed
Distributed File Store Application Consist of API Server to handle file operations and command line tool to do operations
Filestore Distributed File Store Application Consist of API Server to handle file operations and command line tool to do operations (store named binar
A distributed logger micro-service built in go
Distributed Logger A distributed logger micro-service built in go using gRPC for internal communication with other micro-services and JSON for externa
Distributed merge sort for large sets across nodes in a network
distMergeSort An implementation of mergesort distributed across nodes used to sort large sets. Introduction Merge sort partitions sets so that they ca
Distributed key-value store
Keva Distributed key-value store General Demo Start the server docker-compose up --build Insert data curl -XPOST http://localhost:5555/storage/test1
Distributed, offline-first bug tracker embedded in git, with bridges
Distributed, offline-first bug tracker embedded in git, with bridges
Distributed Lab 3: Message Broker in Go
Distributed Lab 3: Message Broker in Go Using the lab sheet There are two ways to use the lab sheet, you can either: create a new repo from this templ
decentralized,distributed,peer-to-peer database.
P2PDB 中文 | English 简介 P2PDB(p2p数据库),是一个去中心化、分布式、点对点数据库、P2PDB使用IPFS为其数据存储和IPFS Pubsub自动与对等方同步数据。P2PDB期望打造一个去中心化的分布式数据库,使P2PDB 成为去中心化应用程序 (dApps)、区块链应用程
A distributed Layer 2 Direct Server Return (L2DSR) load balancer for Linux using XDP/eBPF
VC5 A distributed Layer 2 Direct Server Return (L2DSR) load balancer for Linux using XDP/eBPF This is very much a proof of concept at this stage - mos
MatrixOne is a planet scale, cloud-edge native big data engine crafted for heterogeneous workloads.
What is MatrixOne? MatrixOne is a planet scale, cloud-edge native big data engine crafted for heterogeneous workloads. It provides an end-to-end data
An implementation of the Filecoin Distributed Storage Network
Project Lotus - 莲 Lotus is an implementation of the Filecoin Distributed Storage Network. For more details about Filecoin, check out the Filecoin Spec
Cache list, count with filter param golang, using struct, hashkey
Dumbcache Cache list, count with filter param golang, using struct, hashkey Structure we hash your request object to md5 hashing and add a prefix coun
🦉owlcache is a lightweight, high-performance, non-centralized, distributed Key/Value memory-cached data sharing application written by Go
🦉owlcache is a lightweight, high-performance, non-centralized, distributed Key/Value memory-cached data sharing application written by Go . keyword : golang cache、go cache、golang nosql
Distributed Lab 2: RPC in Go
Distributed Lab 2: RPC in Go Using the lab sheet There are two ways to use the lab sheet, you can either: create a new repo from this template - this
Coroutine based Deterministic 2PC Distributed Transaction
Enviorment set up off the mod go env -w GO111MODULE=off change to GPATH to project directory go env -w GOPATH=$HOME/coroprove Usage This project serve
🌐 (Web 3.0) Pastebin built on IPFS, securely served by Distributed Web and Edge Network.
pastebin-ipfs 简体中文 (IPFS Archivists) Still in development, Pull Requests are welcomed. Pastebin built on IPFS, securely served by Distributed Web and
Secure Distributed Thanos Deployment using an Observability Cluster
Atlas Status: BETA - I don't expect breaking changes, but still possible. Atlas, forced by Zeus to support the heavens and the skies on his shoulders.
Distributed Lab 2: RPC in Go
Distributed Lab 2: RPC in Go Using the lab sheet There are two ways to use the lab sheet, you can either: create a new repo from this template - this
An open-source, distributed, cloud-native CD (Continuous Delivery) product designed for developersAn open-source, distributed, cloud-native CD (Continuous Delivery) product designed for developers
Developer-oriented Continuous Delivery Product English | 简体中文 Table of Contents Zadig Table of Contents What is Zadig Quick start How to use? How to
implementation of some distributed system techniques
Distributed Systems These applications were built with the objective of studding a distributed systems using the most recent technics. The main ideia
Sync distributed sets using bloom filters
goSetReconciliation An implementation to sync distributed sets using bloom filters. Based on the paper "Low complexity set reconciliation using Bloom
Go package for running Linux distributed shell commands via SSH.
Go package for running Linux distributed shell commands via SSH.
Eunomia is a distributed application framework that support Gossip protocol, QuorumNWR algorithm, PBFT algorithm, PoW algorithm, and ZAB protocol and so on.
Introduction Eunomia is a distributed application framework that facilitates developers to quickly develop distributed applications and supports distr
A distributed locking library built on top of Cloud Spanner and TrueTime.
A distributed locking library built on top of Cloud Spanner and TrueTime.
A distributed systems library for Kubernetes deployments built on top of spindle and Cloud Spanner.
hedge A library built on top of spindle and Cloud Spanner that provides rudimentary distributed computing facilities to Kubernetes deployments. Featur
A Go client implementing a client-side distributed consumer group client for Amazon Kinesis.
Kinesumer is a Go client implementing a client-side distributed consumer group client for Amazon Kinesis.
SpiceDB is a Zanzibar-inspired database that stores, computes, and validates application permissions.
SpiceDB is a Zanzibar-inspired database that stores, computes, and validates application permissions. Developers create a schema that models t
go-test-trace is like go test but it also generates distributed traces.
go-test-trace go-test-trace is like go test but it also generates distributed traces. Generated traces are exported in OTLP to a OpenTelemetry collect
painless task queue manager for shell commands with an intuitive cli interface (execute shell commands in distributed cloud-native queue manager).
EXEQ DOCS STILL IN PROGRESS. Execute shell commands in queues via cli or http interface. Features Simple intuitive tiny cli app. Modular queue backend
SigNoz helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc. 🔥 🖥. 👉 Open source Application Performance Monitoring (APM) & Observability tool
Monitor your applications and troubleshoot problems in your deployed applications, an open-source alternative to DataDog, New Relic, etc. Documentatio
A collection of authentication Go packages related to OIDC, JWKs and Distributed Claims.
cap (collection of authentication packages) provides a collection of related packages which enable support for OIDC, JWT Verification and Distributed Claims.
A distributed fault-tolerant order book matching engine
Go - Between A distributed fault-tolerant order book matching engine. Features Limit orders Market orders Order book depth Calculate market price for
Golang implementation of distributed mutex on Azure lease blobs
Distributed Mutex on Azure Lease Blobs This package implements distributed lock available for multiple processes. Possible use-cases include exclusive
Example patterns for distributed service
Cloud Native Tulisan ini akan mengulas hasil pembelajaran dari beberapa sumber #learn-from-books. Dan terinspirasi dari obrolan The Pursuit of Product
a go client for distributed transaction manager DTM. go语言分布式事务管理器DTM的客户端SDK
a client for distributed transaction manager dtm dtmcli 是分布式事务管理器dtm的客户端sdk dtmcli 这个库的代码与dtm下的dtmcli代码保持完全同步,如果您需要线上使用,那么当前的dtmcli相关的依赖非常少,对于最终打包的镜像也
gathering distributed key-value datastores to become a cluster
go-ds-cluster gathering distributed key-value datastores to become a cluster About The Project This project is going to implement go-datastore in a fo
This library contains utilities that are useful for building distributed services.
Grafana Dskit This library contains utilities that are useful for building distributed services. Current state This library is still in development. D
IceFireDB - Distributed disk storage system based on Raft and RESP protocol.
Distributed disk storage database based on Raft and Redis protocol.
Distributed cache and in-memory key/value data store.
Distributed cache and in-memory key/value data store. It can be used both as an embedded Go library and as a language-independent service.
A distributed key value store in under 1000 lines. Used in production at comma.ai
minikeyvalue Fed up with the complexity of distributed filesystems? minikeyvalue is a ~1000 line distributed key value store, with support for replica
Tarmac is a unique framework designed for the next generation of distributed systems
Framework for building distributed services with Web Assembly
gdcache is a pure non-intrusive distributed cache library implemented by golang
gdcache is a pure non-intrusive distributed cache library implemented by golang, you can use it to implement your own distributed cache
goInterLock is golang job/task scheduler with distributed locking mechanism (by Using Redis🔒).
goInterLock is golang job/task scheduler with distributed locking mechanism. In distributed system locking is preventing task been executed in every instant that has the scheduler,
Fleex allows you to create multiple VPS on cloud providers and use them to distribute your workload.
Fleex allows you to create multiple VPS on cloud providers and use them to distribute your workload. Run tools like masscan, puredns, ffuf, httpx or anything you need and get results quickly!
Rink is a "distributed sticky ranked ring" using etcd.
Rink is a "distributed sticky ranked ring" using etcd. A rink provides role scheduling across distributed processes, with each role only assigned
Redwood is a highly-configurable, distributed, realtime database that manages a state tree shared among many peers
Redwood is a highly-configurable, distributed, realtime database that manages a state tree shared among many peers. Imagine something like a Redux store, but distributed across all users of an application, that offers offline editing and is resilient to poor connectivity.
Framework for building distributed services with Web Assembly
Tarmac Framework for building distributed services with Web Assembly Tarmac is a unique framework designed for the next generation of distributed syst
a lightweight distributed transaction management service, support xa tcc saga
a lightweight distributed transaction management service, support xa tcc saga
LiveKit - Open source, distributed video/audio rooms over WebRTC
LiveKit is an open source project that provides scalable, multi-user conferencing over WebRTC. It's designed to give you everything you need to build real time video/audio capabilities in your applications.
YTask is an asynchronous task queue for handling distributed jobs in golang
YTask is an asynchronous task queue for handling distributed jobs in golang
Golimit is Uber ringpop based distributed and decentralized rate limiter
Golimit A Distributed Rate limiter Golimit is Uber ringpop based distributed and decentralized rate limiter. It is horizontally scalable and is based
An actor framework for Go
gosiris is an actor framework for Golang. Features Manage a hierarchy of actors (each actor has its own: state, behavior, mailbox, child actors) Deplo
a Framework for creating microservices using technologies and design patterns of Erlang/OTP in Golang
Technologies and design patterns of Erlang/OTP have been proven over the years. Now in Golang. Up to x5 times faster than original Erlang/OTP in terms
Go Micro is a standalone framework for distributed systems development
Go Micro Go Micro is a framework for distributed systems development. Overview Go Micro provides the core requirements for distributed systems develop
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
JuiceFS is a high-performance POSIX file system released under GNU Affero General Public License v3.0. It is specially optimized for the cloud-native
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.
SeaweedFS Sponsor SeaweedFS via Patreon SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible ent
Distributed Named Pipes
dnpipes Distributed Named Pipes (or: dnpipes) are essentially a distributed version of Unix named pipes comparable to, for example, SQS in AWS or the
Sandglass is a distributed, horizontally scalable, persistent, time sorted message queue.
Sandglass is a distributed, horizontally scalable, persistent, time ordered message queue. It was developed to support asynchronous tasks and message
A realtime distributed messaging platform
Source: https://github.com/nsqio/nsq Issues: https://github.com/nsqio/nsq/issues Mailing List: [email protected] IRC: #nsq on freenode Docs:
Dkron - Distributed, fault tolerant job scheduling system https://dkron.io
Dkron - Distributed, fault tolerant job scheduling system for cloud native environments Website: http://dkron.io/ Dkron is a distributed cron service,
Distributed reliable key-value store for the most critical data of a distributed system
etcd Note: The main branch may be in an unstable or even broken state during development. For stable versions, see releases. etcd is a distributed rel
A distributed key-value storage system developed by Alibaba Group
Product Overview Tair is fast-access memory (MDB)/persistent (LDB) storage service. Using a high-performance and high-availability distributed cluster
CockroachDB - the open source, cloud-native distributed SQL database.
CockroachDB is a cloud-native distributed SQL database designed to build, scale, and manage modern, data-intensive applications. What is CockroachDB?
The lightweight, distributed relational database built on SQLite
rqlite is a lightweight, distributed relational database, which uses SQLite as its storage engine. Forming a cluster is very straightforward, it grace
Elastic Key-Value Storage With Strong Consistency and Reliability
What is Elasticell? Elasticell is a distributed NoSQL database with strong consistency and reliability. Compatible with Redis protocol Use Elasticell
A distributed MySQL binlog storage system built on Raft
What is kingbus? 中文 Kingbus is a distributed MySQL binlog store based on raft. Kingbus can act as a slave to the real master and as a master to the sl
A distributed and coördination-free log management system
OK Log is archived I hoped to find the opportunity to continue developing OK Log after the spike of its creation. Unfortunately, despite effort, no su
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Jocko Kafka/distributed commit log service in Go. Goals of this project: Implement Kafka in Go Protocol compatible with Kafka so Kafka clients and ser
OpenDILab RL Object Store
Introduction Decision AI Store Installation Prerequisites Linux Python = 3.6 pip install . Quick Start Start Etcd Server di_store etcd_server ./conf/
Verifiable credential system on Cosmos with IBC for Distributed Identities
CertX This is a project designed to demonstrate the use of IBC between different zones in the Cosmos ecosystem for privacy preserving credential manag
golang实现的分布式唯一ID生成器distributed id generator,有全局趋势递增、严防时钟漂移、高可用、高性能等特点
ekko-idgenerator是什么 顾名思义,ekko是一个分布式唯一ID生成器,参考了snowFlake思想,但是并不局限于其设计。 名称由来 英雄联盟的时间刺客ekko 特点 易用,最大限度保证系统的易用性,支持Get与MultiGet; 高并发,单机每秒100w个唯一ID生成; 高可用,理
short-url distributed and high-performance
durl 是一个分布式的高性能短链服务,逻辑简单,并提供了相关api接口,开发人员可以快速接入,也可以作为go初学者练手项目.
a dynamic configuration framework used in distributed system
go-archaius This is a light weight configuration management framework which helps to manage configurations in distributed system The main objective of
Layotto is an application runtime developed using Golang, which provides various distributed capabilities for applications
Layotto is an application runtime developed using Golang, which provides various distributed capabilities for applications, such as state management, configuration management, and event pub/sub capabilities to simplify application development.
An implementation of a distributed access-control server that is based on Google Zanzibar
An implementation of a distributed access-control server that is based on Google Zanzibar - "Google's Consistent, Global Authorization System".
Managing your Kubernetes clusters (including public, private, edge, etc) as easily as visiting the Internet
Clusternet Managing Your Clusters (including public, private, hybrid, edge, etc) as easily as Visiting the Internet. Clusternet (Cluster Internet) is
The Fabric Token SDK is a set of API and services that lets developers create token-based distributed application on Hyperledger Fabric.
The Fabric Token SDK is a set of API and services that let developers create token-based distributed application on Hyperledger Fabric.
DTM 是一款跨语言的分布式事务管理方案,在各类微服务架构中,提供高性能和简单易用的分布式事务服务
轻量级分布式事务管理服务 DTM 是一款跨语言的分布式事务管理方案,在各类微服务架构中,提供高性能和简单易用的分布式事务服务。 特色 跨语言 语言无关,任何语言实现了http方式的服务,都可以接入DTM,用来管理分布式事务。支持go、python、php、nodejs、ruby 多种分布式事务协议支
A Lightweight VPN Built on top of Libp2p for Truly Distributed Networks.
Hyprspace A Lightweight VPN Built on top of Libp2p for Truly Distributed Networks. demo.mp4 Table of Contents A Bit of Backstory Use Cases A Digital N
The Fabric Smart Client is a new Fabric Client that lets you focus on the business processes and simplifies the development of Fabric-based distributed application.
Fabric Smart Client The Fabric Smart Client (FSC, for short) is a new Fabric client-side component whose objective is twofold. FSC aims to simplify th
Storj is building a decentralized cloud storage network
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
GTA(Go Task Async) is a lightweight reliable asynchronous task and transaction message library for Golang
GTA (Go Task Async) is a lightweight and reliable asynchronous task and transaction message library for by golang.
Zadig is a cloud native, distributed, developer-oriented continuous delivery product.
Zadig Developer-oriented Continuous Delivery Product English | 简体中文 Table of Contents Zadig Table of Contents What is Zadig Quick start How to use?
high performance distributed task scheduling system, Support multi protocol scheduling tasks
high performance distributed task scheduling system, Support multi protocol scheduling tasks
Antenna RPC is an RPC protocol for distributed computing, it's based on QUIC and Colfer. its currently an WIP.
aRPC - Antenna Remote Procedure Call Antenna remote procedure call (aRPC) is an RPC protocol focused on distributed processing and HPC. aRPC is implem
Grafana Tempo is a high volume, minimal dependency distributed tracing backend.
Grafana Tempo is an open source, easy-to-use and high-scale distributed tracing backend. Tempo is cost-efficient, requiring only object storage to ope
Zadig is a cloud native, distributed, developer-oriented continuous delivery product.
Zadig Developer-oriented Continuous Delivery Product English | 简体中文 Table of Contents Zadig Table of Contents What is Zadig Quick start How to use? Ho
Build share and run your distributed applications.
sealer[ˈsiːlər] provides the way for distributed application package and delivery based on kubernetes.
Pixie gives you instant visibility by giving access to metrics, events, traces and logs without changing code.
Pixie gives you instant visibility by giving access to metrics, events, traces and logs without changing code.
SigNoz helps developer monitor applications and troubleshoot problems in their deployed applications
SigNoz helps developers monitor their applications & troubleshoot problems, an open-source alternative to DataDog, NewRelic, etc. 🔥 🖥
Workflow Orchestrator
Adagio - A Workflow Orchestrator This project is currently in a constant state of flux. Don't expect it to work. Thank you o/ Adagio is a workflow exe
An enhanced HTTP client for Go
Heimdall Description Installation Usage Making a simple GET request Creating a hystrix-like circuit breaker Creating a hystrix-like circuit breaker wi
Distributed RWMutex in Go
Distributed Read-Write Mutex in Go The default Go implementation of sync.RWMutex does not scale well to multiple cores, as all readers contend on the
TalariaDB is a distributed, highly available, and low latency time-series database for Presto
TalariaDB is a distributed, highly available, and low latency time-series database that stores real-time data. It's built on top of Badger DB.
💡 A Distributed and High-Performance Monitoring System. The next generation of Open-Falcon
夜莺简介 夜莺是一套分布式高可用的运维监控系统,最大的特点是混合云支持,既可以支持传统物理机虚拟机的场景,也可以支持K8S容器的场景。同时,夜莺也不只是监控,还有一部分CMDB的能力、自动化运维的能力,很多公司都基于夜莺开发自己公司的运维平台。开源的这部分功能模块也是商业版本的一部分,所以可靠性有保