333 Resources
Golang key-value-store Libraries
Redis inventory is a tool to analyse Redis memory usage by key patterns and displaying it hierarchically
Redis inventory is a tool to analyse Redis memory usage by key patterns and displaying it hierarchically. The name is inspired by "Disk Inventory X" tool doing similar analysis for disk usage.
Windows Store Installer for VS Code
vscode-winsta11er This repo contains the code for a simple Go-based installer for the new Windows store. Releases To create a release, create and push
starenv allows populating environmental variables from variety of sources, such as AWS Parameter Store, GPG encrypted files and more, with extreme ease.
starenv (*env) allows populating environmental variables from variety of sources, such as AWS Parameter Store, GPG encrypted files and more, with extr
pure golang key database support key have value. 非常高效实用的键值数据库。
orderfile32 pure golang key database support key have value The orderfile32 is standard alone fast key value database. It have two version. one is thi
An SSH key pair generator
Keygen An SSH key pair generator. Supports generating RSA and Ed25519 keys. Example k, err := NewWithWrite(".ssh", "my_awesome_key", []byte(""), key.E
An observability database aims to ingest, analyze and store Metrics, Tracing and Logging data.
BanyanDB BanyanDB, as an observability database, aims to ingest, analyze and store Metrics, Tracing and Logging data. It's designed to handle observab
Encrypt your files or notes by your GPG key and save to MinIO or Amazon S3 easily!
Super Dollop Super Dollop can encrypt your files and notes by your own GPG key and save them in S3 or minIO to keep them safe and portability, also yo
A pizza store design using NATS pub sub queue.
A pizza store design using NATS pub sub queue.
SSH Manager - manage authorized_keys file on remote servers
SSH Manager - manage authorized_key file on remote servers This is a simple tool that I came up after having to on-boarding and off-boarding developer
Building a shoe store with golang to learn more about this language :)
shoestore-go Building a shoe store with golang to learn more about this language :) TODO Create a basic webpage with the pages: home : to show homepag
gathering distributed key-value datastores to become a cluster
go-ds-cluster gathering distributed key-value datastores to become a cluster About The Project This project is going to implement go-datastore in a fo
IceFireDB - Distributed disk storage system based on Raft and RESP protocol.
Distributed disk storage database based on Raft and Redis protocol.
Distributed cache and in-memory key/value data store.
Distributed cache and in-memory key/value data store. It can be used both as an embedded Go library and as a language-independent service.
🍭 集合多家 API 的新一代图床
AUXPI 集合多家 API 的新一代图床 功能 特色 支持 web 上传图片 支持 API 上传图片 支持分发,控制反转 各种自由定制请看下面的截图 项目截图 支持拖拽对首页的菜单进行排序和开关控制 图片链接按照权重进行异步分发 首页有几个可视化的图表,方便分析 如果您感觉不错,请您点个 Star
A distributed key value store in under 1000 lines. Used in production at comma.ai
minikeyvalue Fed up with the complexity of distributed filesystems? minikeyvalue is a ~1000 line distributed key value store, with support for replica
yq lets you read YAML files easily on the terminal. You can find key/values easily
yq yq lets you read YAML files easily on the terminal. You can find key/values easily. Motivation Reading yaml configurations for k8s file becomes ard
Mildly performant age public key bruteforcer
vanity-age Mildly performant age vanity public key brute-forcer.
A simple Git Notes Key Value store
Gino Keva - Git Notes Key Values Gino Keva works as a simple Key Value store built on top of Git Notes, using an event sourcing architecture. Events a
red-tldr is a lightweight text search tool, which is used to help red team staff quickly find the commands and key points they want to execute, so it is more suitable for use by red team personnel with certain experience.
Red Team TL;DR English | 中文简体 What is Red Team TL;DR ? red-tldr is a lightweight text search tool, which is used to help red team staff quickly find t
Go scripts for finding an API key / some keywords in repository
Git-Secret Go scripts for finding an API key / some keywords in repository Update V1.0 🚀 Added some API Key checker Screenshoot 📷 How to Install go
Project Kebe is the open-source Snap Store implementation.
Introduction Kebe intends to be a full replacement for the Snap Store. Quickstart Once you have an environment setup (for instance using https://githu
Key-Checker - Go scripts for checking API key / access token validity
Key-Checker Go scripts for checking API key / access token validity Update V1.0.0 🚀 Added 37 checkers! Screenshoot 📷 How to Install go get github.co
a sharded store to hold large IPLD graphs efficiently, packaged as location-transparent attachable CAR files, with mechanical sympathy
DAG store This README will be populated soon. In the meantime, please refer to the design document.
yakv is a simple, in-memory, concurrency-safe key-value store for hobbyists.
yakv (yak-v. (originally intended to be "yet-another-key-value store")) is a simple, in-memory, concurrency-safe key-value store for hobbyists. yakv provides persistence by appending transactions to a transaction log and restoring data from the transaction log on startup.
:key: Idiotproof golang password validation library inspired by Python's passlib
passlib for go 100% modules-free. Python's passlib is quite an amazing library. I'm not sure there's a password library in existence with more thought
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.
SeaweedFS Sponsor SeaweedFS via Patreon SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible ent
Distributed reliable key-value store for the most critical data of a distributed system
etcd Note: The main branch may be in an unstable or even broken state during development. For stable versions, see releases. etcd is a distributed rel
A distributed key-value storage system developed by Alibaba Group
Product Overview Tair is fast-access memory (MDB)/persistent (LDB) storage service. Using a high-performance and high-availability distributed cluster
Elastic Key-Value Storage With Strong Consistency and Reliability
What is Elasticell? Elasticell is a distributed NoSQL database with strong consistency and reliability. Compatible with Redis protocol Use Elasticell
Useful AWS access key attribution tool
whodunnit Working towards this: https://twitter.com/__steele/status/1410437278489477120. Dumping code now to validate if it's useful or not before inv
decentralized kv store based on pubsub in libp2p
pointers decentralized kv store based on pubsub in libp2p Protocol Specification Over View The pointer would receive updates from pubsub network and b
OpenDILab RL Object Store
Introduction Decision AI Store Installation Prerequisites Linux Python = 3.6 pip install . Quick Start Start Etcd Server di_store etcd_server ./conf/
Turn any key/value index into a high-performance two-dimensional spatial index
modular-spatial-index For the demo that this animated gif was generated from
GoBigdis is a persistent database that implements the Redis server protocol. Any Redis client can interface with it and start to use it right away.
GoBigdis GoBigdis is a persistent database that implements the Redis server protocol. Any Redis client can interface with it and start to use it right
CrankDB is an ultra fast and very lightweight Key Value based Document Store.
CrankDB is a ultra fast, extreme lightweight Key Value based Document Store.
sops is an editor of encrypted files that supports YAML, JSON, ENV, INI and BINARY formats and encrypts with AWS KMS, GCP KMS, Azure Key Vault, age, and PGP
sops is an editor of encrypted files that supports YAML, JSON, ENV, INI and BINARY formats and encrypts with AWS KMS, GCP KMS, Azure Key Vault, age, and PGP. (demo)
🔑 A decentralized key derivation protocol for simple passphrase.
Throttled Identity Protocol (TIP) is a decentralized key derivation protocol, which allows people to obtain a strong secret key through a very simple passphrase, e.g. a six-digit PIN.
Fault tolerant, sharded key value storage written in GoLang
Ravel is a sharded, fault-tolerant key-value store built using BadgerDB and hashicorp/raft. You can shard your data across multiple clusters with mult
High-performance, columnar, in-memory store with bitmap indexing in Go
This package contains a high-performance, columnar, in-memory storage engine that supports fast querying, update and iteration with zero-allocations and bitmap indexing.
Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts
Bitcandle Store data on Bitcoin for 350 sats/KB up to 185 kB by using P2SH-P2WSH witness scripts. 225ed8bc432d37cf434f80717286fd5671f676f12b573294db72
Split and distribute your private keys securely amongst untrusted network
cocert An experimental tool for splitting and distributing your private keys safely* cocert, generates ECDSA - P521 key and uses a technique known as
Simplify Kubernetes Secrets Management with Dockhand Secrets Operator
dockhand-secrets-operator Secrets management with GitOps can be challenging in Kubernetes environments. Often engineers resort to manual secret creati
Key-value database stored in memory with option of persistence
Easy and intuitive command line tool allows you to spin up a database avaliable from web or locally in a few seconds. Server can be run over a custom TCP protocol or over HTTP.
Library providing opanapi3 and Go types for store/validation and transfer of ISO-4217, ISO-3166, and other types.
go-types This library has been created with the purpose to facilitate the store, validation, and transfer of Go ISO-3166/ISO-4217/timezones/emails/URL
rosedb is an embedded and fast k-v database based on LSM + WAL
A simple k-v database in pure Golang, supports string, list, hash, set, sorted set.
A simple script to run speedtest(offical) CLI tool and store the results in CSV
PeriodicBW A script made to run official speedtest.net binary periodically and store the results in a CSV file Installation Get the official speedtest
A simple web shop that accepts TurtleCoin
TurtleShop A simple web shop that accepts TurtleCoin Note: This software is not finished. Donate to help development of TurtleShop TRTLuxEnfjdF46cBoHh
golang consul tools
中文文档 consult A consul key/value tool for golang Usage install go get -u github.com/xxjwxc/consult@master New Config conf := consulkv.NewConfig() With
Membin is an in-memory database that can be stored on disk. Data model smiliar to key-value but values store as JSON byte array.
Membin Docs | Contributing | License What is Membin? The Membin database system is in-memory database smiliar to key-value databases, target to effici
Surprisingly space efficient trie in Golang(11 bits/key; 100 ns/get).
Slim - surprisingly space efficient data types in Golang Slim is collection of surprisingly space efficient data types, with corresponding serializati
A minimalistic in-memory key value store.
A minimalistic in-memory key value store. Overview You can think of Kiwi as thread safe global variables. This kind of library comes in helpful when y
An unified key management system to make life easier.
Safebox An unified key management system to make life easier. The main goal of safebox is to make key backup easier with single main key to derive the
Not Yet Another Password Manager written in Go using libsodium
secrets Secure and simple passwords manager written in Go. It aims to be NYAPM (Not Yet Another Password Manager), but tries to be different from othe
reflect api without runtime reflect.Value cost
reflect2 reflect api that avoids runtime reflect.Value cost reflect get/set interface{}, with type checking reflect get/set unsafe.Pointer, without ty
Copier for golang, copy value from struct to struct and more
Copier I am a copier, I copy everything from one to another Features Copy from field to field with same name Copy from method to field with same name
NATS example to store and retrieve large file assets from JetStream.
njs-xfer njs-xfer is a sample application that demonstrates the ability to use NATS and JetStream to store and retrieve large file assets. This sample
A key-value db api with multiple storage engines and key generation
Jet is a deadly-simple key-value api. The main goals of this project are : Making a simple KV tool for our other projects. Learn tests writing and git
A shazam like tool to store songs fingerprints and retrieve them
musig 🔈 A shazam-like tool that allows you to compute song's fingerprints and reverse lookup song names. It's more or less an implementation of the s
A utility library to make use of the X Go Binding easier. (Implements EWMH and ICCCM specs, key binding support, etc.)
xgbutil is a utility library designed to work with the X Go Binding. This project's main goal is to make various X related tasks easier. For example,
Nipo is a powerful, fast, multi-thread, clustered and in-memory key-value database, with ability to configure token and acl on commands and key-regexes written by GO
Welcome to NIPO Nipo is a powerful, fast, multi-thread, clustered and in-memory key-value database, with ability to configure token and acl on command
A course to build distributed key-value service based on TiKV model
The TinyKV Course This is a series of projects on a key-value storage system built with the Raft consensus algorithm
a key-value store with multiple backends including leveldb, badgerdb, postgresql
Overview goukv is an abstraction layer for golang based key-value stores, it is easy to add any backend provider. Available Providers badgerdb: Badger
An in-memory key:value store/cache (similar to Memcached) library for Go, suitable for single-machine applications.
go-cache go-cache is an in-memory key:value store/cache similar to memcached that is suitable for applications running on a single machine. Its major
An embedded key/value database for Go.
bbolt bbolt is a fork of Ben Johnson's Bolt key/value store. The purpose of this fork is to provide the Go community with an active maintenance and de
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
NOTICE: This project have moved to fuse-query VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse. Features High Perform
Distributed reliable key-value store for the most critical data of a distributed system
etcd Note: The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order
SeaweedFS is a distributed storage system for blobs, objects, files, and data warehouse, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV.
SeaweedFS Sponsor SeaweedFS via Patreon SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible ent
EarlyBird is a sensitive data detection tool capable of scanning source code repositories for clear text password violations, PII, outdated cryptography methods, key files and more.
EarlyBird is a sensitive data detection tool capable of scanning source code repositories for clear text password violations, PII, outdated cryptograp
Graviton Database: ZFS for key-value stores.
Graviton Database: ZFS for key-value stores. Graviton Database is simple, fast, versioned, authenticated, embeddable key-value store database in pure
RocksDB/LevelDB inspired key-value database in Go
Pebble Nightly benchmarks Pebble is a LevelDB/RocksDB inspired key-value store focused on performance and internal usage by CockroachDB. Pebble inheri
Use Consul to do service discovery, use gRPC +kafka to do message produce and consume. Use redis to store result.
目录 gRPC/consul/kafka简介 gRPC+kafka的Demo gRPC+kafka整体示意图 限流器 基于redis计数器生成唯一ID kafka生产消费 kafka生产消费示意图 本文kafka生产消费过程 基于pprof的性能分析Demo 使用pprof统计CPU/HEAP数据的
⚡️ A lightweight service that will build and store your go projects binaries, Integrated with Github, Gitlab, Bitbucket and Bitbucket Server.
Rabbit A lightweight service that will build and store your go projects binaries. Rabbit is a lightweight service that will build and store your go pr
Akutan is a distributed knowledge graph store, sometimes called an RDF store or a triple store.
Akutan is a distributed knowledge graph store, sometimes called an RDF store or a triple store. Knowledge graphs are suitable for modeling data that is highly interconnected by many types of relationships, like encyclopedic information about the world. A knowledge graph store enables rich queries on its data, which can be used to power real-time interfaces, to complement machine learning applications, and to make sense of new, unstructured information in the context of the existing knowledge.
HA LDAP based key/value solution for projects configuration storing with multi master replication support
Recon is the simple solution for storing configs of you application. There are no specified instruments, no specified data protocols. For the full power of Recon you only need curl.
In memory Key/Value store in go using gRPC.
In memory cache, using gRPC Contents About Running Server Local Docker Kubernetes Example Helm Terraform API Add Get GetByPrefix GetAllItems DeleteKey
Export the private key from a Swarm json key file
exportSwarmKey Currently it is a pain in the A** to export bee key in to metamask as they are not compatible. This programe will export the private ke
A tools to find the path of a specific key in deep nested JSON.
如何快速从深层嵌套 JSON 中找到特定的 Key #公众号 在爬虫开发的过程中,我们经常遇到一些 Ajax 加载的接口会返回 JSON 数据。
Pogreb is an embedded key-value store for read-heavy workloads written in Go.
Embedded key-value store for read-heavy workloads written in Go
moss - a simple, fast, ordered, persistable, key-val storage library for golang
moss provides a simple, fast, persistable, ordered key-val collection implementation as a 100% golang library.
GhostDB is a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.
GhostDB is designed to speed up dynamic database or API driven websites by storing data in RAM in order to reduce the number of times an external data source such as a database or API must be read. GhostDB provides a very large hash table that is distributed across multiple machines and stores large numbers of key-value pairs within the hash table.
a persistent real-time key-value store, with the same redis protocol with powerful features
a fast NoSQL DB, that uses the same RESP protocol and capable to store terabytes of data, also it integrates with your mobile/web apps to add real-time features, soon you can use it as a document store cause it should become a multi-model db. Redix is used in production, you can use it in your apps with no worries.
Distributed, fault-tolerant key-value storage written in go.
A simple, distributed, fault-tolerant key-value storage inspired by Redis. It uses Raft protocotol as consensus algorithm. It supports the following data structures: String, Bitmap, Map, List.
CLI for Shamir's Secret Sharing and AES key generation, encryption, and decryption.
Shush 🤫 This simple program will help you run Shamir's Secret Sharing algorithm on any file using the split and merge commands.
godesim Simulate complex systems with a simple API.
godesim Simulate complex systems with a simple API. Wrangle non-linear differential equations while writing maintainable, simple code. Why Godesim?
The Go library for working with delimited separated value (DSV).
Package dsv is a Go library for working with delimited separated value (DSV). NOTE: This package has been deprecated. See https://github.com/shuLhan/s
Key/Value database benchmark
USAGE: kvbench OPTIONS OVERVIEW kvbench is a simple benchmarking tool to evaluate the read performance of a key/value store while writes are being app
A simple and powerful SSH keys manager
SKM is a simple and powerful SSH Keys Manager. It helps you to manage your multiple SSH keys easily! Features Create, List, Delete your SSH key(s) Man
[TOOL, CLI] - Filter and examine Go type structures, interfaces and their transitive dependencies and relationships. Export structural types as TypeScript value object or bare type representations.
typex Examine Go types and their transitive dependencies. Export results as TypeScript value objects (or types) declaration. Installation go get -u gi
Extract data or evaluate value from HTML/XML documents using XPath
xquery NOTE: This package is deprecated. Recommends use htmlquery and xmlquery package, get latest version to fixed some issues. Overview Golang packa
Distributed reliable key-value store for the most critical data of a distributed system
etcd Note: The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order
🌰 encrypt/decrypt using ssh keys
ssh-vault 🌰 encrypt/decrypt using ssh private keys Documentation https://ssh-vault.com Usage $ ssh-vault -h Example: $ echo "secret" | ssh-vault -u
An easy-to-use XChaCha20-encryption wrapper for io.ReadWriteCloser (even lossy UDP) using ECDH key exchange algorithm, ED25519 signatures and Blake3+Poly1305 checksums/message-authentication for Go (golang). Also a multiplexer.
Quick start Prepare keys (on both sides): [ -f ~/.ssh/id_ed25519 ] && [ -f ~/.ssh/id_ed25519.pub ] || ssh-keygen -t ed25519 scp ~/.ssh/id_ed25519.pub
:key: Idiotproof golang password validation library inspired by Python's passlib
passlib for go Python's passlib is quite an amazing library. I'm not sure there's a password library in existence with more thought put into it, or wi
goArgonPass is a Argon2 Password utility package for Go using the crypto library package Argon2 designed to be compatible with Passlib for Python and Argon2 PHP. Argon2 was the winner of the most recent Password Hashing Competition. This is designed for use anywhere password hashing and verification might be needed and is intended to replace implementations using bcrypt or Scrypt.
goArgonPass Travis: Drone: All hashing and crypto is done by Go library packages. This is only a utility package to make the process described easier.
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
Natural Language Processing Implementations of selected machine learning algorithms for natural language processing in golang. The primary focus for t
Selected Machine Learning algorithms for natural language processing and semantic analysis in Golang
Natural Language Processing Implementations of selected machine learning algorithms for natural language processing in golang. The primary focus for t
A consistent distributed data store.
Doozer What Is It? Doozer is a highly-available, completely consistent store for small amounts of extremely important data. When the data changes, it
A utility library to make use of the X Go Binding easier. (Implements EWMH and ICCCM specs, key binding support, etc.)
xgbutil is a utility library designed to work with the X Go Binding. This project's main goal is to make various X related tasks easier. For example,
:steam_locomotive: Decodes url.Values into Go value(s) and Encodes Go value(s) into url.Values. Dual Array and Full map support.
Package form Package form Decodes url.Values into Go value(s) and Encodes Go value(s) into url.Values. It has the following features: Supports map of
Go library containing a collection of financial functions for time value of money (annuities), cash flow, interest rate conversions, bonds and depreciation calculations.
go-finance Go library containing a collection of financial functions for time value of money (annuities), cash flow, interest rate conversions, bonds