683 Resources
Golang google-cloud-storage Libraries
GoDrive: A cloud storage system similar to Dropbox or Google Drive, with resilient
Cloud Storage Service Author: Marisa Tania, Ryan Tjakrakartadinata Professor: Matthew Malensek See project spec here: https://www.cs.usfca.edu/~mmalen
A probabilistic data structure service and storage
Skizze ([ˈskɪt͡sə]: german for sketch) is a sketch data store to deal with all problems around counting and sketching using probabilistic data-structu
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values. Authors: Sanjay Ghem
The Swift Virtual File System
*** This project is not maintained anymore *** The Swift Virtual File System SVFS is a Virtual File System over Openstack Swift built upon fuse. It is
SeaweedFS a fast distributed storage system for blobs, objects, files, and data lake, for billions of files
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Goofys is a high-performance, POSIX-ish Amazon S3 file system written in Go
Goofys is a high-performance, POSIX-ish Amazon S3 file system written in Go Overview Goofys allows you to mount an S3 bucket as a filey system. It's a
A user-space file system for interacting with Google Cloud Storage
gcsfuse is a user-space file system for interacting with Google Cloud Storage. Current status Please treat gcsfuse as beta-quality software. Use it fo
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
JuiceFS is a high-performance POSIX file system released under GNU Affero General Public License v3.0. It is specially optimized for the cloud-native
Stream data into Google BigQuery concurrently using InsertAll()
Kik and me (@oryband) are no longer maintaining this repository. Thanks for all the contributions. You are welcome to fork and continue development. B
rosedb is a fast, stable and embedded key-value (k-v) storage engine based on bitcask.
rosedb is a fast, stable and embedded key-value (k-v) storage engine based on bitcask. Its on-disk files are organized as WAL(Write Ahead Log) in LSM trees, optimizing for write throughput.
Distributed disk storage database based on Raft and Redis protocol.
IceFireDB Distributed disk storage system based on Raft and RESP protocol. High performance Distributed consistency Reliable LSM disk storage Cold and
Cloud-Native distributed storage built on and for Kubernetes
Longhorn Build Status Engine: Manager: Instance Manager: Share Manager: Backing Image Manager: UI: Test: Release Status Release Version Type 1.1 1.1.2
Storage Orchestration for Kubernetes
What is Rook? Rook is an open source cloud-native storage orchestrator for Kubernetes, providing the platform, framework, and support for a diverse se
s3git: git for Cloud Storage. Distributed Version Control for Data.
s3git: git for Cloud Storage. Distributed Version Control for Data. Create decentralized and versioned repos that scale infinitely to 100s of millions of files. Clone huge PB-scale repos on your local SSD to make changes, commit and push back. Oh yeah, it dedupes too and offers directory versioning.
Perkeep (née Camlistore) is your personal storage system for life: a way of storing, syncing, sharing, modelling and backing up content.
Perkeep is your personal storage system. It's a way to store, sync, share, import, model, and back up content. Keep your stuff for life. For more, see
"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
Website | Documentation | Download | Contributing | Changelog | Installation | Forum Rclone Rclone ("rsync for cloud storage") is a command-line progr
High Performance, Kubernetes Native Object Storage
MinIO Quickstart Guide MinIO is a High Performance Object Storage released under GNU Affero General Public License v3.0. It is API compatible with Ama
An ATNA (Audit Trail and Node Authentication) Cloud Backup Utility
ATNA Vault ATNA Vault allows you to maintain a secure long-term archive for all your IHE audit messages. IHE vendors who can provide "filter forward"
Server bridging Google's OAuth and service using Radius for authentication
Fringe Fringe is an easy workaround for Google Workplace users who need a Radius server to perform authentication on behalf of other services (e.g. 80
Example project with Litestream and Go
Example project with Litestream and Go This repo contains a simple application that tracks number of page views. The main purpose was to prototype run
☁️ Cloud Torrent: a self-hosted remote torrent client
Cloud torrent is a a self-hosted remote torrent client, written in Go (golang). You start torrents remotely, which are downloaded as sets of files on
Dynamically provisioning persistent local storage with Kubernetes
Local Path Provisioner Overview Local Path Provisioner provides a way for the Kubernetes users to utilize the local storage in each node. Based on the
Distributed disk storage database based on Raft and Redis protocol.
IceFireDB Distributed disk storage system based on Raft and RESP protocol. High performance Distributed consistency Reliable LSM disk storage Cold and
A note taking app, that you can draw in, syncs to the cloud, and is on most platforms!
About NoteDraw About · How to contribute · How to run Structure Codebase Description SRC The sorce code for the client side (Go) Branches Only Ones th
The TinyKV course builds a key-value storage system with the Raft consensus algorithm
The TinyKV Course The TinyKV course builds a key-value storage system with the Raft consensus algorithm. It is inspired by MIT 6.824 and TiKV Project.
[WIP] Cheap, portable and secure NAS based on the Raspberry Pi Zero - with encryption, backups, and more
PortaDisk - Affordable Raspberry Pi Portable & Secure NAS Project Project Status: Early work in progress. web-unlock is still not ready for production
A gateway to expose s3 standard API for any storage type.
s3-gateway this project is used to be compatible with any other storage type. there are tons of object storage services in the internat. However, many
Paxoskv: a Naive and Basic paxos kv storage
paxoskv: a Naive and Basic paxos kv storage 这个repo 目前仅是用于学习的实例代码. 这是一个基于paxos, 只有200行代码的kv存储系统的简单实现, 以最简洁的形式展示paxos如何运行, 作为 可靠分布式系统-paxos的直观解释 这篇教程中的代
Correct the timestamp of photo/video of Google Photo from Google takeout
Correct Timestamp of Google Photo from Google Takeout Development Environment: Ubuntu 20.04 Go 1.17 Usage Require Go 1.16 or later to build. go build
A note taking app, that you can draw in, syncs to the cloud, and is on most platforms!
About NotDraw About · How to contribute · How to run · Trello · FAQ This is achived because I dont want to work on it anymore Structure Codebase Descr
Automatically stop GCE instances
auto-stop-gce-instances Architecture How to deploy 1. Deploy Pub/Sub $ gcloud pubsub topics create $PUBSUB_NAME 2. Deploy Cloud Functions $ gcloud fu
A hack example to servce file as a webserver with a Google Cloud Functions
Overview This project is a hack example to servce file as a webserver with a Google Cloud Functions (normally single purpose, only one entry point). I
This is a simple file storage server. User can upload file, delete file and list file on the server.
Simple File Storage Server This is a simple file storage server. User can upload file, delete file and list file on the server. If you want to build a
Plan team's rotation on google calendar
google-rotation-planner Plan rota on google calendar. Usage Get a credentials.json file from GCloud and place it in the same folder as the executable.
rgkv is a distributed kv storage service using raft consensus algorithm.
rgkv rgkv is a distributed kv storage service using raft consensus algorithm. Get/put/append operation High Availability Sharding Linearizability Tabl
Cloud Native Electronic Trading System built on Kubernetes and Knative Eventing
Ingenium -- Still heavily in prototyping stage -- Ingenium is a cloud native electronic trading system built on top of Kubernetes and Knative Eventing
A key-value storage transaction interpretator.
kv-txn-interpreter A key-value storage transaction interpreter, which provides an etcd-like transaction interface to help you build a transaction over
Alibaba Cloud BPStudio SDK for Go
English | 简体中文 Alibaba Cloud BPStudio SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which vers
Alibaba Cloud Eipanycast SDK for Go
English | 简体中文 Alibaba Cloud Eipanycast SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which ve
Terraform module to provisison Kubernetes Clusters on Hetzner cloud (Based on KubeOne)
Terraform module template Terraform module which creates describe your intent resources on AWS. Usage Use this template to scaffold a new terraform mo
Helps me find good enough stocks that pay enough dividends using IEX Cloud data provider.
divyield Helps me find good enough stocks that pay enough dividends using IEX Cloud data provider. Create database using the postgres/scripts/createdb
Alibaba Cloud sae SDK for Go
English | 简体中文 Alibaba Cloud sae SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which version g
A repository for showcasing my knowledge of the Google Go (2009) programming language, and continuing to learn the language.
Learning Google Golang (programming language) Not to be confused with the Go! programming language by Francis McCabe I don't know very much about the
Alibaba Cloud xixikf SDK for Go
English | 简体中文 Alibaba Cloud xixikf SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which versio
K8s local storage sync for stateful set's using microk8s-hostpath storage classe
Local Storage Sync for microk8s-hostpath The goal is to be able to sync stateful sets between the different nodes of a cluster to allow the data to be
Crossplane provider for Confluent Cloud
provider-confluent provider-confluent is a minimal Crossplane Provider that is meant to be used as a template for implementing new Providers. It comes
A Cloud Native Buildpack that contributes the Syft CLI which can be used to generate SBoM information
gcr.io/paketo-buildpacks/syft The Paketo Syft Buildpack is a Cloud Native Buildpack that contributes the Syft CLI which can be used to generate SBoM i
Network connecter for storage.
database Quick fast connection to database use gorm. Installation $ go get -u github.com/coolstina/connecter Example package main import ( "fmt" "
Alibaba iLogtail : The Lightweight Collector of SLS in Alibaba Cloud
Alibaba iLogtail - The Lightweight Collector of SLS in Alibaba Cloud | 中文版本 iLogtail was born for observable scenarios and has many production-level f
A demo repo to show KICS Github Action in Action
🤖 KICS GitHub Actions Demo This repository shows how KICS GitHub Action can be set and was fully inspired by the documentation on KICS GitHub Actions
Crossplane provider for InfluxDB Cloud
provider-template provider-template is a minimal Crossplane Provider that is meant to be used as a template for implementing new Providers. It comes w
Crossplane provider for InfluxDB Cloud
provider-template provider-template is a minimal Crossplane Provider that is meant to be used as a template for implementing new Providers. It comes w
Nacos command-line tool
目录: nacos-cli 构建安装 源码安装 二进制安装 命令指南 config命令 add get del list version nacos-cli Nacos 命令行工具,基于 Nacos OpenApi 封装的命令行工具。提供一些对配置、服务注册与发现、命名空间的简单操作 。借助 go
The TinyKV course builds a key-value storage system with the Raft consensus algorithm.
The TinyKV Course The TinyKV course builds a key-value storage system with the Raft consensus algorithm. It is inspired by MIT 6.824 and TiKV Project.
cloneMAP: cloud-native Multi-Agent Platform
cloneMAP: cloud-native Multi-Agent Platform cloneMAP is a multi-agent platform (MAP) that is designed to run in a cloud environment based on Kubernete
Access Google Ads API via GRPC
google-ads-pb You can use the golang library to interact with the Google Ads API across grpc. This library is not the official Google Ads API library.
A CLI tool which loads data from yaml files into the Google Cloud Spanner tables
splanter A CLI tool which loads data from yaml files into the Google Cloud Spanner tables (mainly for the development).
GoogleBookAPI is built on top of flogo, a flow based application.
GoogleBookAPI Example GoogleBookAPI is built on top of flogo, a flow based application. Upon launch for first time, the application creates a topic go
A Declarative Cloud Firewall Reverse Proxy Solution with Companion Mobile App
A declarative Cloud firewall reverse proxy solution with inbuilt DDoS protection and alerting mechanism to protect your servers and keeping an eye on those malicious requests
A repository for exploring google go
GoPractice A repository for exploring google go. There are tests in there. Q1) Write a function that sorts a bunch of words by the number of character
Alibaba Cloud GEMP SDK for Go
English | 简体中文 Alibaba Cloud GEMP SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which version
ORM for Cloud Spanner to boost your productivity
ORM for Cloud Spanner to boost your productivity 🚀
This repo contains example on how to consume secrets from Google Secret Manager from GKE
GKE Secret Manager. Environment setup This repo contains examples of how to consume secrets from Google Secret Manager (GSM) from Google Kubernetes En
PaddleDTX is a solution that focused on distributed machine learning technology based on decentralized storage.
中文 | English PaddleDTX PaddleDTX is a solution that focused on distributed machine learning technology based on decentralized storage. It solves the d
Lightweight CLI tool to programmatically rescale your Hetzner virtual server daily to optimize your budget spending
Lightweight CLI tool to programmatically rescale your Hetzner virtual server daily to optimize your budget spending
A Cloud Native Buildpack that provides the Open Liberty runtime
gcr.io/paketo-buildpacks/open-liberty The Paketo Open Liberty Buildpack is a Cloud Native Buildpack that contributes Open Liberty for Java EE support.
Go serverless functions examples with most popular Cloud Providers
go-serverless Go serverless functions examples with most popular Cloud Providers Creating zip archive go mod download go build ./cmd/aws|gcp zip -
This is a small API that provides basic REST endpoints to shorten a URL
This is a small API that provides basic REST endpoints to shorten a URL, get information about the URL, update the URL, and get statistics on most accessed URLs.
Api RESTfull - Go test Cloud Run
gcloudrun User Testando Google Cloud Run, testando com configurar e subir uma aplicação Go no serviço Cloud Run. O objetivo é testar e levantar as pos
Duplicacy: A lock-free deduplication cloud backup tool
Duplicacy: A lock-free deduplication cloud backup tool Duplicacy is a new generation cross-platform cloud backup tool based on the idea of Lock-Free D
Utility for working with files and folders stored on Google Drive
skicka Utility for working with files and folders stored on Google Drive. Note: skicka is not an official Google product! Intro skicka makes it easy t
Alibaba Cloud BatchCompute SDK for Go
English | 简体中文 Alibaba Cloud BatchCompute SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which
Void is a zero storage cost large file sharing system.
void void is a zero storage cost large file sharing system. License Copyright © 2021 Changkun Ou. All rights reserved. Unauthorized using, copying, mo
Go program for uploading files to Google Drive
gdrive-upload Go program for uploading files to Google Drive. Installation Install Go Homebrew: sudo brew install go apt-get: sudo apt-get install gol
Enables a FaaS experience for Knative / Cloud Native Runtimes.
Function Buildpacks for Knative Enables a FaaS experience for Knative / Cloud Native Runtimes. Will soon extend func to create deployable functions vi
LeetCode in Go with the code style strictly follows the Google Golang Style Guide
LeetCode in Go LeetCode Online Judge is a website containing many algorithm questions. Most of them are real interview questions of Google, Facebook,
CSI for S3 compatible SberCloud Object Storage Service
sbercloud-csi-obs CSI for S3 compatible SberCloud Object Storage Service This is a Container Storage Interface (CSI) for S3 (or S3 compatible) storage
CSI driver NVMf mainly supports RDMA and TCP for Software Defined Storage by NVMf
CSI NVMf driver Overview This is a repository for NVMe-oF CSI Driver. Currently it implements bare minimum of th CSI spec. Requirements The CSI NVMf d
Fleex allows you to create multiple VPS on cloud providers and use them to distribute your workload.
Fleex allows you to create multiple VPS on cloud providers and use them to distribute your workload. Run tools like masscan, puredns, ffuf, httpx or a
High quality cloud service emulators for local development stacks
emulators High quality Google Cloud service emulators for local development stacks Why? At FullStory, our entire product and backend software stack ru
This is a cloud-native application that focuses on the DevOps area.
KubeSphere DevOps integrates popular CI/CD tools, provides CI/CD Pipelines based on Jenkins, offers automation toolkits including Binary-to-Image (B2I
FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function Compute (USENIX ATC'21)
FaaSNet FaaSNet is the first system that provides an end-to-end, integrated solution for FaaS-optimized container runtime provisioning. FaaSNet uses l
Key-Value Storage written in Go.
kvs kvs is an in-memory key-value storage written in Go. It has 2 different usage. It can be used as a package by importing it to your code or as a se
Store files in Telegram messages for free and access them from a modern Web UI
Telegram Storage Store files in Telegram messages for free and access them in a nice web UI. Telegram allows to store files (of max 2GB each) for a un
Error interface wrappers for Google's errdetails protobuf types, because they're handy as heck and I want to use them more
Error interface wrappers for Google's errdetails protobuf types, because they're handy as heck and I want to use them more
A simple RESTful API for storing and retrieving data during MRI image reconstructions
MRD Storage Server The MRD Storage Server provides a simple RESTful API for storing and retrieving data during MRI image reconstructions. It supports:
Prometheus exporter of Hetzner Cloud inventory
Hetzner Cloud inventory exporter Prometheus exporter of Hetzner Cloud inventory Build Using docker Requires docker make build Locally Requires go buil
Cloud Service Auto Cert
CSAC (Cloud Service Auto Cert) Features Tencent Cloud Auto DNS Certification Auto Upload Cert File Auto Update CDN HTTPS Cert Auto Update CLB HTTPS Ce
A CLI tool for GCP Cloud Build Triggers
cbtctl A CLI tool for GCP Cloud Build Triggers Usage Run a build trigger with substitutions $ cbtctl run --project GCP Project Name --trigger Trigg
CloudQuery extracts, transforms, and loads your cloud assets into normalized PostgreSQL tables.
The open-source cloud asset inventory backed by SQL. CloudQuery extracts, transforms, and loads your cloud assets into normalized PostgreSQL tables. C
Project containing all scripts and descriptors to deploy Slurpanize in different ways
Slurpanize cloud infrastructure This project is built to install on any hardware or cloud infrastructure the Slurpanize platform. The installation is
The TinyKV course builds a key-value storage system with the Raft consensus algorithm.
The TinyKV Course The TinyKV course builds a key-value storage system with the Raft consensus algorithm. It is inspired by MIT 6.824 and TiKV Project.
Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
Karmada Karmada: Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration Karmada (Kubernetes Armada) is a Kubernetes management system that enables
CDK - Zero Dependency Container Penetration Toolkit
CDK is an open-sourced container penetration toolkit, offering stable exploitation in different slimmed containers without any OS dependency. It comes with penetration tools and many powerful PoCs/EXPs helps you to escape container and takeover K8s cluster easily.
Package zaperations provides a Google Cloud operations suite (formerly Stackdriver) compatible config for the uber-go/zap logger.
Package zaperations provides a Google Cloud Operations (formerly Stackdriver) compatible config for the excellent uber-go/zap logger. Example This exa
A Wrapper Client for Google Spreadsheet API (Sheets API)
Senmai A Wrapper Client for Google Spreadsheet API (Sheets API) PREPARATION Service Account and Key File Create a service account on Google Cloud Plat
Rclone ("rsync for cloud storage") is a command-line program to sync files and directories to and from different cloud storage providers.
Website | Documentation | Download | Contributing | Changelog | Installation | Forum Rclone Rclone ("rsync for cloud storage") is a command-line progr
Alibaba Cloud RMC SDK for Go
English | 简体中文 Alibaba Cloud RMC SDK for Go Requirements It's necessary for you to make sure your system have installed Go environment which version g