699 Resources
Golang data-pipeline Libraries
ThoughtLoom: Transform Data into Insights with OpenAI LLMs
ThoughtLoom: Transform Data into Insights with OpenAI LLMs ThoughtLoom is a powerful tool designed to foster creativity and enhance productivity throu
A fast, easy-of-use and dependency free custom mapping from .csv data into Golang structs
csvparser This package provides a fast and easy-of-use custom mapping from .csv data into Golang structs. Index Pre-requisites Installation Examples C
Substation is a cloud native toolkit for building modular ingest, transform, and load (ITL) data pipelines
Substation Substation is a cloud native data pipeline toolkit. What is Substation? Substation is a modular ingest, transform, load (ITL) application f
A zero-dependency cache library for storing data in memory with generics.
Memory Cache A zero-dependency cache library for storing data in memory with generics. Requirements Golang 1.18+ Installation go get -u github.com/rod
Library of generic data structures for Go.
gods Library of generic data structures for Go. priority queue sorted list priority queue unsorted list priority queue heap priority queue adaptable h
Represent your rego rules programmatically.
Policy Enforcer Policy enforcer is a open source tool that allows you to easily create complex authorization policy. Supports RBAC, ABAC and resource
Kalasa is a NoSQL database and provides more data structures for ease of use.
Kalasa Kalasa is a NoSQL database and provides more data structures for ease of use. 简体中文 | English 特 性 嵌入的存储引擎 数据可以加密存储 可以自定义实现存储加密器 即使数据文件被拷贝，也保证存储数
A version control system to manage large files.
ArtiVC ArtiVC (Artifacts Version Control) is a handy command-line tool for data versioning on cloud storage. With only one command, it helps you neatl
A fast, threadsafe skip list in Go
fast-skiplist Purpose As the basic building block of an in-memory data structure store, I needed an implementation of skip lists in Go. It needed to b
Tigris is a modern, scalable backend for building real-time websites and apps.
Tigris Data Getting started These instructions will get you through setting up Tigris Data locally as Docker containers. Prerequisites Make sure that
This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like Apache Spark.
Introduction This project provides a fully automated one-click tool to create Data Analytics platform in Cloud and Kubernetes environment: Single scri
A fake kube-apiserver that serves static data from files
Static KAS A fake kube-apiserver that serves static data from an Openshift must-gather. Dynamically discovers resources and supports logs. Requires go
Data Structures and Algorithms implementation in Go
Data Structures and Algorithms Clean and simple implementation in Go Implementation There are several data structures and algorithms implemented in th
A lightweight, cloud-native data transfer agent and aggregator
English | 中文 Loggie is a lightweight, high-performance, cloud-native agent and aggregator based on Golang. It supports multiple pipeline and pluggable
Juniper is an extension to the Go standard library using generics, including containers, iterators, and streams.
Juniper Juniper is a library of extensions to the Go standard library using generics, including containers, iterators, and streams. container/tree con
Implements a deep pretty printer for Go data structures to aid in debugging
spew Spew implements a deep pretty printer for Go data structures to aid in debugging. A comprehensive suite of tests with 100% test coverage is provi
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
What is Miller? Miller is like awk, sed, cut, join, and sort for data formats such as CSV, TSV, JSON, JSON Lines, and positionally-indexed. What can M
WIP - Pin - local pipeline project with Docker Golang API.
pin 🔥 WIP - Local pipeline project with Docker Golang API. 🌐 Installation Download latest release You can download latest release from here Install
An experimental tektoncd/pipeline resolver
vegetable resolvers A set of experimental tektoncd/pipeline resolvers. The idea of this is to experiment with what could be achieved with a Resolver.
Harvit harvests data from different sources (e.g websites, APIs), converts and transforms it.
harvit Harvit harvests data from different sources (e.g websites, APIs), converts and transforms it. Contents harvit Contents Requirements Usage Examp
Breaking Cloud Native Web APIs in their natural habitat.
cnfuzz - Cloud Native Web API Fuzzer "Breaking Cloud Native Web APIs in their natural habitat." Fuzzing web APIs in their fully converged Cloud Native
Read the text of memes, then inject that text into the image as searchable metadata.
Make Meme Text Searchable I have an extensive set of memes I've been collecting since the early days of Flickr. #icanhascheeseburger It's a pain in th
Utility to migate ChirpStack v3 data into ChirpStack v4.
ChirpStack v3 to v4 data-migration This utilty migrates data from a single ChirpStack Application Server instance and one or multiple ChirpStack Netwo
`go-redash-query` is a simple library to get structed data from `redash query` sources
go-redash-query go-redash-query is a simple library to get structed data from redash query sources Example Source table id name email 1 Dannyhann rhrn
Mergestat - a command-line tool for running SQL queries on git repositories and related data sources
Query git repositories with SQL. Generate reports, perform status checks, analyze codebases. 🔍 📊
💧 Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack
Website | Community | Blog Get Early Access Visual Data Preparation (VDP) is an open-source tool to streamline the end-to-end visual data processing p
Powerful Blockchain streaming data engine, based on StreamingFast Firehose technology.
Substreams - A streaming data engine for The Graph - by StreamingFast DEVELOPER PREVIEW OF SUBSTREAMS Think Fluvio for deterministic blockchain data.
Esdump is a migration CLI written in Go for migrating index mapping and data from one elasticsearch to another.
esdump Introduction esdump is a migration CLI written in Go for migrating index mapping and data from one elasticsearch to another. Compatibility Elas
Collection of high performance, thread-safe, lock-free go data structures
Garr - Go libs in a Jar Collection of high performance, thread-safe, lock-free go data structures. adder - Data structure to perform highly-performant
A Go package providing a generic data type to track maximum and minimum peak values.
go-peak Overview go-peak is a Go package providing a generic data type that tracks the maximum and minimum peak values within a specific period of tim
Data Structure Series: Heaps and heap applications
heaps Data Structure Series: Heaps and heap applications Current Updates: GO: heaps.go: max-heap implementation standard add, remove, and restore func
ZSet is an in-memory Redis like sorted set datastructure
zset Getting Started Installing To start using hash, install Go and run go get: $ go get -u github.com/arriqaaq/zset This will retrieve the library. U
This is the code example how to use SQL to query data from any relational databases in Go programming language.
Go with SQL example This is the code example how to use SQL to query data from any relational databases in Go programming language. To start, please m
A Simple to use golang masking tool to mask sensitive information from go-lang data-structures
Golang Masking Tool Golang Masking Tool is a simple utility of creating a masker tool which you can use to mask sensitive information. You can use a v
Extract files from DATA.BIN
psptk5 学习研究对象：PSP 太阁立志传 5(TAIKOU RISSHIDEN V) ULJM-05525|303A88BDAC0128BC|0001|G 学习目的：从 DATA.BIN 文件中提取所有的文件 使用方法 psptk5 extract [path of DATA.BIN] [pa
Timeboundmap - A Map data structure with expiration cleanup
timeboundmap A Map data structure with expiration cleanup Benchmark goos: darwin
Livegollection-example-app - A simple web-chat app that demonstrates how the Golang livegollection library can be used for live data synchronization
livegollection-example-app livegollection-example-app is a simple web-chat app t
Tpf2-tpnetmap-toolkit - A toolkit to create svg map images from TransportFever2 world data
tpf2-tpnetmap-toolkit TransportFever2 のワールドデータから svg のマップ画像を作成するツールキットです。 1. 導入方
Users - Restful API that can get/create/update/delete user data from persistence storage
Users Service The users service is used to maintain Restful API that can get/cre
Go-userapi-rest - Build a RESTful API that can get/create/update/delete user data from a persistence database
GO ASSIGNMENT Overview of the Task Context Build a RESTful API that can get/crea
Fake data generator
faker Fake data generator Features Supports data boolean, username, domain, email, firstname, lastname, name, gender, uuid Easy to integrate. Installa
A self-bot that gives data about minecraft names, droptimes, upcoming 3 chars and more.
Commands !searches input - Grabs a usernames searches !info input - Gets information on the account.. cape, skin, uuid etc. !droptime input - ge
✨Super-fast and easy data transforming with any interfaces
BELT Super-fast and easy data transforming with any interfaces Just connect Belt to your Factory Methods Transform data Map Filter Assistance Pipe App
gRPC merupakan metode pendistribusian data melalui sebuah protofile atau stub.
gRPC Definisi gRPC merupakan metode pendistribusian data melalui sebuah protofile atau stub. Kenapa Harus Belajar gRPC? Lebih simple dibanding REST da
A golang tool to view Redis data in terminal
Redis Viewer A tool to view Redis data in terminal. Usage: KeyBoard Description ctrl+c exit redis viewer ↑ previous key ↓ next key ← previous page → n
Build simple microservice with static data
microservice-static-go So this is just example build microservice with static data, i hope this repo will help you learning golang installation 1. clo
Script to fill phishing sites databases with random data and prevent theft
phsfill Script to fill phishing sites databases with random data and prevent theft Installation & Build: To install the library, run go install github
Go-fiber - Implement CRUD Data Go and Mysql using Authentication & Authorization
Implement CRUD Data Go and Mysql using Authentication & Authorization
OpenStreetMap find - A simple command line tool to explore osm data
A small tool for playing around with osm databases (those resulting from osm2pgsql). Read SETUP_DATABASE.md to learn how to set up the required databa
Data Availability Sampling (DAS) on a Discovery-v5 DHT overlay
Implementing Data Availability Sampling (DAS) There's a lot of history to unpack here. Vitalik posted about the "Endgame": where ethereum could be hea
Cheap/fast/simple XLSX file writer for textual data
xlsxwriter Cheap/fast/simple XLSX file writer for textual data -- no fancy formatting or graphs go get github.com/mzimmerman/xlsxwriter data := [][]s
Buffer Compactor is a tool to allow for buffering for a duration and compacting data on keys.
Buffer Compactor is a tool to allow for buffering for a duration and compacting data on keys. It uses a badgerDB and sortedset in order to coridinate a time-delayed queue that also aggregates updates sharing the same key in a extremely peformant manner.
🖥 Securely transfer and send anything between computers with TUI.
🖥️ Securely transfer and send anything between computers with TUI. Installation ways
A Go implementation of an in-memory bloom filter, with support for boltdb and badgerdb as optional data persistent storage.
Sprout A bloom filter is a probabilistic data structure that is used to determine if an element is present in a set. Bloom filters are fast and space
Cut unneeded data from geoip.dat or geosite.dat
Cut unneeded data from geoip.dat or geosite.dat
A simple scraper to export data from buildkite to honeycomb using opentelemetry SDK
A quick scraper program that let you export builds on BuildKite as OpenTelemetry data and then send them to honeycomb.io for slice-n-dice high cardinality analysis.
A blockchain-based demo that shows an alternative strategy for ensuring data and log integrity on aircraft
A blockchain-based demo that shows an alternative strategy for ensuring data and log integrity on aircraft. (Coded in less than 24 hours for GunnHack)
Data-builder - Data builder with golang
databuilder import "github.com/go-coldbrew/data-builder" Index Variables func Is
A Target Tracking , NoteTaking , CheckLists and Data Management GUI App for Bug Hunter's and Pentesters.
Screenshots Features • Installation • Usage • Features • Notes • Sandman A Target Tracking , NoteTaking , CheckLists and Data Management GUI App for B
Grafana Data Source Backend Plugin
Grafana Data Source Backend Plugin This plugin allows you to receive telemetry i
A simple server to convert ATK-IMU901 serial data into websocket stream
A simple server to convert ATK-IMU901 serial data into WebSocket stream.
Tiny go package for fetching high and low value of a stock for any given period range using kite connect historical data APIs.
Tiny go package for fetching high and low value of stock for any given period range using Kite connect Historical data APIs.
Websocket server. Get data from provider API, clean data and send to websoket, when it's changed.
Описание Сервис получает данные по киберспортивным матчам CS:GO от провайдера, структурирует, очищает от лишнего и отправляет всем активным вебсокет к
A Go library for reading sensor data from the Adafruit SCD-40 and SCD-41
A Go module for reading CO2, temperature, and humidity data from the Sesirion SCD4x family of sensors. Example sensors are the Adafruit SCD-40 and Adafruit SCD-41. The former was used during the development of this module.
A go package to add support for data at rest encryption if you are using the database/sql.
go-lockset A go package to add support for data at rest encryption if you are using the database/sql to access your database. Installation In your Gol
Responsible for provide data to the web front-end
Responsible for provide data to the web front-end. Generates names based on preseted datasets (list of example names), but you can upload a custom dataset (it must have at least 23 names)
A bloom filter is a probabilistic data structure that is used to determine if an element is present in a set
A Go implementation of a bloom filter, with support for boltdb and badgerdb as optional in-memory persistent storage.
Nrod-go - Sample application to process Train Movements messages from the Network Rail Open Data feed
NROD Train Movements Processor Sample application to process Train Movements mes
A Golang library to scrape lyrics from musixmatch.com (WIP)
A Golang library to scrape lyrics from musixmatch.com (WIP)
Solutions to AlgoExpert Problems in Six Programming Languages: Python, Java, Go, C++, C#, JavaScript/TypeScript
Solutions to AlgoExpert Problems in Six Programming Languages: Python, Java, Go, C++, C#, JavaScript/TypeScript Discover solutions to AlgoExpert probl
Invidtui - An invidious client, which fetches data from invidious and displays a user interface in the terminal(TUI)
invidtui invidtui is an invidious client, which fetches data from invidious and
TechTalk: Procesamiento masivo de datos con Go y sync.Pool
Procesamiento masivo de datos en Go Si quieres probarlo, descarga alguno de los
Extypes - Extra data types useful for database
ExTypes Extra data types useful for database JSON Object JSON Object is useful f
Go-Yahoo-Finance-Daily-Actives - Scrape for the daily actives on yh Finance and save the data to a CSV, and optionally send it to yourself as an email
Go-Yahoo-Finance-Daily-Actives - Scrape for the daily actives on yh Finance and save the data to a CSV, and optionally send it to yourself as an email
Golang Fake data generator
Fake data generator. Written in Go Installation Faker requires Go 1.17 go get
A yaml data-driven testing format together with golang testing library
Specimen Yaml-based data-driven testing Specimen is a yaml data format for data-driven testing. This enforces separation between feature being tested
A go server which will respond with data to mock a server!
Mocker A go program which will respond with data to mock a server; mainly useful while developing a frontend application, whose backend is not running
In one particular project, i had to import some key/value data to Prometheus. So i have decided to create my custom-built Node Exporter in Golang.
.png)
In one particular project, i had to import some key/value data to Prometheus. So i have decided to create my custom-built Node Exporter in Golang.
Tutorial code for my video Learn to Use Basic Data Structures - Slices, Structs and Maps in Golang
Learn to Use Basic Data Structures - Slices, Structs and Maps in Golang Read text from a file and split into words. Introduction to slices / lists. Co
Go-binsize-treemap - Go binary size SVG treemap
🔍 Go binary size SVG treemap Make treemap breakdown of Go executable binary $ g
Marshallable - Make generic data types marshallable
Marshallable Make generic data types marshallable! Features Implement methods: S
Sig - Statistics in Go - CLI tool for quick statistical analysis of data streams
Statistics in Go - CLI tool for quick statistical analysis of data streams
Implementation of various data structures and algorithms in Go
GoDS (Go Data Structures) Implementation of various data structures and algorithms in Go. Data Structures Containers Lists ArrayList SinglyLinkedList
Atlas is a CLI designed to help companies better work with their data.
Atlas - A Database Toolkit Atlas is a CLI designed to help companies better work with their data. It includes several components that can be used indi
Rental-api - A RESTful-API that allows developers to connect to data about rental properties
Rentals-API is a RESTful-API that allows developers to connect to data about rental properties.
Kdmq - Tool to query KDM data for a given Rancher version
kdmq (kdm query) Tool to query KDM data for a given Rancher version, think of: W
Gosfdc module - a collection of packages containing the data structures from the various Salesforce APIs and Tools
Gosfdc module - a collection of packages containing the data structures from the various Salesforce APIs and Tools
GoAdmin Instruction - A golang framework help gopher quickly build a data visualization platform
GoAdmin Instruction - A golang framework help gopher quickly build a data visualization platform
Git-based DevOps PaaS: Project, Pipeline, Kubernetes, ServiceMesh, MutilCloud
gitctl 一体化 DevOps 平台 从代码到应用的一体化编排，应用全生命周期管理，多云托管。 gitctl 会有哪些功能？ git 代码托管 projec
Conduit - Data Integration for Production Data Stores
Conduit Data Integration for Production Data Stores. 💫 Overview Conduit is a da
PartyGateRDF - PartyGate tools for linked-data scientists
PartyGateRDF - PartyGate tools for linked-data scientists Introduction This is a data set containing references to information published by the media
Data injection wrapper for values maintained in a GCP Secret Manager document.
injector The injector is a utility that retrieves a GCP Secret Manager document which contains an HJSON or JSON object with an embedded top-level envi
Mantil-template-form-to-dynamodb - Receive form data and write it to a DynamoDB table
This template is an example of serverless integration between Google Forms and DynamoDB
Ordered-concurrently a library for parallel processing with ordered output in Go
Ordered-concurrently a library for parallel processing with ordered output in Go. Process work concurrently / in parallel and returns output in a channel in the order of input. It is useful in concurrently / parallelly processing items in a queue, and get output in the order provided by the queue.
Parapipe - paralleling pipeline
Parapipe - paralleling pipeline The library provides a zero-dependency non-blocking buffered FIFO-pipeline for structuring the code and vertically sca
Goavro is a library that encodes and decodes Avro data.
goavro Goavro is a library that encodes and decodes Avro data. Description Encodes to and decodes from both binary and textual JSON Avro data. Codec i
This service is intented to collect data using grpc using Go lang backend and cassandra DB as storage
Go Data Collection This service is intented to collect data using grpc using Go lang backend and cassandra DB as storage. Dev Setup make test_env make
Visualize CSV data in Golang
Golang CSV Viewer Visualize CSV data in Golang Run official example cd official go run . # in another terminal window open http://localhost:8089 bars
Grafana Data Source Backend Plugin Template
Grafana Data Source Backend Plugin Template This template is a starting point for building Grafana Data Source Backend Plugins What is Grafana Data So
pipe JSONL data to SIEM
SIEMSend UNIX philosophy inspired SIEM connector. The binary work is very simple: get a stream of JSON lines from stdin, send them in batches to a SIE