20 Resources
Golang etl Libraries
GoBatch is a batch processing framework in Go like Spring Batch in Java
GoBatch English|中文 GoBatch is a batch processing framework in Go like Spring Batch in Java. If you are familiar with Spring Batch, you will find GoBat
✨Super-fast and easy data transforming with any interfaces
BELT Super-fast and easy data transforming with any interfaces Just connect Belt to your Factory Methods Transform data Map Filter Assistance Pipe App
Conduit - Data Integration for Production Data Stores
Conduit Data Integration for Production Data Stores. 💫 Overview Conduit is a da
Package flow provides support for basic FBP / pipelines
Flow - FBP / pipelines / workers pool Package flow provides support for very basic FBP / pipelines. It helps to structure multistage processing as a s
xyr is a very lightweight, simple and powerful data ETL platform that helps you to query available data sources using SQL.
xyr [WIP] xyr is a very lightweight, simple and powerful data ETL platform that helps you to query available data sources using SQL. Supported Drivers
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
End-to-end computer vision platform Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises. onepa
Ethereum event tracker
Eth-event-tracker Tracker of Ethereum events. Example package main import ( "context" "encoding/binary" "flag" "fmt" "os" "os/signal" "syscall
churro is a cloud-native Extract-Transform-Load (ETL) application designed to build, scale, and manage data pipeline applications.
Churro - ETL for Kubernetes churro is a cloud-native Extract-Transform-Load (ETL) application designed to build, scale, and manage data pipeline appli
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Optimus Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality
a go daemon that syncs MongoDB to Elasticsearch in realtime. you know, for search.
monstache a go daemon that syncs mongodb to elasticsearch in realtime Version 6 This version of monstache is designed for MongoDB 3.6+ and Elasticsear
A serverless cluster computing system for the Go programming language
Bigslice Bigslice is a serverless cluster data processing system for Go. Bigslice exposes composable API that lets the user express data processing ta
A serverless cluster computing system for the Go programming language
Bigslice Bigslice is a serverless cluster data processing system for Go. Bigslice exposes composable API that lets the user express data processing ta
A lightweight stream processing library for Go
go-streams A lightweight stream processing library for Go. go-streams provides a simple and concise DSL to build data pipelines. Wiki In computing, a
A Go native tabular data extraction package. Currently supports .xls, .xlsx, .csv, .tsv formats.
grate A Go native tabular data extraction package. Currently supports .xls, .xlsx, .csv, .tsv formats. Why? Grate focuses on speed and stability first
Declarative streaming ETL for mundane tasks, written in Go
Benthos is a high performance and resilient stream processor, able to connect various sources and sinks in a range of brokering patterns and perform hydration, enrichments, transformations and filters on payloads.
csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
csvplus Package csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream processing operations, indices and joins. The
omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc.
omniparser Omniparser is a native Golang ETL parser that ingests input data of various formats (CSV, txt, fixed length/width, XML, EDI/X12/EDIFACT, JS
Declarative streaming ETL for mundane tasks, written in Go
Benthos is a high performance and resilient stream processor, able to connect various sources and sinks in a range of brokering patterns and perform h
A library for performing data pipeline / ETL tasks in Go.
Ratchet A library for performing data pipeline / ETL tasks in Go. The Go programming language's simplicity, execution speed, and concurrency support m
Apache AVRO for go
avro The purpose of this package is to facilitate use of AVRO with go strong typing. Features github.com/khezen/avro Marshal/Unmarshal AVRO schema git