98 Resources
Golang ecs-cicd-pipeline Libraries
Substation is a cloud native toolkit for building modular ingest, transform, and load (ITL) data pipelines
Substation Substation is a cloud native data pipeline toolkit. What is Substation? Substation is a modular ingest, transform, load (ITL) application f
WIP - Pin - local pipeline project with Docker Golang API.
pin 🔥 WIP - Local pipeline project with Docker Golang API. 🌐 Installation Download latest release You can download latest release from here Install
An experimental tektoncd/pipeline resolver
vegetable resolvers A set of experimental tektoncd/pipeline resolvers. The idea of this is to experiment with what could be achieved with a Resolver.
Breaking Cloud Native Web APIs in their natural habitat.
cnfuzz - Cloud Native Web API Fuzzer "Breaking Cloud Native Web APIs in their natural habitat." Fuzzing web APIs in their fully converged Cloud Native
💧 Visual Data Preparation (VDP) is an open-source tool to seamlessly integrate Vision AI with the modern data stack
Website | Community | Blog Get Early Access Visual Data Preparation (VDP) is an open-source tool to streamline the end-to-end visual data processing p
Asteroids written in Golang using raylib using an ECS system.
Asteroids written in Golang using Raylib using an ECS system.
Thin clones of PostgreSQL to build powerful development, test, QA, staging environments
Database Lab Engine (DLE) ⚡ Blazing-fast cloning of PostgreSQL databases 🐘 Thin clones of PostgreSQL to build powerful development, test, QA, staging
Git-based DevOps PaaS: Project, Pipeline, Kubernetes, ServiceMesh, MutilCloud
gitctl 一体化 DevOps 平台 从代码到应用的一体化编排，应用全生命周期管理，多云托管。 gitctl 会有哪些功能？ git 代码托管 projec
Conduit - Data Integration for Production Data Stores
Conduit Data Integration for Production Data Stores. 💫 Overview Conduit is a da
Fast Entity Component System in Golang
ECS Fast Entity Component System in Golang This module is the ECS part of the game engine i'm writing in Go. Features: as fast as packages with automa
Ordered-concurrently a library for parallel processing with ordered output in Go
Ordered-concurrently a library for parallel processing with ordered output in Go. Process work concurrently / in parallel and returns output in a channel in the order of input. It is useful in concurrently / parallelly processing items in a queue, and get output in the order provided by the queue.
Parapipe - paralleling pipeline
Parapipe - paralleling pipeline The library provides a zero-dependency non-blocking buffered FIFO-pipeline for structuring the code and vertically sca
Simple 2D game to teach myself various things about game development and ECS, etc
2d-grass-game I really don't know what to name this game. Its a big grass field, and its in 2d so....2D Grass game This is a simple 2D game to teach m
Helper tool to create and assign fix versions in Jira
Jira Helper Helper tool to interact with Jira from CI/CD scripts. Its main purpose is to create and assign version based on GitHub releases to Jira ti
Aws-secretsmanager-caching-extension - Cache server for AWS Secrets Manager
AWS Lambda Extension / Sidecar Container Cache Server The cache server is writte
The Buildkite Agent is an open-source toolkit written in Golang for securely running build jobs on any device or network
Buildkite Agent Note: This is the development branch of the buildkite-agent, and may not contain files or code in the current stable release. The buil
Sentiment Analysis Pipeline + API written in Golang (currently processing Twitter tweets).
Go Sentiment Analysis Components Config: config module based in JSON (enter twitter credentials for use) Controllers: handle the API db call/logic for
Sentiment Analysis Pipeline + API written in Golang (currently processing Twitter tweets).
Go Sentiment Analysis Components Config: config module based in JSON (enter twitter credentials for use) Controllers: handle the API db call/logic for
Amazon ECS Container Agent: a component of Amazon Elastic Container Service
Amazon ECS Container Agent The Amazon ECS Container Agent is a component of Amazon Elastic Container Service (Amazon ECS) and is responsible for manag
Amazon Elastic Container Service Agent
Amazon ECS Container Agent The Amazon ECS Container Agent is a component of Amazon Elastic Container Service (Amazon ECS) and is responsible for manag
Cloud Native GoLang Microservices - gRPC, GraphQL
micro-starter-kit Microservices starter kit for Golang, aims to be developer friendly. Build Status Quality Overview What you get Monorepo - Sharing C
Package flow provides support for basic FBP / pipelines
Flow - FBP / pipelines / workers pool Package flow provides support for very basic FBP / pipelines. It helps to structure multistage processing as a s
🥝 Mini ECS CLI Command 🥝
miniecs 🥝 miniecs is a CLI tool for AWS ECS. 🥝 Requirement go 1.17.x or later �Installation go install github.com/jedipunkz/miniecs@latest Usage $ m
A sample for okteto pipelines with terraform
Okteto Pipeline with Terraform (PubSub) This sample covers a producer/consumer a
repo de teste para executar á pipeline do rancher
pipeline-example-go This is a sample golang project to demonstrate the integration with rancher pipeline. Building go build -o ./bin/hello-server Runn
Build the deployment system around GitHub in minutes.
Gitploy Gitploy helps your team build the deployment system around GitHub in minutes. Documentation | Community | Installation Guide What is Gitploy?
Demo app showing an end-to-end CI pipeline with Github Actions, goreleaser and ko
Motivation 💪 I created this repository for learning and education purposes to help everyone to level up their (open source) projects with good docume
Wrapper for ecspresso that creates task definitions at run time.
demitas Wrapper for ecspresso that creates task definitions at run time. Usage demitas - Wrapper for ecspresso that creates task definitions at run ti
Api service to serve messaging feature
Messaging Service Api service to serve messaging feature. This service running in Here Feature User can send message to another user Users can list al
mongodb helper functions, document and pipeline builder
MongoUtils Mongodb helper functions, document and pipeline builder. Helpers ParseObjectID Parse object id from string. ParseObjectID(id string) *primi
Go spider: A crawler of vertical communities achieved by GOLANG
go_spider A crawler of vertical communities achieved by GOLANG. Latest stable Release: Version 1.2 (Sep 23, 2014). QQ群号：337344607 Features Concurrent
Just a playground with some interesting concepts like pipelines aka middleware, handleFuncs, request validations etc. Check it out.
Pipeline a.k.a middleware in Go Just a playground with some interesting concepts like pipelines aka middleware, handleFuncs, request validations etc.
Simple command line tool helper to integrate with hashicorp vault & github api
Overview CI/CD Toolkit is small command line tool helper to integrate with vault secret kv management & github api We can use simple command to genera
Godex is a Godot Engine ECS library.
Godex Godex is a Godot Engine ecs library. Disclaimer: this module is still in development, open an issues to report any problem or a new discussion i
Simple HTTP server written in golang
Simple HTTP server written in golang Simple webserver in golang, to demonstrate basic functionalities like e.g. sending back some request header info,
ECS task event/log tracer CLI
tracer tracer is a tracing tool for Amazon ECS tasks. tracer shows events and logs of the tasks order by timestamp. example Run a task successfully an
CI/CD Learning
cicd-learning CI/CD Learning /gowebapp Building Here we will cover building the application and docker image Go To build the web app, just run, from t
This POC is built with the goal to collect events/logs from the host systems such as Kubernetes, Docker, VMs, etc. A buffering layer is added to buffer events from the collector
What is does This POC is build with the goal to collect events/logs from the host systems such as Kubernetes, docker, VMs etc. A buffering layer is ad
A simple Go app and GitHub workflow that shows how to use GitHub Actions to test, build and deploy a Go app to Docker Hub
go-pipeline-demo A repository containing a simple Go app and GitHub workflow that shows how to use GitHub Actions to test, build and deploy a Go app t
🤖 DroneCI plugin to skip pipelines based on files changes
DroneCI Skip Pipeline 🤖 DroneCI plugin to skip pipelines based on files changes Motivations This DroneCI plugin enables you skip (or short-circuit) a
This is a cloud-native application that focuses on the DevOps area.
KubeSphere DevOps integrates popular CI/CD tools, provides CI/CD Pipelines based on Jenkins, offers automation toolkits including Binary-to-Image (B2I
A CLI tool to manage and streamline AWS ECS deployments
Outback CLI 🦘 About The Project Outback is CLI tool written in Go to help streamline the process of deploying containerized applications to AWS Elast
Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines.
Dataflow Summary Dataflow is a Kubernetes-native platform for executing large parallel data-processing pipelines. Each pipeline is specified as a Kube
Secret management toolchain
Harp TL;DR. Why harp? Use cases How does it work? Like a Data pipeline but for secret Immutable transformation What can I do? FAQ License Homebrew ins
A sample golang project to demonstrate the integration with rancher pipeline
pipeline-example-go This is a sample golang project to demonstrate the integration with rancher pipeline. Building go build -o ./bin/hello-server Runn
tfa is a 2fa cli tool that aims to help you to generate 2fa code on CI/CD pipelines.
tfa tfa is 2fa cli tool that aim to help you to generate 2fa code on CI/CD pipelines. You can provide secret with stdin or flag. Install brew install
Simple example using Git actions + Argo CD + K8S + Docker and GO lang
CICD-simple_example Simple example using Git actions + Argo CD + K8S + Docker and GO lang Intro Pre reqs Have an ArgoCD account and Installed. Docker
Build a retractable ECS load balance network through aliyun openapi.
ECSEquilizer 通过阿里云OpenAPI建立一个可伸缩的负载均衡网络调度器。 简介 为确保代理集群网络和计算能力可以通过ECS云服务动态伸缩，所以制定实现以下策略。 节点分为static和dynamic两种，static节点是通过配置文件(config.yaml)实现预设的，固定不变。 d
Zeus - A Devops Automation Tool
With this tool we are trying generalize and minimize devops reperating task while trying to encourage shared responsibility model acorss devloper teams.
go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.
go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.
depstat is a dependency analyzer for Go modules enabled projects.
depstat is a dependency analyzer for Go modules enabled projects. It runs as part of the Kubernetes CI pipeline to help evaluate dependency updates to Kubernetes.
A simple CLI tool to use the _simulate API of elasticsearch to quickly test pipelines
elasticsearch-pipeline-tester A simple CLI tool to use the _simulate API of elasticsearch to quickly test pipelines usage: pipelinetester [flags] p
go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.
English | 简体中文 go-stash go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, proces
Library to watch and follow kubernetes resources in CI/CD deploy pipelines
kubedog Kubedog is a library to watch and follow Kubernetes resources in CI/CD deploy pipelines. This library is used in the werf CI/CD tool to track
Code for the Go pipeline blog post
Concurrent and Parallel Pipelines in Go This repository contains the code that goes along with a blog post about concurrent and parallel pipelines in
Entitas-Go is a fast Entity Component System Framework (ECS) Go 1.17 port of Entitas v1.13.0 for C# and Unity.
Entitas-Go Entitas-GO is a fast Entity Component System Framework (ECS) Go 1.17 port of Entitas v1.13.0 for C# and Unity. Code Generator Install the l
原生mongodb查询表单式转golang bson
Pipeline to BSON A simple CLI app to convert MongoDB pipeline command in JSON format to Golang BSON structs. How it works? simply by running the app:
churro is a cloud-native Extract-Transform-Load (ETL) application designed to build, scale, and manage data pipeline applications.
Churro - ETL for Kubernetes churro is a cloud-native Extract-Transform-Load (ETL) application designed to build, scale, and manage data pipeline appli
Prometheus exporter for Amazon Elastic Container Service (ECS)
ecs_exporter 🚧 🚧 🚧 This repo is still work in progress and is subject to change. This repo contains a Prometheus exporter for Amazon Elastic Contai
Modern UI for Ansible
Releases Docker Hub Install Instructions Troubleshooting Contribution Guide Roadmap UI Walkthrough (external blog) Release Signing All releases after
Machine is a library for creating data workflows.
Machine is a library for creating data workflows. These workflows can be either very concise or quite complex, even allowing for cycles for flows that need retry or self healing mechanisms.
This repository contains Prowjob configurations for Amazon EKS Anywhere.
Amazon EKS Anywhere Prow Jobs This repository contains Prowjob configuration for the Amazon EKS Anywhere project, which includes the eks-anywhere and
Pack a Go workflow/function as a Unix-style pipeline command
tpack Pack a Go workflow/function as a Unix-style pipeline command. Wiki In Unix-like computer operating systems, a pipeline is a mechanism for inter-
Devtron is an open source software delivery workflow for kubernetes written in go.
Devtron is an open source software delivery workflow for kubernetes written in go.
A tool to automate some of my tasks in ECS/ECR.
severinoctl A tool to automate some tasks in ECS/ECR. Work in progress... Prerequisites awscli working aws credentials environment AWS_REGION exported
Ento is an Entity Component System written in Go.
Ento is an Entity Component System written in Go.
Baker is a high performance, composable and extendable data-processing pipeline for the big data era
Baker is a high performance, composable and extendable data-processing pipeline for the big data era. It shines at converting, processing, extracting or storing records (structured data), applying whatever transformation between input and output through easy-to-write filters.
Semantic version generator using git commit keywords and overrides
Semantic version generator Project created overnight, to prove that management of semantic versioning is NOT painful and do not require arguments and
A go library for easy configure and run command chains. Such like pipelining in unix shells.
go-command-chain A go library for easy configure and run command chains. Such like pipelining in unix shells. Example cat log_file.txt | grep error |
Kubedock is a minimal implementation of the docker api that will orchestrate containers on a Kubernetes cluster, rather than running containers locally.
Kubedock Kubedock is an minimal implementation of the docker api that will orchestrate containers on a kubernetes cluster, rather than running contain
Zadig is a cloud native, distributed, developer-oriented continuous delivery product.
Zadig Developer-oriented Continuous Delivery Product English | 简体中文 Table of Contents Zadig Table of Contents What is Zadig Quick start How to use?
Zadig is a cloud native, distributed, developer-oriented continuous delivery product.
Zadig Developer-oriented Continuous Delivery Product English | 简体中文 Table of Contents Zadig Table of Contents What is Zadig Quick start How to use? Ho
A library to help you create pipelines in Golang
pipeline Pipeline is a go library that helps you build pipelines without worrying about channel management and concurrency. It contains common fan-in
httpx is a fast and multi-purpose HTTP toolkit allows to run multiple probers using retryablehttp library, it is designed to maintain the result reliability with increased threads.
Features • Installation • Usage • Running httpx • Notes • Join Discord httpx is a fast and multi-purpose HTTP toolkit allow to run multiple probers us
Arkanoid game in Go using Ebiten game engine with ECS.
Arkanoid-go Arkanoid game in Go using Ebiten game engine with ECS. You must have Git LFS installed when cloning the repository to download assets. See
ecsk is a CLI tool to interactively use frequently used functions of docker command in Amazon ECS. (docker run, exec, cp, logs, stop)
English / 日本語 ecsk ECS + Task = ecsk 😆 ecsk is a CLI tool to interactively use frequently used functions of docker command in Amazon ECS. (docker run
Robust, flexible and resource-efficient pipelines using Go and the commandline
Robust, flexible and resource-efficient pipelines using Go and the commandline Project links: Documentation & Main Website | Issue Tracker | Chat Why
Inspr is an application mesh for simple, fast and secure development of distributed applications.
Inspr is an engine for running distributed applications, using multiple communication patterns such as pub sub and more, focused on type consistency a
Provides an interactive prompt to connect to ECS Containers using the ECS ExecuteCommand API.
ecsgo Heavily inspired by incredibly useful gossm, this tool makes use of the new ECS ExecuteCommand API to connect to running ECS tasks. It provides
Powerful workflow engine and end-to-end pipeline solutions implemented with native Kubernetes resources. https://cyclone.dev
Cyclone Cyclone is a powerful workflow engine and end-to-end pipeline solution implemented with native Kubernetes resources, with no extra dependencie
A distributed, fault-tolerant pipeline for observability data
Table of Contents What Is Veneur? Use Case See Also Status Features Vendor And Backend Agnostic Modern Metrics Format (Or Others!) Global Aggregation
VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.
NOTICE: This project have moved to fuse-query VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse. Features High Perform
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
go_spider A crawler of vertical communities achieved by GOLANG. Latest stable Release: Version 1.2 (Sep 23, 2014). QQ群号：337344607 Features Concurrent
A lightweight stream processing library for Go
go-streams A lightweight stream processing library for Go. go-streams provides a simple and concise DSL to build data pipelines. Wiki In computing, a
A rapid http(s) benchmark tool written in Go
gonetx/httpit httpit is a rapid http(s) benchmark tool which on top of fasthttp. Also thanks to cobra and bubbletea. Installation Get binaries from re
Vilicus is an open source tool that orchestrates security scans of container images(docker/oci) and centralizes all results into a database for further analysis and metrics.
Vilicus Table of Contents Overview How does it work? Architecture Development Run deployment manually Usage Example of analysis Overview Vilicus is an
Easily run your Compose application to the cloud with compose-cli
This CLI tool makes it easy to run Docker containers and Docker Compose applications in the cloud using either Amazon Elastic Container Service (ECS) or Microsoft Azure Container Instances (ACI) using the Docker commands you already know.
Run the same Docker images in AWS Lambda and AWS ECS
serverlessish tl;dr Run the exact same image for websites in Lambda as you do in ECS, Kubernetes, etc. Just add this to your Dockerfile, listen on por
Browse your AWS ECS Clusters in the Terminal
Browse your AWS ECS Clusters in the Terminal. The ecsview application is a terminal-based UI for browsing Amazon Elastic Container Service (ECS) clust
Package strit introduces a new type of string iterator, along with a number of iterator constructors, wrappers and combinators.
strit Package strit (STRing ITerator) assists in development of string processing pipelines by providing a simple iteration model that allows for easy
csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
csvplus Package csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream processing operations, indices and joins. The
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
go_spider A crawler of vertical communities achieved by GOLANG. Latest stable Release: Version 1.2 (Sep 23, 2014). QQ群号：337344607 Features Concurrent
go.pipeline is a utility library that imitates unix pipeline. It simplifies chaining unix commands (and other stuff) in Go.
go.pipeline go.pipeline is a utility library that imitates unix pipeline. It simplifies chaining unix commands (and other stuff) in Go. Installation g
Build powerful pipelines in any programming language.
Gaia is an open source automation platform which makes it easy and fun to build powerful pipelines in any programming language. Based on HashiCorp's g
An n:m message multiplexer written in Go
What is Gollum? Gollum is an n:m multiplexer that gathers messages from different sources and broadcasts them to a set of destinations. Gollum origina
An n:m message multiplexer written in Go
What is Gollum? Gollum is an n:m multiplexer that gathers messages from different sources and broadcasts them to a set of destinations. Gollum origina
A library for performing data pipeline / ETL tasks in Go.
Ratchet A library for performing data pipeline / ETL tasks in Go. The Go programming language's simplicity, execution speed, and concurrency support m
Pipelines using goroutines
pipeline This package provides a simplistic implementation of Go pipelines as outlined in Go Concurrency Patterns: Pipelines and cancellation. Docs Go