Esdump is a migration CLI written in Go for migrating index mapping and data from one elasticsearch to another.

esdump

GoDoc Go codecov Go Report Card Release License: MIT


asciicast

Introduction

esdump is a migration CLI written in Go for migrating index mapping and data from one elasticsearch to another.

Compatibility

Elasticsearch version Esdump version Remarks
7.x 2.x Coming soon.
6.x 1.x Actively maintained.
5.x 1.x Actively maintained.

Install

  • If go version < 1.17,
go get -v github.com/wubin1989/[email protected]
  • If go version >= 1.17,
go install -v github.com/wubin1989/[email protected]

Usage

➜  ~ esdump -h
migrate index from one elasticsearch to another

Usage:
  esdump [flags]

Flags:
  -d, --date string       date field of docs
      --desc              ascending or descending order by the date type field specified by date flag
  -e, --end string        end date, use time.Local as time zone, you may need to set TZ environment variable ahead
      --excludes string   excludes fields, multiple fields are separated by comma
  -h, --help              help for esdump
      --includes string   includes fields, multiple fields are separated by comma
  -i, --input string      source elasticsearch connection url
  -l, --limit int         limit for one scroll, it takes effect on the dumping speed (default 1000)
  -o, --output string     target elasticsearch connection url
  -s, --start string      start date, use time.Local as time zone, you may need to set TZ environment variable ahead
      --step duration     step duration (default 24h0m0s)
  -t, --type string       migration type, such as "mapping", "data", empty means both
  -v, --version           version for esdump
  -z, --zone string       time zone of the date type field specified by date flag (default "UTC")

Example

export TZ=Asia/Shanghai && esdump --input=http://localhost:9200/test --output=http://localhost:9200/test_dump --date=pubAt --start=2019-01-01 --zone=UTC --step=72h --excludes=html

License

MIT

Owner
Will Wu
A full-stack developer focusing on big data platform and mobile app. Main stack includes nodejs, java, golang, flutter.
Will Wu
Similar Resources

Yaf - Yet another system fetch that is minimal and customizable

Yaf - Yet another system fetch that is minimal and customizable

Yaf - Yet Another Fetch [Support] [Installation] [Usage] Brief Yet Another Fetch

Oct 11, 2022

Another Go shellcode loader designed to work with Cobalt Strike raw binary payload.

Another Go shellcode loader designed to work with Cobalt Strike raw binary payload.

Bankai Another Go shellcode loader designed to work with Cobalt Strike raw binary payload. I created this project to mainly educate myself learning Go

Dec 29, 2022

😎 Yet Another yes clone but in Golang

Yeah Output a string repeatedly until killed. Yet Another yes clone but in Golang. Usage Just like yes: yeah This will print "y" until the process is

Apr 7, 2022

A command line tool to prompt for a value to be included in another command line.

readval is a command line tool which is designed for one specific purposeβ€”to prompt for a value to be included in another command line. readval prints

Dec 22, 2021

Yay - Yet another stack-oriented toy language that transpiles to Go code. Heavily inspired by Tsoding's Porth YouTube series

yay Yet another stack-oriented toy language that transpiles to Go code. Heavily

Feb 12, 2022

It is an easy and fast tool to install your packages with just one command.

Trouxa It is an easy and fast tool to install your packages with just one command. What means "Trouxa"? In portuguese, Trouxa means something like a "

Sep 29, 2022

Libraries and CLIs for my personal all-in-one productivity system including components like bookmarks, notes, todos, projects, etc.

bntp.go Libraries and CLIs for my personal all-in-one productivity system including components like bookmarks, notes, todos, projects, etc. Neovim int

Sep 13, 2022

Go-file-downloader-ftctl - A file downloader cli built using golang. Makes use of cobra for building the cli and go concurrent feature to download files.

ftctl This is a file downloader cli written in Golang which uses the concurrent feature of go to download files. The cli is built using cobra. How to

Jan 2, 2022
Go cmd util that prints cmd-line args with their index

echoidx This is an exercise of the book The Go Programming Language, by Alan A.

Dec 18, 2021
The blackbean is a command tool for elasticsearch operations by using cobra.
The blackbean is a command tool for elasticsearch operations by using cobra.

The blackbean is a command tool for elasticsearch operations by using cobra. Besides, blackbean is the name of my lovely French bulldog.

Mar 3, 2022
This package can parse date match expression, which used by ElasticSearch

datemath-parser this package is pure go package, this package can parse date match expression, which used by ElasticSearch. Date Math Definition you c

Jan 8, 2022
Another CLI framework for Go. It works on my machine.
Another CLI framework for Go. It works on my machine.

Command line interface framework Go framework for rapid command line application development

Dec 30, 2022
CLI filters the contents of the csv file according to the filters from the another file.

filtercsv CLI filters the contents of the csv file according to the filters from the another file. Made to process big files by a lots of filters. By

Dec 2, 2021
✨ Create a new production-ready project with backend, frontend and deploy automation by running one CLI command!
✨ Create a new production-ready project with backend, frontend and deploy automation by running one CLI command!

✨ Create a new production-ready project with backend, frontend and deploy automation by running one CLI command!

Dec 31, 2022
Yet another Yogurt - An AUR Helper written in Go
Yet another Yogurt - An AUR Helper written in Go

Yay Yet Another Yogurt - An AUR Helper Written in Go Help translate yay: Transifex Features Advanced dependency solving PKGBUILD downloading from ABS

Jan 3, 2023
Yet another emojify command written in Go 🍜
Yet another emojify command written in Go 🍜

go-emojify Yet another emojify command written in Go ?? Installation $ go get github.com/yusukebe/go-emojify/cmd/go-emojify Usage $ go-emojify "I lov

Nov 7, 2021
Go-api-cli - Small CLI to fetch data from an API sync and async

Async API Cli CLI to fetch data on "todos" from a given API in a number of ways.

Jan 13, 2022
Portal is a quick and easy command-line file transfer utility from any computer to another πŸ–₯️ 🌌 πŸ’»
Portal is a quick and easy command-line file transfer utility from any computer to another πŸ–₯️ 🌌 πŸ’»

Portal is a quick and easy command-line file transfer utility from any computer to another ??️ ?? ??

Dec 27, 2022