Jocko
Distributed commit log service in Go that is wire compatible with Kafka.
Created by @travisjeffery, continued by nash.
Goals:
- Protocol compatible with Kafka so Kafka clients and services work with Jocko
- Distribute a single binary
- Use Serf for discovery, Raft for consensus (and remove the need to run ZooKeeper)
- Simpler configuration settings
TODO
- Map features missing
- Extensive protocol compliance test suit
- Update all dependencies and code to up-to-date Go (as of MAR2020)
Reading
- How Jocko's built-in service discovery and consensus works
- How Jocko's (and Kafka's) storage internals work
Project Layout
├── broker broker subsystem
├── cmd commands
│ └── jocko command to run a Jocko broker and manage topics
├── commitlog low-level commit log implementation
├── examples examples running/using Jocko
│ ├── cluster example booting up a 3-broker Jocko cluster
│ └── sarama example producing/consuming with Sarama
├── protocol golang implementation of Kafka's protocol
├── prometheus wrapper around Prometheus' client lib to handle metrics
├── server API subsystem
└── testutil test utils
└── mock mocks of the various subsystems
Building
Local
-
Clone Jocko
$ go get github.com/nash-io/jocko -
Build Jocko
$ cd $GOPATH/src/github.com/nash-io/jocko $ make build(If you see an error about
depnot being found, ensure that$GOPATH/binis in yourPATH)
Docker
docker build -t nash-io/jocko:latest .
Contributing
See CONTRIBUTING for details on submitting patches and the contribution workflow.
License
Jocko is under the MIT license, see the LICENSE file for details.
