HTTP API Gateway

您好，对这个项目不是很了解，可能在配置上有点问题，不知道是怎么回事，麻烦帮忙指点下，多谢。 我的环境下： ## gateway的log如下： 2016/06/30 19:57:18 log.go:31: [INFO] set log level to 2016/06/30 19:57:18 gateway.go:68: [INFO] conf:<&{Addr::80 MgrAddr::8081 EtcdAddr:http://127.0.0.1:2379 EtcdPrefix:/gateway LogLevel:info EnableRuntimeVal:false EnableCookieVal:false EnableHeadVal:false ReqHeadStaticMapping:map[] RspHeadStaticMapping:map[]}> 2016/06/30 19:57:18 ruletable.go:467: [INFO] RouteTable start watch. 2016/06/30 19:57:18 etcd.go:379: [INFO] Etcd watch at: 2016/06/30 19:57:18 ruletable.go:564: [WARN] Load clusters fail. [error]: 100: Key not found (/gateway) [5] 2016/06/30 19:57:18 ruletable.go:579: [WARN] Load servers from etcd fail. [error]: 100: Key not found (/gateway) [5] 2016/06/30 19:57:18 ruletable.go:610: [WARN] Load binds from etcd fail. [error]: 100: Key not found (/gateway) [5] 2016/06/30 19:57:18 ruletable.go:625: [WARN] Load aggregations from etcd fail. [error]: 100: Key not found (/gateway) [5] 2016/06/30 19:57:18 ruletable.go:595: [WARN] Load routings from etcd fail. [error]: 100: Key not found (/gateway) [5] 2016/06/30 19:57:18 manager.go:72: [INFO] Mgr listen at :8081.

## admin的log如下： start at 192.168.2.56:9090 time=2016-06-30T20:04:01-07:00, remote_ip=192.168.2.71, method=GET, uri=/, status=404, took=958.284µs, sent=9 bytes time=2016-06-30T20:04:11-07:00, remote_ip=192.168.2.71, method=GET, uri=/gateway, status=404, took=2.547534ms, sent=9 bytes

不知道为什么admin访问的时候老是404“Not Found”。使用的用户名和密码都是：admin

用docker-compose方式启动了所有组件, 已经用了一段时间了, 一直可以打开ui. 不知为何突然再也打不开了, 访问http://x.x.x.x:9093/ui/index.html一直报错: {"message":"Not Found"} . 这里的IP不是127.0.0.1. 请问如何解决? 各种办法都试过了, 系统都用了新的.

尝试在后台添加JavaScript类型的plugin，内容如下：

function NewPlugin(cfg) {
  // import builtin modules
  var JSON = require("json")
  var HTTP = require("http")
  var REDIS = require("redis")
  var LOG = require("log")
  // init plugin
  return {
    // filter pre method
    "pre": function(ctx) {
  return {"code": 403, "error": "not login"}
    }
  }
}

但是没有效果，请求还是被正常转发 能否提供一个plugin_js的示例，谢谢！

I tried with 'git clone' , 'go get', 'download zip', but none worked

env: golang 1.9 macOS 10.13.2

error with 'git clone' and same as 'go get': git clone https://github.com/fagongzi/gateway.git Cloning into 'gateway'... remote: Counting objects: 13134, done. remote: Compressing objects: 100% (6/6), done. remote: Total 13134 (delta 0), reused 1 (delta 0), pack-reused 13128 Receiving objects: 100% (13134/13134), 32.29 MiB | 79.00 KiB/s, done. Resolving deltas: 100% (4722/4722), done. error: unable to create symlink vendor/github.com/coreos/etcd/Documentation/README.md: File name too long error: unable to create symlink vendor/github.com/coreos/etcd/cmd/etcd: File name too long error: unable to create symlink vendor/github.com/coreos/etcd/cmd/etcdctl: File name too long error: unable to create symlink vendor/github.com/coreos/etcd/cmd/tools: File name too long fatal: unable to checkout working tree warning: Clone succeeded, but checkout failed. You can inspect what was checked out with 'git status' and retry the checkout with 'git checkout -f HEAD'

error with 'unzip'

how can i solved this? (CSDN博客上说zip解压失败可能是子文件夹的问题，是不是vendor文件夹依赖呆导致的？感谢你的开源与帮助)

在mac下按照文档clone下来代码后，进入项目根目录下，运行go build cmd/proxy/proxy.go 报如下错误： go install command-line-arguments: build output "proxy" already exists and is a directory

请问下这个问题怎么解决呢？

我的go sdk环境配置如下： GOARCH="amd64" GOBIN="" GOEXE="" GOHOSTARCH="amd64" GOHOSTOS="darwin" GOOS="darwin" GOPATH="~/go" GORACE="" GOROOT="/usr/local/Cellar/go/1.8.1/libexec" GOTOOLDIR="/usr/local/Cellar/go/1.8.1/libexec/pkg/tool/darwin_amd64" GCCGO="gccgo" CC="clang" GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/jz/yzzkw_gs5z701z5_x47403gw0000gn/T/go-build946663768=/tmp/go-build -gno-record-gcc-switches -fno-common" CXX="clang++" CGO_ENABLED="1" PKG_CONFIG="pkg-config" CGO_CFLAGS="-g -O2" CGO_CPPFLAGS="" CGO_CXXFLAGS="-g -O2" CGO_FFLAGS="-g -O2" CGO_LDFLAGS="-g -O2"

gateway存放目录： ~/go/src/github.com/fagongzi/gateway

为API规则配置了"https支持", 添加了证书, 但是不生效. 看proxy日志, 证书配置已经加载上了. 添加参数-addr-https=192.168.66.211:443, 重启proxy443仍然无法打开. 日志中也没体现. 我的proxy, apiserver都是master分支的. 但是尝试过编译v3.0.0分支, 包编译无法通过, 多个包拉不到或版本不对. 于是从fagongzi/manba-proxy:latest里把二进制文件manba-proxy拷了出来启动, 问题依旧. 请问如何解决?

现象：从日志看，健康检查运行正常，对于一个不可用服务会打出server <%d, %s, %d> check failed, errors 这句log。但是从未出现server <%d> DOWN 这句log，request也仍然会dispatch到不正常的服务去。可能是判断prev != svr.status的时候出问题。

配置：limit-heathcheck = 5, server的check interval为10秒，超时为10秒

check方法中持有写锁的时间包含了调用back-end服务的健康检查接口的时间。 当back-end down的时候，如果超时设置得比较长，那么持有写锁的时间也就较长。而转发的时候也会申请同一个锁的读锁，会被block住较长的时间。

偶然也会有死锁，应该和heathCheckTimeout方法中也申请了锁有关。Schedule方法在偶然的情况下会直接执行heathCheckTimeout，而不是由另一个goroutine执行，导致没有释放锁就先申请锁了。

func (r *dispatcher) heathCheckTimeout(arg interface{}) { id := arg.(uint64) r.RLock() _, ok := r.servers[id] r.RUnlock() if ok { r.checkerC <- id } }

func (r *dispatcher) check(id uint64) { r.RLock() defer r.RUnlock() svr, ok := r.servers[id] if !ok { return }

defer func() {
	if svr.meta.HeathCheck != nil {
		if svr.useCheckDuration > r.cnf.Option.LimitIntervalHeathCheck {
			svr.useCheckDuration = r.cnf.Option.LimitIntervalHeathCheck
		}
		svr.heathTimeout, _ = r.tw.Schedule(svr.useCheckDuration, r.heathCheckTimeout, id)
	}
}()

修复当tuntime.go的selectServer抛出异常时，读写锁r未释放，导致后续请求加锁hang住的问题 异常栈： 2018/01/29 13:25:32 panic: runtime error: invalid memory address or nil pointer dereference Stack trace: goroutine 12080 [running]: runtime/debug.Stack(0xc0420358a8, 0x9d4760, 0xe21080) D:/Go/src/runtime/debug/stack.go:24 +0xae github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*workerPool).wor kerFunc.func1(0xc0422d0200, 0xc042035f68) D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/workerpool.go:207 +0x95 panic(0x9d4760, 0xe21080) D:/Go/src/runtime/panic.go:491 +0x291 github.com/fagongzi/gateway/pkg/proxy.(*clusterRuntime).selectServer(0x0, 0xc042 52c000, 0x0) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/runtime.go:66 +0 x2d github.com/fagongzi/gateway/pkg/proxy.(*dispatcher).selectServer(0xc042044d20, 0 xc04252c000, 0x0, 0xe53dc0) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/dispatcher.go:15 1 +0x3c github.com/fagongzi/gateway/pkg/proxy.(*dispatcher).routingOpt(0xc042044d20, 0xc 04252c000, 0xc0422d4000) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/dispatcher.go:14 1 +0x143 github.com/fagongzi/gateway/pkg/proxy.(*dispatcher).dispatch(0xc042044d20, 0xc04 252c000, 0x0, 0x0, 0x0) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/dispatcher.go:12 5 +0x2af github.com/fagongzi/gateway/pkg/proxy.(*Proxy).ReverseProxyHandler(0xc0421300c0, 0xc04252c000) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/proxy.go:250 +0x 69 github.com/fagongzi/gateway/pkg/proxy.(*Proxy).ReverseProxyHandler-fm(0xc04252c0 00) D:/goprojects/src/github.com/fagongzi/gateway/pkg/proxy/proxy.go:100 +0x 3b github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*Server).serveCo nn(0xc04235f2c0, 0xdebe40, 0xc0422f8018, 0xc042035e01, 0x101) D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/server.go:1494 +0x618 github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*Server).(github .com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.serveConn)-fm(0xdebe40, 0xc0422f8018, 0xc0422d0201, 0xc042035f68) D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/server.go:1223 +0x45 github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*workerPool).wor kerFunc(0xc0422d0200, 0xc04211cde0) D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/workerpool.go:224 +0x14b github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*workerPool).get Ch.func1(0xc0422d0200, 0xc04211cde0, 0x97e3a0, 0xc04211cde0) D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/workerpool.go:183 +0x3c created by github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp.(*work erPool).getCh D:/goprojects/src/github.com/fagongzi/gateway/vendor/github.com/valyala/ fasthttp/workerpool.go:182 +0x143

不适用manba，直接压测gin的http接口 压测一个ping接口（可以理解为hello world） 2000次 失败数为0.

使用manba网关后 会出现113个 500的返回。 proxy是直接拉取的master编译的。 压测工具是github中开源的go-stress-testing 。

请问可能是哪里出了问题？

2019/09/22 22:53:10.017435 [info] [GET]/department/49: match api department, has 1 dispatches 2019/09/22 22:53:10.017457 [info] [GET]/department/49: dipatch node 0 force using default panic: runtime error: invalid memory address or nil pointer dereference [signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x181c65d]

goroutine 137 [running]: github.com/fagongzi/gateway/pkg/proxy.(*dispatchNode).getResponseBody(0xc000498160, 0x0, 0x0, 0x100000000000008) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/pkg/proxy/dispatcher.go:159 +0x4d github.com/fagongzi/gateway/pkg/proxy.(*render).renderRaw(0xc000330540, 0xc00040c480, 0xc000498160) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/pkg/proxy/render.go:135 +0xcf github.com/fagongzi/gateway/pkg/proxy.(*render).renderSingle(0xc000330540, 0xc00040c480) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/pkg/proxy/render.go:74 +0x1a0 github.com/fagongzi/gateway/pkg/proxy.(*render).render(0xc000330540, 0xc00040c480, 0x0) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/pkg/proxy/render.go:51 +0xee github.com/fagongzi/gateway/pkg/proxy.(*Proxy).ServeFastHTTP(0xc00027c000, 0xc00040c480) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/pkg/proxy/proxy.go:318 +0xb96 github.com/valyala/fasthttp.(*Server).serveConn(0xc000486000, 0x1bcc420, 0xc000376030, 0x0, 0x0) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp/server.go:1932 +0x824 github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc00037a2d0, 0xc000326d40) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp/workerpool.go:212 +0xc0 github.com/valyala/fasthttp.(*workerPool).getCh.func1(0xc00037a2d0, 0xc000326d40, 0x18bf020, 0xc000326d40) /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp/workerpool.go:184 +0x35 created by github.com/valyala/fasthttp.(*workerPool).getCh /Users/xiangzhi/Work/Go/src/github.com/fagongzi/gateway/vendor/github.com/valyala/fasthttp/workerpool.go:183 +0x119

func TestFindMatchAmbiguity(t *testing.T) {
	r := NewRoute()
	r.Add(&metapb.API{
		ID:         1,
		URLPattern: "/a/b/c",
		Method:     "*",
	})
	r.Add(&metapb.API{
		ID:         2,
		URLPattern: "/(string):x/b/e",
		Method:     "*",
	})

	params := make(map[string]string, 0)
	paramsFunc := func(name, value []byte) {
		params[string(name)] = string(value)
	}

	id, _ := r.Find([]byte("/a/b/e"), "GET", paramsFunc)
	fmt.Println(id, params)
}

输出： 0 map[]

预期是要匹配到api_id =2, 实际上匹配不了

当server端支持keep-alive时，连续向proxy发送大量请求，proxy会报错dispatch node 0 failed with error EOF。启动参数调整--limit-conn-keepalive=30，问题出现概率会降低。当彻底关闭server的keep-alive问题可以解决，但是这会带来严重性能损耗。

请问这是bug还是有什么参数？

Bumps github.com/valyala/fasthttp from 1.2.0 to 1.34.0.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.