The output produced by bombardier cannot be consumed by Prometheus.

It would be nice to have metrics like this:

Prometheus' node_exporter has textfile collector. The collector scans directory for .prom files and adds the metrics found in the file to its own metrics set.

This way, I can run bombardier every minute, output results to bombardier.prom file and the metrics will be picked up by Prometheus server.

I would like to come up with a number of metrics and have an option to output results as a Prometheus metric.

For example, the following output:

Statistics        Avg      Stdev        Max
  Reqs/sec      6607.00     524.56       7109
  Latency       29.86ms     5.36ms   305.02ms

would result in the following metrics:

• bombardier_http_request_rate_avg
• bombardier_http_request_rate_max
• bombardier_http_request_rate_stdev
• bombardier_http_latency_avg
• bombardier_http_latency_stdev
• bombardier_http_latency_max

Each metric could have one or more labels associated with it.

For example, the following command:

bombardier -c 200 -d 10s -l http://ya.ru

would result in the following metrics:

conn: 200
duration: 10
url: http://ya.ru

Further, it would be helpful to output UUID associated with each test.

There are problems connecting with envoy proxy

What version of bombardier are you using?

bombardier version v1.2

What operating system and processor architecture are you using (if relevant)?

linux/amd64

What did you do?

docker run --rm -d -p 10000:10000 envoyproxy/envoy:latest

$ curl -I http://localhost:10000
HTTP/1.1 200 OK
...

$ bombardier http://localhost:10000
Statistics        Avg      Stdev        Max
  Reqs/sec         9.45     210.84    4724.01
  Latency        10.01s     3.58ms     10.01s
  HTTP codes:
    1xx - 0, 2xx - 0, 3xx - 0, 4xx - 0, 5xx - 0
    others - 125
  Errors:
    read tcp [::1]:9050->[::1]:10000: i/o timeout - 1
    read tcp [::1]:9248->[::1]:10000: i/o timeout - 1
    read tcp [::1]:9258->[::1]:10000: i/o timeout - 1
    read tcp [::1]:9004->[::1]:10000: i/o timeout - 1
...

With net/http client all ok

$ bombardier --http1 http://localhost:10000
Statistics        Avg      Stdev        Max
  Reqs/sec       335.52     128.07     750.00
  Latency      365.64ms    86.23ms   565.60ms
  HTTP codes:
    1xx - 0, 2xx - 0, 3xx - 3479, 4xx - 0, 5xx - 0
    others - 0
  Throughput:   308.91KB/s

What you expected to happen?

A typical http connection

What actually happened?

read tcp [::1]:9004->[::1]:10000: i/o timeout - 1

Hi,

I'm trying to load a test a binary upload endpoint using multipart/form-data and was wondering if it's possible to make bombardier handle this type of request?

thanks!

When i run this command "go get -u -v github.com/codesenberg/bombardier" i get error

package github.com/codesenberg/bombardier/vendor/golang.org/x/net/http2:
vendor/golang.org/x/net/http2/pipe.go:1:1: expected 'package', found 'EOF'

Please give me a solution, thanks you so much| [From MacOS]

What version of bombardier are you using?

bombardier version v1.1.1 windows/386

What operating system and processor architecture are you using (if relevant)?

windows/386

What did you do?

bombardier -d 1m http://localhost:55555/test/00660066

What you expected to happen?

I expected it to run for 1 minute.

What actually happened?

Bombarding http://localhost:55555/test/00660066 for 1m0s using 125 connections
[============>------------------------------------------------------------] 50sp
anic: runtime error: index out of range

goroutine 167 [running]:
codesenberg/bombardier/vendor/github.com/codesenberg/concurrent/float64/histogra
m.(*Histogram).getShardFor(0x31372710, 0xe498c1cd, 0x4088ffa5, 0xfa894f1a)
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/vendor/github.com/codesenberg/concurrent/float64/histogram/histogram.go:53 +0x5
c
codesenberg/bombardier/vendor/github.com/codesenberg/concurrent/float64/histogra
m.(*Histogram).Add(0x31372710, 0xe498c1cd, 0x4088ffa5, 0x1, 0x0)
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/vendor/github.com/codesenberg/concurrent/float64/histogram/histogram.go:64 +0x3
1
codesenberg/bombardier/vendor/github.com/codesenberg/concurrent/float64/histogra
m.(*Histogram).Increment(0x31372710, 0xe498c1cd, 0x4088ffa5)
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/vendor/github.com/codesenberg/concurrent/float64/histogram/histogram.go:58 +0x3
d
main.(*bombardier).recordRps(0x31270fc0)
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/bombardier.go:259 +0x1b8
main.(*bombardier).rateMeter(0x31270fc0)
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/bombardier.go:239 +0xa5
created by main.(*bombardier).bombard
        C:/Users/frei/Documents/Go/Workspaces/Default/src/codesenberg/bombardier
/bombardier.go:273 +0xfc

This happens with no rhyme or reason I can detect. Sometimes it panics with -d 1s, sometimes it works for 10s with no issues.

Hi,

I want to do load test for a POST request that the Content-Type: application/x-www-form-urlencoded; charset=UTF-8.

and the form data is: action=get_data&number=1234

is it possible to do it with bombadier?

Thanks.

Could you include an example where you use http headers ?

Tried to set with the following

bombardier -c 2 -d 2s -H 'Content-Type: application/json' -data '{"key": "value"}' -m POST http://localhost:5001

but when I examined the target I'm getting the following content type value

application/x-www-form-urlencoded application/json application/json

How can you set multiple headers ?

Thanks Pat

What version of bombardier are you using?

in case you've built bombardier yourself or version obtained by

# bombardier --version
bombardier version v1.2 linux/amd64

in case you are using binaries.

What operating system and processor architecture are you using (if relevant)?

linux/amd64

What did you do?

# bombardier http://www-service/
host www-service: invalid host

Describe steps that can be used to reproduce the error.

What you expected to happen?

Bombardier would try to resolve www-service which is a valid DNS name in my setup.

What actually happened?

Bombardier quits with the message:

host www-service: invalid host

I couldn't find the error message in the source code, so I think it is some vendor bug trying to validate domains even though they shouldn't. www-service.default which is also a valid DNS name works fine.

Why the latency result of the bom is different with the python requests package?

bom average 1.58ms, requests 250ms

bom result:

Statistics        Avg      Stdev        Max
  Reqs/sec      6286.72     460.12    7012.96
  Latency        1.58ms   349.64us    26.34ms
  HTTP codes:
    1xx - 0, 2xx - 63013, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     2.13MB/s

python requests package:
>>> import requests
>>> url = "http://10.143.192.105:9362/hotrizon/GetScore?m2=000029da81eafcfcdbde82d6bd2d2&qid=29957933"
>>> import time
>>> def func():
...     t = time.time()
...     requests.get(url)
...     print time.time() -t 
... 
>>> func()
0.376302957535
>>> func()
0.293756961823
>>> func()
0.292520046234
>>> func()
0.291940927505
>>> func()
0.291563034058
>>> func()
0.292473077774

I get the following installing via the readme method

go get: installing executables with 'go get' in module mode is deprecated.
        Use 'go install pkg@version' instead.
        For more information, see https://golang.org/doc/go-get-install-deprecation
        or run 'go help get' or 'go help install'.

First of all, thank you very much @codesenberg for this an amazing and useful project!

What version of bombardier are you using?

bombardier --version
bombardier version v1.1.2 windows/386

What did you do?

bombardier --help

or

bombardier -c 1 -r 1 -d 1s -q -l http://ya.ru --help
unknown short flag '-q'

or

bombardier -c 1 -r 1 -d 1s --no-print -l http://ya.ru --help
unknown long flag '--no-print'

What you expected to happen?

As it is in the Docs.

usage: bombardier [<flags>] <url>

Fast cross-platform HTTP benchmarking tool

Flags:
      --help                  Show context-sensitive help (also try --help-long
                              and --help-man).
      --version               Show application version.
  -c, --connections=125       Maximum number of concurrent connections
  -t, --timeout=2s            Socket/request timeout
  -l, --latencies             Print latency statistics
  -m, --method=GET            Request method
  -b, --body=""               Request body
  -f, --body-file=""          File to use as request body
  -s, --stream                Specify whether to stream body using chunked
                              transfer encoding or to serve it from memory
      --cert=""               Path to the client's TLS Certificate
      --key=""                Path to the client's TLS Certificate Private Key
  -k, --insecure              Controls whether a client verifies the server's
                              certificate chain and host name
  -H, --header="K: V" ...     HTTP headers to use(can be repeated)
  -n, --requests=[pos. int.]  Number of requests
  -d, --duration=10s          Duration of test
  -r, --rate=[pos. int.]      Rate limit in requests per second
      --fasthttp              Use fasthttp client
      --http1                 Use net/http client with forced HTTP/1.x
      --http2                 Use net/http client with enabled HTTP/2.0
  -p, --print=<spec>          Specifies what to output. Comma-separated list of
                              values 'intro' (short: 'i'), 'progress' (short:
                              'p'), 'result' (short: 'r'). Examples:
  
                                * i,p,r (prints everything)
                                * intro,result (intro & result)
                                * r (result only)
                                * result (same as above)
  -q, --no-print              Don't output anything
  -o, --format=<spec>         Which format to use to output the result. <spec>
                              is either a name (or its shorthand) of some format
                              understood by bombardier or a path to the
                              user-defined template, which uses Go's
                              text/template syntax, prefixed with 'path:' string
                              (without single quotes), i.e.
                              "path:/some/path/to/your.template" or
                              "path:C:\some\path\to\your.template" in case of
                              Windows. Formats understood by bombardier are:
  
                                * plain-text (short: pt)
                                * json (short: j)

Args:
  <url>  Target's URL

What actually happened?

usage: bombardier [<flags>] <url>

Fast cross-platform HTTP benchmarking tool

Flags:
      --help                  Show context-sensitive help (also try --help-long
                              and --help-man).
      --version               Show application version.
  -c, --connections=125       Maximum number of concurrent connections
  -t, --timeout=2s            Socket/request timeout
  -l, --latencies             Print latency statistics
  -m, --method=GET            Request method
  -b, --body=""               Request body
  -f, --body-file=""          File to use as request body
  -s, --stream                Specify whether to stream body using chunked
                              transfer encoding or to serve it from memory
      --cert=""               Path to the client's TLS Certificate
      --key=""                Path to the client's TLS Certificate Private Key
  -k, --insecure              Controls whether a client verifies the server's
                              certificate chain and host name
  -H, --header="K: V" ...     HTTP headers to use(can be repeated)
  -n, --requests=[pos. int.]  Number of requests
  -d, --duration=10s          Duration of test
  -r, --rate=[pos. int.]      Rate limit in requests per second
      --fasthttp              Use fasthttp client
      --http1                 Use net/http client with forced HTTP/1.x
      --http2                 Use net/http client with enabled HTTP/2.0

Args:
  <url>  Target's URL

bombardier -c 1 -m POST -b "{\"refreshToken\": \"abc\"}" -H "Content-length: 23" -H "Content-Type : application/json; charset=utf-8" -H "X-JWT-Assertion : a very long JWT here" -n 1 http://myApi.com/MyOperation

executing this I get a 400...

if I copy/paste these values to postman, it works as expected...

Please provide an option to save response body

What version of bombardier are you using?

v1.2.5

What operating system and processor architecture are you using (if relevant)?

windows/amd64

What you expected to happen?

save response body of the request

What actually happened?

only gives http status code like 2xx, 4xx, etc.

Im installing bombardier in a Docker and bombardier --version outputs bombardier version unspecified linux/amd64

#### install go && bombardier
RUN wget https://go.dev/dl/go1.19.1.linux-amd64.tar.gz
RUN rm -rf /usr/local/go && tar -C /usr/local -xzf go1.19.1.linux-amd64.tar.gz
RUN echo 'export PATH=$PATH:/usr/local/go/bin:~/go/bin' >> ~/.bashrc
RUN source ~/.bashrc
RUN go install github.com/codesenberg/bombardier@latest
RUN bombardier --version

This is an example of what a bug report can look like. Please, feel free to also provide any other information relevant to the issue.

What version of bombardier are you using?

% bombardier --version
bombardier version unspecified linux/amd64

I just installed now via go get -u github.com/codesenberg/bombardier ..so i guess thats 9376ab4 then?

What operating system and processor architecture are you using (if relevant)?

% uname -a
Linux <snip> 5.13.19-2-MANJARO #1 SMP PREEMPT Sun Sep 19 21:31:53 UTC 2021 x86_64 GNU/Linux

What did you do?

I want to stress-test my elasticsearch server while running an index-update to see how many non-200 responses i get while closing/changing/opening-again the index. For that i want bombardier running a search (which is a GET-with-body request) while triggering an index-update in another shell.

What you expected to happen?

Allow me to send a payload with a GET request

What actually happened?

 % bombardier -c125 -l  -H 'Content-type: application/json' -b '{"from": 0, "size": 10, "query": {"match_all": {}}}' 'http://elastic:elastic@elasticsearch:9200/watchlist_record/_search?pretty'
GET and HEAD requests cannot have body

Thats technically not correct, it always was ok the send a body with a GET request, it just shouldnt be used. But as mentioned here: https://stackoverflow.com/questions/978061/http-get-with-request-body that is also obsolete by now. curl for example allows to specify a body along with a GET request. If there is no special reason why this should not work with bombardier, i would love to see this also being allowed :) Shall we change

- cantHaveBody = []string{"GET", "HEAD"}
+ cantHaveBody = []string{"HEAD"}

?