The added params are:

• gravity: "-gravity" param, default is Center
• crop: "-crop" param with "+repage"
• rotate: "-rotate" param
• monochrome: "-monochrome" param
• grey: "-colorspace" param with "GRAY"
• no_strip: "-strip" param
• trim: "-trim" param
• no_interlace: "-interlace" param with "Line". Useful for JPEG, I'm not sure about other formats.
• flip: "-flip" param
• flop: "-flop" param Please go to GraphicsMagick documentation for detailed explanation.

Added test functions for buildArguments.

Params parser now divided into 3 main parts to parse int, bool and string type params. Adding params is easier this way.

When we use cache (memory, redis, both of them), and run GOMAXPROCS=2, we see next:

1. 50 request per second
2. 8 core 100% loading

Then, we turn off cache and see:

1. 8000 request per second
2. 8 core 50% loading

???

I added the package "cache/file" that support a disk based cache system. With low memory environment the disk based cache system is useful.

Usage (part of examples/cache):

var flagFile     = "/tmp"

// part of examples/cache/cache.go
func newServerFile(srv imageserver.Server) imageserver.Server {
	if flagFile == "" {
		return srv
	}
	cch := imageserver_cache_file.Cache{flagFile }
	kg := imageserver_cache.NewParamsHashKeyGenerator(sha256.New)
	return &imageserver_cache.Server{
		Server:       srv,
		Cache:        &cch,
		KeyGenerator: kg,
	}
}

Hello there, nice server !

Would that be possible to hotlink images to cache ?

Something like

http://fuckingfrogs.fr:8080/?source=http://stock.wikimini.org/w/images/b/b5/Poney_shetland-9380.jpg

that would make the server download the image only on the first hit and then cache it ?

Cheers !

Hi Pierrre,

I would like some help deploying a golang image server using your package to the Google App Engine.

Problem is, App Engine rejects the use of sockets. I think in order to rectify the issue, "google.golang.org/appengine/socket" package is necessary.

I'm trying to follow this github issue to fix the issue: https://github.com/go-sql-driver/mysql/issues/457

"google.golang.org/appengine"
"github.com/go-sql-driver/mysql"
"google.golang.org/appengine/socket"

dial := func(addr string) (net.Conn, error) {
        return socket.Dial(appengine.NewContext(r), "tcp", addr)
    }

mysql.RegisterDial("external", dial)

However, I'm not sure how I could get access to the http request from where the Redis socket.Dial() is called.

Hi, the project is awesome and I like it very much. I want to use it as my image server, however, I found all the images are loaded from a special folder naming testdata. I am wondering How can I custom some codes to make it possible that I can totally use the project as an image server including getting images from a custom folder on my disk.

in Windows Server 2012 Failure to perform normally time.LoadLocation("GMT")

The error is as follows：

UTC open C:\Go/lib/time/zoneinfo.zip: The system cannot find the path specified.

And I found your questions at go's issues，But our system is different

I found in the test that the program can be used normally by modifying imageserver/http/util.go/GMT to UTC. Therefore, if the GMT in the source code is changed to UTC, is this correct? I hope to get your suggestion?

//src
// var expiresHeaderLocation = getTimeLocation("GMT")
//me code
var expiresHeaderLocation = getTimeLocation("UTC")

Hi! Thanks for this repo, I'm trying to learn Go so maybe it's my fault but I'm struggling with an error.

I cloned the repo in the folder where I have Go projects and I can run: go run simple.go and this is working: http://localhost:8080/?source=https://www.google.co.uk/images/srpr/logo11w.png

But if I try to add a parameter: http://localhost:8080/?source=https://www.google.co.uk/images/srpr/logo11w.png&width=200

I receive Internal Server Error

How can I debug this?

Go 1.3 on OSX 10.9.4

Many thanks

System Info

• OS: Windows10
• Go version: go1.10.1 windows/amd64
• GOPATH: C:\projects
• GOROOT: C:\Go\
• DEP: dep
• PROJECT NAME: image

Expected Bahavior

Server started

Actual Behavior

unexpected directory layout: import path: github.com/pierrre/imageserver root: C:\projects\src dir: C:\projects\src\image\vendor\github.com\pierrre\imageserver expand root: C:\projects\src expand dir: C:\projects\src\image\vendor\github.com\pierrre\imageserver separator: \

Description

I tried your demo https://github.com/pierrre/imageserver/blob/master/examples/simple/simple.go with dep instead of go get, and this error happend when I tried to testrun.

This only happens when I use dep, and imageserver is under vendor folder. It works when I use go get, but I don't see why it doesn't work anymore when I use dep.

When I use the file cache option, IF my instance runs out of space, what will hapepn? Does your server automatically delete files to free up disk space?

when i use advanced demo to run is ok, but browse the url like localhost:8080/image/1.jpg the result is : invalid param "path": unknown image "image/1.jpg" so,please tell me how to use advanced demo if i want to use graphicsmagick,how to use thank you!

hmac.Signer is an http.Handler that will sign the rest of the URI and parameters, redirecting to the signed URI to prime the cache. So signing request http://localhost:8081/_sign/food/20200723_0017_01.jpg?quality=10 redirects to http://localhost:8081/QfuWvArP9zsFRKwSJuG2MJz4DZsZe2NoVUmy7WBAwaw/food/20200723_0017_01.jpg?expiration=1669988210032&quality=10 (note the hash component and the appended expiration parameter). If any parameters are changed, the hash verification will fail. If the expiration (milliseconds from UNIX epoch) expires, the verification will fail. I can provide a full example if desirable. Happy to iterate on this for a while too if there is feedback.

It can be wired into the groupcache example ala:

func startHTTPServer() {
	http.Handle("/", http.StripPrefix("/", newImageHTTPHandler()))
	if hmacKey != "" {
		hs := hmac.NewSigner([]byte(hmacKey), hmacDuration)
		http.Handle("/_sign/", http.StripPrefix("/_sign/", hs))
	}
	http.Handle("/favicon.ico", http.NotFoundHandler())
	initGroupcacheHTTPPool() // it automatically registers itself to "/_groupcache"
	http.HandleFunc("/stats", groupcacheStatsHTTPHandler)
	err := http.ListenAndServe(flagHTTP, nil)
	if err != nil {
		panic(err)
	}
}

hmac.Parser is a Parser to allow "expiration" to be a valid parameter.

func newImageHTTPHandler() http.Handler {
	return &imageserver_http.Handler{
		Parser: imageserver_http.ListParser([]imageserver_http.Parser{
			&imageserver_http.SourcePathParser{},
			&imageserver_http_crop.Parser{},
			&imageserver_http_gift.RotateParser{},
			&imageserver_http_gift.ResizeParser{},
			&imageserver_http_image.FormatParser{},
			&imageserver_http_image.QualityParser{},
			&hmac.Parser{},
		}),
		Server: newServer(),
	}
}

hmac.Verifier is an imageserver.Server that should be first (aka last) in a composition tree.

func newServer() imageserver.Server {
	srv = newServerImage(srv)
	srv = newServerGroupcache(srv)
	if hmacKey != "" {
		srv = hmac.NewVerifier(srv, hmacKey, hmacDuration)
	}
	return srv
}

The S3 credentials can be provided directly or in the environment. Fully composable and works excellently with the groupcache implementation. Admittedly plays loose with contexts. Resolves #26

In the groupcache example, swapping out testdata and updating newServer() , while taking a new CLI argument for awsS3bucket works perfectly. If the S3 path would be s3://somebucket/food/20200809_0030_01.jpg then http://localhost:8081/food/20200809_0030_01.jpg?&width=1024 would be example path. I can provide a full example if desirable. Happy to iterate on this for a while too if there is feedback.

func newServer() imageserver.Server {
	srv, err := s3.NewS3Server(awsRegion, awsAccessKey, awsSecretKey, awsS3bucket)
	if err != nil {
		panic(err)
	}
	srv = newServerImage(srv)
	srv = newServerGroupcache(srv)
	return srv
}

First off, kudos for the awesome work.

Is there a way to use this with S3 bucket ? Something like a CDN server.

Example flow:

1. When user goes to:

http://localhost/path/to/s3/file.jpg?width=100&height=200

2. The server then downloads the file from S3, applies the given transformations and outputs the final image's buffer in response.

Hi Pierrre,

I'm a golang/devops newbie.

I have a Node JS web-application and chatbot that uses this repository as the golang image server to handle all the images processing (with file cache system).

The image server is deployed in 2 instances and load balanced.

I predict that my current setup serves/handles about ......... 500,000 to 1,000,000 images/requests per day in various sizes ... Hard to tell what the number is exactly.

About 3 weeks ago, I noticed that a lot of my images were loading extremely slow and turning up broken. At that point I upgraded both my instances from micro to 1 vCPU, 3.75 GB mem. That actually solved the problem easily.

Fast forward to now, I'm starting to notice some slow loading images again and saw the broken images issue once or twice only.

Could I please get some advice and tips from you for dev-ops and scaling?

I have never really had to handle scaling before and I'm not sure how and what data to look at to measure if my instances' resources are sufficient.

For example, this may sound really dumb but when I look at the monitoring section in Google Cloud Platform, the CPU only peaks at 3% to 4% max, and I'm unsure if I'm looking at the right numbers.

Thank you kindly in advance.