assuming you already know, webapps often use lists like; comments, likes etc.. followers etc.. I see that; rocksdb rocks with ledisdb. however, never saw benchmark results for LLEN. does it full scan over list ? or it incr + 1 when we command lpush. I don;t think that fullscan is somehow faster than a local key - value. I short, I wonder LLEN performance and how it works :)

Now "scan" commands are very redundant and complicate, see #137. It is time to refactor them.

For compatibility, I may not remove old XSCAN, XLSCAN, etc..., so maybe another API is better, like this:

XKEYSCAN type cursor [MATCH match] [COUNT count]

"type" is kv, list, hash, set, and zset. This API likes redis SCAN, to iterates keys, for different data type.

But if we don't care compatibility, we may use XSCAN instead, @pkieltyka.

XHSCAN key cursor [MATCH match] [COUNT count]

XHSCAN likes redis HSCAN to iterates hash field and values.

XSSCAN key cursor [MATCH match] [COUNT count]

XSSCAN likes redis SSCAN to iterates set memebers.

XZSCAN key cursor [MATCH match] [COUNT count]

XZSCAN likes redis ZSCAN to iterates zset element and score.

https://github.com/siddontang/ledisdb/issues/354

extremely slow, how do I speed it up? Afterall, I'm using RAM, using redis directly is 2x slower (because of the TCP roundtrip i suspect) but other in-memory such as freecache is running around 50ms average for both SET and GET.

Currently with the example you have provided, I'm running HMset at 6s. Can you pls give example on how to speed this up? I suspect it's at the FVPair area but... any ideas?

Hope you can look into the GC area like freecache. Thanks in advance.

pure SET and GET only 3x slower than freecache which is "acceptable"

godep go install -tags 'linenoise leveldb lua' ./... github.com/siddontang/ledisdb/vendor/lua could not determine kind of name for C.lua_tointeger could not determine kind of name for C.lua_tonumber godep: go exit status 2 make: *** [build] Error 1

An error with lua version? I 'm using lua-5.2

uname -a

Linux ubdesk1404 3.13.0-53-generic #89-Ubuntu SMP Wed May 20 10:34:39 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

$PATH

/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/home/cloud/gocode/bin

make

godep go install -tags 'linenoise ' ./... cmd/ledis-load/main.go:6:2: cannot find package "github.com/siddontang/ledisdb/config" in any of: /usr/src/pkg/github.com/siddontang/ledisdb/config (from $GOROOT) /home/cloud/prototypes/ledisdb/src/github.com/siddontang/ledisdb/Godeps/_workspace/src/github.com/siddontang/ledisdb/config (from $GOPATH) /home/cloud/gocode/src/github.com/siddontang/ledisdb/config cmd/ledis-load/main.go:7:2: cannot find package "github.com/siddontang/ledisdb/ledis" in any of: /usr/src/pkg/github.com/siddontang/ledisdb/ledis (from $GOROOT) /home/cloud/prototypes/ledisdb/src/github.com/siddontang/ledisdb/Godeps/_workspace/src/github.com/siddontang/ledisdb/ledis (from $GOPATH)

//在一个go程里不停地往ledis数据库里插入，达到一定的长底LPop数据。跑了5300秒，内存占用从最开始的324468KB 到最后的964292KB，中间一直在上涨，没有降过。

const (
    K_LOGS = "logs"
)

func textInsert(db *ledis.DB, val []byte, limit int) {
    c, err := db.RPush([]byte(K_LOGS), []byte(fmt.Sprintf("[%s] %s", time.Now().String(), string(val))))
    if err != nil {
        log.Fatalln("add log of ", val, " failed:", err)
    }
    if c > int64(limit) {
        if _, err := db.LPop([]byte(K_LOGS)); err != nil {
            log.Fatalln("pop log failed:", err)
        }
    }
}

func main() {
    var l *ledis.Ledis
    var db *ledis.DB
    var err error

    cfg := lediscfg.NewConfigDefault()
    cfg.DBName = goleveldb.MemDBName
    if l, err = ledis.Open(cfg); err != nil {
        log.Println("open underlying log db failed")
        log.Fatalln(err)
    }

    if db, err = l.Select(0); err != nil {
        log.Println("open underlying log db failed")
        log.Fatalln(err)
    }

    mylimit := 20000
    for i := 0; ; i++ {
        textInsert(db, []byte(fmt.Sprintf("hello %d", i)), mylimit)
    }
}

Any ideas how to workaround the following issue:

$ GOOS=linux GOARCH=amd64 go build -o streams_$GOOS_$GOARCH
Godeps/_workspace/src/github.com/siddontang/ledisdb/store/mdb/mdb.go:9:2: C source files not allowed when not using cgo: mdb.c midl.c

I am building my app on a Mac for Linux using go 1.4.2. My app depends on Ledis (v0.4-61-gb9d10ac). I am using the boltdb or memory backend, so I dont even need mdb support.

My first time playing with ledis-server, just wanted to offer some feedback. The "-config" file must exist or the server can't be started. Rather it makes more sense to either require config or db_name to start since the config file doesnt have anything in it besides the db_name.

Also, perhaps instead of a json config file you could use https://github.com/BurntSushi/toml ? .. doesnt really matter I guess, but even if you call it /etc/ledis.conf using a toml format, it will feel good and unixy, and just a better format for this kind of thing IMHO.

We had a ledis master/slave setup that was replicating fine.

We recently experienced some data corruption on the master so we took it down and promoted the slave to be the new master.

Replication now no longer works between the new master and the old master (which is now the slave). The new slave had all its prior data removed and should just function like a brand new ledis slave node.

On the new master:

10.0.0.208:6380> info replication
# Replication
role:master
pub_log_num:0
pub_log_ack_per_time:0
slaveof:
slaves:10.0.0.99:6380
last_log_id:4102189945
first_log_id:4050241982
commit_log_id:4102189945
master_last_log_id:0

On the new slave:

10.0.0.99:6380> info replication
# Replication
role:slave
pub_log_num:0
pub_log_ack_per_time:0
slaveof:10.0.0.208:6380
last_log_id:0
first_log_id:0
commit_log_id:0
master_last_log_id:0
master_link_status:up
slave_priority:100
slave_repl_offset:0

Is there some additional tasks required to set up replication in this case?

Hello,

2 newest version ledis-server "localhost:6380" "localhost:6381" are running, and I want to replicate them. But "SLAVEOF" command return following error.

127.0.0.1:6381> slaveof 127.0.0.1 6380
(error) ERR slaveof must enable replication

I changed use_replication=false to true and restart, but nothing goes well. Is there another options essential to start replication?

Then I put slaveof="localhost:6380" to the conf of localhost:6381 and restart. Now localhost:6381 should be slave, and ROLE command displays like this.

127.0.0.1:6381> role
1) "slave"
2) "localhost"
3) (integer) 6381
4) "connect"
5) (integer) 0

Status is slave. It's ok. but "3) (integer) 6381" is slave port. According to redis reference, this should be master port.

master node show following. this means master without slave.

127.0.0.1:6380> role
1) "master"
2) (integer) 0
3) (empty list or set)

Replication not working.

redis-cli -p 6380
127.0.0.1:6380> set a b
OK
127.0.0.1:6380> get a
"b"
redis-cli -p 6381
127.0.0.1:6381> get a
(nil)

I found nothing under the path "data_dir/rpl". Am I doing something wrong?

make build_lmdb

godep go install -tags ' lmdb' ./...
godep: WARNING: Go version (go1.6) & $GO15VENDOREXPERIMENT=1 wants to enable the vendor experiment, but disabling because a Godep workspace (Godeps/_workspace) exists package github.com/siddontang/ledisdb/cmd/ledis-load imports github.com/siddontang/ledisdb/ledis imports github.com/siddontang/ledisdb/rpl imports github.com/siddontang/ledisdb/store imports github.com/siddontang/ledisdb/store/mdb imports github.com/siddontang/ledisdb/vendor/gomdb: must be imported as gomdb godep: go exit status 1 make: *** [build_lmdb] 错误 1