Redis keys not expiring

[cdaguerre]

The Redis storage provider does not set key TTL correctly (using Redis 6.2). Or is the behavior below expected?

[darkweak]

Hey @cdaguerre thats definitively a bug 😄

[darkweak]

@cdaguerre can you paste an the request you're sending and the responses (the one with the store and the one with the age/ttl) ?

[darkweak]

@cdaguerre should be fixed in the latest release.

[K0tBegemot]

I have this problem too. In standlone mode with latest release, /flush method does not clear the cache contents

[darkweak]

@K0tBegemot do you have a curl request?

[HobMartin]

Same problem to me. I use Redis cluster and when I send PURGE request, keys in Redis still exist.
After trying to reproduce it, I believe I understand why it happened.

Keys and Stale was store in one cluster slot, but IDXs stores in different and when PURGE request call DeleteMany method I've got panic: multi key command with different key slots are not allowed.

How fix that?

[darkweak]

@HobMartin Can you paste your configuration, and a curl request to reproduce please? 🙏

[HobMartin]

@darkweak Of course.
My Caddy config:

(redis_cache) {
  redis {
    configuration {
      InitAddress clustercfg.xxxxx.yyyyy.use1.cache.amazonaws.com:6379 // here cluster config endpoint
      TLSConfig
      Username "username"
      Password "password"
    }
  }
}
{
  cache {

    api {
      basepath /_cache
      souin
    }
    import redis_cache

    stale 60s
    ttl 120s

    key {
      disable_body
      disable_method
      headers Content-Type Authorization
      hide
    }
  }
}

And curl request

curl -x PURGE https://cache-testing.test.com/_cache/souin/cache-testing

I use Souin Api endpoint with name of site to remove caching for a specific site. BTW,

curl -x PURGE https://cache-testing.test.com/_cache/souin/

doesn't work too.
And PURGE by surrogate key, didn't clear as well

FYI, I specify TLSConfig, because without it Caddy failed when starting.

As I know, issue with cross slot could be fixed by using https://redis.io/docs/reference/cluster-spec/#hash-tags in key name. And It will be great for me, because I can specify hashtag by different site. But I cannot customize cache key in Souin 😢

[HobMartin]

@darkweak any updates?

[darkweak]

@HobMartin sorry for the delay. I opened a PR that concerns the redis storage #489. I will try to take your issue in it. About the hashtags, it it really mandatory? Maybe this redis/rueidis#177 (reply in thread) could solve that instead (DoMulti usage).

[darkweak]

@HobMartin I pushed a new commit that may support the redis hashtags. You can enable it using the HashTag directive in the redis configuration.

{
    order cache before rewrite
    cache {
        api {
            souin
        }
        ttl 1000s
    }
}

:4443
respond "Hello World!"

route /redis-configuration/* {
    cache {
        redis {
            configuration {
                HashTag "{something}"
                ClientName souin-redis
                InitAddress 127.0.0.1:6379
                SelectDB 0
            }
        }
    }
    respond "Hello redis"
}

By the way I fixed the purge but the API is the following to flush all keys:

curl -X PURGE '{YOUR_DOMAIN}/{SOUIN_API_PATH}/flush'

You can try that using the latest commit a9f87ce02be5b871101db189345eb3c81ce01676:

xcaddy build  --with github.com/darkweak/souin/plugins/caddy@a9f87ce02be5b871101db189345eb3c81ce01676  --with github.com/darkweak/souin@a9f87ce02be5b871101db189345eb3c81ce01676

[HobMartin]

Hey, @darkweak, thanks for adding hashtags. The keys are finally deleted, but I have a problem with the updated key name in this commit. As I see, you use a hashed key, but I need to have the host in the key name.

Let me explain my situation. I have a dynamic host handler in Caddy, and I've added a cache for those hosts. The problem arises when I need to purge the cache for a single hostname. I've been using regex in the API call to Souin, but with the hashed key, this method is no longer effective.

BTW, from Souin, get endpoint got a response without new hashed keys

[HobMartin]

@darkweak what about of support caddy placeholders in hashtag name? This will be so helpful in my case.

[darkweak]

@HobMartin placeholders support is currently in progress here #514 🙂