http://karpoke.ignaciocano.com/tags/cach%C3%A9/Recent content in Caché on Karpoke - Just Another BlogHugo -- 0.159.0esSat, 14 Jan 2017 14:36:00 +0100http://karpoke.ignaciocano.com/2017/01/14/moving-persistent-data-out-of-redis/Sat, 14 Jan 2017 14:36:00 +0100http://karpoke.ignaciocano.com/2017/01/14/moving-persistent-data-out-of-redis/<blockquote> <p>Transitioning all that information transparently involved planning and coordination. For each problem domain using persistent Redis, we considered the volume of operations, the structure of the data, and the different access patterns to predict the impact on our current MySQL capacity, and the need for provisioning new hardware.</p> <p>For the majority of callsites, we replaced persistent Redis with GitHub::KV, a MySQL key/value store of our own built atop InnoDB, with features like key expiration. We were able to use GitHub::KV almost identically as we used Redis: from trending repositories and users for the explore page, to rate limiting to spammy user detection.</p>