All 7 Redis Performance Tuning & Benchmarking questions
More in Redis Performance Tuning & Benchmarking
What tool does Redis provide for benchmarking its performance, and how do you use it? What common commands and usage patterns should generally be avoided because they can cause performance problems on a large Redis dataset? How does the size of values stored in Redis affect overall performance, and what strategies help manage very large values? How do you use the redis-cli --latency option to measure the round trip time between your client and a Redis server? How would you conduct a thorough performance benchmarking exercise to compare two different Redis configurations before deciding which to use in production? What operating system level tuning settings can affect Redis performance, and how would you optimize them for a production deployment?
Advertisement
Redis › Redis Performance Tuning & Benchmarking

What is pipelining, and how does it improve throughput when performing many operations against Redis?

Beginner

Answer

Pipelining lets you send multiple commands to Redis together without waiting for a response after each individual one, dramatically reducing the impact of network round trip time when performing many operations, since you only wait for all the responses to come back together at the end rather than one at a time.
-- Without pipelining: many separate round trips
-- With pipelining: commands batched into fewer round trips
pipe = redis.pipeline()
for i in range(1000):
    pipe.set(f'key{i}', f'value{i}')
pipe.execute()
Real-world example A data migration script uses pipelining to insert one hundred thousand records into Redis, completing significantly faster than it would have by sending each individual command as a separate network round trip.

Common follow-ups: Is there a reasonable limit to how many commands should be included in a single pipeline batch?;Does pipelining provide any atomicity guarantees like a transaction does?

Connection Pooling & Client Libraries;Transactions
All 7 Redis Performance Tuning & Benchmarking questions