All 7 RedisTimeSeries questions
More in RedisTimeSeries
How do you add a new data point to a Redis time series, and how do you query a range of recent data? How do you configure automatic downsampling in RedisTimeSeries, where detailed recent data is aggregated into coarser summaries over time? How do you configure a retention period for a Redis time series so old data is automatically removed after a certain amount of time? What aggregation functions are available when querying a range of data from a Redis time series, and how do you apply one during a query? How does RedisTimeSeries handle labels and how can you use them to query across multiple related time series at once?
Advertisement
Back to results for “Architecture”
Redis › RedisTimeSeries

How would you design a monitoring system architecture using RedisTimeSeries that efficiently handles both high frequency raw data ingestion and long term historical trend analysis?

Advanced

Answer

You would configure a short retention period for high frequency raw data optimized for immediate alerting and detailed recent analysis, set up multiple compaction rules creating progressively coarser aggregated time series such as hourly, daily, and monthly summaries, and configure appropriately longer retention periods for each of those aggregated series based on how far back you actually need historical trend visibility.
TS.CREATE raw_metrics RETENTION 3600000
TS.CREATE hourly_metrics RETENTION 604800000
TS.CREATERULE raw_metrics hourly_metrics AGGREGATION avg 3600000
Real-world example A large scale infrastructure monitoring platform maintains raw metrics for just one hour for immediate alerting, hourly aggregates for a week of detailed trend analysis, and monthly aggregates retained indefinitely for long term capacity planning, all automatically maintained through RedisTimeSeries compaction rules.

Common follow-ups: How many levels of downsampling are typically reasonable for a monitoring system?;What is the storage tradeoff between keeping more levels of aggregation versus fewer?

Redis Memory Optimization;Redis Modules Overview
All 7 RedisTimeSeries questions