Not All Retrievals are Useful: Cross-Attention for Input-Aware RAG in Time Series Forecasting
Two new research papers explore advancements in retrieval-augmented generation (RAG) for time series forecasting. The first paper introduces SERAF, a framework that uses both time series similarity and textual descriptions for retrieval, demonstrating improved forecasting accuracy across multiple datasets. The second paper, Cross-RAG, addresses the issue of irrelevant retrieved data by employing cross-attention to focus on query-relevant samples, showing improved stability and performance across various RAG methods and forecasting models. AI
IMPACT These papers introduce novel techniques to improve the accuracy and stability of AI models in time series forecasting by enhancing how external knowledge is integrated.