All Tags
AWS
ai
algorithm-design
architecture
browser
cloud
cloud-efficiency
cloud-principles
cost-reduction
data-centric
data-compression
data-processing
deployment
design
documentation
edge-computing
email-sharing
energy-efficiency
energy-footprint
enterprise-optimization
green-ai
hardware
libraries
llm
locality
machine-learning
maintainability
management
measured
microservices
migration
mobile
model-optimization
model-training
multi-objective
network-traffic
parameter-tuning
performance
queries
rebuilding
scaling
services
storage-optimization
strategies
tabs
template
testing
workloads
Tactic: RAG Context Caching
Tactic sort:
Awesome Tactic
Type: Architectural Tactic
Category: green-ml-enabled-systems
Title
RAG Context Caching
Description
Long content processing increases energy consumption, context caching can significantly improve the efficiency of indexing by reducing redundant retrievals. Systems such as CacheBlend, MPIC, RAGCache, and TurboRAG are available to incorporate caching into your RAG-Based Systems.
Participant
AI and RAG Practitioners.
Related software artifact
RAG-Based Systems.
Context
RAG. Unsustainable RAG. Green AI.
Software feature
Adaptive Contextual Caching. CacheBlend. MPIC. RAGCache. TurboRAG.
Tactic intent
Environmentally Sustainable RAG and through energy efficiency and reduction of computational waste.
Target quality attribute
Energy Efficiency.
Other related quality attributes
< unknown >
Measured impact
TurboRAG [33] improves energy efficiency by precomputing and storing KV caches offline, reducing redundant retrieval and achieving 98.46% lower computational resource utilization compared to standard RAG.
Source
Improving The Environmental Sustainability of RAG-Based Systems: A Rapid Review by Zhinuan GuoGraphical representation
