All Tags
AWS
algorithm-design
architecture
cloud-principles
cost-reduction
data-centric
data-compression
data-processing
deployment
design
edge-computing
energy-footprint
hardware
libraries
locality
machine-learning
management
measured
migration
model-optimization
model-training
performance
queries
rebuilding
scaling
services
strategies
template
workloads
Tactic: Design for Memory Constraints
Tactic sort:
Awesome Tactic
Type: Architectural Tactic
Category: green-ml-enabled-systems
Title
Design for Memory Constraints
Description
Model training requires memory, and sometimes memory leaks and OOM (out of memory) errors may occur during that process. If that happens, the knowledge gained during the prior training process is lost. By considering memory availability constraints and addressing possible OOM exceptions, the system can be designed to operate within the available memory limits. It reduces the likelihood of errors and prevents unnecessary energy consumption (Shanbhag at al 2022).
Participant
Data Scientist
Related software artifact
Memory
Context
Machine Learning
Software feature
< unknown >
Tactic intent
Improve energy efficiency by considering memory constraints during training to prevent knowledge loss due to a premature termination, which would in turn require to restart the process from the beginning, therefore increasing energy consumption
Target quality attribute
Recoverability
Other related quality attributes
Energy Efficiency
Measured impact
< unknown >
Source
Shriram Shanbhag, Sridhar Chimalakonda, Vibhu Saujanya Sharma, and Vikrant Kaulgud. 2022. Towards a Catalog of Energy Patterns in Deep Learning Development. In Proceedings of the International Conference on Evaluation and Assessment in Software Engineering 2022. 150–159. (DOI: https://doi.org/10.1145/3530019.3530035)Graphical representation
![]( /AwesomeAndDarkTactics/assets/diagrams/design-for-memory-constraints.png)