Carbon-Aware Workload Shaping for Event-Driven Microservices Across Multi-Region Clouds
DOI:
https://doi.org/10.71238/snnst.v1i02.182Abstract
Cloud infrastructure that power event-driven microservices is increasingly deployed across geographic regions and uses electricity on a scale that is a significant source of greenhouse gas emissions in the world. This paper integrates the results of 20 peer-reviewed and industry sources on carbon-aware computing, sustainable data-center design, and event-driven microservice architecture to create a unified framework for shaping workloads in a carbon-aware fashion for multi-region clouds. The synthesis brings together recent work on carbon-aware scheduling and scaling systems with temporal workload-shifting and existing microservice communication patterns to shed light on how the event-driven pipelines can be reorganized in terms of time, space, and elasticity while maintaining the latency service-level agreements. The quantitative results presented are based on the reported carbon reduction from elastic carbon scaling up to fifty-one per cent, carbon reduction from latency-aware geographic provisioning up to seventy per cent and carbon savings from temporal shifting up to more than twenty per cent during weekends in several national grids. The paper also places these gains in perspective against the overall information and communication technology (ICT) emissions curve, which saw global data-center electricity consumption grow to around two hundred five terawatt-hours in 2018, or nearly one per cent of the world's total electricity consumption – despite a five-hundred-fifty-percent increase in computing workloads. A suggested reference architecture combines carbon-intensity forecasting, event-broker-level routing and elastic autoscaling to form a closed loop that works for Kafka-based and serverless event-driven applications.
Downloads
References
B. Acun et al., “Carbon Explorer: A Holistic Framework for Designing Carbon Aware Datacenters,” in ASPLOS 2023 - Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Association for Computing Machinery, 2023, pp. 118–132. doi: 10.1145/3575693.3575754.
A. S. G. Andrae and T. Edler, “On Global Electricity Usage of Communication Technology: Trends to 2030,” Challenges, vol. 6, no. 1, pp. 117–157, 2015, doi: 10.3390/challe6010117.
L. Belkhir and A. Elmeligi, “Assessing ICT global emissions footprint: Trends to 2040 & recommendations,” J. Clean. Prod., vol. 177, pp. 448–463, 2018, doi: 10.1016/j.jclepro.2017.12.239.
A. Bellemare, Building Event-Driven Microservices. Sebastopol, CA, USA: O’Reilly Media, Inc., 2020. [Online]. Available: https://www.oreilly.com/library/view/building-event-driven-microservices/9781492057888/
M. Dayarathna, Y. Wen, and R. Fan, “Data Center Energy Consumption Modeling: A Survey,” IEEE Commun. Surv. Tutorials, vol. 18, no. 1, pp. 732–794, 2016, doi: 10.1109/COMST.2015.2481183.
W. A. Hanafy, Q. Liang, N. Bashir, D. Irwin, and P. Shenoy, “CarbonScaler: Leveraging Cloud Workload Elasticity for Optimizing Carbon-Efficiency,” Proc. ACM Meas. Anal. Comput. Syst., vol. 7, no. 3, pp. 1–28, 2023, doi: 10.1145/3626788.
B. Stopford, Designing Event-Driven Systems: Concepts and Patterns for Streaming Services with Apache Kafka. Sebastopol, CA, USA: O’Reilly Media, Inc., 2018. [Online]. Available: https://www.oreilly.com/library/view/designing-event-driven-systems/9781492038252/
I. Karabey Aksakalli, T. Çelik, A. B. Can, and B. Tekinerdogan, “Deployment and communication patterns in microservice architectures: A systematic literature review,” J. Syst. Softw., vol. 180, 2021, doi: 10.1016/j.jss.2021.111014.
R. N. Laigner, Y. Zhou, M. A. V. Salles, Y. Liu, and M. Kalinowski, “Data Management in Microservices: State of the Practice, Challenges, and Research Directions,” Proc. VLDB Endow., vol. 14, no. 13, pp. 3348–3361, 2021, doi: 10.14778/3484224.3484232.
Z. Liu, M. Lin, A. Wierman, S. H. Low, and L. L. H. Andrew, “Greening Geographical Load Balancing,” IEEE/ACM Trans. Netw., vol. 23, no. 2, pp. 657–671, 2015, doi: 10.1109/TNET.2014.2308295.
J. Malmodin and D. Lundén, “The Energy and Carbon Footprint of the Global ICT and E&M Sectors 2010–2015,” Sustainability, vol. 10, no. 9, 2018, doi: 10.3390/su10093027.
E. Masanet, A. Shehabi, N. Lei, S. Smith, and J. Koomey, “Recalibrating global data center energy-use estimates,” Science (80-. )., vol. 367, no. 6481, pp. 984–986, 2020, doi: 10.1126/science.aba3758.
A. Rahmatulloh, F. Nugraha, R. Gunawan, and I. Darmawan, “Event-Driven Architecture to Improve Performance and Scalability in Microservices-Based Systems,” in 2022 International Conference Advancement in Data Science, E-learning and Information Systems (ICADEIS), IEEE, 2022, pp. 1–6. doi: 10.1109/ICADEIS56544.2022.10037390.
H. F. O. Rocha, Practical Event-Driven Microservices Architecture: Building Sustainable and Highly Scalable Event-Driven Microservices. Berkeley, CA: Apress, 2022. doi: 10.1007/978-1-4842-7468-2.
A. Souza et al., “CASPER: Carbon-Aware Scheduling and Provisioning for Distributed Web Services,” in Proceedings of the 14th International Green and Sustainable Computing Conference (IGSC 2023), Association for Computing Machinery, 2023, pp. 67–73. doi: 10.1145/3634769.3634812.
V. Velepucha and P. Flores, “A Survey on Microservices Architecture: Principles, Patterns and Migration Challenges,” IEEE Access, vol. 11, pp. 88339–88358, 2023, doi: 10.1109/ACCESS.2023.3305687.
P. Wiesner, I. Behnke, D. Scheinert, K. Gontarska, and L. Thamsen, “Let’s Wait Awhile: How Temporal Workload Shifting Can Reduce Carbon Emissions in the Cloud,” in Proceedings of the 22nd International Middleware Conference, Association for Computing Machinery, 2021, pp. 260–272. doi: 10.1145/3464298.3493399.
P. Wiesner, D. Scheinert, T. Wittkopp, L. Thamsen, and O. Kao, “Cucumber: Renewable-Aware Admission Control for Delay-Tolerant Cloud and Edge Workloads,” in Euro-Par 2022: Parallel Processing, vol. 13440, Springer International Publishing, 2022, pp. 218–232. doi: 10.1007/978-3-031-12597-3_14.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Srinivas Nune, Karthik Juluri (Author)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.





