Resilience-Aware Serverless Orchestration for Stateful Enterprise Workloads Across Multi-Region AWS Environments
DOI:
https://doi.org/10.71238/snnst.v2i02.236Keywords:
AWS; Disaster Recovery; Exactly-Once Semantics; Multi-Region Resilience; Serverless Workflow Orchestration; Stateful Serverless ComputingAbstract
Distributed applications are useful on servers, but enterprise applications like order processing and payments applications have a need for durable state, multi-step coordination, and predictable behaviour in case of failure of an AWS Region.Distributed applications work well on servers, but enterprise workloads like order processing and payments demand durable state, multi-step coordination and predictable behaviour in the case of AWS Region failures. This article examines the literature and the primary AWS documentation up to this date and investigates the possibility of resiliently orchestrating such workloads across Regions. The selected and relevant sources from a focused search into systems, database, and software-engineering venues supported the identification of mechanisms, guarantees, evaluation settings, and reported results extracted and placed into an evidence matrix of 62 sources. With respect to serverless workflows, each of the reported log-based protocols provides exactly-once execution and transactions, and is 2x or 4x faster than the unprotected version, all running within a single failure domain, and with a reported 20–40% improvement. The default configuration for AWS is to replicate business data across Regions, each of which have a claimed latency of about 1 second, and the state of executing workflows is region scoped. In multi-Region workflows, the availability model is separated into availability of the work, in addition to the availability of the recovery time and recovery points. It shows world dependence and how this impacts availability, and shows that workflow progress is not replicated but rather the availability of this progress is the effective recovery point.
Downloads
References
E. Jonas, “Cloud programming simplified: A Berkeley view on serverless computing,” 2019. doi: 10.48550/arXiv.1902.03383.
P. Castro, V. Ishakian, V. Muthusamy, and A. Slominski, “The rise of serverless computing,” Commun. ACM, vol. 62, no. 12, pp. 44–54, 2019, doi: 10.1145/3368454.
M. Brooker, M. Danilov, C. Greenwood, and P. Piwonka, “On-demand container loading in AWS Lambda,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2023, pp. 315–328. doi: 10.48550/arXiv.2305.13162.
S. Eismann, “The state of serverless applications: Collection, characterization, and community consensus,” IEEE Trans. Softw. Eng., vol. 48, no. 10, pp. 4152–4166, 2022, doi: 10.1109/TSE.2021.3113940.
P. Leitner, E. Wittern, J. Spillner, and W. Hummer, “A mixed-method empirical study of Function-as-a-Service software development in industrial practice,” J. Syst. Softw., vol. 149, pp. 340–359, 2019, doi: 10.1016/j.jss.2018.12.013.
J. M. Hellerstein, “Serverless computing: One step forward, two steps back,” in Proc. 9th Biennial Conf. Innovative Data Syst. Res. (CIDR), 2019. doi: 10.48550/arXiv.1812.03651.
S. Burckhardt, C. Gillum, D. Justo, K. Kallas, C. McMahon, and C. S. Meiklejohn, “Durable functions: Semantics for stateful serverless,” Proc. ACM Program. Lang., vol. 5, no. OOPSLA, p. 133, 2021, doi: 10.1145/3485510.
P. García López, M. Sánchez-Artigas, G. París, D. Barcelona Pons, Á. Ruiz Ollobarren, and D. Arroyo Pinto, “Comparison of FaaS orchestration systems,” in Proc. IEEE/ACM Int. Conf. Utility Cloud Comput. Companion (UCC Companion), 2018. doi: 10.1109/UCC-Companion.2018.00049.
H. S. Gunawi, “Why does the cloud stop computing? Lessons from hundreds of service outages,” in Proc. 7th ACM Symp. Cloud Comput. (SoCC), 2016. doi: 10.1145/2987550.2987583.
L. Huang, “Metastable failures in the wild,” in Proc. 16th USENIX Symp. Oper. Syst. Design Implement. (OSDI), 2022, pp. 73–90.
Amazon Web Services, “AWS fault isolation boundaries,” 2022.
Amazon Web Services, “Disaster recovery of workloads on AWS: Recovery in the cloud,” 2022.
H. Zhang, A. Cardoza, P. B. Chen, S. Angel, and V. Liu, “Fault-tolerant and transactional stateful serverless workflows,” in Proc. 14th USENIX Symp. Oper. Syst. Design Implement. (OSDI), 2020, pp. 1187–1204. doi: 10.48550/arXiv.2010.06706.
Z. Jia and E. Witchel, “Boki: Stateful serverless computing with shared logs,” in Proc. 28th ACM Symp. Oper. Syst. Principles (SOSP), 2021, pp. 691–707. doi: 10.1145/3477132.3483541.
J. Wen, Z. Chen, X. Jin, and X. Liu, “Rise of the planet of serverless computing: A systematic review,” ACM Trans. Softw. Eng. Methodol., vol. 32, no. 5, p. 131, 2023, doi: 10.1145/3579643.
H. Shafiei, A. Khonsari, and P. Mousavi, “Serverless computing: A survey of opportunities, challenges, and applications,” ACM Comput. Surv., vol. 54, no. 11s, pp. 1–32, 2022, doi: 10.1145/3510611.
J. Scheuner and P. Leitner, “Function-as-a-Service performance evaluation: A multivocal literature review,” J. Syst. Softw., vol. 170, p. 110708, 2020, doi: 10.1016/j.jss.2020.110708.
A. Agache, “Firecracker: Lightweight virtualization for serverless applications,” in Proc. 17th USENIX Symp. Netw. Syst. Design Implement. (NSDI), 2020, pp. 419–434.
L. Wang, M. Li, Y. Zhang, T. Ristenpart, and M. Swift, “Peeking behind the curtains of serverless platforms,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2018, pp. 133–146.
M. Shahrad, “Serverless in the wild: Characterizing and optimizing the serverless workload at a large cloud provider,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2020, pp. 205–218. doi: 10.48550/arXiv.2003.03423.
A. Joosen, “How does it function? Characterizing long-term trends in production serverless workloads,” in Proc. ACM Symp. Cloud Comput. (SoCC), 2023, pp. 443–458. doi: 10.1145/3620678.3624783.
A. Sahraei, “XFaaS: Hyperscale and low cost serverless functions at Meta,” in Proc. 29th ACM Symp. Oper. Syst. Principles (SOSP), 2023. doi: 10.1145/3600006.3613155.
A. Klimovic, Y. Wang, P. Stuedi, A. Trivedi, J. Pfefferle, and C. Kozyrakis, “Pocket: Elastic ephemeral storage for serverless analytics,” in Proc. 13th USENIX Symp. Oper. Syst. Design Implement. (OSDI), 2018, pp. 427–444.
I. E. Akkus, “SAND: Towards high-performance serverless computing,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2018, pp. 923–935.
D. Barcelona-Pons, M. Sánchez-Artigas, G. París, P. Sutra, and P. García-López, “On the FaaS track: Building stateful distributed applications with serverless architectures,” in Proc. 20th Int. Middleware Conf., 2019, pp. 41–54. doi: 10.1145/3361525.3361535.
S. Shillaker and P. Pietzuch, “Faasm: Lightweight isolation for efficient stateful serverless computing,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2020, pp. 419–433. doi: 10.48550/arXiv.2002.09344.
V. Sreekanti, “Cloudburst: Stateful functions-as-a-service,” Proc. VLDB Endow., vol. 13, no. 11, pp. 2438–2452, 2020, doi: 10.14778/3407790.3407836.
V. Sreekanti, C. Wu, S. Chhatrapati, J. E. Gonzalez, J. M. Hellerstein, and J. M. Faleiro, “A fault-tolerance shim for serverless computing,” in Proc. 15th Eur. Conf. Comput. Syst. (EuroSys), 2020, p. 15. doi: 10.1145/3342195.3387535.
Z. Jia and E. Witchel, “Nightcore: Efficient and scalable serverless computing for latency-sensitive, interactive microservices,” in Proc. 26th ACM Int. Conf. Archit. Support Program. Lang. Oper. Syst. (ASPLOS), 2021, pp. 152–166. doi: 10.1145/3445814.3446701.
S. Qi, X. Liu, and X. Jin, “Halfmoon: Log-optimal fault-tolerant stateful serverless computing,” in Proc. 29th ACM Symp. Oper. Syst. Principles (SOSP), 2023. doi: 10.1145/3600006.3613154.
W. Zhang, V. Fang, A. Panda, and S. Shenker, “Kappa: A programming framework for serverless computing,” in Proc. 11th ACM Symp. Cloud Comput. (SoCC), 2020, pp. 328–343. doi: 10.1145/3419111.3421277.
S. Zhuang, S. Wang, E. Liang, Y. Cheng, and I. Stoica, “ExoFlow: A universal workflow system for exactly-once DAGs,” in Proc. 17th USENIX Symp. Oper. Syst. Design Implement. (OSDI), 2023, pp. 269–286.
S. Burckhardt, “Netherite: Efficient execution of serverless workflows,” Proc. VLDB Endow., vol. 15, no. 8, pp. 1591–1604, 2022, doi: 10.14778/3529337.3529344.
J. Wen and Y. Liu, “An empirical study on serverless workflow services,” 2021. doi: 10.48550/arXiv.2101.03513.
N. Shahidi, J. R. Gunasekaran, and M. T. Kandemir, “Cross-platform performance evaluation of stateful serverless workflows,” in Proc. IEEE Int. Symp. Workload Characterization (IISWC), 2021, pp. 63–73. doi: 10.1109/IISWC53511.2021.00017.
P. García López, A. Arjona, J. Sampé, A. Slominski, and L. Villard, “Triggerflow: Trigger-based orchestration of serverless workflows,” in Proc. 14th ACM Int. Conf. Distrib. Event-Based Syst. (DEBS), 2020. doi: 10.1145/3401025.3401731.
D. H. Liu, A. Levy, S. Noghabi, and S. Burckhardt, “Doing more with less: Orchestrating serverless applications without an orchestrator,” in Proc. 20th USENIX Symp. Netw. Syst. Design Implement. (NSDI), 2023, pp. 1505–1519.
E. Brewer, “CAP twelve years later: How the ‘rules’ have changed,” Computer (Long. Beach. Calif)., vol. 45, no. 2, pp. 23–29, 2012, doi: 10.1109/MC.2012.37.
D. Abadi, “Consistency tradeoffs in modern distributed database system design: CAP is only part of the story,” Computer (Long. Beach. Calif)., vol. 45, no. 2, pp. 37–42, 2012, doi: 10.1109/MC.2012.33.
G. DeCandia, “Dynamo: Amazon’s highly available key-value store,” in Proc. 21st ACM Symp. Oper. Syst. Principles (SOSP), 2007, pp. 205–220. doi: 10.1145/1294261.1294281.
M. Elhemali, “Amazon DynamoDB: A scalable, predictably performant, and fully managed NoSQL database service,” in Proc. USENIX Annu. Tech. Conf. (USENIX ATC), 2022, pp. 1037–1048.
A. Verbitski, “Amazon Aurora: Design considerations for high throughput cloud-native relational databases,” in Proc. ACM SIGMOD Int. Conf. Manage. Data, 2017, pp. 1041–1052. doi: 10.1145/3035918.3056101.
J. C. Corbett, “Spanner: Google’s globally distributed database,” ACM Trans. Comput. Syst., vol. 31, no. 3, p. 8, 2013, doi: 10.1145/2491245.
W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen, “Don’t settle for eventual: Scalable causal consistency for wide-area storage with COPS,” in Proc. 23rd ACM Symp. Oper. Syst. Principles (SOSP), 2011, pp. 401–416. doi: 10.1145/2043556.2043593.
M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski, “Conflict-free replicated data types,” in Proc. 13th Int. Symp. Stabilization, Safety, Security Distrib. Syst. (SSS), 2011, pp. 386–400. doi: 10.1007/978-3-642-24550-3_29.
H. Garcia-Molina and K. Salem, “Sagas,” in Proc. ACM SIGMOD Int. Conf. Manage. Data, 1987, pp. 249–259. doi: 10.1145/38713.38742.
P. Helland, “Life beyond distributed transactions: An apostate’s opinion,” in Proc. 3rd Biennial Conf. Innovative Data Syst. Res. (CIDR), 2007, pp. 132–141.
A. Avizienis, J.-C. Laprie, B. Randell, and C. Landwehr, “Basic concepts and taxonomy of dependable and secure computing,” IEEE Trans. Dependable Secur. Comput., vol. 1, no. 1, pp. 11–33, 2004, doi: 10.1109/TDSC.2004.2.
P. Huang, “Gray failure: The Achilles’ heel of cloud-scale systems,” in Proc. 16th Workshop Hot Topics Oper. Syst. (HotOS), 2017, pp. 150–155. doi: 10.1145/3102980.3103005.
N. Bronson, A. Aghayev, A. Charapko, and T. Zhu, “Metastable failures in distributed systems,” in Proc. 18th Workshop Hot Topics Oper. Syst. (HotOS), 2021, pp. 221–227. doi: 10.1145/3458336.3465286.
M. Brooker, T. Chen, and F. Ping, “Millions of tiny databases,” in Proc. 17th USENIX Symp. Netw. Syst. Design Implement. (NSDI), 2020, pp. 463–478.
A. Basiri, “Chaos engineering,” IEEE Softw., vol. 33, no. 3, pp. 35–41, 2016, doi: 10.1109/MS.2016.60.
S. Ristov, S. Pedratscher, and T. Fahringer, “xAFCL: Run scalable function choreographies across multiple FaaS systems,” IEEE Trans. Serv. Comput., vol. 16, no. 1, pp. 711–723, 2023, doi: 10.1109/TSC.2021.3128137.
S. Ristov, D. Kimovski, and T. Fahringer, “FaaScinating resilience for serverless function choreographies in federated clouds,” IEEE Trans. Netw. Serv. Manag., 2022, doi: 10.1109/TNSM.2022.3162036.
A. F. Baarzi, G. Kesidis, C. Joe-Wong, and M. Shahrad, “On merits and viability of multi-cloud serverless,” in Proc. 12th ACM Symp. Cloud Comput. (SoCC), 2021, pp. 600–608. doi: 10.1145/3472883.3487002.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Kedar Pradhan (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Facebook 
Instagram 
Twitter 
Youtube 
+62 822 2101 3235
northpressmail@gmail.com