Large-Scale Architecture: The Unreasonable Effectiveness of Simplicity • Randy Shoup • YOW! 2022

This presentation was recorded at YOW! 2022. #GOTOcon #YOW Randy Shoup - VP Engineering & Chief Architect at eBay @randyshoup46 RESOURCES @randyshoup ABSTRACT Building distributed systems that work is quite challenging. But systems that provide customer value will grow and evolve, and scaling those systems by multiple orders of magnitude is even harder. Citing specific failures and successes from internet-scale consumer properties like Google and eBay, and measuring customer value through the architecturalilities, this session deep-dives into the often counterintuitive architectural principles of simplicity, orthogonality, asynchrony, and feedback. Simplicity helps us turn seemingly intractable problems into discrete and solvable ones. We will discuss component responsibilities, single-threaded straight-line processing, and making changes in small steps. Orthogonality allows us to compose separate concerns and bound the complexity of each dimension of the problem. We will discuss processing abstractions like mixins and addons, as well as communication abstractions like channels and pipes. Asynchrony and eventual consistency further reduce complexity and lead us to drive the system design directly from what really matters – what is actually changing in our core business domain. We will explore events, caching, and dataflow. Finally, fast and consistent feedback help us continually maintain and improve a complex system. We will discuss quality feedback in the small, as well as systems feedback in the large. You will take away some interesting anecdotes, as well as actionable insights you can put into practice in scaling your own systems. [...] TIMECODES 00:00 Intro 01:38 eBay architecture 03:55 Amazon architecture 06:00 Large-scale architecture 06:43 Simple components 14:12 Simple interactions 20:30 Simple changes 30:04 Putting it all together 44:54 Outro 45:35 Q&A Read the full abstract here: RECOMMENDED BOOKS Mary & Tom Poppendieck • Lean Software Development • Ron Kohavi, Ya Xu, Diane Tang • Trustworthy Online Controlled Experiments • Simon Brown • Software Architecture for Developers Vol. 2 • David Farley • Modern Software Engineering • Dave Farley & Jez Humble • Continuous Delivery • Woods, Erder & Pureur • Continuous Architecture in Practice • George Fairbanks • Just Enough Software Architecture • #SoftwareArchitecture #MinimumViableArchitecture #ModularMonolith #Monolith #Microservices #FeatureFlags #ContinuousDelivery #RandyShoup #SoftwareEngineering #Programming #TDD #SoftwareDevelopment #EventDrivenArchitecture #NetflixArchitecture AmazonArchitecture #FeatureFlag #Sharding #YOWcon Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at Sign up for updates and specials at SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.