Serverless & Event-driven Patterns for GenAI • Uma Ramadoss & Dhiraj Mahapatro • GOTO 2023

This presentation was recorded at GOTO EDA Day 2023. #GOTOcon #GOTOeda #GOTOedaday Uma Ramadoss - Sr. Solutions Architect, Integration Services at AWS Dhiraj Mahapatro - Principal Serverless Solutions Architect at AWS RESOURCES Uma Dhiraj ABSTRACT GenAI creates new and exciting opportunities for application development. GenAI also introduces challenges in how developers build application architecture to meet the different needs of AI. Developers need efficient and cost-effective ways to host, train, and ultimately, consume GenAI. In this session, you will learn about new event-driven architectural patterns that are helping developers to build GenAI solutions quickly and effectively run on AWS at scale. By the end of the session, you will walk away with several EDA pattern options for hosting, context tuning, and consuming GenAI to cater to different business use cases. [...] TIMECODES 00:00 Intro 00:52 Agenda 01:40 Introduction to generative Al 07:26 Use cases 11:36 Why use serverless with generative Al? 15:01 Serverless services 18:52 Serverless patterns for generative Al 30:11 How to build context based on internal knowledge? 37:08 Hosting foundation models 37:46 Documents summarization on SageMaker at scale 43:12 Summary 44:09 Outro Download slides and read the full abstract here: RECOMMENDED BOOKS James Urquhart • Flow Architectures • Adam Bellemare • Building Event-Driven Microservices • Peter Sbarski • Serverless Architectures on AWS • Michael Stack • Event-Driven Architecture in Golang • Ford, Richards, Sadalage & Dehghani • Software Architecture: The Hard Parts • Gerardus Blokdyk • Event-Driven Architecture EDA • #GenAI #GenerativeAl #LLM #SageMaker #Serverless #EDA #EventDrivenArchitecture #SoftwareArchitecture #AWS #EventDriven #Microservices #AsynchronousEvents #UmaRamadoss #DhirajMahapatro Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at Sign up for updates and specials at SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.