ATHENA SEMINAR SERIES: A Model Management Layer for Edge Intelligence
This event has passed.
Friday, March 3, 2023 - 12:00 to 13:00
The NSF AI Institute for Edge Computing (Athena) presents the next in our seminar series by Dr. Peizhen Guo, titled “A Model Management Layer for Edge Intelligence” on Friday, March 3, 2023, from 12-1pm EST via Zoom.
Edge intelligence has already become a reality, where servers, mobile, wearable, and IoT devices analyze data collected or generated at end devices and extract actionable insights, increasingly via deep learning inference and in real time. In this talk, we present a DNN model management framework that automatically generates and selects models for diverse hardware capability and performance requirements. Our framework consists of a series of services that handle neural network model tailoring, model indexing and query, and approximate computation reuse. Together, these services provide abstractions and algorithms to restructure the computation flow, reducing programming and deployment time by orders of magnitude and improving resource efficiency by 3x-10x.
Peizhen Guo received his Ph.D. in Computer Science from Yale University in 2021, advised by Wenjun Hu, PI in Athena. His research interests are in mobile systems, edge computing, and machine learning systems. In particular, his recent work has explored system abstractions and runtime support to redesign ML workflows for better programmability and performance. Peizhen is currently a software engineer at Google.