Hardware inefficiencies pose major limitations to U.S. Department of Defense (DoD) applications; current processors simply cannot keep up with the large and complex machine learning (ML) workloads needed to perform their missions. Utilizing co-design (concurrent design of electronic system hardware and software components), this project aims to provide tools to overcome these limitations and yield practical results that increase battery life, reduce weight warfighters must carry, increase maneuverability of forces, and reduce time from sensor to shooter.

This three-year project will develop accelerator intellectual property (IP) for novel ML accelerators that can be incorporated into specialized edge hardware that is optimized for mission size, weight, and power (SWaP). We will target the most computationally expensive parts of the application domain and focus on identifying accelerators for the ML workloads that are the primary performance bottlenecks in our target application systems. Our primary technical objective is to deliver application-dependent accelerator co-designs that are 2x more energy efficient than existing GPU solutions.

Through analysis and simulation phases, our project will establish tools and methodologies for the identification and implementation of accelerators that will be incorporated into a co-design flow for system on chips (SoCs). Improving efficiency in edge applications is a challenging problem that involves simulations of the integrated system as well as simulations of the newly designed component and how it integrates into the system. This project responds to a DoD need and opportunity to not only improve efficiency in targeted edge applications, but to do so at scale.

Advancing the capability of hardware-software co-design will result in improvements in energy efficiency that improve timeliness and affordability by saving time and resources. Because leading-edge software capabilities are foundational to this work, the CMU SEI is uniquely suited to lead this project and set a course for hardware-software co-design for the DoD.