Runtime DNN performance scaling through resource management on heterogeneous embedded platforms

Abstract

DNN inference is increasingly being executed locally on embedded platforms, due to the clear advantages in latency, privacy and connectivity. Modern SoCs typically execute a combination of different and dynamic workloads concurrently, it is challenging to consistently meet latency/energy budgets because the local computing resources available to the DNN vary considerably. In this poster, we show how resource management can be applied to optimise the performance of DNN workloads by monitoring and tuning both software and hardware constantly at runtime. This work shows how dynamic DNNs trade-off accuracy with latency/energy/power on heterogeneous embedded CPU-GPU platform.

More information

Identifiers

ORCID for Jonathon Hare: orcid.org/0000-0003-2921-4283

ORCID for Geoff Merrett: orcid.org/0000-0003-4980-3894

Catalogue record

Export record