Publications Repository - Gdańsk University of Technology

Page settings

polski
Publications Repository
Gdańsk University of Technology

Treść strony

Modeling and Simulation for Exploring Power/Time Trade-off of Parallel Deep Neural Network Training

In the paper we tackle bi-objective execution time and power consumption optimization problem concerning execution of parallel applications. We propose using a discrete-event simulation environment for exploring this power/time trade-off in the form of a Pareto front. The solution is verified by a case study based on a real deep neural network training application for automatic speech recognition. A simulation lasting over 2 hours on a single CPU accurately predicts real results from executions that take over 335 hours in a cluster with 8 GPUs. The simulations allow also estimating the impact of data package imbalance on the application performance.

Authors

Additional information

DOI
Digital Object Identifier link open in new tab 10.1016/j.procs.2017.05.214
Category
Aktywność konferencyjna
Type
materiały konferencyjne indeksowane w Web of Science
Language
angielski
Publication year
2017

Source: MOSTWiedzy.pl - publication "Modeling and Simulation for Exploring Power/Time Trade-off of Parallel Deep Neural Network Training" link open in new tab

Portal MOST Wiedzy link open in new tab