Category Archives: Deep Learning

GPU utilization with neural networks

Abstract Nowadays GPUs are widely used for neural networks training and inference. It’s clear that GPUs are faster than CPU, but how much and do they do their best on such tasks. In this article we’re testing performance of the basic neural network training operation—matrix-vector multiplication using basic and kind of top GPUs, AWS p2.xlarge…
Read More

HW selection benchmark for deep learning

Our company is doing active research in the area of deep learning. To be a bit more specific - we are building very wide embedding layers. We need to be able to perform an interactive research and we need to be able to train a lot of networks on-demand. The number of weights in our…
Read More