New computers with powerful GPUs can bottleneck at the CPU if code is not modified to increase batch sizes sent to the GPUs. To improve processing performance of your system, update and tune hyperparameters in your code to deliver larger batch payloads to your GPU.

Tuning to balance overfitting and underfitting, we found a 5x performance on model training, giving our team more time to do experiments.

Adil Lheureux published a good read on the topic called “How to maximize GPU utilization by finding the right batch size” that you should check out.