Dmitry.AI

How to estimate the maximum allowed batch size for a TensorFlow training?

tensorflow-usage
training
batch-size
tensorflow
(Dmitry Fedyuk) #1

You can estimate the largest batch size using:

Max batch size= available GPU memory bytes / 4 / (size of tensors + trainable parameters)

stackoverflow.com/a/46656508

What is the optimal batch size for a TensorFlow training?
What does mean «train_config» → «batch_size» in TensorFlow?
(Dmitry Fedyuk) #2

See also: