Tips for training Transformers

Practical takeways for training transformers

Download

   shariq.pdf wamiq.pdf

Abstract

Practical tips and tricks to train Transformers, presented by Wamiq and Shariq.