← Back to program
Talk
Building Proprietary Transformers at Scale
Time: Wed 6 May, 10:00 – 10:30
Building a proprietary transformer model with tens of millions of parameters is an engineering challenge. Training it on 100TB of proprietary Counter-Strike 2 data is a logistical nightmare.