Life Style
xAI breaks records with ‘Colossus’ AI training system
Elon Musk’s xAI has unveiled its record-breaking AI training system, dubbed ‘Colossus’.
Musk revealed that the xAI team had successfully brought the Colossus 100k H100 training cluster online after a 122-day process. Not content with its existing capabilities, Musk stated, “over the next couple of months, it will double in size, bringing it to 200k (50k H200s).”
The scale of Colossus is unprecedented, surpassing every other cluster to date. For context, Google uses 90,000 GPUs while OpenAI utilises 80,000 GPUs—both of which have been surpassed by xAI’s creation, even prior to Colossus’ doubling in size over the coming months.