Elon Musk’s synthetic intelligence startup, xAI, has activated its supercomputer cluster in Memphis, Tennessee, which is comprised of 100,000 Nvidia H100 GPUs. Tesla CEO Elon Musk confirmed the milestone in a submit on social media platform X.
xAI had a busy weekend, with the AI startup asserting a hiring ramp on X. Musk highlighted these efforts on Monday morning, stating that xAI was trying to improve its human expertise benefit. Apparently sufficient, Musk additionally inspired those that are all for AI to use to Tesla and X.
However positively trying to improve our human expertise benefit, so please apply at @xAI, in addition to @Tesla and @X https://t.co/sf4hMRco9f
— Elon Musk (@elonmusk) July 22, 2024
Musk then talked about {that a} collaboration between groups from xAI, X, and Nvidia has enabled the Memphis Supercomputer cluster to begin coaching at 4:20 a.m. native time. As per Musk, the supercomputer cluster options 100,000 Nvidia H100 GPUs, successfully making it probably the most highly effective AI coaching cluster out there in the present day.
“Good work by xAI staff, X staff, Nvidia staff, and supporting corporations getting Memphis Supercluster coaching began at ~4:20 a.m. native time. With 100k liquid-cooled H100s on a single RDMA material, it’s probably the most highly effective AI coaching cluster on this planet! This can be a vital benefit in coaching the world’s strongest AI by each metric by December this 12 months,” Musk wrote in a submit on X.
This can be a vital benefit in coaching the world’s strongest AI by each metric by December this 12 months
— Elon Musk (@elonmusk) July 22, 2024
xAI’s supercomputer cluster is predicted for use to coach the corporate’s massive language mannequin, Grok, which is at present rolled out as a characteristic for X Premium subscribers. Earlier this month, Musk famous in a submit on X that xAI’s Grok 3 can be educated on 100,000 H100 GPUs so “it must be actually one thing particular.”
Earlier reviews from Memphis again in early June recommended that xAI can be constructing a supercomputer cluster informally dubbed the “Gigafactory of Compute” on the 785,000-square-foot former Electrolux Memphis facility. In a press launch, the Better Memphis Chamber said that xAI’s supercomputer challenge represents town’s largest capital funding by a new-to-market firm in Memphis historical past.
xAI’s funding is substantial. As per a Benzinga report, every Nvidia H100 GPU is estimated to price between $30,000 to $40,000. Contemplating that xAI is utilizing 100,000 Nvidia H100 items, Elon Musk’s AI startup seems to have spent about $3 billion to $4 billion for the challenge.
Don’t hesitate to contact us with information suggestions. Simply ship a message to [email protected] to provide us a heads up.
