{"id":92812,"date":"2024-09-03T16:26:51","date_gmt":"2024-09-03T20:26:51","guid":{"rendered":"https:\/\/danielschristian.com\/learning-ecosystems\/?p=92812"},"modified":"2024-09-03T16:45:56","modified_gmt":"2024-09-03T20:45:56","slug":"when-a-i-s-output-is-a-threat-to-a-i-itself-bhatia-xai-introduces-most-powerful-ai-training-system-in-the-world-other-items-re-ai","status":"publish","type":"post","link":"http:\/\/danielschristian.com\/learning-ecosystems\/2024\/09\/03\/when-a-i-s-output-is-a-threat-to-a-i-itself-bhatia-xai-introduces-most-powerful-ai-training-system-in-the-world-other-items-re-ai\/","title":{"rendered":"“When A.I.\u2019s Output Is a Threat to A.I. Itself” [Bhatia], xAI introduces most powerful AI training system in the world +other items re: AI"},"content":{"rendered":"

When A.I.\u2019s Output Is a Threat to A.I. Itself <\/strong><\/a>— from nytimes.com by Aatish Bhatia
\nAs A.I.-generated data becomes harder to detect, it\u2019s increasingly likely to be ingested by future A.I., leading to worse results.<\/em><\/p>\n

All this A.I.-generated information can make it harder for us to know what\u2019s real. And it also poses a problem for A.I. companies. As they trawl the web for new data to train their next models on \u2014 an\u00a0increasingly challenging task\u00a0\u2014 they\u2019re likely to ingest some of their own A.I.-generated content, creating an unintentional feedback loop in which what was once the output from one A.I. becomes the input for another.<\/p>\n

In the long run, this cycle may pose a threat to A.I. itself.\u00a0Research\u00a0has\u00a0shown\u00a0that\u00a0when generative A.I. is trained on a lot of its own output, it can get a lot worse.<\/p>\n

\n
\n

This weekend, the @xAI<\/a> team brought our Colossus 100k H100 training cluster online. From start to finish, it was done in 122 days.<\/p>\n

Colossus is the most powerful AI training system in the world. Moreover, it will double in size to 200k (50k H200s) in a few months.<\/p>\n

Excellent\u2026<\/p>\n

\u2014 Elon Musk (@elonmusk) September 2, 2024<\/a><\/p><\/blockquote>\n