AI Foundation Models for the Rest of Us — from future.a16z.com by Elliot Turner
Excerpt:
While 2012’s state-of-the-art systems could be trained on a $700 video game card, today’s state-of-the-art systems – often referred to as foundation models – likely require tens of millions of dollars in computation to train.
The emergence of these massive-scale, high-cost foundation models brings opportunities, risks, and limitations for startups and others that want to innovate in artificial intelligence and machine learning.