Regarding the margins, it's also clearly their strategy to undercut OpenAI and Anthropic and apply margin compression towards their businesses in a way that they can't afford.
Google has been quite aggressive with this strategy and it's both hurt the field (limiting the ability of those companies to scale their business relevant to the value created), as well as forced them to optimize and outcompete on efficiency and product outcomes.
Cost per view model to start with is an odd choice. Safe for them. I understand the reasoning. But not so reassuring for advertisers who have been so accustomed to paying for clicks. Curious where this goes. There's a huge potential of knowing intent and context.
Who can afford $100B over 4 or 5 years for data center? Very few are capable. The list is incredibly short. Maybe: 1. Microsoft/OpenAI 2. Google 3. Amazon 4. Apple 5. Meta 6. Maybe Elon (it is possible that there are enough crazy people to put money on Elon) Anyone else? I am increasingly doubtful if more than 3 or 4 will bother to invest at this level for training. In 3 or 4 years, there may be no one willing to invest at this level for training.