Recently, we talked to Dan Fu and Tri Dao – authors of “Hungry Hungry Hippos” (aka “H3”) – on our Deep Papers podcast. H3 is a proposed language modeling architecture that performs comparably to ...
Dr. Lewis’ presentation, titled “State-Space Models vs Transformers at the Extreme Edge: Architectural Choices for Low Power AI,” will examine the trade-offs and opportunities in designing AI models ...
It’s becoming increasingly costly to develop and run AI. OpenAI’s AI operations costs could reach $7 billion this year, while Anthropic’s CEO recently suggested that models costing over $10 billion ...