Observed Signal · Mar 11, 2024 · Technical Release · Source: Trending Topics · Impact: 2/5 · Sentiment: Neutral
Claude-3 Tops AI IQ Ranking, Beats ChatGPT-4
Blogger Maxim Lott conducted an IQ test on current AI models using a 35-question verbal translation of the Norwegian Mensa IQ test. Anthropic's Claude-3 achieved an IQ of 101, the first AI to surpass the average human IQ of 100, and outperformed OpenAI's ChatGPT-4, which scored 85. The test focused on reasoning rather than visual interpretation. Claude-1 and Claude-2 scored 64 and 82 respectively, while Microsoft's Bing Copilot and Google's Gemini scored 79 and 77.5. Lott projects future models could reach IQs of 120-140, indicating rapid progress in AI development.
AI model IQ ranking showcases rapid progress in GenAI models, relevant to adtech tools, but not a major industry-shifting event.
Track Anthropic Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Anthropic's Claude-3 achieved an IQ of 101 in a verbal Mensa-based test.
- OpenAI's ChatGPT-4 scored an IQ of 85 on the same test.
- The test was a 35-question verbal translation of the Norwegian Mensa IQ test created by Maxim Lott.
- Claude-1 scored 64, Claude-2 scored 82, Bing Copilot scored 79, and Gemini scored 77.5.
- The article predicts next Claude model could reach IQ 120 in 12-16 months.
Connected Companies & Entities
4 Entities mapped“Anthropic's Claude-3 has been shown to beat its rivals, including OpenAI's ChatGPT-4, and is also the first AI to exceed the usual human IQ ...”
“When Lott ChatGPT-4 described the matrices in words, it resulted in an assessable IQ. On average, OpenAI's model answered an average of 13 o...”
“In fourth place is Bing Copilot from Microsoft with an IQ of 79....”
“In fifth place is Gemini from Google with an IQ of 77.5....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AI Stocks Sink as OpenAI Revenue Misses Reported Figure
Shares of Nvidia, Oracle, CoreWeave and other AI-related companies fell on Thursday after details emerged about OpenAI's revenue. OpenAI told investors it reached roughly $50 billion in annualized revenue at the end of September, lower than the widely reported $68 billion figure. A person familiar with the matter said the $68 billion figure included gross revenue from partners, making it more comparable to Anthropic. OpenAI also highlighted 77% total run rate growth in Q3 and 107% growth in enterprise business. The company is preparing for a potential IPO, with a valuation of $852 billion, and is in early talks to raise around $30 billion in new funding.
Microsoft Xbox creates new division for films, series, parks
Microsoft's Xbox gaming division announced the creation of a new business unit dedicated to films, television series, and theme park attractions. The move signals an expansion into entertainment and immersive experiences beyond video games, leveraging Xbox's intellectual property. This strategic diversification is part of Microsoft's broader ambition to grow its media and entertainment footprint, following trends seen across the industry. The new division will focus on developing and producing content based on Xbox franchises, potentially opening new revenue streams for the company. Financial details or a timeline for the division's operations have not been disclosed.
US Government Excludes Microsoft from Visa Program
The US government has barred Microsoft from participating in the permanent residency process for foreign workers with H-1B visas, accusing the company of abusing the program. Vice President JD Vance stated that Microsoft laid off 6,000 American employees last year while benefiting from 6,300 H-1B visa holders. The Department of Labor, led by Keith Sonderling, will not accept new permanent residency applications from Microsoft, as well as several consulting firms and Adobe. This action comes weeks before the midterm elections and reflects the Trump administration's broader criticism of the H-1B program, which it claims disadvantages American workers. Microsoft has not yet responded. The move could impact the tech industry's ability to retain skilled foreign talent.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.