Observed Signal · Apr 9, 2024 · Product Launch · Source: Trending Topics · Impact: 2/5 · Sentiment: Positive
AI2 Releases Fully Open LLM OLMo with Training Data
The Allen Institute for AI (AI2) has launched OLMo, a new large language model (LLM) designed to redefine open source AI by releasing the complete training data alongside the model. OLMo is built on the Dolma dataset, containing three trillion tokens, and is available in four 7B-scale variants trained on at least 2 trillion tokens each. The release includes full model weights, inference code, training metrics, protocols, and over 500 checkpoints per model. OLMo's performance is benchmarked against other open-source models like Meta's Llama 2, Falcon 7B, and MPT 7B, not commercial models like GPT-4 or Gemini. The project aims to increase transparency in LLM research. OLMo was trained on the LUMI supercomputer in Finland. AI2 lists Meta, Microsoft, and Databricks as partners.
Significant open-source LLM release from a non-profit, but impact on AdTech is indirect and limited in immediate scale.
Track Meta Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- AI2 released OLMo, an open-source LLM with complete pretraining data.
- OLMo is based on the Dolma dataset with 3 trillion tokens.
- Four OLMo model variants on 7B scale were trained with at least 2T tokens each.
- More than 500 checkpoints per model are publicly available.
- OLMo was benchmarked against Llama 2, Falcon 7B, and MPT 7B.
Connected Companies & Entities
8 Entities mapped“AI2 compared OLMo to Meta's Llama 2, and Meta is also listed as a partner....”
“AI2 has Microsoft as a partner, according to the article....”
“AI2 has Databricks as a partner; Databricks is the parent company of MosaicML....”
“OLMo is distributed via Hugging Face....”
“Mentioned as a comparison point, its GPT-4 is not used for benchmarks....”
“Mentioned as a comparison point, its Gemini 1.5 is not used for benchmarks....”
“Mentioned as a comparison point, its Claude 3 is not used for benchmarks....”
“Finnish AI startup also works with the LUMI supercomputer....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Google launches unified agentic AI for Gemini
At a Google Cloud event on Thursday, Google announced it is bringing agentic AI to its Gemini assistant, launching a unified agent that can autonomously plan and execute tasks on behalf of users. Aimed initially at businesses, the agent can connect to internal systems and external tools, use custom skills, and even choose from third-party models like Anthropic's Claude. It will have its own Workspace account with an email address, and will write its own audit trail. Early testers include On, Shopify, and PayPal. Gemini has over 1 billion monthly active users, and nearly 90% of Fortune 100 companies use Gemini Enterprise.
Microsoft Xbox creates new division for films, series, parks
Microsoft's Xbox gaming division announced the creation of a new business unit dedicated to films, television series, and theme park attractions. The move signals an expansion into entertainment and immersive experiences beyond video games, leveraging Xbox's intellectual property. This strategic diversification is part of Microsoft's broader ambition to grow its media and entertainment footprint, following trends seen across the industry. The new division will focus on developing and producing content based on Xbox franchises, potentially opening new revenue streams for the company. Financial details or a timeline for the division's operations have not been disclosed.
US Government Excludes Microsoft from Visa Program
The US government has barred Microsoft from participating in the permanent residency process for foreign workers with H-1B visas, accusing the company of abusing the program. Vice President JD Vance stated that Microsoft laid off 6,000 American employees last year while benefiting from 6,300 H-1B visa holders. The Department of Labor, led by Keith Sonderling, will not accept new permanent residency applications from Microsoft, as well as several consulting firms and Adobe. This action comes weeks before the midterm elections and reflects the Trump administration's broader criticism of the H-1B program, which it claims disadvantages American workers. Microsoft has not yet responded. The move could impact the tech industry's ability to retain skilled foreign talent.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.