Observed Signal · Oct 23, 2023 · Study Publication · Source: Trending Topics · Impact: 2/5 · Sentiment: Negative
Stanford Study Finds Alarming Lack of Transparency in AI Models
The Stanford Center for Research on Foundation Models (CRFM) published the Foundation Model Transparency Index (FMTI), developed with researchers from Princeton and MIT to measure how transparent AI companies are about their large language models. Findings showed the highest transparency scores were only between 47 and 54 on a 0–100 scale. Meta's Llama 2 ranked first at 54, while OpenAI scored 47, Google 41, and Anthropic 39. Rishi Bommasani, CRFM Society Lead, warned that current opacity creates challenges for businesses, policymakers, academics, and consumers. The research argues that limited transparency makes it harder for companies to safely build on commercial foundation models, for academics to conduct independent research, for regulators to design meaningful policies, and for consumers to understand model limitations or seek redress. OpenAI has described its reduced openness as a precaution, saying it moved away from releasing everything to sharing access securely.
The FMTI documents declining transparency among major AI model providers, a systemic issue relevant to AI-powered marketing and advertising technologies and regulatory oversight; however, it is an academic study with no immediate operational impact on the AdTech ecosystem.
Track OpenAI Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Stanford University researchers developed the Foundation Model Transparency Index (FMTI).
- Meta's Llama 2 received the highest transparency score of 54 out of 100.
- OpenAI received a transparency score of 47 percent.
- Google scored 41 percent, and Anthropic scored 39 percent.
- Rishi Bommasani and researchers from Stanford, Princeton, and MIT built the index.
Connected Companies & Entities
4 Entities mapped“OpenAI had a transparency score of 47 percent and described its lack of transparency as a precaution....”
“Meta's Llama 2 took the top position in the transparency ranking with a score of 54....”
“Google scored only 41 percent in the Foundation Model Transparency Index....”
“Anthropic reached a transparency score of 39 percent....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
AI Stocks Sink as OpenAI Revenue Misses Reported Figure
Shares of Nvidia, Oracle, CoreWeave and other AI-related companies fell on Thursday after details emerged about OpenAI's revenue. OpenAI told investors it reached roughly $50 billion in annualized revenue at the end of September, lower than the widely reported $68 billion figure. A person familiar with the matter said the $68 billion figure included gross revenue from partners, making it more comparable to Anthropic. OpenAI also highlighted 77% total run rate growth in Q3 and 107% growth in enterprise business. The company is preparing for a potential IPO, with a valuation of $852 billion, and is in early talks to raise around $30 billion in new funding.
US Government Excludes Microsoft from Visa Program
The US government has barred Microsoft from participating in the permanent residency process for foreign workers with H-1B visas, accusing the company of abusing the program. Vice President JD Vance stated that Microsoft laid off 6,000 American employees last year while benefiting from 6,300 H-1B visa holders. The Department of Labor, led by Keith Sonderling, will not accept new permanent residency applications from Microsoft, as well as several consulting firms and Adobe. This action comes weeks before the midterm elections and reflects the Trump administration's broader criticism of the H-1B program, which it claims disadvantages American workers. Microsoft has not yet responded. The move could impact the tech industry's ability to retain skilled foreign talent.
US suspends Microsoft, Adobe from green card labor program
The U.S. Department of Labor announced the suspension of Microsoft and Adobe from its Permanent Labor Certification program, along with Cognizant, Infosys, Capgemini, Tata, Wipro, and HCL. Secretary Keith Sonderling cited active federal investigations for Microsoft and Adobe, and criticized the companies for allegedly taking jobs from American workers. Vice President JD Vance specifically accused Microsoft of replacing laid-off workers with H-1B visa holders. Microsoft responded by defending its hiring practices, stating that the majority of its U.S. employees are Americans and that most H-1B petitions are for existing employees. The announcement was made during a White House summit on H-1B fraud, coinciding with President Trump honoring several tech CEOs with the National Medal of Science.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.