Groq vs Ollama

Hardware Specialization Returns For AI Inference Era

The a16z newsletter article revisits the historic debate between general-purpose and specialized chips, arguing that the pendulum has swung back in favor of specialized hardware for AI inference. It details how general-purpose CPUs won in the 1990s due to volume-driven performance gains, but shifts to GPUs and the end of Dennard scaling changed the landscape. The article highlights that specialized chips like Nvidia's LPU (formerly Groq), Cerebras, and d-Matrix are now complementary to GPUs, delivering better performance per watt for heterogeneous inference workloads. It reports that GPUs have surpassed CPUs in revenue, and that inference demand is expected to grow 24x while power availability only doubles by 2030. The author, from Gimlet, advocates for orchestrating diverse accelerators to maximize efficiency.

• GPUs generated more revenue than CPUs for chip companies.
• Nvidia acquired Groq, now known as Nvidia's LPU.
• Inference demand is projected to increase 24x from 2026 to 2030, while power availability only doubles.

Nvidia's $20B Groq Deal Faces Stockholder Lawsuit

A lawsuit filed by former Groq engineers Joshua Rubin and Benjamin Serebrin alleges that Nvidia's $20 billion deal with Groq "squeezed out" stockholders. The complaint, filed on October 2 at the Delaware Court of Chancery, claims the deal offered a "lowball" price and that Groq's board approved the transaction without a required stockholder vote. The lawsuit argues that a conflicted board cost stockholders billions of dollars, pointing to $17 billion allocated to a non-exclusive license and $3 billion in Nvidia RSUs for employees. Groq dismissed the lawsuit as "meritless," stating the licensing agreement with Nvidia delivered exceptional value. Nvidia has not commented. The deal, announced in December, involved a licensing agreement for Groq's inference technology, with CEO Jonathan Ross and other leaders joining Nvidia, but Groq remains an independent company.

• Former Groq engineers Joshua Rubin and Benjamin Serebrin filed a lawsuit on Oct. 2 alleging Nvidia's $20B deal with Groq shortchanged stockholders.
• The lawsuit claims Groq's board approved the transaction without a required stockholder vote and that the deal cost stockholders 'billions of dollars.'
• The deal allocated $17 billion for a non-exclusive license and $3 billion in Nvidia RSUs for moving employees.

Groq Founder: Poor Leadership Cost Company Years

Jonathan Ross, founder of AI chip maker Groq, admitted in a podcast that his management failures initially cost the company three to four years. A former Google engineer, Ross founded Groq in 2016 to develop Language Processing Units (LPUs) as alternatives to Nvidia GPUs. He acknowledged being 'a terrible leader' at the start, citing mistakes in hiring employees who were not self-sufficient and giving them too much responsibility, leading to stagnation. He learned to focus on people management and became more selective in hiring. In December 2025, Nvidia signed a $20 billion licensing and talent deal with Groq, after which Ross and other key engineers moved to Nvidia, where Ross now serves as chief architect for software. Groq continues as an independent company led by Adam Winter. Similar leadership challenges were shared by Figma CEO Dylan Field and Duolingo CEO Luis von Ahn.

• Jonathan Ross founded Groq in 2016 to develop AI inference chips (LPUs) as alternatives to Nvidia GPUs.
• Ross admitted that his poor leadership set back Groq by three to four years.
• In December 2025, Nvidia signed a $20 billion license and talent deal with Groq.

DeepSeek Launches V4.1 Flash with Novel Encoder-Decoder Architecture

DeepSeek released DeepSeek-V4.1-Flash, a 763B-parameter mixture-of-experts model employing a novel causal encoder-decoder architecture with 8B active parameters for prefill and 16B for decode. It features native vision understanding, 1M token context, an MIT license, and extreme inference efficiency, claiming up to 1/8 KV cache footprint versus V4 Flash. Independent evals (Artificial Analysis Index 40, Vals Index #1 open-weight) show it surpasses V4 Pro at lower cost. API pricing is $0.30/1M input and $1.20/1M output tokens. DeepSeek has soft-retired V4 Pro, routing traffic to V4.1 Flash. The model supports SSD offload and local deployment, with Ollama and Baseten offering day-0 support. Technical discussions highlight the architecture's novelty and potential impact on long-context agents.

• DeepSeek launched V4.1-Flash with a causal encoder-decoder architecture, 763B total params (8B prefill/16B decode active).
• Artificial Analysis Index scores V4.1-Flash at 40, above V4 Pro and below GLM-5.3-Flash.
• API pricing: $0.30 per 1M input tokens, $1.20 per 1M output tokens, cached input $0.006 per 1M.

Ollama's transparent pricing

Ollama's Pro, Max, and Team plans now use industry-standard per-token pricing with usage included on every plan.

Developer Builds Autonomous AI Agent to Hunt Paid Bounties

A developer built an autonomous AI agent that scans hundreds of online gig/bounty listings, filters scams and human-only tasks, generates deliverables using live market data and a local LLM, and notifies a human for approval. The stack uses free tools (Python orchestration, Ollama with a local model, Chart.js, public crypto APIs, GitHub Pages, Windows Task Scheduler) resulting in $0/month infrastructure cost. In 48 hours the agent found many listings but only a handful were actionable due to geo-walls, ghost sponsors, and other filters; the author highlights the need for revenue tracking and human-in-the-loop oversight.

• Author built an autonomous AI agent that scans 232+ listings across multiple platforms to find paid work and generate deliverables.
• Stack used: Python orchestration, Ollama with qwen3:4b (local LLM), Chart.js, CoinGecko, DeFiLlama, Solana RPC, GitHub Pages, and Windows Task Scheduler.
• Total stated infrastructure cost: $0/month.