Observed Signal · Sep 18, 2020 · Technical Release · Source: OnlineMarketing.de · Impact: 4/5 · Sentiment: Neutral
Googlebot to crawl HTTP/2 pages starting mid-November
Google announced that Googlebot will begin crawling a subset of pages over HTTP/2 starting in mid-November 2020. Pages will be crawled via HTTP/2 only if the server supports the protocol and site owners opt in; sites using HTTP/1.1 will continue to be crawled as before. HTTP/2 is described as faster and more efficient because a single TCP connection can multiplex multiple data streams, reducing server resource usage during crawling. Initially, only isolated pages will be crawled via HTTP/2, with gradual expansion over time. Page operators can opt out by returning a 421 HTTP status code or by contacting the Googlebot team. Google references its official blog posts and the Google Webmasters Twitter announcement for context. The development underscores Google's focus on crawl efficiency and protocol evolution in the indexing process.
Technical release by a major platform (Google) impacting crawling/infrastructure; high industry relevance but not consumer-facing.
Track Google Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- Googlebot will crawl pages over HTTP/2 starting mid-November 2020.
- Crawling over HTTP/2 occurs only for servers that support the protocol and when operators do not opt out.
- Opt-out is possible via a 421 HTTP status response or by contacting the Googlebot team.
- HTTP/2 enables multiplexing over a single TCP connection, reducing server resource usage during crawling.
- Initial rollout will be limited to isolated pages, with broader adoption later.
Connected Companies & Entities
1 Entity mappedRelated Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Google launches unified agentic AI for Gemini
At a Google Cloud event on Thursday, Google announced it is bringing agentic AI to its Gemini assistant, launching a unified agent that can autonomously plan and execute tasks on behalf of users. Aimed initially at businesses, the agent can connect to internal systems and external tools, use custom skills, and even choose from third-party models like Anthropic's Claude. It will have its own Workspace account with an email address, and will write its own audit trail. Early testers include On, Shopify, and PayPal. Gemini has over 1 billion monthly active users, and nearly 90% of Fortune 100 companies use Gemini Enterprise.
US Government Excludes Microsoft from Visa Program
The US government has barred Microsoft from participating in the permanent residency process for foreign workers with H-1B visas, accusing the company of abusing the program. Vice President JD Vance stated that Microsoft laid off 6,000 American employees last year while benefiting from 6,300 H-1B visa holders. The Department of Labor, led by Keith Sonderling, will not accept new permanent residency applications from Microsoft, as well as several consulting firms and Adobe. This action comes weeks before the midterm elections and reflects the Trump administration's broader criticism of the H-1B program, which it claims disadvantages American workers. Microsoft has not yet responded. The move could impact the tech industry's ability to retain skilled foreign talent.
US suspends Microsoft, Adobe from green card labor program
The Trump administration has suspended Microsoft, Adobe, and six other major tech firms—Capgemini, Cognizant, HCL, Infosys, Tata, and Wipro—from the U.S. Permanent Labor Certification program, which facilitates green cards for skilled foreign workers. Secretary of Labor Keith Sonderling cited active federal investigations and alleged fraud, noting that no new or pending applications from these companies will be accepted. Vice President JD Vance accused Microsoft of replacing laid-off workers with H-1B visa holders. Microsoft defended its practices, stating that most U.S. employees are American and that 80% of its H-1B petitions were for existing employees. The announcement was made during a White House summit on H-1B fraud, and the administration also plans to investigate nine universities, including Harvard, Yale, and Stanford, over student visa program abuse.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.