Observed Signal · Aug 12, 2026 · Technical Release · Source: DEV Community · Impact: 2/5 · Sentiment: Positive
Detecting Deleted YouTube Videos with JSONL Diffing
The author discovered 11 YouTube videos deleted from a channel after their analytics pipeline reported uploads as successful. The YouTube Data API v3 omitted the deleted videos, so the pipeline's input-side health checks (which monitor local queue state and upload timestamps) did not notice. The author implemented detect_disappeared(), which diffs a live videos.list fetch against a JSONL history (one row per date/video_id) to surface disappearances, appending rows with status: "disappeared" to history and excluding those markers from future snapshots and median calculations. A subtle bug where disappeared markers were previously counted as presences was fixed by filtering out status: "disappeared" rows when building the prior snapshot. The article documents outputs (GitHub Actions warning annotation and a daily report table), test coverage, and considerations for false positives and monitoring improvements.
Practical technique for publishers and analytics pipelines to detect removed content and avoid survivorship bias; useful for measurement accuracy but not industry-shifting.
Track GitHub Signals & Market Shifts in Real-Time
Polaris7 autonomous intelligence agents track regulatory filings, primary sources, executive changes, and deal flow 24/7. Create your free Explorer workspace to monitor these entities.
Key Takeaways & Evidence Grounding
- The author found 11 videos deleted from a tracked YouTube channel after an analytics cron run.
- The YouTube Data API v3 omitted deleted videos entirely, making them distinguishable from unlisted/private in this setup.
- detect_disappeared() compares today's live videos.list response to the most recent JSONL history snapshot and reports IDs absent from the live set.
- A bug where history rows with status: "disappeared" were treated as presence was fixed by filtering those rows out when building the prior snapshot.
- The webpage indicates a publication date of 2026-08-12.
Connected Companies & Entities
2 Entities mapped“It opens GitHub Issues when a cron doesn't fire, when the queue goes stale, or when an upload timestamp is missing....”
“The YouTube Data API v3 omitted them entirely, which means deleted rather than unlisted or private....”
Ontology Mapping & Concepts
Related Market Signals & Shifts
Recent verified developments and strategic activity across this market segment.
Fully Automated Daily YouTube Shorts Channel
A developer describes building "Progress Bar of the Year", a fully automated YouTube Shorts channel that uploads a vertical video each morning showing the percentage of the year elapsed plus a short historical fact. The pipeline is implemented in JavaScript/TypeScript and uses Google Gemini API to generate daily historical facts, Remotion (React-based) to programmatically render animated MP4 videos, and the YouTube Data API v3 to upload videos. Orchestration is handled by a Bash script scheduled via crontab on a local Mac mini; OAuth2 refresh tokens are stored to automatically refresh YouTube access tokens. The article outlines design choices, idempotency checks, logging, and possible future extensions like localization and analytics.
LearnCurator: AI-ranked YouTube Tutorial Search
A developer-built product called LearnCurator is a YouTube tutorial search engine that filters out short and non-relevant videos, ranks results using engagement and recency metrics, and enriches rankings with sentiment scores derived from AI analysis of YouTube comments. The system uses YouTube Data API v3 for video data, Gemini 1.5 Flash for comment sentiment, Netlify Functions for backend, and Supabase for feedback storage and caching. A live demo is available at learncurator.netlify.app and the author published the write-up on May 18, 2026.
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.