Commit Graph

48 Commits

Author SHA1 Message Date
Nubenetes Bot
9d13a6a21a fix: store gh_pushed as None instead of 'N/A' at enrichment source
The date field gh_pushed was written as the literal string 'N/A' when
GitHub data was unavailable (fast_enrich, gemini_utils). That non-date
string then reached datetime.fromisoformat() downstream. Now writes None
(which all readers already handle); gh_license keeps its 'N/A' string
sentinel since it is a displayed value, not a date.

Also hardens the twin fromisoformat() call in agentic_curator's MVQ
penalty check (guards N/A/None and wraps parsing) so a bad value can't
crash a curation batch.

Adds scripts/normalize_gh_pushed.py to clean the 281 existing inventory
entries (run in CI to avoid SQLite float-serialization churn — see
script docstring).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-19 15:10:06 +02:00
Nubenetes Bot
4e87c248fd feat: implement AI-powered news digest engine, MkDocs UX overhaul, pipeline hardening, and stub page merges
- Add 26-category news digest engine (src/news_digest.py) with Gemini AI ranking
  for 3/6/12 month temporal panels across tech, cloud, and geo categories
- Add discovered_at, company, geo_region fields to inventory schema with backfill
  script populating 18K+ existing entries
- Fix critical v2-mkdocs.yml bug: plugins were nested under theme (silently disabled)
- Add MkDocs Material features: instant nav, breadcrumbs, footer, announce bar
- Add trending cards CSS grid and replace Agentic Pulse with dynamic Trending Now
- Generate tech-digest.md and industry-digest.md with tabbed 3/6/12 month views
- Merge 12 stub pages (<40 lines each) into parent categories with redirects
- Replace 50 bare except:pass patterns with contextual logging across all pipeline files
- Expand autonomous discovery from 6 to 14 GitHub search queries
- Add stale health re-check for online entries older than 30 days
- Track addition_method by source type (rss, twitter, github_trending)
- Add digest generation step to CI publish workflow

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-19 00:38:56 +02:00
Nubenetes Bot
44e607a83a feat: implement offline mock debate simulator and clickable tag filters sync 2026-06-18 03:17:22 +02:00
Nubenetes Bot
ff9087e3a2 feat(curation): achieve 100% coverage for AI enrichment and GitHub metadata metrics without Gemini API 2026-06-18 00:49:32 +02:00
Nubenetes Bot
dd273d53c6 perf(automation): massive parallelization for Health, Metadata and AI engines 2026-06-14 12:12:49 +02:00
Nubenetes Bot
425faacf89 fix: call_gemini_with_retry returns full list for JSON lists, enabling bulk evaluations 2026-06-01 23:35:55 +02:00
Nubenetes Bot
76196c5c35 fix(ai): force gemini flash usage and define impact_score in prompt 2026-06-01 14:40:11 +02:00
inafev
7e3d5a082f feat: sync V2 elite curated edition and README metrics [skip ci] 2026-05-24 15:40:08 +02:00
Nubenetes Bot
69eeca361b feat: integrate official YouTube Data API v3 for robust metadata extraction 2026-05-22 20:08:01 +02:00
Nubenetes Bot
e054cdc4f0 fix: update Gemini grounding tool name to google_search to resolve API 400 error 2026-05-22 19:44:05 +02:00
Nubenetes Bot
c7dedbeed1 fix: force Gemini Pro for video grounding and strengthen generic title detection 2026-05-22 19:40:37 +02:00
Nubenetes Bot
54abd7ac41 fix: resolve YouTube bot detection and force AI grounding for accurate video enrichment 2026-05-22 19:37:31 +02:00
Nubenetes Bot
75a6d8430c fix: robust YouTube extraction using yt-dlp and fix Markdown rendering in video hub 2026-05-22 19:15:49 +02:00
Nubenetes Bot
f7216afbd7 fix: implement AI Grounding fallback for YouTube to resolve platform hallucinations 2026-05-22 17:25:52 +02:00
Nubenetes Bot
cbee3d49c1 feat: standardize YouTube enrichment across all pipelines and modularize Video Hub workflow 2026-05-22 17:13:53 +02:00
Nubenetes Bot
1b6c518751 fix: resolve AI timeout bottleneck and enhance exception telemetry
- Increased httpx timeout to 180s to accommodate large JSON payloads.
- Added exception type name to telemetry logs for better diagnostic precision.
2026-05-21 14:33:48 +02:00
Nubenetes Bot
9bb60eef29 build: inject detailed telemetry logging for precise quota diagnostics
- Added payload size estimation (tokens) before requests.
- Added exact Token consumption (Prompt/Candidates) on success.
- Added exact error messages (response.text) on 429 and 50x errors to diagnose quota exhaustion limits (RPM vs TPM).
2026-05-21 13:45:04 +02:00
Nubenetes Bot
d05afb2970 fix: adjust batch size to 50 and enforce strict Lite-only policy
- Reduced BATCH_SIZE_FAST to 50 to prevent AI request timeouts.
- Hardened call_gemini_with_retry to strictly use Flash/Lite models when prefer_flash=True.
- Ensured newest model versions are prioritized within the Flash tier.
2026-05-21 11:25:50 +02:00
Nubenetes Bot
c31bcb23ea fix: resolve markdown linting errors and optimize V2 workflow performance 2026-05-20 17:57:00 +02:00
Nubenetes Bot
ecae477063 fix: resolve cross-key throttling and premature Tenacity backoff 2026-05-20 10:31:39 +02:00
Nubenetes Bot
4d14161d26 chore: modernize CI/CD, UI aesthetics, and documentation 2026-05-20 10:03:32 +02:00
Nubenetes Bot
29892a9848 feat: implement multi-agent Analyst-Auditor workflow for robust V2 tagging 2026-05-19 20:57:38 +02:00
Nubenetes Bot
28e07c83dd feat(v2): implement on-demand metadata enrichment and GH stars fetching 2026-05-19 19:14:21 +02:00
Nubenetes Bot
c2d450bcbc fix: restore protocol slashes and refine trailing slash removal logic 2026-05-18 19:42:18 +02:00
Nubenetes Bot
5947bf4a33 fix: enforce zero-trailing-slash policy and global URL normalization 2026-05-18 19:29:11 +02:00
Nubenetes Bot
e69f60de44 feat(ops): implement Mandate 34 for URL normalization and automate V2 sync 2026-05-18 15:28:51 +02:00
Nubenetes Bot
989c866681 fix(normalization): implement Mandate 34 to prevent recursive trailing slashes in URLs 2026-05-18 10:22:20 +02:00
Nubenetes Bot
f53bc4e043 feat(ai): integrate MCP-style Real-time Web Grounding across all curation and health workflows 2026-05-18 00:30:54 +02:00
Nubenetes Bot
537a09cc7d feat(ai): enforce robust TOC standards (no emojis, no ampersands) across all layers and document as Mandate 30 2026-05-17 16:42:08 +02:00
Nubenetes Bot
0ff0994d12 feat(ops): implement self-healing infrastructure, executive V2 introductions, and strict V1 preservation rules 2026-05-17 10:50:18 +02:00
Nubenetes Bot
1dbb7e8949 feat(ai): implement canonical URL updates, DB garbage collection, and memory efficiency metrics 2026-05-16 18:51:33 +02:00
Nubenetes Bot
1a8242aeeb feat(ai): harden architecture with global semaphore, token tracking, and quality-based upgrades 2026-05-16 14:21:38 +02:00
Nubenetes Bot
81db48afae feat(ai): implement adaptive multi-tier orchestration, global rate limiting, and document architecture 2026-05-16 14:19:06 +02:00
Nubenetes Bot
b7e644f15d perf(ai): implement smart batching and pre-flight caching to reduce API traffic by 90% 2026-05-16 14:04:58 +02:00
Nubenetes Bot
a62e6c0ad9 feat(ai): implement exponential backoff and adaptive rate limiting to prevent 429 loops 2026-05-16 13:46:54 +02:00
Nubenetes Bot
d347f3904a feat(ai): implement transparency suite with dynamic scoring and performance-first key rotation 2026-05-16 13:33:20 +02:00
Nubenetes Bot
d2e9c0d7bf feat(gemini): implement Dynamic AI Model Discovery and Scoring Engine 2026-05-16 13:04:48 +02:00
Nubenetes Bot
603ef5d5a5 fix: resolve V2 optimizer issues (models 404, parsing errors, empty exceptions) 2026-05-15 01:08:45 +02:00
Nubenetes Bot
71505dff0a fix: improve rate-limit handling and add granular logging for curation 2026-05-14 22:03:07 +02:00
Nubenetes Bot
bfebd939f1 chore: localize PR reports, logs, and core utilities to English 2026-05-14 21:09:13 +02:00
Nubenetes Bot
fdfee39bba feat: implement MVQ, descriptive style guide, and optimized API rotation 2026-05-14 20:51:01 +02:00
Nubenetes Bot
9690bc501c feat: optimize curation workflow with parallel URL expansion and repository consolidation 2026-05-14 18:43:30 +02:00
Nubenetes Bot
2cbca0fbe0 feat: enhance curation engine with robust retries, detailed logging, and branch-specific workflows 2026-05-14 18:30:29 +02:00
Nubenetes Bot
42d7da9e8b feat: implement granular real-time logging, batch processing, and multi-key API rotation 2026-05-14 17:21:52 +02:00
Nubenetes Bot
f2b064e9a8 fix: optimize Gemini model list and implement aggressive backoff for 429/503 errors 2026-05-12 18:34:19 +02:00
Nubenetes Bot
5df404a161 fix: resolve Gemini API 404/503 errors and workflow permission issues 2026-05-12 13:27:21 +02:00
Nubenetes Bot
f8cd680400 fix(gemini): enhance API diagnostics and add gemini-1.5-pro fallback 2026-05-12 10:22:03 +02:00
Nubenetes Bot
dd666d8e6f fix(gemini): implement resilient model rotation and v1beta endpoint to fix 404 errors 2026-05-11 22:49:32 +02:00