Smart News Crawler Demo - News and Content given End-User Identity
This reference implementation demonstrates how to use kya tokens to gate agent and bot access to websites and APIs.
Content publishers can require agents and bots to present verified kya tokens that deliver the identity of their human end-user before accessing protected content. This allows publishers to preserve their relationship with human end-users while enabling legitimate agent access.
Artifacts
Watch how verified identity tokens allow bots to access protected publisher content.
Run the crawler yourself and observe identity-gated access in action.
Explore the full crawler and bot manager source code.
This demo showcases the versatility of the KYAPay protocol and the near universal applicability of the protocol in enabling agentic commerce.
The Problem
Publishers typically:
- Monetize through advertising impressions
- Sell subscriptions to human users
- Restrict automated scraping via bot management systems
As a result, most crawlers, bots, and agents are blocked by default.
However, blocking all automation prevents legitimate, user-authorized agents from accessing content on behalf of real people.
The Skyfire Solution
Skyfire enables agents and bots to present a verified identity token, a kya token, to websites and APIs.
A kya token:
- Cryptographically verifies the identity of the human principal, or business entity
- Is signed and auditable
- Allows agents to act on behalf of real users
- Preserves publisher visibility into end-user identity
What This Demo Includes
This demo includes source code for:
- Web crawler: Submits
kyatokens when accessing protected content - Bot manager: Verifies tokens before granting access
Together, these components demonstrate identity gated automation in practice.
Updated 10 days ago
