This demo / reference implementation demonstrates access to protected / premium website content by a "paying" web crawler. The web crawler creates KYAPay tokens and delivers them to the website in every request. The bot blocker / web application firewall protecting the website validates / verifies the token and grants access to the website. If the token is missing or its balance is depleted, then the bot blocker / web application firewall returns an HTTP 402 status to the web crawler along with information on how to acquire / create the KYAPay tokens.
We have included source code for all the parties involved
- Web crawler
- Bot blocker
Artifacts
- Demo video: https://youtu.be/onkJ1LlS7q8?feature=shared
- Live demo: https://crawler-demo.skyfire.xyz/
- GitHub repo: https://github.com/skyfire-xyz/skyfire-solutions-smart-web-crawler-demo
This demo showcases the versatility of the KYAPay protocol and the near universal applicability of the protocol in enabling agentic commerce.