Kudurru
Click to visit website
About
Kudurru is a service by Spawning that actively blocks AI scrapers from websites. It uses a defense network to identify and reject or misdirect requests from active web scrapers. The network includes over a thousand websites hosting millions of media links used in popular datasets for training Generative AI models. It offers real-time protection, extensive coverage, and is easy to join, with a Wordpress plugin available and more plugins planned for other web providers. Kudurru also allows users to misdirect scrapers by serving alternative images, influencing the output of AI models. Kudurru temporarily blocks clients who appear to be actively scraping datasets.
Platform
Features
• real-time protection
• easy to join
• extensive coverage
FAQs
How does it work?
Kudurru monitors popular AI datasets for scraping behavior, and coordinates amongst the network to quickly identify scrapers. When a scraper is identified, its identity is broadcast to all protected Kudurru sites. All Kudurru sites then collectively block the scraper from downloading content from their respective host. When the scraper is finished, Kudurru informs the network and traffic is allowed to proceed as normal.
Is rejecting scrapers my only option with Kudurru?
In addition to rejecting scrapers, you can also select an alternative image to return in place of the images that scrapers are requesting. This misdirection can cause models to form inaccurate associations with your style and influence the output they produce.
Is the Kudurru network currently active?
Yes, the network has over one thousand active websites hosting millions of pieces of media found in popular AI datasets. The map at the top of this page is a live view into the web scrapers who are working their way through those datasets and are being blocked from the content hosted on protected websites.
I already opted out with Spawning/robots.txt/etc. Why do I need Kudurru?
Opt-outs are requests for web scrapers. Kudurru is not a request. While the EU requires opt-outs to be respected when training commercial AI models, many organizations currently ignore them. Websites using Kudurru will reject or misdirect identified web scrapers, even those who ignore opt-outs.
What hosting platforms are supported?
Our first easy-to-use plugin is for Wordpress websites. We'll continue to develop plugins for other platforms based on the beta waitlist. If you self-host your website and would like to participate in the beta, please email us at **kudurru@spawning.ai**. We're happy to walk you through a manual install.
Can I choose certain web scrapers to allow?
In the current beta (as of October 12, 2023), Kudurru rejects all media requests from every identified web scraper. We've seen several educational institutions scraping these datasets, and we are planning to give Kudurru users the option to allow educational institutions access soon.
I have a feature request, how can I get in touch?
Please send us an email at **kudurru@spawning.ai**.
Is Kudurru open source?
The source code for the current beta version of Kudurru's wordpress plugin is available to members of Kudurru's network. Before leaving beta, we expect to make the code available on GitHub.
What happens if scrapers identify members of the Kudurru network?
Scrapers could choose to avoid scraping those domains, and that's kind of the point.
What was the inspiration for Kudurru?
We were inspired by the excellent paper, “Poisoning Web-Scale Training Datasets is Practical” by Carlini et al. You can download the paper at this link: <https://arxiv.org/abs/2302.10149>. The authors describe “split-view poisoning,” which takes advantage of the static nature of AI training datasets. We extend this idea to a dynamic context, with live websites coordinating to identify scrapers and react to their activity in real time. If you're a researcher who finds Kudurru interesting, feel free to reach out! We have extensive datasets prepared for people just like you. We'd love to hear your thoughts and insights.
Job Opportunities
There are currently no job postings for this AI tool.
Ratings & Reviews
No ratings available yet. Be the first to rate this tool!
Featured Tools
Songmeaning
Songmeaning uses AI to reveal the stories and meanings behind song lyrics. It offers lyric translation and AI music generation.
View Details
Whisper Notes
Offline AI speech-to-text transcription app using Whisper AI. Supports 80+ languages, audio file import, and offers lifetime access with a one-time purchase. Available for iOS and macOS.
View Details
GitGab
Connects Github repos and local files to AI models (ChatGPT, Claude, Gemini) for coding tasks like implementing features, finding bugs, writing docs, and optimization.
View Details
nuptials.ai
nuptials.ai is an AI wedding planning partner, offering timeline planning, budget optimization, vendor matching, and a 24/7 planning assistant to help plan your perfect day.
View Details
Make-A-Craft
Make-A-Craft helps you discover craft ideas tailored to your child's age and interests, using materials you already have at home.
View DetailsPixelfox AI
Free online AI photo editor with comprehensive tools for image, face/body, and text. Features include background/object removal, upscaling, face swap, and AI image generation. No sign-up needed, unlimited use for free, fast results.
View Details
Smart Cookie Trivia
Smart Cookie Trivia is a platform offering a wide variety of trivia questions across numerous categories to help users play trivia, explore different topics, and expand their knowledge.
View Details
Code2Docs
AI-powered code documentation generator. Integrates with GitHub. Automates creation of usage guides, API docs, and testing instructions.
View Details