About ScreenEDBot
ScreenED is in pilot development. Today ScreenEDBot visits only a short list of education websites, slowly and occasionally. This page says what it does and how to stop it.
What it is
ScreenEDBot is the automated program that ScreenED uses to read public web pages so that a school's search tool can show students the title, address and a short summary of good pages, and send them to your site to read the rest. Students can only open pages their school has approved, so every visit that comes from ScreenED is a student on a school-managed Chromebook looking at a page their teacher or school chose.
How to recognise it
| Name | ScreenEDBot |
|---|---|
| User agent | ScreenEDBot/0.1 (+https://screenedforschools.com/screenedbot; [email protected]) |
| Contact | [email protected] or the support form |
How it behaves
- It reads your robots.txt first and follows it, including Disallow and Crawl-delay.
- It makes no more than one request a second to a site, and slower when you ask for slower.
- It stops if your server answers with errors or "too many requests".
- It stays on the site it was sent to, skips search, login, cart and calendar pages, and skips pages marked noindex.
- It does not log in, fill in forms, or try to get around a block. If a site refuses it, it goes away. We would rather ask you.
- Where a site offers an official feed or API, we use that instead of visiting pages.
What it keeps
- A page's address, title and a short summary (usually the description you wrote for search engines).
- For small sites, a limited amount of the page's text so search can find it. For large sites, only titles and summaries.
- It does not keep pictures, videos or anything behind a login or paywall. Every result links back to your page.
How to opt out
Add this to your robots.txt:
User-agent: ScreenEDBot
Disallow: /
Or email [email protected]. We will stop visiting your site and remove its pages from our index. If you would like to talk about a feed, a slower schedule or a closer partnership, we would be glad to hear from you.