Trust · For school web teams
How Prospecta reads school athletics pages
Prospecta helps families research college sports programs. To show coach background that families can trust, we read a small number of public pages on official school athletics websites. Our crawler is called ProspectaCoachBot. This page explains what it reads, how slowly it goes, and how to ask us to stop.
What we read
Public coach and staff pages, coach biography pages, and team schedule and results pages on official school athletics sites. That is all.
We do not read athlete profiles or rosters, we do not log in anywhere, and we do not follow links to other websites.
Why
Families want to know who they would be playing for: how long a coach has been at the school, where they coached and played before, and how the team has done. We show those facts with a link to the school page they came from and the date we checked it, so families can always see the source for themselves.
How slowly
One request every 10 seconds or slower per site. If your robots.txt sets a longer Crawl-delay, we use yours. If your site tells us it is busy, we wait and try again later, and if it blocks us, we stop.
robots.txt and opting out
We read your robots.txt before we crawl and follow the rules for ProspectaCoachBot and for *. If either group disallows a page, we skip it.
To opt out of everything, add this to your robots.txt:
User-agent: ProspectaCoachBot Disallow: /
Or email us with your site address and we will exclude the site.
Contact
Questions or requests: help@getprospecta.ai
Our requests identify themselves with this user agent:
ProspectaCoachBot/1.0 (+https://www.getprospecta.ai/crawler)