About our crawler
How Join a Startup collects job listings, and how to ask us to stop or to remove something.
Join a Startup lists jobs that employers publish on their own careers pages and hiring systems. Our crawler is called JoinAStartupBot, and its requests carry that name. When we read an employer's own web pages, we check its robots.txt file and avoid paths it asks crawlers to stay away from. We also read publicly accessible job feeds from hiring systems. If a site returns an error or asks us to slow down, we wait before trying again.
If you want us to stop collecting from a careers site, or you want a job or company listing removed or corrected, send us a request. You can write as a company representative, or as the rights holder or their authorised representative for the content. Tell us which careers site, company or listing page you mean and what you would like us to do. If your concern is about copyright or personal information, say so. We review each request and may ask for details to confirm who you are before we act.