For site owners
CareJobsNowBot, CareJobs.Now's crawler
CareJobs.Now is a free job board for people who work in healthcare. Its crawler reads employers' public job listings once a night so that job seekers find every open job in one place, each linking to the employer's own application.
How it works
What our crawler does, and what it never does
What it reads
The public job listings of healthcare employers (their own career sites and the hiring systems those sites use) and of job boards that publish theirs, so that CareJobs.Now can list each open job with a link to the employer's own application. It reads nothing behind a sign-in, a paywall or a bot check, and it never applies, signs up or submits a form.
How it identifies itself
Every request names it: the user agent "CareJobsNowBot/1.0 (+https://carejobs.now; healthcare job aggregator)". Each request also carries a Web Bot Auth signature (an HTTP message signature, RFC 9421, by an Ed25519 key) whose public key is published at https://carejobs.now/.well-known/http-message-signatures-directory, so a site or its network can verify that a request naming CareJobsNowBot is really ours.
The rules it keeps
It reads robots.txt first and never asks for a path it disallows, for CareJobsNowBot or for all crawlers. It waits the Crawl-delay a site asks between requests, holds a few requests at a time to any one host, backs off when a host answers "too many requests" and stops asking a host that keeps refusing. Each employer's listings are read once a night (05:00 to 07:00 UTC), and a job's own page only when the job is new to us or no longer listed.
Contact
Reaching us about the crawler
To have your listings read differently, more slowly or not at all, say so in your robots.txt (it is read again every night) or write to us, and we will answer. More about the board is on the About page.