WorkFromAsia

Our crawler

WorkFromAsia reads public job listings from companies' careers pages and the job board systems they use (such as Greenhouse, Lever, Ashby and Workable).

It identifies itself with this user agent:

WorkFromAsiaBot/1.0 (+https://workfromasia.com/bot)

It only requests public listing pages and public job feeds, keeps the number of requests to each site small, backs off when a site asks it to slow down, and reuses cached responses when nothing has changed. On company websites it follows robots.txt: a Disallow for WorkFromAsiaBot (or for every crawler) keeps it out. Job board systems' public job feeds are made for this kind of use.

We store each posting's title, link and posting date, plus the text needed to check whether it is open to Asia. Listings link back to the company's original posting.

To ask us to stop crawling your site or to remove your listings, email hello@workfromasia.com.