Guides

Field references and how-to guides for the scrapers we build and maintain: real output, real costs, and the obstacles each source site puts in the way.

• A working Naukri API request and its response
  There is no public Naukri API. Naukri publishes the data on its pages and nowhere else. Anyone who needs that data in bulk must write a scraper,…
• Seek has no public API. Here is the one we use
  There is no official Seek API. Seek keeps the data in its markup, so accessing it in bulk means scraping the pages.
• Wellfound API: 71 fields, no official endpoint
  There is no official Wellfound API. The data lives in the site's markup, so bulk access means scraping the pages.
• Upwork API: 55 fields, no official endpoint
  Look for an Upwork API and you will not find an official one. The data lives in Upwork's markup, so bulk access means scraping.
• Internshala has no public API. Here is the one we use
  There is no public Internshala API. The data lives on the page and nowhere else. Anyone who needs that data in bulk has to write a scraper, maintain…
• The unofficial Bayt API — 68 fields per call
  There is no public Bayt API. Getting the data means reading it from the page—and adapting whenever the layout changes.
• Query Jobstreet programmatically: 73 fields, one call
  There is no official Jobstreet API. The data sits in page markup, which means bulk access requires scraping.
• Query Stepstone programmatically: 81 fields, one call
  Stepstone does not publish a Stepstone API. The useful data is rendered into each page, so extracting it at volume requires an HTML parser—and ongoing…
• Autoscout24 has no public API. Here is the one we use
  Autoscout24 does not publish an Autoscout24 API. The useful data is rendered directly into each page, so extracting it at volume requires an HTML…
• The unofficial Trustpilot API — 96 fields per call
  A Trustpilot API would make this easy. There isn't one. The data has to come off the page—and come off it again whenever the layout shifts.
• Google Maps Scraper: 31 fields, no API key, no quota
  The Google Maps Scraper below reads Google Maps pages without an API key or quota. By comparison, the official Google Maps API is metered, tied to a…