Menu

How to scrape Workday job postings to JSON (and get past the 2,000-job limit)
πŸ“°

How to scrape Workday job postings to JSON (and get past the 2,000-job limit)

DEV Community: apiΒ·William JinΒ·23 days ago
#1W3ljtKU
#devtoapi#devto#dev#jobs#nvidia
Reading 0:00
15s threshold

A huge number of large employers host their careers pages on Workday. You can spot them by the address: something.wd5.myworkdayjobs.com/SiteName . If you're building a job board, tracking hiring at target companies, doing labor-market research, or just want an alert when a company posts a role you care about, you'll want those postings as structured data, not HTML.

The good news is that Workday's job search page is a single-page app backed by a JSON API, so you don't need a headless browser. The less good news is a handful of quirks, the main one being that search results stop at 2,000. This post walks through the API, a short Python scraper, the gotchas, and a hosted option you can also hand to an AI agent.

Step 1: Decode the career-site URL

Take NVIDIA's careers site:

https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite └─tenantβ”€β”˜β””hostβ”˜ └──────siteβ”€β”€β”€β”€β”€β”€β”˜

Enter fullscreen mode

Exit fullscreen mode

Host: nvidia.wd5.myworkdayjobs.com (the wd1 , wd3 , wd5 ...…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.