Oxylabs’ Jobs Scraper is a data gathering solution allowing you to extract real-time information from any jobs website effortlessly. This brief guide explains how a Jobs Scraper works and provides code examples to understand better how you can use it hassle-free.
You can obtain job results by providing your own URLs to our service. We will return the HTML for any jobs page you specify.
The example below illustrates how you can obtain the HTML of a sample job posting from indeed.com
import requests
from pprint import pprint
# Structure payload.
payload = {
'source': 'universal',
'url': 'https://www.indeed.com/companies/best-agriculture-companies'
}
# Get response.
response = requests.request(
'POST',
'https://realtime.oxylabs.io/v1/queries',
auth=('user', 'pass1'),
json=payload,
)
# Instead of response with job status and results url, this will return the
# JSON response with the result.
pprint(response.json())
Find code examples for other programming languages here
{
"results": [
{
"content": " ... </html>",
"created_at": "2023-12-18 11:39:49",
"updated_at": "2023-12-18 11:40:05",
"page": 1,
"url": "https://www.indeed.com/companies/best-agriculture-companies",
"job_id": "7142478560421252097",
"status_code": 613
}
]
}
With our Jobs Scraper, you can conveniently extract public data from any job web page. Gather necessary job information such as company profiles, salary ranges, job descriptions, location, and qualifications needed to study market trends and stay ahead in your career search. If you have any queries, reach out to our support team using live chat or drop us an email at hello@oxylabs.io.