The rise of RESTful APIs has been met by a rise in tools for creating, testing, and managing them.
Menu
sfvadmin
The rise of RESTful APIs has been met by a rise in tools for creating, testing, and managing them.
Your are only few steps away from activation Web Unblocker
To create your API user, simply come up with a username and password and hit Create API user.
Once you’re done creating your first API user, you’ll receive a cURL example. You can paste it into your terminal or any other setup you prefer and test how it works.
You did all the necessary steps to start using Web Unblocker.
Run a test query to scrape quotes.toscrape.com, localizing your results to the United States.
Visit our documentation for further guidelines.
Note that the cURL sample already has some pre-set parameters like location x-proxying-geo-location: United States and JavaScript rendering x-proxying-render: html. The latter can be implemented when experiencing low success rates or retrieving empty content.
See the image below for a breakdown of cURL structure:
For your convenience, we’ve also added the cURL example in code format:
curl 'http://quotes.toscrape.com/js/'\
-U 'USERNAME:PASSWORD' -x 'unblock.proxying.io:60000'\
-H 'x-proxying-geo-location: United States'\
-H 'x-proxying-render: html' -k -v
Once you’ve sent the request, you should get an output similar to the one below:
HTTP/1.1 200 OK
X-Job-Id: 1234567890123456
X-Session-Id: 123randomString
cf-cache-status: DYNAMIC
cf-ray: 55c2ab837eddcba8-VIE
content-encoding: gzip
content-length: 72657
content-type: text/html
date: Tue, 1 Jan 2020 00:00:01 GMT,expect-ct: max-age=
last-modified: Tue, 1 Dec 2020 00:00:00 GMT
server: cloudflare
status: 200
strict-transport-security: max-age=31536000
X-DNS-Prefetch-Control: off
Set-Cookie: NID=1234567890; expires=Wed, 29-Jul-2020
Set-Cookie: 1P_JAR=0987654321; expires=Wed, 29-Jul-202
x-cache: MISS from localhost
x-cache-lookup: MISS from localhost:3129
<html>content here</html>
Check out the video below for a visual guide:
Web Unblocker employs pre-defined cookies, headers, and sessions to optimize website unblocking. So, it’s best that you refrain from sending any custom parameters commonly used for unblocking, as they may interfere with Web Unblocker’s ability to get quality data.
That being said, for special cases, we support a list of additional functionalities for target-specific requests:
To reuse the same IP for multiple requests, add a session ID, which can be a random string of characters.
To use an IP address from a specific location.
To send custom headers, use x-proxying-force-headers: 1 when submitting your request.
To add custom cookies to your requests.
If your target site returns a non-standard status code with a successful response, you can send the response status code, and our system will not retry the request.
To render JavaScript, use html to get a rendered HTML or png to get a screenshot of the page. You can also define your own browser instructions, such as clicking, inputting, and more. List of instructions.
Web Unblocker allows you to send a POST request to a web endpoint of your choice. You can send data to a target website, making it return a different result.
See the following table for a list of some of the most common status codes indicating errors:
OK
All went well.
Multiple error messages
Wrong request structure. Perhaps a misspelled parameter or an invalid value. Find more information in the response body.
Missing authorization header or incorrect login credentials.
Forbidden
This resource isn’t available to your account.
Not Found
The job ID you’re looking for is no longer available.
Timeout
The request timed out.
Too many requests
You’ve exceeded the rate limit.
Internal Server Error
We’re experiencing some issues. We’re probably aware of the issues, but you can report it anyway.
Faulted After Too Many Retries
Something went wrong. Try again at no extra cost or get in touch with us.
sfvadmin
Design amazing digital experiences that create more happy in the world.
