How do you create compelling presentations that wow your colleagues and impress your managers?

Thank you for activation free trial

Let’s setup Web Unblocker 

Your are only few steps away from activation Web Unblocker

Creating an API user

To create your API user, simply come up with a username and password and hit Create API user.

Create your Web Unblocker user

You need a user start using Web Unblocker

Making a basic cURL request 

Once you’re done creating your first API user, you’ll receive a cURL example. You can paste it into your terminal or any other setup you prefer and test how it works.

You're all set!

You did all the necessary steps to start using Web Unblocker.

Run a test query to scrape quotes.toscrape.com, localizing your results to the United States.

You did all the necessary steps to start using Web Unblocker.

curl http://quotes.toscrape.com/js/’-U
user1765:**********-X’unblock.proxying.io:60000-Hx-proxying-geo-location:

Visit our documentation for further guidelines.

Note that the cURL sample already has some pre-set parameters like location x-proxying-geo-location: United States and JavaScript rendering x-proxying-render: html. The latter can be implemented when experiencing low success rates or retrieving empty content.

See the image below for a breakdown of cURL structure:

curl http://quotes.toscrape.com/js/’\
-U’ USERNAME: PASSWORD ‘ -x’ unblock.proxying.io : 60000 ‘ \ -H ‘ x-proxying-geo-location: United States ‘ \
-H ‘ x-proxying-render: html ‘ -k -v

For your convenience, we’ve also added the cURL example in code format:

				
					curl 'http://quotes.toscrape.com/js/'\
-U 'USERNAME:PASSWORD' -x 'unblock.proxying.io:60000'\
-H 'x-proxying-geo-location: United States'\
-H 'x-proxying-render: html' -k -v
				
			

Once you’ve sent the request, you should get an output similar to the one below:

				
					HTTP/1.1 200 OK
X-Job-Id: 1234567890123456
X-Session-Id: 123randomString
cf-cache-status: DYNAMIC
cf-ray: 55c2ab837eddcba8-VIE
content-encoding: gzip
content-length: 72657
content-type: text/html
date: Tue, 1 Jan 2020 00:00:01 GMT,expect-ct: max-age=
last-modified: Tue, 1 Dec 2020 00:00:00 GMT
server: cloudflare
status: 200
strict-transport-security: max-age=31536000
X-DNS-Prefetch-Control: off
Set-Cookie: NID=1234567890; expires=Wed, 29-Jul-2020
Set-Cookie: 1P_JAR=0987654321; expires=Wed, 29-Jul-202
x-cache: MISS from localhost
x-cache-lookup: MISS from localhost:3129

<html>content here</html>
				
			

Check out the video below for a visual guide:

Additional functionalities

Web Unblocker employs pre-defined cookies, headers, and sessions to optimize website unblocking. So, it’s best that you refrain from sending any custom parameters commonly used for unblocking, as they may interfere with Web Unblocker’s ability to get quality data. 

That being said, for special cases, we support a list of additional functionalities for target-specific requests:

Parameter
Description
X-Proxying-Session-Id

To reuse the same IP for multiple requests, add a session ID, which can be a random string of characters.

X-Proxying-Geo-Location

To use an IP address from a specific location.

Headers

To send custom headers, use x-proxying-force-headers: 1 when submitting your request.

Cookies

To add custom cookies to your requests.

X-Proxying-Status-Code

If your target site returns a non-standard status code with a successful response, you can send the response status code, and our system will not retry the request.

X-Proxying-Render

To render JavaScript, use html to get a rendered HTML or png to get a screenshot of the page. You can also define your own browser instructions, such as clicking, inputting, and more. List of instructions.

POST requests

Web Unblocker allows you to send a POST request to a web endpoint of your choice. You can send data to a target website, making it return a different result.

Response codes 

See the following table for a list of some of the most common status codes indicating errors:

Parameter
Status
Description
200

OK

All went well.

400

Multiple error messages

Wrong request structure. Perhaps a misspelled parameter or an invalid value. Find more information in the response body.

401
Authorization header not provided/Invalid authorization header/
Client not found

Missing authorization header or incorrect login credentials.

403

Forbidden

This resource isn’t available to your account.

404

Not Found

The job ID you’re looking for is no longer available.

408

Timeout

The request timed out.

429

Too many requests

You’ve exceeded the rate limit.

500, 502, 503

Internal Server Error

We’re experiencing some issues. We’re probably aware of the issues, but you can report it anyway.

550

Faulted After Too Many Retries

Something went wrong. Try again at no extra cost or get in touch with us.

People also ask

Yes, you can try us for free for 30 days. If you want, we’ll provide you with a free, personalized 30-minute onboarding call to get you up and running as soon as possible.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

About the author

IN THIS ARTICLE:

Ready to scale your data?

Subscribe to our newsletter

Fast, powerful and worry-free online
protection

Related articles