Instantly make your existing web scrapers unblockable, scalable & maintainable With minimal code changes

DataHen Till is a FREE companion tool to your existing web scrapers that instantly makes them more unblockable, scalable, and maintainable, with minimal code changes.

Integrates with many languages and frameworks with minimal code changes

Features

Till includes the following features to make scraper development and maintenance more pleasant.

Sticky Sessions

Your scraper can selectively reuse the same user-agent, proxy IP, and cookie jar for multiple requests. This allows you to easily group your requests based on certain workflow, and allow you to avoid detection from anti-scraping systems.

Manage Cookies

No need to build your cookie management logic in your scraper codes. Till stores the cookies for you so that you can easily set and get the cookies on any request.

User-Agent Randomizer

Till automatically generates random user-agent on every request. Choose to identify your scraper as a desktop browser, or a mobile browser, or you can even override it with your custom user-agent.

Proxy IP address rotation

Supply a list of proxy IPs, and Till will randomly use them on every request. Saves you time in needing to set up a separate proxy rotation service.

Request log

Log all HTTP requests and use the Web UI for easy troubleshooting and debugging.

HTTP Caching

Cache all HTTP responses locally for debuggability and save bandwidth and costs during scraper reruns

Global ID

Assigns every request with a unique GID (Global ID) to make tracing your HTTP requests easily

HTTP Request Interceptions

Intercept any HTTP request such as bypassing Advertising trackers like Google Ads, and have it return any response.

How it works

Till works as a Man In The Middle (MITM) proxy that listens to incoming HTTP(S) requests and forwards those requests to the target server as needed. While it does so, it enhances each request to increase unblockability. It also logs and caches the responses to make your scraper maintainable and scalable.

Instantly enhances your web scrapers

Connect your scrapers to Till via the Proxy protocol, and your scraper will instantly become more unblockable, scalable, and maintainable.

Unblockability

Unblocking scrapers is more an art than science, it requires a lot of thought and reverse engineering of target websites. Till helps with common blocking scenarios by increasing fingerprinting of the HTTP requests through methods such as user-agent randomization and proxy rotation. Till also makes it easy for you to diagnose on why your scrapers are blocked, so that you can easily reverse engineer your target websites.

Scalability

Till comes with tried and true way to scale your scrapers, such as caching of HTTP requests, managing retries, reusing cookies, and more.

Maintainability

Till assigns any HTTP request with a unique Global ID (GID) and logs the request. This makes it easy for you to find and debug any requests that was made by your scrapers on the Web UI.

Addons

Add-on high quality proxies, and other features to help scale your web scrapers!

HTTP Caching

Cache all HTTP responses locally for debuggability and save bandwidth and costs during scraper reruns.

What's included

  • Make your scrapers more scalable

  • Ability to replay your scrapers, if it fails.

  • Save bandwidths, and other costs, such as proxies.

  • Unlimited cache use on any Till instance.

Per Month

$1 USD

Learn more

Sticky Sessions

Your scraper can selectively reuse the same user-agent, proxy IP, and cookie jar for multiple requests. This allows you to easily group your requests based on certain workflow, and allow you to avoid detection from anti-scraping systems.

No need to build your cookie management logic in your scraper codes. Till stores the cookies for you so that you can easily set and get the cookies on any request.

What's included

  • Stick Cookie-Jar to a certain session

  • Stick proxy IPs to a certain session

  • Stick a User-Agent to a certain session

  • Unlimited use on any Till instance

Per Month

$1 USD

Learn more

Request Interceptions

Intercept any HTTP request such as bypassing Advertising trackers like Google Ads, and have it return any response.

What's included

  • Regular Expression based matching for granularity

  • Matches multiple HTTP method (GET, POST, etc.)

  • Unlimited request interceptions on any Till instance.

Per Month

$1 USD

Learn more

Rotating Data Center Proxy

Unblock your scrapers with our high quality rotating data center proxies

What's included

  • 20 GB/month included. $1/GB thereafter.

  • Rotation through ~110,000 USA data center IPs

Per Month

$20 USD

Rotating Residential Proxy

Unblock your scrapers with our high quality residential proxies from around the world

What's included

  • 1GB/month included. $8/GB thereafter.

  • Access 20 Million residential IPs from 159 countries.

  • Country based selections

Per Month

$8 /GB

Static ISP Proxy

Unblock your scrapers with our static ISP proxies from 22 countries.

What's included

  • 1GB/month included. $10/GB thereafter.

  • Access 1 Million active IPs from 22 countries.

  • Country based selections

Per Month

$10 /GB

Till is not for you if...

As much as we want you to use Till, but honestly, it's not for everyone.
Till is most probably not for you if:

You're not a developer

If you're not a developer, Till is probably not for you, since there are technical things to think through. Consider DataHen services if you're looking for full-service data collection, web scraping, and ETL service.

You're looking to build everything by yourself

Build vs Buy. Implementing all of Till's features into your custom scraping system takes lots of planning and architecting. We at DataHen have done so, and it sucks having to re-implement it over and over again.

If you're willing to spend the time and energy to build the best web scraping system for your specific use case, then you don't need Till.

Frequently asked questions

Can’t find the answer you’re looking for? Reach out to our customer support team.

Does it come with proxies?

Till does not come with proxies by default, but you can either use your own or you can buy some quality proxies from us.

How does your licensing work?

Once you sign up to one of our license plans, you'll get an auth token that you can use to run Till on-premise, locally.

Is support included?

For paid plans we offer support during our Toronto office business hours (EST)

Why is my scraper still blocked?

Unblocking a scraper is more an art than science. While Till helps with the most common ways for your scrapers to be unblocked and provides detailed logs, sometimes you will still need to troubleshoot further. If you need help, feel free to contact us our Datahen Consulting Services Team.

Is Till an on-prem software?

Yes, it is. You run it on your infrastructure or locally on your computer. All it needs is the auth token, which you can get by signing up