Instantly make your existing web scrapers scalable, debuggable & maintainable Building scrapers is easy but scaling them is hard!

Till is a scraper debugging tool to your existing web scrapers that instantly makes them more scalable and maintainable, with minimal code changes.

Integrates with many languages and frameworks with minimal code changes

Features

Based on DataHen's decade of experience of building thousands of scrapers that scrapes billions of pages, Till was built to make it easy for you to instantly scale and mantain your scrapers.

Sticky Sessions

Your scraper can selectively reuse the same user-agent, proxy IP, and cookie jar for multiple requests. This allows you to easily group your requests based on certain workflow, and allow you to avoid detection from anti-scraping systems.

Manage Cookies

No need to build your cookie management logic in your scraper codes. Till stores the cookies for you so that you can easily set and get the cookies on any request.

User-Agent Randomizer

Till automatically generates random user-agent on every request. Choose to identify your scraper as a desktop browser, or a mobile browser, or you can even override it with your custom user-agent.

Proxy IP address rotation

Supply a list of proxy IPs, and Till will randomly use them on every request. Saves you time in needing to set up a separate proxy rotation service.

Request log

Log all HTTP requests and use the Web UI for easy troubleshooting and debugging.

HTTP Caching

Cache all HTTP responses locally for debuggability and save bandwidth and costs during scraper reruns

Global ID

Assigns every request with a unique GID (Global ID) to make tracing your HTTP requests easily

HTTP Request Interceptions

Intercept any HTTP request such as bypassing Advertising trackers like Google Ads, and have it return any response.

How it works

Till works as a Man In The Middle (MITM) proxy that listens to incoming HTTP(S) requests and forwards those requests to the target server as needed. While it does so, it enhances each request to increase unblockability. It also logs and caches the responses to make your scraper maintainable and scalable.

Instantly enhances your web scrapers

Connect your scrapers to Till via the Proxy protocol, and your scraper will instantly become more scalable and maintainable.

Unblockability

Unblocking scrapers is more an art than science, it requires a lot of thought and reverse engineering of target websites. Till helps with common blocking scenarios by increasing fingerprinting of the HTTP requests through methods such as user-agent randomization and proxy rotation. Till also makes it easy for you to diagnose on why your scrapers are blocked, so that you can easily reverse engineer your target websites.

Scalability

Till comes with tried and true way to scale your scrapers, such as caching of HTTP requests, managing retries, reusing cookies, and more.

Maintainability

Till assigns any HTTP request with a unique Global ID (GID) and logs the request. This makes it easy for you to find and debug any requests that was made by your scrapers on the Web UI.

Pricing

All paid plans come with a 5000 free request and a 7-day free trial.

No risk, No obligation, Cancel anytime.

Free

FREE forever

Best for people who don't scrape often.

Signup Free
Features
Features Included
HTTP Requests 5000/month
Proxy IP randomization Yes
Global ID Yes
Sticky Sessions No
Cookie Management No
Request Interceptions No
Customizable User-Agent Generation No
User-Agent Randomization Desktop only
Instances 3
HTTP Caching 5000 cache hits/mo.
HTTP Cache Retention Week
Request Log Retention Week
Support
Support Included
Priority Support Email No
Dedicated Account Manager No

Freelance

$49 /mo

Best for developers who scrape regularly on multiple projects.

Signup Freelance
Features
Features Included
HTTP Requests 200K/mo
Proxy IP randomization Yes
Global ID Yes
Sticky Sessions Yes
Cookie Management Yes
Request Interceptions Yes
Customizable User-Agent Generation Yes
User-Agent Randomization Desktop only
Instances 5
HTTP Caching 200K cache hits/mo. $3 per additional 100K/mo.
HTTP Cache Retention Month
Request Log Retention Month
Support
Support Included
Priority Support Email Yes
Dedicated Account Manager No

Startup

$99 /mo

Best for organizations that needs scalable and reliable scraping.

Signup Startup
Features
Features Included
HTTP Requests 1 million/mo
Proxy IP randomization Yes
Global ID Yes
Sticky Sessions Yes
Cookie Management Yes
Request Interceptions Yes
Customizable User-Agent Generation Yes
User-Agent Randomization Desktop, Mobile and others
Instances 50
HTTP Caching 1 million cache hits/mo. $2.50 per additional 100K/mo.
HTTP Cache Retention Month
Request Log Retention Month
Support
Support Included
Priority Support Email Yes
Dedicated Account Manager No

Enterprise

$249 /mo

Best for organizations that needs massively scalable and reliable scraping.

Signup Enterprise
Features
Features Included
HTTP Requests 5 million/mo
Proxy IP randomization Yes
Global ID Yes
Sticky Sessions Yes
Cookie Management Yes
Request Interceptions Yes
Customizable User-Agent Generation Yes
User-Agent Randomization Desktop, Mobile and others
Instances 100
HTTP Caching 5 million cache hits/mo. $2 per additional 100K/mo.
HTTP Cache Retention Unlimited
Request Log Retention Unlimited
Support
Support Included
Priority Support Email Yes
Dedicated Account Manager Yes

Till is not for you if...

As much as we want you to use Till, but honestly, it's not for everyone.
Till is most probably not for you if:

You're not a developer

If you're not a developer, Till is probably not for you, since there are technical things to think through. Consider DataHen services if you're looking for full-service data collection, web scraping, and ETL service.

You're looking to build everything by yourself

Build vs Buy. Implementing all of Till's features into your custom scraping system takes lots of planning and architecting. We at DataHen have done so, and it sucks having to re-implement it over and over again.

If you're willing to spend the time and energy to build the best web scraping system for your specific use case, then you don't need Till.

Frequently asked questions

Can’t find the answer you’re looking for? Reach out to our customer support team.

Does it come with proxies?

Till does not come with proxies by default, but you can either use your own or contact us to help set you up with our wide range of proxy services.

How does your licensing work?

Once you sign up to one of our license plans, you'll get an auth token that you can use to run Till on-premise, locally.

Is support included?

For paid plans we offer support during our Toronto office business hours (EST)

Why is my scraper still blocked?

Unblocking a scraper is more an art than science. While Till helps with the most common ways for your scrapers to be unblocked and provides detailed logs, sometimes you will still need to troubleshoot further. If you need help, feel free to contact us our Datahen Consulting Services Team.

Is Till an on-prem software?

Yes, it is. You run it on your infrastructure or locally on your computer. All it needs is the auth token, which you can get by signing up