DataHen Till is a FREE companion tool to your existing web scrapers that instantly makes them more unblockable, scalable, and maintainable, with minimal code changes.
Integrates with many languages and frameworks with minimal code changes
Till includes the following features to make scraper development and maintenance more pleasant.
Your scraper can selectively reuse the same user-agent, proxy IP, and cookie jar for multiple requests. This allows you to easily group your requests based on certain workflow, and allow you to avoid detection from anti-scraping systems.
No need to build your cookie management logic in your scraper codes. Till stores the cookies for you so that you can easily set and get the cookies on any request.
Till automatically generates random user-agent on every request. Choose to identify your scraper as a desktop browser, or a mobile browser, or you can even override it with your custom user-agent.
Supply a list of proxy IPs, and Till will randomly use them on every request. Saves you time in needing to set up a separate proxy rotation service.
Log all HTTP requests and use the Web UI for easy troubleshooting and debugging.
Cache all HTTP responses locally for debuggability and save bandwidth and costs during scraper reruns
Assigns every request with a unique GID (Global ID) to make tracing your HTTP requests easily
Intercept any HTTP request such as bypassing Advertising trackers like Google Ads, and have it return any response.
Till works as a Man In The Middle (MITM) proxy that listens to incoming HTTP(S) requests and forwards those requests to the target server as needed. While it does so, it enhances each request to increase unblockability. It also logs and caches the responses to make your scraper maintainable and scalable.
Connect your scrapers to Till via the Proxy protocol, and your scraper will instantly become more unblockable, scalable, and maintainable.
Unblockability
Scalability
Maintainability
Add-on high quality proxies, and other features to help scale your web scrapers!
Cache all HTTP responses locally for debuggability and save bandwidth and costs during scraper reruns.
Make your scrapers more scalable
Ability to replay your scrapers, if it fails.
Save bandwidths, and other costs, such as proxies.
Unlimited cache use on any Till instance.
Your scraper can selectively reuse the same user-agent, proxy IP, and cookie jar for multiple requests. This allows you to easily group your requests based on certain workflow, and allow you to avoid detection from anti-scraping systems.
No need to build your cookie management logic in your scraper codes. Till stores the cookies for you so that you can easily set and get the cookies on any request.
Stick Cookie-Jar to a certain session
Stick proxy IPs to a certain session
Stick a User-Agent to a certain session
Unlimited use on any Till instance
Intercept any HTTP request such as bypassing Advertising trackers like Google Ads, and have it return any response.
Regular Expression based matching for granularity
Matches multiple HTTP method (GET, POST, etc.)
Unlimited request interceptions on any Till instance.
Unblock your scrapers with our high quality rotating data center proxies
20 GB/month included. $1/GB thereafter.
Rotation through ~110,000 USA data center IPs
Unblock your scrapers with our high quality residential proxies from around the world
1GB/month included. $8/GB thereafter.
Access 20 Million residential IPs from 159 countries.
Country based selections
Unblock your scrapers with our static ISP proxies from 22 countries.
1GB/month included. $10/GB thereafter.
Access 1 Million active IPs from 22 countries.
Country based selections
As much as we want you to use Till, but honestly, it's not for everyone.
Till is most probably not for you if:
If you're not a developer, Till is probably not for you, since there are technical things to think through. Consider DataHen services if you're looking for full-service data collection, web scraping, and ETL service.
Build vs Buy. Implementing all of Till's features into your custom scraping system takes lots of planning and architecting. We at DataHen have done so, and it sucks having to re-implement it over and over again.
If you're willing to spend the time and energy to build the best web scraping system for your specific use case, then you don't need Till.
Can’t find the answer you’re looking for? Reach out to our customer support team.
Till does not come with proxies by default, but you can either use your own or you can buy some quality proxies from us.
Once you sign up to one of our license plans, you'll get an auth token that you can use to run Till on-premise, locally.
For paid plans we offer support during our Toronto office business hours (EST)
Unblocking a scraper is more an art than science. While Till helps with the most common ways for your scrapers to be unblocked and provides detailed logs, sometimes you will still need to troubleshoot further. If you need help, feel free to contact us our Datahen Consulting Services Team.
Yes, it is. You run it on your infrastructure or locally on your computer. All it needs is the auth token, which you can get by signing up
