This allows you to easily monitor and troubleshoot requests that your scrapers are currently sending.
Note: This feature is enabled by default. However, if you want to specify other configurations, the following are the options:
|logger.ttl||Time-to-live for the request log records. Allowed values:
Note: Till stores the log data inside your Data Directory on your local disk. You can change the TTL settings to save disk space. The lesser the TTL, the smaller the space in your disk that will be used.
When you have already created a config file, you can add a configuration like so:
# Logger settings logger: # Disable the logger feature # Defaults to false. disabled: false # TTL (Time To Live). How long a request log record will be allowed to live before it gets deleted. # Defaults to "week". ttl: "week"
Now, you just need to verify that your Till configuration is working.
Let's first send a request via till using
$ curl 'https://fetchtest.datahen.com' -k --proxy http://localhost:2933
Next, you can go to http://localhost:2980/requests and see your request log history.
How To Use