EPIPE Communications

#define EPIPE 32 /* Broken pipe */

Spider Print

EPIPE Communications is doing various research on world wide web and internet evolution. Results of this research will be published at a later date.

Our web spider (also known as web robot, web crawler) is called epipe-spider. It crawls through some known and published web sites and collects information for statistical purposes. This includes information such as the IP address, the name of the hosting provider and the name of the web server software used to host the site. We specifically do not collect e-mail addresses.

epipe-spider obeys robots.txt rules. For example if you wish to deny our spider all access to your site, place the following in your robots.txt:

User-agent: epipe-spider
Disallow: /

Please do not use IP addresses to block our access as they might change. It is better to userobots.txt or block based on client-supplied user-agent string (user-agent string starting with "epipe-spider").

Do not hesitate to contact us if you think there is something wrong.

 
You are here  : Home Spider