er... I think you need to define the link depthon a case by case basis. I.e. popbitch should only be one link deep.
(
rob,
Mon 11 Feb 2002, 5:29,
archived)
FlibzAre you going to enter the google programming contest?
(
Wifey,
Mon 11 Feb 2002, 5:43,
archived)
Yeah,I said just then (points up)
"At the moment it only trawls 2 links deep - this will in the future vary from site to site. "
It does some things with internal links too, so although it scans internal links for
more URLs, it doesn't list them in results, thus avoiding 3.5 billion links to view_profile.php etc...
("At the moment it only trawls 2 links deep - this will in the future vary from site to site. "
It does some things with internal links too, so although it scans internal links for
more URLs, it doesn't list them in results, thus avoiding 3.5 billion links to view_profile.php etc...
flibz,
Mon 11 Feb 2002, 6:40,
archived)