Yeah,I said just then (points up)
'At the moment it only trawls 2 links deep - this will in the future vary from site to site. '
It does some things with internal links too, so although it scans internal links for
more URLs, it doesn't list them in results, thus avoiding 3.5 billion links to view_profile.php etc...
('At the moment it only trawls 2 links deep - this will in the future vary from site to site. '
It does some things with internal links too, so although it scans internal links for
more URLs, it doesn't list them in results, thus avoiding 3.5 billion links to view_profile.php etc...
flibz,
Mon 11 Feb 2002, 6:40,
archived)