This kind of methods are thus not commonly utilized by conforming web robots or Net crawlers; some that don't conform have a tendency to make requests with no regard to context or consequences. This a little bit improves the common pace of communications and also to steer clear of the occasio