please why am i forced to allow these massive giants to harvest my site.

Block all requests with specified user agents, or even requests that have no user agent specified.