Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Most actually do via the user agent string in the request. You can't stop a malicious bot this way, but you could kill most bot traffic with a rewrite rule, presuming robots.txt isn't good enough.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: