How to block specific user agents on nginx web server
May 14, 2015, 10:00 (0 Talkback[s])
(Other stories by Xmodulo)
The modern Internet is infested with various malicious robots and crawlers such as malware bots, spambots or content scrapers which are scanning your website in surreptitious ways, for example to detect potential website vulnerabilities, harvest email addresses, or just to steal content from your website. Many of these robots can be identified by their signature "user-agent" string.