ftp - Strange GET request in Apache Log -


i'm monitoring website apache log , saw stranges requests, see:

51.255.65.74 - - [28/may/2016:11:48:02 -0300] "get /insert/xahanave.html http/1.1" 404 1035 "-" "mozilla/5.0 (compatible; ahrefsbot/5.1; +http://ahrefs.com/robot/)" 207.46.13.128 - - [28/may/2016:11:49:13 -0300] "get / http/1.1" 200 14188 "-" "mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" 66.249.64.87 - - [28/may/2016:11:49:32 -0300] "get /css/kin8tengoku-1144-may.html http/1.1" 404 1039 "-" "mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)" 

well, ftp don't have folder "/insert/xanahave", neither file 'kin8tengoku' in folder css. possibile make request non existen file/folder ?

important: days ago site hacked , "insert" folder created without permission in ftp, clean , folder "insert" don't exist anymore. big question is, why requests folder continue ?

because files picked ahrefs, bing search engine , google search engine when , periodically recheck files see if there changes. how google , return date information on site.

you can see it's these companies user agent sent (at end of each line). some, more nefarious bots, pretend googlebot quick google of these ip addresses show these legitimate ones.

as can see server correctly responds 404 (page not found status) and, providing there no links them, these companies take hint , drop them index , stop requesting them. can take month or two. don't in case 404 error because accidentally removed page or similar.


Comments

Popular posts from this blog

ios - RestKit 0.20 — CoreData: error: Failed to call designated initializer on NSManagedObject class (again) -

java - Digest auth with Spring Security using javaconfig -

laravel - PDOException in Connector.php line 55: SQLSTATE[HY000] [1045] Access denied for user 'root'@'localhost' (using password: YES) -