Skip to main content
16 events
when toggle format what by license comment
Jan 29, 2019 at 21:51 history closed eis
idmean
il_raffa
Robert Longson
Arun Vinoth PrecogTechnologies
Duplicate of Stack Overflow sitemap.xml gives a 404
Jan 29, 2019 at 20:50 vote accept NullDev
Jan 29, 2019 at 19:51 comment added idmean 403 would be the appropriate error code here...
Jan 29, 2019 at 19:45 review Close votes
Jan 29, 2019 at 21:51
Jan 29, 2019 at 19:20 answer added gparyani timeline score: 6
Jan 29, 2019 at 16:52 comment added NullDev @DavidG Ah good to know. Thanks for the info!
Jan 29, 2019 at 11:45 comment added DavidG @NullDev Not quite true about the IP range, Google doesn't publish the IP addresses, instead it suggests you do a reverse DNS lookup to get the name, then a forward lookup to confirm the IP.
Jan 28, 2019 at 20:25 history edited jscs CC BY-SA 4.0
Less waffle, more syrup
Jan 28, 2019 at 17:30 history edited Heretic Monkey CC BY-SA 4.0
Edited name of sites to their proper names
Jan 28, 2019 at 17:14 comment added Erik A @NullDev Yeah, removed the comment because I thought that might be true (+ I forgot to remove cookies so that could also interfere)
Jan 28, 2019 at 16:44 comment added NullDev @ErikvonAsmuth Well, googlebot always is always in the same IP Range. So its probably restricted to specific IP's.
Jan 28, 2019 at 16:40 comment added NullDev @rene Interesting. Thanks for the heads up!
Jan 28, 2019 at 16:17 comment added rene reference: meta.stackexchange.com/questions/33965/… so not a bug but status-by-design
Jan 28, 2019 at 16:15 comment added rene It returns 404 becuase the sitemap.xml is whitelisted for the googlebot (and a few others) and blacklisted, aka 404, for everyone else.
Jan 28, 2019 at 16:00 comment added Erik A Not like that really matters, Google has a custom indexing policy for Stack Overflow anyway, but I guess they should at least remove it from their robots.txt.
Jan 28, 2019 at 15:52 history asked NullDev CC BY-SA 4.0