Certainly his position as the GOAT has been removed. I don't think his legacy as one of the "big 3" of the modern era is going away.
I am interested in your distain for Fed. I personally find Djok hard to warm to, but Federer always seemed like a genuinely nice bloke to me and I enjoyed watching him more than Djok or Nadal.
I've never thought of Federer as particularly divisive, but here we are!