Obama supporters considered it a racist comment during the 2008 primary when Hillary was running against Obama. Clinton was trying to work on Ted Kennedy's endorsement of Hillary when he made the comment. The press picked up on it and in a nasty political environment, Obama supporters ran with it. There was and is no love lost between the Obamas and Clintons.
Racist statement? Depends on what side you are on.
