Why do people think it's about race?

President-elect Obama did not make race any part of his campaign. He was strictly about America - ALL America. Why has his win seemingly scared witless the section of the white population who are bigoted and prejudiced? Are they afraid that he might enact measures against them as they might in his place? I'm in the UK and am looking forward to a more well-rounded America in the world.