Jesse Jackson apologizes, but what is so bad about what he said?

Jesse Jackson has come under fire for making what he called "hurtful and wrong" comments during a taping for Fox News on Sunday.
From what I understand, Jackson said that Obama was "talking down" to black people during his mega speeches instead of addressing issues that concern the black community such as unemployment, the mortgage crisis and the number of blacks in prison.
In other words, Jesse Jackson basically called Barack Obama an elitist. I'm also sure that Jackson didn't use the best words to discuss it.
What's the big deal? On Wednesday Jackson held a press conference and apologized.
I don't think its that big of a deal, do you?

