Conference speaker diversity

So the atheist movement has a problem with speakers at conferences being disproportionately white men, and maybe a couple white women thrown in if you’re lucky. I’m sure isolated counterexamples could be found, but it’s an issue I see a lot of people complaining about, and a lot of jackasses defending on stupid grounds.
Of the 10 announced speakers for Skepticon 9, only two are white men and one of those is trans. One black man, one black woman, the rest white women.
If previous years are any indication, the final list will be just as diverse, they aren’t just holding back to drop all the white men on us in one big shot.
This can’t be all that hard a problem to solve if a conference that doesn’t pay speakers fees(though they do cover travel and lodging) can make it work.