I'm in south Overland Park. Right now Google is quoting 33 minutes to the K, and 35 minutes to the new stadium site. Factor in ease of parking at the K and I think it will take a little more time to get downtown.
That said downtown probably is quicker for KS people Lenexa, Shawnee, north OP, etc.