Cameron’s ex strategy advisor says PM only knows what’s happening in other departments because of news reports