I really like the idea, but writing and speaking are totally different ways of communicating. People don't direct as much conscious thought into what they say, as what they write.
Will people actually be able to handle sitting down and listening to what people have spoken down a phone line?