This is an excellent point. Your communication is only as secure as the weakest endpoint (in the same vein, perhaps your correspondents might be of the opposing viewpoint and might feel weird about their personal mails being stored by someone who's rolling his own IT and security).