Perhaps what we need is a group chat that automatically maintains a summary of relevant chat history created by AI?

The AI could maintain a Wiki with relevant stuff gathered from the discussions.

Not sure if it's good enough today, but it does seem like an interesting prospect. Not many people like filling Wikis.