This is an interesting point, but I wonder if it is an opportunity. If everyone expects a college-style beer-and-pizza party, why not? Maybe something you can do with some existing friends first, and then start inviting new people over? Something like "Hey there's this crazy thing some of my friends and I do. Want to come to the next one?"