Self-hosted IP-phone network

Just for fun, a few associations I'm part of want to set up our own IP-phone network, with our own phone numbers and such.

• Is this possible?
• How would one go about doing this?
• Does it have to be it's own separate network or can it work via the internet without special setup beyond a public IP?