How to Remove Node.js and Reinstall with Homebrew

I've installed Node.js via the installer on their website. I've also installed a few packages already. Is there an easy way to uninstall all of this so I can install node.js and npm via Homebrew?

The reason for this is I'm having to prefix most commands with sudo and would prefer not to do this.

Any help is appreciated. Thanks!