Recently I finally got around to adding my public key into my Github account, as described here
But then there is one more step you have to do to your already existing checked out projects to get them to use this. That is update the origin to use SSH and not HTTPS.
So cd to your project and run something like:
git remote set-url origin email@example.com:USER/PROJECTNAME.git