I'd stick him in with your brooder chicks, less chance of being picked on than with a grumpy bantam who suddenly realises she's acquired an interloper.
But before you give up, 'cheep' or 'pipe' at your goose eggs - they'll answer, if anyone is still in there, trying to get out (this amazes non-smallholding friends when they hear it!). If you can candle to see the air sack a tiny bit of 'helping' might be in order - stop the second you get any membrane bleeding - which means they are not quite ready to hatch.