@felish Stop reprimanding him and making him smell his pee or you'll scare him into start hiding to pee/poop and then you'll really be in hell.
Since he's not potty trained you shouldn't be giving him access to your entire house where he can just pee everywhere.