For zombies without intelligence or motor skills, staying on the 2nd floor or higher seems to be the answer

If you play Resident Evil, there are almost no zombies coming through the windows from the 2nd floor up, so as long as you keep the doors closed properly, you can basically consider them unable to enter.