Does fuel efficiency really differ between fresh air and recirculated air on hot days??

During the peak of summer, when I use the air conditioning, it feels like the fuel efficiency is much better when I set it to recirculate rather than fresh air mode.
This isn't just my imagination, is it?
The commuting conditions were exactly the same, but the difference seems quite noticeable.