This Tiny Door On My Wall Below The Window? 1926 NYC Apartment Building

Answer: It is a cold box.

Also read: Breaking: Kid Rock and Jason Aldean’s You Can’t Cancel America Tour Breaks Taylor Swift’s Attendance Record