Originally under the name of Two Weeks Notice, they primarily began playing shows at Station 34 in Mount Prospect, IL after participating alongside various musicians in their local music festival, 56 Music Fix. After much time spent working on original music during the COVID-19 pandemic, their members decided on their final name, Ice House Mary.