While brahmacharis live in an asrama so do grhasthas. The word asrama means shelter. What is the shelter in grhastha-asrama? Narada Muni describes it to Maharaja Yudhistra in the seventh canto: the daily hearing of the Lord's pastimes. There is no other shelter in the grhastha-asarama. Taking shelter anywhere else means that grhastha-asarama transforms into the grahmedi-asarama. There is no asarama for grhamedis, because they have no shelter, no asrama. If grhasthas are not hearing Srimad Bhagavatam every day, either by attending the temple Bhagavatam class or somehow in association of devotees, then they are not within the asrama.
Lectures from a disciple Volume 1 "Spiritual Lives of Grhasthas", Pg 365"