Living financially independent, and working independent from the society of devotees, can better help a devotee to live by the teachings of Bhagavad-Gita - by not being idle, artifically maintained, and thus unengaged in their "material" duties, and by becoming more appreciative of the available time for their spiritual duties - hearing, chanting, remembering, worshipping the deity etc. When living by these principles then one's so-called "material" duties are not material at all, but rather they become a support to their spiritual duties. This is called gauna dharma.When one lives by these principles, and does so with the right understanding, then their association with devotees becomes more meaningful and complete.
Collected Letters Written to Friends and Disciples Vol 4, Pg 54, 2nd paragraph