Google Maps location not updated

My google maps location has been shared with my husband but sometimes when he tries to track me he can not see my location and the icon is greyed out, however when I access google maps it gives real time update to him. Also note that my background refresh for the app is on and location option also has always selected.