In the market I am familiar with you will find the traffic helicopter flying when most, if not all, recreation flyers are sitting on the ground. The traffic guys are flying daytime down to 800 ft. and 5 miles, and in high winds that keep most flyers on the ground. (Night flying has higher minimums.) Yes, Special VFR is required, but there is typically no problem getting that.
In fact, flying in these conditions is somewhat easier since there is less radio traffic with the towers in Class D airspace. (The Class B towers have little recreation flyers anytime.)