From Swat (mingora) main bus stop, local transport (van) goes to Timergara. It is a large city, with good hotels. Fare per person Rs. 120 and it takes 2.5 - 3 hours.
From Timergara local vans go to Dir. 2.5-3 hours and 130 per person. I did not stay in Dir. But some good hotels must be there,
From Dir to Thall is jeep track. 2-3 Local jeeps go daily with about 400 per person in about 5 hours. You can book a jeep in 6000-8000 perhaps.
At Thall only a bit better hotel is green hills. Not very good but has spacious rooms with attached baths. I did not stay here.
From Thall go to upper Kumrat by jeep and come back for night stay at Thall.
Raja is very helpful person. contact him he will help what ever he could. His contact no is in earlier pages of the thread.
Good luck, Family visit is certainly possible. I don't think of any danger if you don't stay in forest of kumrat with family at night.