Fairy meadows is not at ALL recommended for family, read mustansar hussain tarrar book "NANGA PARBAT" and u will convince ur self, from Raikot Bridge to Tatto village is the driest and hottest track in northern areas.
Just a suggestion: As u r taking family with infant, dont go too adventurous, visit to Naran or Jalkhad is enough, but still Jalkhad is not advisable by car ,there r a few patches which might be hard for cultus frame, anyhow i saw a cultus there but not advisable, why put ur car and family at risk, if u r travelling by jeep then u can cross babusar too, but after mid july when snow melts, last year i went in early july and road along Lulusar lake was closed due to heavy snow.