@zeeshan.minhas
I suggest that you propose a work-in-progress itinerary and divide the trip into two parts, from 5th(Sat) to 12th(Sat) September and 13th(Sun) to 20th(Sun). You can manage Lahore-Khunjerab-Lahore including Gilgit, Hunza and Nagar within the first week and people interested in that part only can join you. The second part could be either Shandoor, Chitral, Dir, Swat or Skardu, Shigar, Khaplu, Devsai, Astore(Rama). People interested in that part can join you for the second week.
Very few people can get two weeks off, the majority can manage one week at most.