Yes astore valley is worth visiting, I believe that due to army deployment in area and restrictions by army there, this valley never gained much importance due to controlled access, but some people who had a chance to visit all the places in astore said that its most beautiful valley among all the places in Gilgit Baltistan and Swat due to many reasons. The places worth visiting in the valley as per my knowledge and experience is:
Places with unrestricted access:
Tarshing
Rupal Valley
Deosai National Park
Rama Lake and meadows
Places which have controlled access:
Burzil Pass
Rainbow Lake
Minimurg
and other spots after chillum leading to minimurg.
I hope other people can correct and suggest some other places as well