You will not be allowed to do this track from taobat side as this side is dangerously close to LOC. You can however enter Minimarg from Astore side which will change your route altogether. You can follow the following path:
ISL ---> NARAN ---> BABUSAR TOP ---> CHILAS ---> ASTORE ---> CHILUM CHOWKI ---> BURZIL PASS ---> MINIMARG
This route also requires army approval and your entrance can be denied even after legitimate approval is intact, if situation at LOC is volatile at that point in time.