Dear, bypassing Gojra is possible but the road is small and through villages. it will take 30 minutes, speed up to max 80km/hr and some sharp turns. It will take you on Jhang-Toba Road in city near Iqbal Nagar. If you want to explore, choose day time. After EXIT from M4, go towards Gojra, Before crossing canal bridge; take right turn and then take left. Follow this tiny road to reach Toba.
Recommendation is: Use Main Highway road to approach Toba from Goj. Travelling in night time is NOT SAFE at all.