This is fine, it's something beautiful and part of culture, history etc...
What's not is places like governor house in lahore, where it's just vast amount of land, not being used for any reason, yet located right in the middle of the city (could be auctioned to public and made into hotels, shops/plazas, residential space, etc). Other places include corp commander house (why does he need to live in such a central location?). And there are so many more examples where it's just land in the middle of the city owned by gov. and not being used productively.