If its your own land then building a bhatta cost is very low even some lacks will do. The main thing is the matti you need to make bricks not just any matti but of fine quality. Everyone faces challenges in all kinds of businesses its about dedication. If you can dedicate 100% of your own time to the factory then you can even make billions in this industry.
As I said never leave work on a munshi or manager and the main thing is your location and dealer network. Most brick factories have dealers in nearby cities who stock there bricks and sell further for premium, they are your returning customers you need to get hold of them before you start your work.
1 of the biggest names in brick factories is of these guys and you see how high there turnover is after viewing there website http://www.niazibricks.com/