Starting a new business is not as quickly as newbies think, but it is also not rocket science. I don't believe so budget matters a lot. The things that matter are the idea of business, your grip over the products that you want to sell, complete research about the target niche and marketing, especially online marketing. These days businesses of all kinds are coming with their website or online presence, and if you have less budget for online marketing then you should try to free listing tools like you can list your site at Google. It will rank your business in first searches when people would like to know about your business-oriented products etc. In the same token, positive reviews by customers at review sites like Yelp, Manta, SiteJabber and scangator.com will definitely improve your online reputation and will increase your online presence as well.
However, as the market is uncertain nowadays, then it is better to come with complete research.