@nabeelkhan
You can remove your ads using the Remove Ad option. In future, if you wish to re-list those ads, you can just use the Republish option and the ads will start appearing in the classifieds search.
I hope this is the answer you were looking for, should it not answer your question, feel free to reach out.