This is the company fault with the steering rack of Honda X, you can check this forum full of other Honda X owners complaining about this issue and as you said that your car is not in warranty anymore, so I'm afraid that you have to get it repaired/replaced by some expert mechanic by yourself.
However, I would suggest you first get it checked by some expert mechanic before getting it replaced/repaired, but I think that unfortunately, you have to pay the price for this problem.
Hope it helps and I wish that you got this problem solved soon and at a nominal price.