As Rahat bhai explains that the Accords of that era indeed had a transmission problem which was never rectified by Honda at that time (JDM - USDM - Euro - AUDM). You can try flushing the transmission but I doubt that'll help you out, it'll only be a temporary fix, especially at this stage - ultimately you're looking at a transmission change. You can get the car scanned and checked for errors, usually it'll show "Shift-Malfunction" or "Pressure-Switch error" - You can try replacing the pressure-switch but again I doubt that'll fix anything. If you're from Islamabad or Rawalpindi I suggest that you get your car checked from Nazir Auto located at G-8/1. I got mine checked at Honda Avenue from my own professional Honda certified mechanic (P:S I trust that person with all my heart) - who outsourced the car to his Ustaad somewhere in Rawalpindi. It was the first time when I never even went to the mechanic, the car was towed from Honda Avenue and delivered at home when it was fixed.
Before I changed my transmission my first-to-second gear became unbearable, jerking at every presented situation. From upshifts to downshifts it was throughout a struggle. I tried to apply less throttle when shifting into second but that barely helped. In the 7th generation Accord as you might be aware there are a variety of variants, get the only transmission which is compatible with the Accord CL series as it's a sequential gearbox (Auto - Manual) unlike the only Auto gearbox available in the other Accord varients.
I did the fluid flush myself which probably extended my car's transmission life for approximately 5,000-6,000KM. If you do not get it changed eventually you'll find your "D" green-light blinking in the cluster and it'll be too late for you, thats one indication that your gearbox is finished.
Ever since I got mine changed Allhumdillah, Allah ka bohat karam hai I've never been more satisfied. If there's in anyway I could help you out please let me know.