if you pull the knob it'll come out but thats not the issue, mine same knob in 2006 altis was hard, i took it to toyota 3S they dismantled only the knob part by lying in the footwell and accessing it from there and applied some grease, it worked like a charm never had trouble again, they didn't disassemble anything from front, i would advise the same