The hospital said it had received similar cases in the past, with patients items such as ballpoint pens and cables up their penises.
When he finally did visit a doctor, he told them he had got into trouble while engaging in 'urethral play'.
Jiann Bang-bing, head of urology at Kaohsiung Veterans General Hospital in Kaohsiung, Taiwan said the plastic rod measured 20cm (7.87 in) long and 1cm (0.39 inches) wide.
Accident
The patient claimed he was pleasuring himself when he accidentally inserted the device into his bladder.
A routine cystoscopy - an endoscopic procedure into the man's bladder - helped remove the toy, which had already caused inflammation and blood in his urine.
The patient was discharged from hospital and is expected to make a full recovery.
Doctor Jiann reminded members of the public to properly sanitise sex toys and to make use of lubricants in order to avoid serious injury.
Golf balls
Others have also been admitted with golf balls and light bulbs stuck up their anuses, the hospital added.