Bowie is credited as playing ALL instruments on a rare version of "Rebel Rebel". 
This can be found on the Sound and Vision box set (Ryko, 1989).