Just a small extract from Wikipedia (couldn't resist - "Do You Mind?"):
In 1955, Ross worked at a nightclub in Miami Beach called Ciro's. He was spotted by Nat Hiken and Phil Silvers, who were planning You'll Never Get Rich (later known as The Phil Silvers Show and sometimes Sgt. Bilko) and loved Ross's comedy skills. Ross was hired on the spot and cast as the mess sergeant, Rupert Ritzik.
Ross made Ritzik memorable. Ritzik was henpecked, dumb, and greedy, always an easy mark for Bilko's schemes. Whenever Ritzik had a sudden inspiration, he would hesitate and stammer "Ooh! Ooh!" before articulating his idea. The catch phrase came from the actor's own frustration when he couldn't remember his lines. Silvers would deliberately stray from the scripted dialogue and give Ross the wrong cues, prompting a genuinely confused reaction and an agonized "Ooh! Ooh!" from Ross.
After The Phil Silvers Show ended in 1959, Nat Hiken went on to produce Car 54, Where Are You? and cast Joe E. Ross as Patrolman Gunther Toody of New York's 53rd Precinct. Fred Gwynne, another Bilko alumnus, played Toody's partner, Francis Muldoon. Toody could usually be counted on at some point to say, "Ooh! Ooh!" or "Do you mind? Do - you - mind?". Ross became so identified with his policeman role that he recorded an album of songs entitled "Love Songs from a Cop". Roulette Records released the LP in 1964. Ross did the voice for Toody for the episode "Car 54" of Hanna-Barbera's Wait Till Your Father Gets Home, in which Toody and Muldoon moonlight running a day care center and one of the children turns up missing.
Ross also starred as Gronk in Sherwood Schwartz's ill-fated 1966 sitcom It's About Time, which featured two 1960s American astronauts who were thrown back in time to the prehistoric era.