https://www.metv.com/stories/william-conrad-said-that-audiences-loved-cannon-because-he-was-relatable

Viewers could see themselves in the detective.

Exactly. He looked like an authentic tough cop that retired to become a detective