Given the fact that he was single, he was an older gentleman (which is on its own ironic considering that George Gaynes managed to live up until the ripe old age of 96, if I'm not mistaken), and his income probably wasn't high enough to support a child.