The relative lack of early contact with your child has a circular effect. The older your child becomes without a bond having been established, the more awkward you and your child will feel when you are together. And the more awkward you feel together, the less you will want to engage each other again.
Difficult children are difficult to be with. Instead of pleasure, they often provide stress and frustration. Instead of offering joy, they cause you to wish you had a different child. You believe that he can't do anything right. It is natural to want to withdraw from interactions which are painful and unrewarding.
How do you not lose patience with a difficult child?