First point of clarification.  The prohibition against a keeper using his/her hands deals with a "deliberate pass"  from a teammate.  Note well, the law does not say a "deliberate pass back to the keeper."

For example, you have a defender who plays a square pass in the penalty area to a fellow defender.  The keeper sees an oncoming attacker who is going to get to the ball before the defender and picks up the ball (or plays it with his hands) in the penalty area before the attacker gets to it.  Proper call is keeper handling a deliberate pass and an indirect free kick for the attacking team.

Second.  The laws of the game state that the pass must be deliberate and must be with the feet.  Therefore a ball played from the thigh back to the keeper which the keeper handles is not a pass therefore not an infraction of the laws of the game.  So, if in the opinion of the referee the defender is not attempting to pass the ball but attempting to do something (like clear it out) then there is no violation.

Third.  To your point about denial of a goal scoring opportunity and the possibility of a card.  As strange as it sounds since a keeper is allowed to use his/her hands within his/her penalty area there is NO possibility of a red/yellow card for a keeper handling a deliberate pass (or throw in) from one of their teammates even if that handling prevents a goal.  See my first example.  Basically, it is impossible for a keeper to be sanctioned (PK, yellow or red card) for the handling the ball in his penalty area regardless of who plays it.  Except for the indirect free kick.

Finally, that is a very good you tube clip.  Looking at the clip the interpretation from both the Center and the AR must have been given the body position of the defender and the pressure by the attacker player that this was not a deliberate pass but rather an attempt to kick the ball out of trouble.  Close but it looks to me like a good no call.