hang back
1. To stay some distance behind or away, be unwilling to move forward.
Mary offered the little girl candy, but she was shy and hung back.
2. To hesitate or be unwilling to do something.
Lou wanted Fred to join the club, but Fred hung off.
Categories:
Source: A Dictionary of American Idioms