make oneself scarce
make oneself scarce {v. phr.}, {slang}
To leave quickly; go away.
The boys made themselves scarce when they saw the principal coming to stop their noise.
A wise mouse makes himself scarce when a cat is nearby.
Categories:
Source: A Dictionary of American Idioms