stick to one's knitting

To do your own job and not bother other people.
The trouble with Henry is that he is always telling other people what to do; he can't stick to his knitting.
Categories: bother informal verb