That is not “I am going to blackmail someone” but more there is a point where you just know too much and people start to be threatened and/or they think you have been around too much.
Some organisations will only learn when those people move on just how valuable they were.
Experienced and knowledgeable people to have around are critical – only having staff “learning on the job” is not a good way forward.