A really simple rule of thumb – if you keep call recordings expect a data subject to want to have a copy.
If you don’t want them to have a copy – destroy the recording at the appropriate time.
Of course, never destroy the recording when someone asked for it – that might force the ICO to take action.