From what I understand, they don't leave the river per se, they spend the time in their wintering holes, deep and not prone to freezing (like dodgeboy's beaver ponds). There will also be migration from spawning which will increase the population of bigger fish periodically. Just need to find the pools