Don't push too hard too quick. I often walk, then slow jog when I'm getting over a cold or illness. And that does seem to help. But I think you want to be careful about breathing really heavily / deeply and increasing heart rate too much. It has been a few years since it happened, but I've had a couple colds turn into respiratory infections which I blame on doing too much too soon. In recent years, I have been careful to build back up easily.
Good reminder...I do tend to be impatient!