Yes, electrolytic caps are an exception most of the time. Some real sticklers ever get lathered up about those being original but most people understand that they age and need replacement. Some people will have strong opinions about which caps to use. I ran into that when recapping my Leak Stereo 20.
Definitely clean the surfaces of the existing RCAs, but don't change them just to change them.
BTW, welcome to VHiFi.