I started using row machines at the gym for this exact reason. It's a really low impact workout but provides great cardio and involves your entire body.
Please be very careful with rowing machines.
If your vertebral discs are herniated you have a very high risk of making things much worse.
(As told to me by my physical therapist and surgeons...)