The first program I ever got I typed in from a book. It made a spinning pyramid on a VIC-20. It took hours and hours only for it to disappear when I shut off the computer. Tapes were amazing!
Yes, I recall borrowing books from the library in order to type in the programs. Can't say I recall punch cards, but I'm sure someone around here does.