If the electron starts with zero energy at infinity (e.g. a parabolic orbit, a natural default assumption), and some of the potential energy is converted into free EM radiation due to acceleration of the electron as it is falling down the potential well, then it will become bound to the proton. My reading of phkahler's original statement is that the electron will wind up going faster than the speed of light (which is incorrect, due to gamma) due to falling down the potential well, and not due to having non-zero kinetic energy at infinity...
> If the electron starts with zero energy at infinity...it will become bound to the proton
Even if that's true (I'm not sure it always is--see below), that case is extremely rare. A much more common case is Bremsstrahlung, which you mentioned upthread--and as the Wikipedia article you referenced notes, the electron in this process starts out free and remains free after the radiation is emitted; it does not become bound to the proton.
> My reading of phkahler's original statement is that the electron will wind up going faster than the speed of light (which is incorrect, due to gamma) due to falling down the potential well, and not due to having non-zero kinetic energy at infinity...
That may have been the original intent, yes (and, as you note, it's wrong because it neglects the gamma factor). However, even in that case, what matters is not the electron's energy at infinity in the proton's rest frame, but its energy in the center of mass frame. If the electron is really falling in from far enough away that the relativistic gamma factor is relevant, which is what was implied by pkahler's original statement, then its energy in the center of mass frame (or more precisely the center of momentum frame, since in relativity you have to take momentum and energy into account) will be relativistic, i.e., large enough that it's by no means guaranteed that it will emit enough energy in radiation to become bound to the proton.