Actually deeply thinking of plant lifecycle and morality of it all is interesting question. Is it morally more wrong to feed grass to cow after it has shed its seed than to eat fruits and prevent their seeds from spreading? Clearly in first case plant is already dying, but has done it's life and procreation. On other hand later case is clear exploitation comparable to abortion.
Probably should have been clearer about us eating them and shitting in toilet where it ends up in sewage treatment with no chances of ever sprouting...