Yes; it has to be one way. Current goes from the row wire to the columns that are connected to it via diodes. Some of those columns have other diodes connecting them to other rows. Current must not flow in that reverse direction, otherwise columns would be randomly shorted together via rows that are not currently (no pun intended) being probed.
