But in this case with slow speed, it's the massive (literally) amount of mass of the cargo ship that gives it an un-intuitively large amount of energy.
To your point, it is mass. Most people don't understand mass on water. At 1 knot the ship would do the exact same damage, topple the support and drop the bridge.