Yes, everyone needs parallel computing on this scale, it's just that they don't know it (yet). In the same way that everyone needed 3Ghz single core CPU when they already had 2GHz single core CPUs.
GPUs are different to CPUs in many ways, not least of which is that they are very difficult to debug, do not support recursion (this might have changed?), need special,non-standard data structures (streams). Multi-core CPUs suffer none of these limitations and developers can use non-proprietary standard build tools to develop software for them.
GPUs are different to CPUs in many ways, not least of which is that they are very difficult to debug, do not support recursion (this might have changed?), need special,non-standard data structures (streams). Multi-core CPUs suffer none of these limitations and developers can use non-proprietary standard build tools to develop software for them.