What would happen if we stopped fishing?

Less than a century ago, the world's oceans were swarming with giant fish. Could we ever get them back?