"that difference is only seen when the player with worse potential reaches his ceiling " is the correct part. So if you have a high potential player, but he has poor starting skills, or is already old, then his potential really doesn't matter. He will never get skills high enough to matter.
This is a very good question to ask, as too many users put too much value in potential when buying players. Not to say potential isn't important, because it is.