Is it a new installation? If so make sure the inlet is on the right. The only other logical explanation is the one you suggest.
It should take a few minutes for the water to start tasting salty if operating properly. If salty right away the O rings are the probable cause.
Good luck