Sure if it makes you that uncomfortable then you need to decide, but it's not something that is "wrong" per say and there needs to be compromise if you respect his choices.
But like was said about, if it's a deal breaker then you need to leave because you can't tell him to stop something that is natural to him (unless it borders on excessive or freaky)