Getting a post office box is a good way to keep important information private and checks safe. Another way would be to get a mailbox that has a lock and a very small 'one way in' mail slot.
This could be a pain in the neck when receiving large envelopes and small packages but the inconvenience of picking those items up a the Post Office would be a small price to pay.