Can people find you from your P.O. Box?

My fans on an art website have wanted to send me things in the past, but I don't want to give out my address for obvious reasons. I have a P.O. Box that is located in a different town, and I want to have people send me stuff using that, but I'm still afraid to announce it. Is it possible that people can track you down if they have your name and your P.O. Box?