While traveling in areas that are prone to pick-pocketing, it is always recommended for men to keep their wallets in the front pocket of your pants. But just warp a rubber-band over your wallet before putting in your pocket. This will make it difficult even for expert thieves because of the additional friction because of the rubber-band.
This also prevents the wallet to, accidentally, drop out coins or papers.