There is no way to change the difficulty in Castle Creeps TD at this time.
The Difficulty meter you see indicates the difficulty of the selected Level based on your current Tower Strength. The more you Upgrade your Towers, you will begin to see the difficulty of certain Levels reduce.