There is also the Black Swan pub. Go straight on to the right of the bar, then turn left and left again. Best to buy a drink, though.
When it is open, the sports pavilion at Finches Field offers toilets.
In an emergency, you may want to take advantage of the fact that several of the roads in Pease Pottage are lined by bushes and trees.