I would take the moss off and put it in a seperate pot. A thick moss carpet can keep air and water from the soil and keeps it wet too long. It's usually not a big problem on healthy trees but your tree sounds stressed already so it doesn't need anything else to cope with.

Tony