Mike,
If you open the check valve, the pump can not be running... If you open it when the spa water is low, I would expect some water to flow out, but it really depends on your plumbing.. Just take it out, clean it up and stick it back in. Make sure it goes back in the same direction it came...