Regardless of whether your diving board is still ok or not, the standard for residential pool construction tolerances is +/- 3 inches for depth, and, if your measurements prove to be correct, your builder is way off that. You should still hold him accountable for that.