Frustration after fourth attack on rare Ripon building