It’s all or nothing I’m afraid. I faced a similar dilemma when I signed up, as I enjoy the odd sports bet, but in the end it was the right decision for me.
Based on what you’ve shared, you should sign up anyway. It’s only ever a downhill slope with gambling, it won’t get better. Sign up and save yourself a tonne of money.