Determinism just means that your decisions are the inevitable result of the past. This doesn't mean it's not your decision.
The opposite, non-determinism, means that your decisions aren't fully determined by your own past and experiences, which to me sounds like a greater violation of free will.
How?