They probably knew you were drinking anyway... hard to hide. At least the panic attacks highlighted the fact you're trying to stop.
In general it gets harder to withdraw as time goes on. Panic Attacks happen more often too. It's a good reason to make this last experience your last.