After long convos on the phone with AT&T and Apple, I finally got it activated. Had to ditch the old number, got to AT&T store and get a new sim card, activate as a new account and then finally cancel my old phone number and account.
The second attempt at activation was completed in 15 mins.
Oh yeah, now I can finally attest to the greatness of this phone.