Most infuriating = Moghedian. Every time she escaped or Nynaeve let her live I :facepalm. Same sort of frustrations with Lanfear.
Scariest, tho, is tougher. Probably Graendal or Moridin. I agree M'Hael is awesome. Sermihage we know less of so the mystery helps. Same with Sermihage...