But they say that Callandor was the most powerful sa'angereal ever created, only matched by the double statues. Lews Therin had neither of those available.
But yes, the key was the ability to link with the women, and using all three Powers to seal the prison again.