The last time the holders were knocked out of the FA Cup by a non-league side was January 1909: ironically, it was Palace who ...