When you uninstall Apple's version of X, you may leave behind a receipt, causing Apple to think X is still installed. So make sure you also remove /Library/Receipts/X11User.pkg.