The WpSolr scripts conflicted with WP core Jquery. When both core Jquery and WPsolr active it will return 404 page.
I can solve the issue by disable Core Jquery from loading, but WPsolr itself seems to include function to call for core jquery. To confirm this, I used the Plugin Load Filter to disable WPsolr on a page, and the remove core jquery scripts only works on this page.