Should We Eliminate Books of the Bible that Don't Line Up with the Rest of It?

I have read that Martin Luther wanted to exclude the epistle of James from the canon of Scripture, probably because of one apparent contradiction between James and Paul on justification by works vs faith. Should we be willing to exclude one of our holy writings as a result of contradictions or other evidence?

First off, Luther was wrong to want to omit James, because there is no contradiction. James isn’t saying that works save you - he is saying works prove you ARE saved (See James 2:14-26). 

We believe that God wrote the Bible, and we believe God put it all together - all 66 divinely inspired books God made certain were put into one volume. Read God Wrote a Book by James MacDonald for an excellent answer to this, particularly chapter 2.