Should marital infidelity be illegal?

Many states, including Colorado, have laws against marital infidelity on the books. These laws are rarely if ever enforced. Politicians often attempt to repeal them, but those attempts are often unsuccessful. Many people think that the government ought to "take a moral stand" even if the law isn't enforced. Does that view have any merit? Should these laws be repealed? Why or why not?