Does a doctor violate a woman's rights by refusing to perform an abortion?

Many people on the left claim that a doctor who refuses to perform an abortion -- or a pharmacist who refuses to dispense Plan B -- is thereby violating the rights of the woman. Those doctors and pharmacists, however, claim that they're exercising their own freedom of religion. Who is right?