No because that is not what they serve. If they had a dish only served to Muslims, but not infidels, then you would have a case.
But they don't serve it based on religious beliefs and we can't limit others based off religious beliefs? I guess the difference would be the "official" reasoning for not serving it. If the baker just said he was too booked, he wouldn't be in this situation.