Yep. It depends on the context.

If somebody cares to research the history of such cases they will find that Jews and atheists and some other groups have sued municipalities over the years when those municipalities overtly endorse a sectarian display on the courthouse/city hall lawn to the exclusion of others.

There's been more sectarian fighting over government religion in this country over the centuries than there has been atheists asserting their rights. Back in the day the Catholics and Protestants had riots over which Bible to use in schools and most of the old school prayer lawsuits were some minority sect that didn't like being compelled to recite prayers of another religion. That was long before O'Hair came along and ruined the country.