Configuration of Raley Notifications is available from two places:

1) Top menu of Jira

2) Jira Unified Plugin Manager

The first option is available to Jira admins, System admins and users who has Project Admins role in some Jira project. The latter is available only for Jira Admins. 

If you need to limit access of Project Admins to configuration of Raley Notifications, then you should do the following:

1) Log-in with Jira System admin user

2) Navigate to Add-Ons → Manage Add-Ons → Raley Email Notifications → Configure

3) Choose "settings"

4) Add the following line to the settings:

show_addon_to_pa=false

5) Click save. Now you can log-out and login with user who has ProjectAdmin permissions to check if the Raley has disappeared from the top menu