When modifying profile settings in the polymer UI, the setting "add roles to notification emails" seems to be deactivated. I could only enable it by going back to the deprecated UI, then once saving my settings there with the roles-suffix checkbox ticked.