When a user has only the "Display Service Provider" right, it doesn't actually allow them to Display the Service Provider (i.e. go to Administration > Service Provider or access /Organization/OrganizationDetails/123456). Instead, they get the "you don't have sufficient rights" error message.

grant the "Edit Service Providers" right to access the "Display Service Provider" page.