How do I restrict Access to Competitors based on the Restrictions in the Business Roles?

I have put in restrictions to access Competitors based on the Rule by Sales Organization. However, this doesn't seem to segregate the views of the Competitors in the system based on the user's position in a Sales Org.