Some objects have snapping always on

Sometimes a drawing will have certain objects that always get snapped-to, even when snapping is turned off. What causes this, and how can it be fixed?