I mean It's a little unlikely that a spirit is following you two to different locations. You could have been cursed though. Maybe you got cursed by someone, that would be more believable to me.
Burn some sage in your house.
If you're that concerned, seek out someone who can remove the curse or...