Edit: Solved. Thanks Reisen.
On the Ranking menu, press R2/Right Trigger to pull up the list of players you’re following.
[S]How do I stop following ranked players for replays? I followed a couple players when the game first came out, but the “No new replays available” message is getting annoying. I don’t even remember the players’ tags anymore.[/S]