I figured I would replace the front pads to rule them out as the cause, since I had a set. But then I figured I would also install new rotors, since I had a set. That did the trick. But now I don't know if it was the pads or the rotors.