Help after getting constantly bombarded with notifications of someone trying to log in
So like a month ago, my account got pwned and with that my Facebook. They made a page but I caught it in time setup 2fa changed my pass all the things you should do and now I am just waiting for the page to get permanently deleted. However about 2 weeks ago I've started getting these annoying notifications about someone trying to log in. I figured out that it was someone logging in through my old password but not getting in due to 2fa. I tried it in an incognito window and it for some reason let me get in, but asked for 2fa.
So I have a couple questions: any way for me to stop these notifications or remove the old password? I tried to change the email, which doesn't work anymore but for some reason my phone number does, even though it's been removed. Any help is appreciated ❤️❤️ I really don't want to change my phone number due to Facebook