If you can still sign in, go to account.microsoft.com/security, select Manage how I sign in, expand the wrong phone number and select Remove. Before removing it, make sure the account has another method you can access, such as your email address.
Please note that Microsoft no longer allows adding a phone number as a new verification method on personal accounts, so you won’t be able to add the correct number in its place. You can use an email address or the Microsoft Authenticator app instead.