Using Classic Outlook on Windows for personal email, calendar, and contact management
If you also have an IMAP account in the profile sometimes it can also cause this issue. There is a registry key that could help, https://www.slipstick.com/problems/outlook-exe-continues-running-after-you-exit-outlook/. This MVP article also has a ready-made registry key if you need it. Download the reg key and double click to add it. You can drag the reg key file into Notepad if you want to see the path and setting. If you only have the Hotmail account in the profile it won't help in this case.