On the MSN Weather page, search results are kept at the top of the screen. To remove a location that was added there, select the X next to that saved search result.
If the issue is the main weather location being shown on MSN.com, click the pencil icon next to the location and temperature, then set the default location you want.
References: