Hi!
Welcome to Microsoft Q&A forum.
Please let me know if you've done the step already so we can skip it.
I'll provide you steps that will help regarding this phantom layout that appears no matter what you do.
Step 1: You need to remove it from the language list.
- Settings → Time & language → Language & region
- Make sure English (United States) is not listed.
- Keep only your desired layout (English (Estonia) etc.).
- If ENG-US keeps appearing, click it → Language options → Remove keyboard → US.
Step 2: Force your layout as default for all users
- Press Win + R, type control /name Microsoft.RegionAndLanguage → Enter.
Click Administrative tab → Copy settings.
- Tick Welcome screen and system accounts and New user accounts, then OK.
- This overwrites the system-wide default with your preferred layout.
Step 3: Delete the US layout registry key. (do not skip this step)
- Run regedit and navigate to:
- HKEY_USERS.DEFAULT\Keyboard Layout\Preload
- Delete any value whose data is 00000409.
- Do the same under:
- HKEY_CURRENT_USER\Keyboard Layout\Preload
- and HKEY_CURRENT_USER\Keyboard Layout\Substitutes
Reboot you computer once done.