Thank you for the screenshot, your RAM usage is normal for Windows 11, the operating system on its own will use 3.5GB+ of RAM without any apps running, Windows 11 is very resource intensive.
You can try to disable any startup apps on the Startup tab in Task Manager, but usually you will not be able to lower the RAM usage of the Windows 11 OS.