Since the laptop runs fine without the battery and the new battery sits at exactly 4%, this usually isn't a dead battery. It's more often Windows holding on to old battery information from the previous pack, or the charging circuit needing a reset after the swap. Let's reset both.
- Shut down the laptop, unplug the charger, remove the battery, then hold the power button for 30 seconds. Put the battery back in and plug in the charger.
- Boot into Windows, right-click Start > Device Manager, expand Batteries, right-click "Microsoft ACPI-Compliant Control Method Battery" and choose Uninstall device. Then restart. Windows reinstalls it with fresh readings.
- Leave the laptop plugged in and powered off for about 2 hours, then boot and check the percentage.
- If it's still stuck, check your laptop maker's BIOS for a battery calibration option and run it, and make sure the BIOS is up to date, since new batteries sometimes need it to be recognized.
Hover over the battery icon in the taskbar and tell me what it says: "plugged in, charging", "plugged in, not charging", or something else. And what's the laptop make and model? That tells me whether the charger is the next thing to look at.
If this helped, please click Accept Answer so others with a stuck battery percentage can find it.