Dear Justin,
Good day!!
Firstly, we are sorry for the inconvenience caused with the OneDrive for Business and please allow us to help you at our best.
As per the description shared, I would like to confirm whether you are prompted with “Working offline. Changes will be uploaded when you reconnect” when you open your OneDrive in the browser:

If yes, I would like to convey that the Offline mode is a new feature in the OneDrive, where it will allow the users to access the content in the OneDrive in the browser without the internet connection and for reference here is the article: Work with OneDrive web app when offline - Microsoft Support
To turn off the Offline mode in your OneDrive for Business, I request you follow the steps:
Open the OneDrive for Business in the browser> My Files tab> Click on the Details or Info at the top right> Click on Turn Off under the Offline mode> In the Confirmation Dialogue, please click on Turn Off.

Next time when you reopen the OneDrive for Business in the browser, you will not see Offline Mode.
**Note:**If you still the Offline Mode after turning it off, please clear the browser cache and check the outcome.
For reference on the steps, check the section “Turn off Offline mode” in this article: Work with OneDrive web app when offline - Microsoft Support
If there is any misunderstanding from our end, we apologize and request you share the more detailed information with some screenshots (if you get the error when attaching the images in your reply post, please upload to any cloud location and share the link with us), where it will help us to better understand and guide you further.
Appreciate your patience and understanding. Have a great day!!
Best Regards,
Sophia