A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
Hi Wiesneski,
The other answers cover the main idea well. I'd add two things that can make the new structure easier to maintain.
1. Let your folders help with metadata
People often skip metadata when uploading files. If you keep a few folders, one per project for example, you can configure default column values for each folder.
Go to Library settings > General settings > Column default value settings, select the folder, and set the default Project and Department values.
New files uploaded directly to that folder can then pick up those values automatically. Leave Document Type for users to choose, since that can vary between files.
This won't automatically update existing files. Also, don't assume that moving files between folders will update their metadata.
For existing files, you can select several at once and update their properties together in the Details pane.
Microsoft's guide: Bulk edit list item properties
2. Know when to keep folders
If you're using the default document library connected to Teams, keep the standard channel folders in place.
If a whole category of documents needs different access permissions, consider a separate library with its own permissions. That's generally easier to manage than multiple folders with different permissions.
I'd try this with one project first before reorganizing the entire library.
I also wrote a longer guide covering folders vs metadata, naming conventions, permissions and views (my own article):
https://www.billyperalta.com/blog/sharepoint-document-library-best-practices/