Hello
I am trying to make sense the location you are referring to?
Are you talking about in Word, you go to File tab, and then on this page, where you have list of files from "Recent", "Favorites", and "shared with me"?
If so, the font size of this list is managed by your Windows interface actually.
Assuming you are on Windows 11, go to Settings > Accessibility > Text Size, use the slider to adjust the size, then click on Apply. That should also change the font size in Word > File tab.