Do you mean the floating insert comment icon?
If so, in Word, go to Files > Options > General,and make sure "Enable modern comments" is disabled. Then restart Word and test. It shouldn't happen after that.
=============
As for the blue arrow, that one is a bit unclear since it is not a stard Windows feature. Can you take a screenshot or picture of the screen so I can have some visual hint as what it can be, I suspect that one is related to third party app.