Hello Peerke and welcome to the forum!
Would you by any chance have obstructed the side microphone on the left of the phone with your finger while in speaker mode?
If yes, the issue was already discussed here:
4 Likes