Go to settings → users
There the Guest account should be listed.
Change to this Guest account
Again go to settings → users
Then you should get the option to remove the guest account.
If I recall it right, that is.
I right now don’t have my phone at hand.
Edit: I guess if there is no guest account that the icon disappears as well.