It seems there is a bug in Ubunutu (a possibly other distro’s) that certain keys don’t work as they should.
For example Page up and Page down in the guest were producing something similar to a right click.
The fix for me was quite simple: echo "xkeymap.nokeycodeMap = true" >> ~/.vmware/config
More helpful tips are here