These are common trouble of VWware. The last time that I used a VMware Player is nearly a year ago. One get sound nearly not to work an the reachable screen size in fullscreen mode is, as I can remember, restricted to HD (1366 x 768). I think with the release of one of the next servicepacks or Mavericks 10.9 you are with your hardware specs are good to go with a vanila install of OSX. If in your bios section are for vga the options for integrated and switchable gfx - you have in your system a working HD4000 -,then you are just now right to go. Then your ATI card will probably never work. If there are no options to switch between gfx cards, your output is done bei 8770m.
This card is a successer of ATI series 7 and 6. Under the following link you can find nearer information: http://www.notebookc...0M.86799.0.html
If you have time you can read this guide: http://www.insanelym...-for-beginners/
You should also have look in the downloadsection and get there Pandora. You have to get an original MountainLion.app to generate automaticly your usbinstaller. You are guided through the install options. You can do the installer in VMware. Therefore you must activate the usb port for it.
I suggest, that you should do the install on an other harddisk in an external enclosure or exchange the an other disk with your Win8 disk. In any case you need an 8 GB usb-stick.
In your bios you have, if the options are there, set usb to legacy, sata to manual and ahci, bios boot to legacy and disable secure boot.
Please read in the New User Lounge the pinned topics. You should also put your relevant hardware for easier to support, put in your signature, like many others this have done.