Jump to content

[How To] X800 XL set up with working Display Manager and QE/CI


  • Please log in to reply
231 replies to this topic

#1
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
As I was re-doing my OS recently, I figured it was a good time to give a guide of how you can get your hardware up and running. This is also partially an off-site backup of every step I performed, just in case my computer completely crashes.

Edit: These instructions should work on a lot more cards than just an X800 XL. If you get your card to work with these instructions, add the card model that you own to this thread. You also need to be running OS X 10.4.4 or 10.4.5 (or have the ATIRadeon9700 set of Extensions from that version of OS X). Please do not ask me for those files as I cannot legally redistribute them.

Getting ready

It would be a good idea to backup your entire Extensions directory before proceeding just in case you royally mess up anything.
sudo cp -R /System/Library/Extensions /System/Library/ExtensionsBackup
Enter your password when prompted.

In order to do some of these steps more easily, we're going to run TextEdit and HexEdit in Super User mode. This will save you having to learn nano, vi, or any of those other terminal-based programs.

For TextEdit, open a new window in Terminal. Copy and paste the following:
sudo /Applications/TextEdit.app/Contents/MacOS/TextEdit
Enter your password when prompted.

For HexEdit, things are a little bit more tricky, especially because HexEdit doesn't come on the computer.
HexEdit 2.00 at MacUpdate

It's in a .sit archive, and since OS X no longer comes with Stuffit Expander, you'll have to download that, too.
Stuffit Expander 11.0 at MacUpdate

After you've downloaded and extracted HexEdit, drag HexEdit Release into your Applications folder. Open up another window in Terminal, and copy and paste the following:
sudo /Applications/"HexEdit Release"/HexEdit.app/Contents/MacOS/HexEdit
Enter your password when prompted.

Now you have two simple editing utilities set up with some pretty advanced power. Until you close them, they have the potential to harm protected files.

Part 1, Callisto Installation

I used b006 for installation purposes. It's available on Omni's new website.

After extracting b006, Look in the folder for CallistoHAL.kext. Right-Click on this file and go to Show Package Contents. Double click on Contents, and then drag Info.plist to TextEdit in the dock.

Find
<key>IOPCIMatch</key>
<string>0x41501002&0xffffffff</string>
and change it to
<key>IOPCIMatch</key>
<string>0x554d1002&0xffffffff</string>
Make sure you replace 554d with whatever your specific Device ID is, which is avaliable in System Profiler, and then save and close the file.

Open up another Terminal window, and type (or copy) this into Terminal:
sudo -s
cd <Drag in the directory where the Callisto .kext files are at>
chown -R root:wheel Callisto*
chmod -R 755 Callisto*
cp -R Callisto*  /System/Library/Extensions/
rm -f /Library/Preferences/com.apple.window*
rm -f /Library/Preferences/ByHost/com.apple.window*
rm -f /Library/Preferences/ByHost/com.apple.pref*
rm /System/Library/Extensions.mkext
rm /System/Library/Extensions.kextcache
Enter your password when prompted

Reboot your computer and make sure you can set new resolutions before continuing.

Part 2, QE/CI Installation

Jump back to the top and re-open TextEdit and HexEdit as described.

I performed this while my system was still at version 10.4.5. Newer .kext files may not perform the same.

Navigate to /System/Library/Extensions, locate ATIRadeon9700GA.plugin, right-click and go to Show Package Contents. Double click on Contents, and then drag Info.plist to TextEdit in the dock.

Find
<key>IOProviderClass</key>
<string>IONDRVFramebuffer</string>
and change it to
<key>IOProviderClass</key>
<string>CallistoFB</string>
Save and close the file.

Open up another Terminal window, and type (or copy) this into Terminal:
sudo -s
chown -R root:wheel /System/Library/Extensions/ATIRadeon9700GA.plugin/ 
chmod -R 755 /System/Library/Extensions/ATIRadeon9700GA.plugin/
Enter your password when prompted.

Now for the hex editing part. Edit: If your card's device ID is listed anywhere in the bottom of this post, you are probably finished. If it is, restart your computer and check before continuing.

Note: The following does the SAME thing as the "Koverg" patch. However, I was never able to get the Koverg patch to work automatically for me, so I performed the following:

Navigate to /System/Library/Extensions/ locate ATIRadeon9700.kext, right-click and go to Show Package Contents. Double click on Contents, and then drag Info.plist to TextEdit in the dock. We'll come back to it in a minute.

In your Finder window, go inside the MacOS folder, and then drag ATIRadeon9700 to HexEdit in the dock. In HexEdit, Go to Find->Find & Replace.

Under Find, type in
3d 60 5b 00 00
Under Replace, type in
3d 4d 55 00 00

If you did not have the same Device ID as me (0x554d), you need to swap each half. For example, if my card had a Device ID of 0x1234, I would put in the Replace box "3d 34 12 00 00".

Set the Matching to Hex, and hit Find Next/Find Previous to make sure that there are two occurrences of this in the file. Once you're sure there are two occurrences and that your Device ID is correct, go ahead and click on Replace All. Go ahead and save your changes and exit HexEdit.

Go back to TextEdit and scroll down thru Info.plist

Find
<key>IOPCIMatch</key>
<string>....  0x5b601002 ....</string>
and change it to
<key>IOPCIMatch</key>
<string>....  0x554d1002 ....</string>
replacing 554d with your Device ID.

Save and close the file.

Open up a fresh Terminal window, and type in the following:
sudo -s
chown -R root:wheel /System/Library/Extensions/ATIRadeon9700.kext/ 
chmod -R 755 /System/Library/Extensions/ATIRadeon9700.kext/ 
rm /System/Library/Extensions.mkext
rm /System/Library/Extensions.kextcache
Enter your password when prompted.

Go ahead and restart your computer. Check System Profiler, and you should have QE/CI working, complete with mouse tearing. I'll leave you to the Search feature to figure out how to turn that off.


The following information was relocated from post #96.

If you're interested on whether or not your Device ID is already contained inside of the Info.plist file or in the file you need to HexEdit already, here's a list, with an (approximate) graphics card equivalent. If your card's Device ID matches the first list, you probably don't need to mess with ATIRadeon9700.kext; if it matches the second, I would not touch it at all.

ATIRadeon9700.kext/Contents/Info.plist
.0x3E501002 RV380 0x3e50 [Radeon X600]
.0x3E541002 RV380 0x3e54 [FireGL V3200]
.0x41441002 R300 AD [Radeon 9500 Pro]
.0x41481002 R350 AH [Radeon 9800]
.0x41501002 RV350 AP [Radeon 9600]
.0x41521002 RV350 AR [Radeon 9600]
.0x4A481002 R420 JH [Radeon X800]
0x4A491002 R420 JI [Radeon X800PRO]
0x4A4A1002 R420 JJ [Radeon X800SE]
0x4A4B1002 R420 JK [Radeon X800]
0x4A4C1002 R420 JL [Radeon X800]
0x4A4D1002 R420 JM [FireGL X3]
.0x4A4E1002 M18 JN [Radeon Mobility 9800]
.0x4E441002 Radeon R300 ND [Radeon 9700 Pro]
.0x4E481002 Radeon R350 [Radeon 9800 Pro]
.0x4E501002 RV350 [Mobility Radeon 9600 M10]
.0x4E541002 M10 NT [FireGL Mobility T2]
.0x4E561002 M11 NV [FireGL Mobility T2e]
.0x5B601002 RV370 5B60 [Radeon X300 (PCIE)]
.0x5B621002 RV380 [Radeon X600 (PCIE)]
.0x5B641002 RV370 5B64 [FireGL V3100 (PCIE)]
Those dots signify I could find them inside the ATIRadeon9700.kext/Contents/MacOS/ATIRadeon9700.

ATIRadeon9700.kext/Contents/MacOS/ATIRadeon9700
0x5B601002 RV370 5B60 [Radeon X300 (PCIE)]
0x5B621002 RV380 [Radeon X600 (PCIE)]
0x5B641002 RV370 5B64 [FireGL V3100 (PCIE)]
0x3E501002 RV380 0x3e50 [Radeon X600]
0x3E541002 RV380 0x3e54 [FireGL V3200]

0x4A4E1002 M18 JN [Radeon Mobility 9800]
0x4A481002 R420 JH [Radeon X800]
0x41441002 R300 AD [Radeon 9500 Pro]
0x3E501002 RV380 0x3e50 [Radeon X600]
0x3E541002 RV380 0x3e54 [FireGL V3200]

0x4E541002 M10 NT [FireGL Mobility T2]
0x4E481002 Radeon R350 [Radeon 9800 Pro]
0x4E501002 RV350 [Mobility Radeon 9600 M10]
0x4E441002 Radeon R300 ND [Radeon 9700 Pro]

0x5B601002 RV370 5B60 [Radeon X300 (PCIE)]
0x4E561002 M11 NV [FireGL Mobility T2e]
0x5B621002 RV380 [Radeon X600 (PCIE)]
0x5B641002 RV370 5B64 [FireGL V3100 (PCIE)]

0x41501002 RV350 AP [Radeon 9600]
0x41521002 RV350 AR [Radeon 9600]
0x41481002 R350 AH [Radeon 9800]
These are grouped according to what other numbers I found them near.

#2
evil

evil

    InsanelyMac Protégé

  • Members
  • Pip
  • 8 posts
works perfect for the x800pro aswell. i also used the Callisto_b008 driver. i am able to set the resolution in the display settings tab full qe/ci!!!

thanks for the great write up and the easy to follow instructions!!!

#3
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
I forgot to mention...If your computer won't boot, here's how you can fix it:

Boot into Single User Mode (-s)

/sbin/mount -uw /
rm -R /System/Library/Extensions/Callisto* <To remove Callisto>
cp -R /System/Library/ExtensionsBackup/ATI* /System/Library/Extensions/ <To restore ATI kexts>
rm /System/Library/Extensions.mkext
rm /System/Library/Extensions.kextcache
reboot


#4
ѕӎѳѳ₮ңӌ

ѕӎѳѳ₮ңӌ

    InsanelyMac Leg-End

  • Members
  • PipPipPipPipPipPipPip
  • 506 posts
  • Location:Underground, UK
  • Interests:DUH!!
Hi, boris also has a solution to this. I have a question though, well a few actually. Does this work with sleep and wake? Can you use a dvi monitor? Can games such as cod2 or quake 4 play with this? The first two questions appear to be the limitations of boris' solution.

#5
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
I don't know a whole lot about Boris' solution, but from what I can tell, it's designed to get X1000-series cards working by replacing codes which are used for the X1600. This method (the "Koverg" section) is designed to replace the values for the X300 PCI Express card in the ATIRadeon9700 files.

Past that, I'm not sure how to answer your questions. Final Cut Pro works for me, and that's what I was aiming for in my OSX86 installation.

#6
ѕӎѳѳ₮ңӌ

ѕӎѳѳ₮ңӌ

    InsanelyMac Leg-End

  • Members
  • PipPipPipPipPipPipPip
  • 506 posts
  • Location:Underground, UK
  • Interests:DUH!!

I don't know a whole lot about Boris' solution, but from what I can tell, it's designed to get X1000-series cards working by replacing codes which are used for the X1600. This method (the "Koverg" section) is designed to replace the values for the X300 PCI Express card in the ATIRadeon9700 files.

Past that, I'm not sure how to answer your questions. Final Cut Pro works for me, and that's what I was aiming for in my OSX86 installation.


Sorry, i just re-read the title, x800xl not x1800xl. Doh :wallbash:

:withstupid:

#7
Orlics

Orlics

    InsanelyMac Protégé

  • Members
  • Pip
  • 5 posts
I tried to get this working with my X800 GTO, but the damn thing won't boot. Restoring the old kexts worked, so it's got to be the 10.4.6 9700.kext. Is there a way to get an older ATIRadeon9700.kext anywhere on the internet? Could any of you send me yours?

Oh, and the Callisto drivers work alone. It's the QE/CI I want. And btw, I'm installing Mac for FCP too. :)

#8
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
lol...nice....

Mine won't do you much good because I didn't backup mine until I upgraded from 10.4.5 to 10.4.6/10.4.7, which was after I fixed QE/CI.

#9
Orlics

Orlics

    InsanelyMac Protégé

  • Members
  • Pip
  • 5 posts
Could I try yours anyway? :P

#10
dungeon

dungeon

    InsanelyMac Protégé

  • Members
  • Pip
  • 34 posts
i've got everything working. THe only problem is that I have X300SE but system only shows 32MB of video RAM. Any ideas?

#11
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts

i've got everything working. The only problem is that I have X300SE but system only shows 32MB of video RAM. Any ideas?

Yeah...Don't play any video games that weren't designed for the mac in the first place <_<

Your card misreporting itself may or may not be problematic, but if it is, try the following and see if it improves at all:
  • Remove Callisto
  • Restore/undo your changes to ATIRadeon9700GA.plugin ONLY.
  • Manually/Permanently set your resolution in com.apple.Boot.plist
Search the forums for more information on the last step.

#12
pat_ty

pat_ty

    InsanelyMac Protégé

  • Members
  • PipPip
  • 51 posts
I have done every step. I finally got QE, CI, and adjustable resolution. However, I still see the mouse tearing.

If I install only Callisto, I always get adjustable resolution and no mouse tearing.

Which option should I pick? Is there any way to get everything perfect? or I have to use mouse locator with the first option.

PS. I have X300SE with 5B60

#13
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
Because we don't have the ability to report our cards to the Operating System correctly, you have the choice of either having mouse tearing (with QE/CI) or not having mouse tearing (without QE/CI). Mouse tearing is just one of the things that you'll have to live with probably until they release the Intel Towers and someone hacks the drivers off of them.

QE/CI (and the mouse tearing that comes with it) is a critical part of OS X, and is used in everything from webpage renders (which can work without QE/CI) to DVD Playback (which does require QE/CI) to applications like Final Cut Pro (which will not even install without QE/CI support).

P.S. If you have an ID of 0x5b60, what did you do of the last half of the instructions? Just the ATIRadeon9700GA.plugin?

#14
pat_ty

pat_ty

    InsanelyMac Protégé

  • Members
  • PipPip
  • 51 posts
What I did was modify this code only

<key>IOProviderClass</key>
<string>CallistoFB</string>

Moreover I also did change some value in this because it was not exactly the same value as you said

<key>IOPCIMatch</key>
<string>.... 0x5b601002 0x3E541002</string>

Lastly I ran these commands
sudo -s
chown -R root:wheel /System/Library/Extensions/ATIRadeon9700.kext/
chmod -R 755 /System/Library/Extensions/ATIRadeon9700.kext/
rm /System/Library/Extensions.mkext
rm /System/Library/Extensions.kextcache

#15
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
Well...you are right about that one part...

I had already checked back at what I had done, and there should be 0x5b601002 listed somewhere on that line...it's just not next to last. I think I just figured that it wasn't worth doing another edit operation to the original command, but it could possibly cause confiusion, so I'll fix it.

In other words, 0x5b601002 probably appears on that line in your ATIRadeon9700 twice.

#16
silverbullit

silverbullit

    InsanelyMac Protégé

  • Members
  • Pip
  • 36 posts
I could change resoltions on a Mobilty 9200 but I accidentally checked the wrong resolution how do I get my system back?

#17
silverbullit

silverbullit

    InsanelyMac Protégé

  • Members
  • Pip
  • 36 posts
Okay for some reason I after I reinstalled everything. When I did all of part 1 and im going to select my resolution my screen goes black and it has lines all over it. Im going to try the alternative build. Does anyone know if this is because im not selecting the correct resolution?

#18
silverbullit

silverbullit

    InsanelyMac Protégé

  • Members
  • Pip
  • 36 posts
Finally! I got callisto to work on my system by using build 003. But after I tried q support my system won't start. I haden't been able to figure out how to install callisto. Your instructions are really awesome. Your the man!

#19
phoenix3200

phoenix3200

    InsanelyMac Geek

  • Members
  • PipPipPip
  • 116 posts
This may (make or) break your system, but...

Try going into ATIRadeon8500.kext/Conteints/Mac OS/ATIRadeon8500 in HexEdit, search for 3D 63 5C and replace it with 3D XX XX (with XX XX being your device id swapped). There's only one instance of it, and don't add on the extra 0's as seen below. Do the same changes I listed for the rest of the 9700 files, except apply it to the 8500 set instead, replacing 0x5c631002 in the process with your device id.

0x5c631002 is supposedly the Radeon Mobility 9200 AGP, so I'm thinking that it would be the closest thing that you could change.

As always, make sure you remember how to fix it if it messes up.

#20
silverbullit

silverbullit

    InsanelyMac Protégé

  • Members
  • Pip
  • 36 posts
Well. I tried with the latter instructions that you gave me. Turns out my device ID is 5c61. So its really really close. After I made the changes my system works. But anything that needs hardware accelerations fails. It seems that we are really close. Is there something that Im missing. The DVD player opens. It used to say that it couldn't. But now it crashes. Chess opens but crashes. I bet its probably the next kext or something. Any ideas. Greatly Greatly appreciated.

PS: Also I replaced Hex Edit the right way swapped with 61 5C capital
Also I replaced in text edit with capital C -could that be it





0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users

© 2014 InsanelyMac  |   News  |   Forum  |   Downloads  |   OSx86 Wiki  |   Mac Netbook  |   PHP hosting by CatN  |   Designed by Ed Gain  |   Logo by irfan  |   Privacy Policy