Cyberdevs Posted Saturday at 07:29 PM Share Posted Saturday at 07:29 PM Just came across a nice video on youtube about using modern nVidia and AMD GPUs on macOS: "TinyGPU app lets you use AMD and NVIDIA GPUs on macOS over USB4/Thunderbolt with tinygrad." https://docs.tinygrad.org/tinygpu/ There are bunch of videos on youtube that you can see if that's really worth using. 6 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/ Share on other sites More sharing options...
deeveedee Posted yesterday at 12:02 AM Share Posted yesterday at 12:02 AM (edited) @Cyberdevs I'm not sure which I'm more excited about: learning about macOS graphics with modern nVidia or the fact that I'm reading a post from you! Great to see you here!!!! 🎉💙 Edited yesterday at 12:03 AM by deeveedee 3 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850903 Share on other sites More sharing options...
Max.1974 Posted yesterday at 12:10 AM Share Posted yesterday at 12:10 AM Nice see you again my friend ! 🤩🍀👊🏻👏🏻 7 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850904 Share on other sites More sharing options...
Cyberdevs Posted yesterday at 04:20 AM Author Share Posted yesterday at 04:20 AM @deeveedee and @Max.1974 Thanks guys It's nice to be back. It's been a crazy couple of months! 4 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850905 Share on other sites More sharing options...
deeveedee Posted yesterday at 02:22 PM Share Posted yesterday at 02:22 PM (edited) @Cyberdevs I took a quick look at the link you posted. I read your post too quickly and thought you were referring to modern NVidia graphics over thunderbolt/usb4. It looks like the link discusses tensor processing on nVidia over Thunderbolt/USB4 - correct?. Still very cool. I'm doing all of my AI programming on Linux (Ubuntu) with nVidia RTX dGPUs and PyTorch. When I get my first real Apple Silicon Mac, I will have to revisit this. Thanks! EDIT: I haven't explored this for a while, but it also looked promising. Edited yesterday at 02:50 PM by deeveedee 2 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850910 Share on other sites More sharing options...
Alpha22 Posted yesterday at 02:39 PM Share Posted yesterday at 02:39 PM @Cyberdevs welcome back 3 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850911 Share on other sites More sharing options...
Cyberdevs Posted yesterday at 04:17 PM Author Share Posted yesterday at 04:17 PM @Alpha22 Thanks @deeveedee Yeah the main reason for using Nvidia GPUs on Macs would be mostly to benefit their RAW power for AI, and it seems to be working somewhat ok, not as optimal as Windows or Metal on macOS but it's great news that some people are rewriting the whole Nvidia drivers for macOS from the ground up. 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850915 Share on other sites More sharing options...
Mirone Posted 23 hours ago Share Posted 23 hours ago @Cyberdevs, Glad to see you back! 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850921 Share on other sites More sharing options...
Cyberdevs Posted 17 hours ago Author Share Posted 17 hours ago @Mirone Thanks man 1 Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850924 Share on other sites More sharing options...
ori Posted 14 hours ago Share Posted 14 hours ago Has anyone tested the RTX 5080 or 5090 on PCIe with these drivers? Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850925 Share on other sites More sharing options...
deeveedee Posted 7 hours ago Share Posted 7 hours ago (edited) @ori Are you trying to use your RTX 5080 or 5090 for Tensor Processing? If so, the article posted by Cyberdevs indicates support for an eGPU connected via USB4/Thunderbolt interface. The article doesn't mention PCIe interface support. Also, if you are hoping to use the RTX 5080 / 5090 as a graphics card for macOS, you made the same mistake that I did when I first read this. TinyGPU enables eGPU Tensor Processing for TinyGrad. It is not a graphics driver for macOS. From the article... TinyGPU app lets you use AMD and NVIDIA GPUs on macOS over USB4/Thunderbolt with tinygrad. Requirements macOS (13.0+) USB4/Thunderbolt port A supported GPU (AMD RDNA3+ or NVIDIA Ampere+) Edited 7 hours ago by deeveedee Link to comment https://www.insanelymac.com/forum/topic/362864-using-nvidia-amd-gpus-on-macos-intel-and-apple-silicon-for-tensor-processing/#findComment-2850932 Share on other sites More sharing options...
Recommended Posts