-
Notifications
You must be signed in to change notification settings - Fork 66
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AMD IPU Device not detected on 7940hs #5
Comments
Hi @abdulmueid, The IPU is an integrated hard IP on the 7940HS die, so there is no possibility that #3 is the cause. Regarding #1, this image is of poor quality but it should get the job done: Regarding #2, there does not appear to be a BIOS setting on my ASUS TUF Gaming A15 (7940HS). The driver was pre-installed on this machine when purchased. --Quenton |
Thank you for the validation and the screenshot @quentonh Here's what I see in Device Manager: I tried booting into a linux distro to run lspci and lshw to see maybe it's a Windows issue and it not being able to detect the Hardware ID but I got the same result in Linux. None of the above commands detect the device 1502 or mention IPU anywhere. I have reached out to the manufacturer to see if there's something they can do. In the meanwhile I am open to any diagnosis and ideas to get this working. Thanks again for the feedback. |
@abdulmueid Thanks for the update. Please let us know what you find out. It strikes me that the NUC box is an ideal form factor for some interesting Edge AI applications, and it would be a shame if the IPU was not enabled for this product. I am from the Xilinx side of the house, not the AMD side of the house, but I see no indications that there is an alternative SKU that disables the IPU: https://www.amd.com/en/product/13036 |
@quentonh Yes, it would be a real shame, as I was looking forward to digging into the AI capability of this CPU. I have a feeling this is a driver issue (a la "modeswitch" on some hardware under Linux) which is hiding the IPU. Can you please tell me the model number of your ASUS Laptop? I want to download the drivers from ASUS and compare the versions across CPU, Chipset and other system devices to see if there's a newer driver that I can install or patch with my device IDs and install? Thanks for the assistance. |
Quick update: Found an interesting tidbit in the Ryzen AI info footnote at https://www.amd.com/en/products/ryzen-ai
I found another instance where a Lenovo laptop with 7840hs also did not have it enabled. https://community.amd.com/t5/drivers-software/ryzen-ai-drivers/m-p/619895 I guess we are at the mercy of OEMs. |
Ah-so! That might be the explanation. Asus FA5071XI Driver: |
Hello, I am having the same problem on a Lenovo LOQ 16 with Ryzen 7840HS. I have already posted the issue on AMD Community. Wanted to add that I tried to install the drivers found on Microsoft Catalog as posted by @quentonh. The prompt says "kipudrv.inf: oem52.inf added successfully on 0 devices". It seems that for the drivers to work the IPU must be at least recognized, which it doesn't. So I don't know if we need another driver for the device to appear, and the IPU driver for the IPU to work. Waiting for updates |
It would be good to get some clarity and options from AMD side, as I am sure many people bought machines based on these CPUs because Ryzen AI / IPU is part of the package. Maybe allow developers to unlock / enable this capability. I assume it's locked/unlocked at firmware level. If I get any feedback / update from the manufacturer, I will update this issue. |
It seems none of the 7040 mini PCs from beelink, minisforum or GMK has Ryzen AI enabled, maybe it's where the Phoenix chips with faulty AI engine went? |
I don't think it is legal to sell a CPU model with some features disabled without mentioning it beforehand. If this is the case the users should be eligible for a refund. I have the same problem with a Lenovo laptop. I think that Ryzen AI cores have to be enabled at firmware/BIOS level like the GPU. Maybe since only a few models have been sold so far with Ryzen 7000 processors, brands like Lenovo are still using the old BIOS version which does not include support for Ryzen AI. I have hope that a BIOS update could resolve the issue, otherwise I should be entitled to return the laptop whenever I want. |
I have similar issue, cpu AMD Ryzen 7840HS. A bit disappointed with AMD on this issue. I choose this cpu because of Ryzen AI instead of Intel, kinda regret it now. I hope BIOS fix/update would enable this feature. There is also not much discussion on forum/blog about this issue. I'm on Lenovo as well. Was thinking of purchasing minisforum/beelink with 7840HS/7940HS, now it will be on hold until AMD clear things up with etc manufacturer. AMD touting how great is cpu with ryzen AI , now I think AMD had misguided us. |
All, we are escalating this concern internally and I hope that we can provide a formal response soon. It is not known to me whether this issue results from a lack of understanding on the part of OEMs as to the importance of IPU support for this CPU, or if perhaps we may have provided early BIOS templates for this architecture that did not include the IPU. We will of course be encouraging ALL Ryzen AI OEMs to enable support for the IPU. That said, I doubt that there is any contractual obligation for a specific OEM to enable support for a specific CPU feature, so there will be some degree of "buyer beware" and perhaps it makes sense for us to create and maintain a list of OEM products that are known to enable IPU support. I do also suggest that you share your concerns with the specific OEM. They may not realize or recognize the oversight until such time as it is pointed out to them. Stay tuned, we will update you ASAP. |
All, I have one small update, I have heard from one of our internal developers that at least one OEM platform (NUC that @abdulmueid mentioned) that was tested internally was found to have the IPU device hidden in the Windows Device Manager. Once we installed the driver we were able to leverage the IPU on that platform. https://www.thewindowsclub.com/show-non-present-devices-windows |
Thank you for the help given, quentonh. I've tried this earlier, no luck having the device to appear or running the ryzen AI demo. Let me specify out things I tried; Windows 11 is updated to the latest available from Windows Update. Lenovo BIOS/firmware and drivers are all updated to the latest available from manufacture website. |
Thanks for the internal escalation and assistance @quentonh I have been going back and forth with the support from GMKTec and I have yet to get it working. I am having a hard time explaining the issue to them because they keep saying it's a AMD driver issue and I tried explaining it's an OEM enablement issue. They also mentioned "Show hidden devices" view and that didn't work either. Since you/your team have access to the GMK box, can you please check the BIOS version? Mine is currently on v2.22.1287 (Build 06/11/2023). If you are on a newer BIOS version then it's definitely enabled in newer BIOS. |
Asked beelink about their upcoming GTR7 (7840HS mini PC), got this reply while their product page has no mention of Ryzen AI:
|
@chicheng As much as they say it's enabled. Ask for proof i.e. screenshot from the device manager with AMD IPU Device. Play it safe. I got burned with my GMKTec K4 missing Ryzen AI. |
I have not received an update from the internal engineering team that purchased the GMTek K4. Given this, I can only assume that we in fact may have no have confirmation internally that the GMKTec K4 can be made to work. I did pen an email to GMKTek asking them to enable support, but as of today, I have not received a response. We did confirm internally that the MINISFORUM NUC does enable the IPU and hence may be an option for some developers. Also, I am still awaiting a more formal response from the Client business unit, but as of this moment I am not expecting that there is much they will be able to do and in the near term. I believe that the simple reality is that this may be a buyer beware situation such as @abdulmueid mentions. Ultimately, AMD has little control over whether a particular OEM enables specific features in BIOS. I suggest that we simply keep this GH issue open and use this as a forum to allow users to discuss the specific products that do (or do not) enable the IPU. If I receive additional updates, I will share them. |
Thank you @quentonh for trying to reach out to GMKTec and doing all you can. This whole debacle got me down a rabbit hole of how UEFI system works, what are its constituent parts (vars, modules, boot stages, etc) and what are the control mechanisms which may enable/disable certain system features. So far I have managed to save the ROM, extract the full UEFI menu including hidden options (no mention of Ryzen AI, IPU or anything related there), and all the EFI vars. Is it possible to get the documentation that AMD provides to OEMs for enabling the CPU features? I imagine this information is locked tight, but if the information for enabling Ryzen AI / IPU can be obtained, I am happy to delve into it. Let me know your thoughts. |
Can we create a page to track devices that have a working solution to enable the IPU. Reading through all the comments it still raises doubts on which mini PC anyone should get to take benefit of the IPU. |
@chaudhariatul Regarding a page to track supported devices, yes, I think we can create a public Wiki page for this purpose. The MINISFORUM NUC has been verified internally by our engineering team, so that is one option for a mini PC. The Linux question was asked here. I cannot personally comment on this apart from to say that the initial focus is very much on Windows, however, I just cross-linked your comments to that original issue. |
@quentonh, what about fully open-source this demo? And what are the plans for this CPU(?) feature? I asked as a developer. Seems like AMD itself has not fully decided what it wants to do with this, am I right? |
I'm also experiencing the same issue, can't find the AMD IPU device. Lenovo. |
I can confirm two things, after getting and setting up a Lenovo IdeaPad 5 Pro with R7 7840HS last month and now a MinisForum UM790 Pro with R9 7940HS, both with Win11 Pro installed by myself. The Lenovo IdeaPad Pro shows no potential IPU Device anywhere, while the MinisForum UM790 Pro, after installing all the usual drivers today, still showed a "VEN_1022&DEV_1502" missing drivers, and neither Adrenaline nor Windows could find one by themselves. Now here I stumbled over a hint and the above mentioned driver from the MS Update Catalog offered the solution: Seems to be an elusive device BTW, the driver is from April, so not much is happening. |
@Amnesist good to see you got it working on Minisforum. |
Thanks for that link, but that newer driver puts the IPU Device out of order with a signature error. So back to the one and only working one. |
Regarding the driver signature, you have our attention on this and I have brought this problem to light internally. And yes, there is much internal ongoing work. To avoid saying "too much" I will tell you that will be another release shortly that will provide support for additional model architectures. |
Hi folks, I have been advised that there will be a driver update (10.106.8.62) that will be pushed next week. This driver will be signed "Microsoft Windows Hardware Compatibility Publisher" and the link that @Amnesist mentioned will be the source for this new driver once available. Following this, we expect to begin pushing driver updates in sync with AMD Adrenalin towards the end of Sept or into October. So, please check the docs pages next week for an updated driver (hopefully the first half of next week). --Quenton |
So no linux support yet? |
You're in luck too SER7 gang, they initially e-mailed me the SER7 IPU BIOS and just got me the correct GTR7 IPU version. So I assume they've got it working on all 7840hs models. I bought a GTR7 and went through issues with it randomly rebooting and had to send it back for a new one which has been working great but then I looked and saw this IPU issue and had to let them know it's not okay to ignore AI as this is the first x86 chip with it on board. Let us know how it goes friend. I'll be honest that all of this Ryzen AI stuff is a bit too involved for me, but I'll assume once the IPU shows up in the device manager that the system will be ready to rip when people start making executables for consumers. I would love to see it implemented in an app like LM Studio. |
Thanks for your information. I have contacted them via email, and they have sent me a BIOS file with IPU enabled. I run the demo "multi-model-exec", but I can't tell if it employs the IPU. Disabling/Enabling the IPU device in the device manager seems not make any difference. I will do more tests. |
That's good news that the IPU shows up now. I would assume there's going to be bugs and issues while Ryzen AI and its associated driver matures. Do let us know if you find out anything else. Curious how many tokens per second it does with LLM responses. Sending positive vibes out to everyone involved with this exciting new technology! |
If the IPU shows up, then everything about hardware/bios are alright, am I correct?
I have made the "opt-pytorch" example working, executed Profiling with larger prompt lengths - (8-256) , and got similar results: 4.x Tokens/sec (mine is 7840hs). But surprisingly, the results is much slower than running same profiling on CPU target. And executing “whisper --audio .\test_audio.m4a --target aie-cpu” in the "whisper-tiny" example, the output of "encoder running time" is 3.x seconds that is far from what the document shows (0.04s). Considering what i have got, this is my question: Could I assume my device is working properly ? |
I got the time to install the new BIOS and Ryzen AI driver. Glad to report that on Bee-Link GTR7 the IPU at least shows up in the device manager. As for your experiments (thanks for sharing btw), I would conclude that the IPU is not being used. 4-9tok/sec. is what I have been getting in LM Studio with the CPU. If a phone can do 20tok/sec with ~5TOPS performance then our 7840hs should be closer to 50tok/sec as I have heard the IPU having 10-12TOPS of performance. I saw your new issue opened and hope the team at AMD can get us all on the right track soon. I'd like stable diffusion running on the IPU since these kids with Xiaomi 14 and Vivo x100 will have it in the palm of their hand! |
Hi, @quentonh I have a question. Can you confirm that all things need OEM manufacturers to do are simply enabling the IPU in the BIOS they provided, and once the IPU shows up, there is nothing else they should do ? I am worrying about if they did everything necessary and if they did these things correctly. Is there any chance that the IPU has some kind of mal-function (like lack of capability, missing some features or shortage of computing power, etc.), though device manager says "This device is working properly"? |
+1 ... AMD should support Windows and Linux by default ... as Nvidia does ... just saying ... |
I have already posted my performance concerns in another thread which has been closed already. There, you can read:
Have you seen any performance numbers so far? I haven't. But they don't stop to use their secret numbers in their presentations like yesterday when they presented their "all new" Ryzen 8000 CPUs where Ryzen AI is going to be 1.4x faster. |
I'm hoping more progress will be made over the upcoming months with the IPU being not enabled on our devices, especially because my laptop model (Ryzen 7840HS+4060, LOQ 15 2023) is listed as a RyzenAI laptop from the AI Event. |
According to AMD Ryzen™ 9 7940HS documentation: The China version of this processor has neither the AI Engine nor a Launch Date So not having the AI Engine might be a real possibility especially for Chinese manufacturers? |
Great! So we get screwed because of politics once again. --Reatan Alloy 9 |
+1 |
According to a report in July 2023, 7840h, the China-specific version of 7840hs, removed IPU. |
Just confirming here that on the China only variant of the Minisforum UM780 (7840HS) running Win11 that under Device Manager I do see the IPU listed under System Devices. So it looks like both UM790 and UM780 have Ryzen AI enabled. If your vendor doesn't have this enabled, send them a message! |
@zombie12138 In discussions with our Client product team, they have confirmed that the IPU is NOT disabled at a hardware level for China SKUs. The report that you mention has been stated as incorrect by that team. We will try to close the loop with the authors and have them correct this. |
Hi everyone a lenovo forum thread was created a few months ago that rightfully asks the Lenovo team to BIOS-enable the IPU of the 7840Hs in the Lenovo Ideapad 5 Gen 8. We only got the response that the engineers have acknowledged the issue. But still no update, we only want the features we paid for, please if it is not a hassle consider adding a +1 or commenting something in this thread: |
Hi guys. Now with new version of bios on Firebat U6 (r7-7840h(s)) AMD IPU works. Before it isn't available. So, maybe it isn't problem with processors for Chinese. |
Changes to description.json
I sent an email to GMKtec ([email protected]):
and received this reply:
|
@Snuupy this is great news. On the GMKTec website the available BIOS is still the old one from December 2023. Can you request the IPU enabled BIOS and upload it here / share with us? Thank you |
@abdulmueid just email them and ask for it for your specific model, I don't have any gmktec minipcs |
It finally happened. GMKTec sent the BIOS with IPU Device enabled. Attaching the BIOS zip and a screenshot from device manager. K4_1.10_GMK_20231117_IPU_TEST.zip Closing thread now! |
Seems like this firmware is from 17/11/23, while the one they gave earlier is from 28/12/23. Curious. Also the name suggests that this was some test build. I do hope that all of the changes/improvements that are avilable in the 28/12 build are also available in the 17/11 build. Can anyone confirm this? |
@Tsury Everything is working the same. No change in BIOS menu options. No difference in performance. Not sure if there are any regressions but so far, it's all working well with the IPU BIOS. |
congrats :) I might get a K6 since it's really good value...hmm |
Btw, what does the IPU capability give me if I only use it to play games? Does it offer any benefit for me? |
Hi, I am reaching out to address an issue I encountered with my Redmi Book Pro 15 (2023)- Ryzen 7 7840HS. Recently, I installed the AMD IPU driver on my device, but upon completion of the installation process, I noticed that the AMD IPU is not appearing in the Device Manager. I have followed all the installation instructions carefully and ensured that the driver was properly installed. However, despite these efforts, I cannot seem to locate the AMD IPU in the Device Manager. I have also attempted to troubleshoot the issue by restarting the device and re-installing the driver, but to no avail. Thank you for your attention to this matter. I look forward to your prompt response and resolution of the issue. |
Hi,
Just purchased a 7940hs based mini pc (GMKTec K4) and I am unable to detect the AMD IPU Device in Device Manager. I have the drivers available and tried installing them, but it looks like the IPU device itself does not exist.
Looking at the drivers .inf file, it appears to be looking for a device with hardware ID: PCI\VEN_1022&DEV_1502
I ran
Get-PnpDevice -PresentOnly | Sort-Object -Property "Class" | Format-Table -AutoSize
to get all the hardware IDs present on the system and cannot find the hardware ID that IPU Device driver is looking for. See attached output of the command below.HardwareIDs.txt
These are the scenarios coming to my mind:
Any help will be much appreciated.
Thank you
The text was updated successfully, but these errors were encountered: