NVMe tunneling over USB4 / PCIe Alt mode?
I'm looking for a way to get an external NVMe enclosure connected via USB4 (PCIe Alt mode) to a Ryzen 7735HS (Rembrandt) based miniPC (MinisForum UM773 Lite). The USB4 controller is properly recognized: --8<---------------cut here---------------start------------->8--- ~> lspci -tv -[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 17h-19h PCIe Root Complex … +-08.3-[36]--+-00.0 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #8 | +-00.3 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #5 | +-00.4 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #6 | \-00.5 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4/Thunderbolt NHI controller #1 … --8<---------------cut here---------------end--------------->8--- Connecting an NVMe enclosure with an AsMedia AS2364 controller to the USB4 port however has this result: --8<---------------cut here---------------start------------->8--- ~> lsusb -vt … /: Bus 08.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M ID 1d6b:0003 Linux Foundation 3.0 root hub |__ Port 1: Dev 3, If 0, Class=Mass Storage, Driver=uas, 10000M ID 174c:2364 ASMedia Technology Inc. … --8<---------------cut here---------------end--------------->8--- Connection over USB should result in 20000M connection speed with this enclosure and cable; however it doesn't even use 2x2 mode, much less the PCIe Alt mode that would allow NVMe tunneling (hopefully). Instead it connects via UAS, so the disk shows up as SCSI disk and I cannot use NVMe CLI tools (among other things, that would allow me to change the sector size from 512 to 4096 on the QLC based 4TB SSD without having to mount them on an internal M2 port in a spare PC). Does anyone have any insights into how to make this work and/or can share experiences with NVMe enclosures where this works out of the box? Regards, Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+
Please ignore, problems with list test only simoN Am 04.11.23 um 11:08 schrieb ASSI:
I'm looking for a way to get an external NVMe enclosure connected via USB4 (PCIe Alt mode) to a Ryzen 7735HS (Rembrandt) based miniPC (MinisForum UM773 Lite). The USB4 controller is properly recognized:
--8<---------------cut here---------------start------------->8--- ~> lspci -tv -[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 17h-19h PCIe Root Complex … +-08.3-[36]--+-00.0 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #8 | +-00.3 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #5 | +-00.4 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #6 | \-00.5 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4/Thunderbolt NHI controller #1 … --8<---------------cut here---------------end--------------->8---
Connecting an NVMe enclosure with an AsMedia AS2364 controller to the USB4 port however has this result:
--8<---------------cut here---------------start------------->8--- ~> lsusb -vt … /: Bus 08.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M ID 1d6b:0003 Linux Foundation 3.0 root hub |__ Port 1: Dev 3, If 0, Class=Mass Storage, Driver=uas, 10000M ID 174c:2364 ASMedia Technology Inc. … --8<---------------cut here---------------end--------------->8---
Connection over USB should result in 20000M connection speed with this enclosure and cable; however it doesn't even use 2x2 mode, much less the PCIe Alt mode that would allow NVMe tunneling (hopefully). Instead it connects via UAS, so the disk shows up as SCSI disk and I cannot use NVMe CLI tools (among other things, that would allow me to change the sector size from 512 to 4096 on the QLC based 4TB SSD without having to mount them on an internal M2 port in a spare PC).
Does anyone have any insights into how to make this work and/or can share experiences with NVMe enclosures where this works out of the box?
Regards, Achim.
-- www.becherer.de
On 04.11.2023 13:08, ASSI wrote:
I'm looking for a way to get an external NVMe enclosure connected via USB4 (PCIe Alt mode) to a Ryzen 7735HS (Rembrandt) based miniPC (MinisForum UM773 Lite). The USB4 controller is properly recognized:
--8<---------------cut here---------------start------------->8--- ~> lspci -tv -[0000:00]-+-00.0 Advanced Micro Devices, Inc. [AMD] Family 17h-19h PCIe Root Complex … +-08.3-[36]--+-00.0 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #8 | +-00.3 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #5 | +-00.4 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4 XHCI controller #6 | \-00.5 Advanced Micro Devices, Inc. [AMD] Rembrandt USB4/Thunderbolt NHI controller #1 … --8<---------------cut here---------------end--------------->8---
Connecting an NVMe enclosure with an AsMedia AS2364 controller to the USB4 port however has this result:
--8<---------------cut here---------------start------------->8--- ~> lsusb -vt … /: Bus 08.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M ID 1d6b:0003 Linux Foundation 3.0 root hub |__ Port 1: Dev 3, If 0, Class=Mass Storage, Driver=uas, 10000M ID 174c:2364 ASMedia Technology Inc. … --8<---------------cut here---------------end--------------->8---
Connection over USB should result in 20000M connection speed with this enclosure and cable; however it doesn't even use 2x2 mode, much less the PCIe Alt mode that would allow NVMe tunneling (hopefully). Instead it connects via UAS, so the disk shows up as SCSI disk and I cannot use NVMe CLI tools (among other things, that would allow me to change the sector size from 512 to 4096 on the QLC based 4TB SSD without having to mount them on an internal M2 port in a spare PC).
Does anyone have any insights into how to make this work and/or can share experiences with NVMe enclosures where this works out of the box?
Does the following help? https://docs.kernel.org/6.2/admin-guide/thunderbolt.html
Andrei Borzenkov writes:
Does the following help?
Thanks, didn't know that. The bus shows up and the controller is authorized and the security level is set to "user": --8<---------------cut here---------------start------------->8--- # cat /sys/bus/thunderbolt/devices/domain0/0-0/authorized 1 # cat /sys/bus/thunderbolt/devices/domain0/security user --8<---------------cut here---------------end--------------->8--- The device, when plugged in, still shows up on USB (10 instead of 20 GiB/s) and doesn't leave a trace in the sysfs for Thunderbolt. So I can't do any of the further experimentation until I clear that hurdle. Regards, Achim. -- +<[Q+ Matrix-12 WAVE#46+305 Neuron microQkb Andromeda XTk Blofeld]>+ SD adaptation for Waldorf microQ V2.22R2: http://Synth.Stromeko.net/Downloads.html#WaldorfSDada
participants (3)
-
Andrei Borzenkov -
ASSI -
Simon Becherer