I was running into this problem to. I ended up solving it by adding support for all the permutations of [OUEX]HCI and "high speed usb2/3 bus support" into my kernel. (Not sure why they were disabled, I must never have noticed them while installing.
For reference:
CONFIG_USB_OHCI_HCD=m
CONFIG_USB ...