Add drivers that are used in HiFive Unleashed to linux-modules instead of linux-modules-extra. I built those kernels and download the files and checked the modules were present in the linux-modules package by grepping from them after doing a dpkg -c linux-modules......deb.