The main point is to understand the boot process, and build or download a kernel with the VF2 patches, as while most of it is upstreamed already[1], it's still not 100%.
0. https://forum.rvspace.org/c/visionfive-2/19
1. https://rvspace.org/en/project/JH7110_Upstream_Plan