A Vulkan driver for Orange Pi 5 Plus would enable me to use desirable model library precompiled binary files from Machine Learning Compilation that are not available for the Mali architecture alone. The precompiled binary files for model libraries desired: Llama 34B RWKV 1B5, 3B,7B GPTBigCode 15B https://llm.mlc.ai/docs/prebuilt_models.html
Where do I find one? TIA :)
Driver binaries for specific board hardware must come from the board or chipset provider, as they will integrate additional required functionality such as SoC-specific power management.
We only provide prebuilt binaries for a very limited number of boards, which are those we happen to have used internally for testing (Mali Drivers | Mali GPU User-Space Binary Drivers – Arm Developer).
TYVM Peter, so now I understand I will need to query Orange Pi of Shenzhen Xunlong Software Co., Ltd, the board provider, or Rockchip based in Fuzhou, Fujian province, the chipset provider. :)