标题： 通过在IREE中启用RISC-V微内核支持来加速GenAI工作负载 显示英文标题

标题： Accelerating GenAI Workloads by Enabling RISC-V Microkernel Support in IREE

摘要： 该项目使IREE支持RISC-V微内核，IREE是一个基于MLIR的机器学习编译器和运行时。 该方法首先在IREE的传递管道中为RISC-V64目标启用MLIR linalg方言收缩操作到linalg.mmt4d操作的降低，然后开发了针对RISC-V的优化微内核。 与上游IREE和Llama.cpp相比，对Llama-3.2-1B-Instruct模型的性能增益进行了比较。 显示英文摘要

摘要： This project enables RISC-V microkernel support in IREE, an MLIR-based machine learning compiler and runtime. The approach begins by enabling the lowering of MLIR linalg dialect contraction ops to linalg.mmt4d op for the RISC-V64 target within the IREE pass pipeline, followed by the development of optimized microkernels for RISC-V. The performance gains are compared with upstream IREE and Llama.cpp for the Llama-3.2-1B-Instruct model.