Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes
<|reference_start|>Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes: The widespread adoption of data-centric algorithms, particularly Artificial Intelligence (AI) and Machine Learning (ML), has exposed the limitations of centralized processing infrastructures, driving a shift towards edge computing. This necessitates stringent constraints on energy efficiency, which traditional von Neumann architectures struggle to meet. The Compute-In-Memory (CIM) paradigm has emerged as a superior candidate due to its efficient exploitation of available memory bandwidth. However, existing CIM solutions require high implementation effort and lack flexibility from a software integration standpoint. This work proposes a novel, software-friendly, general-purpose, and low-integration-effort Near-Memory Computing (NMC) approach, paving the way for the adoption of CIM-based systems in the next generation of edge computing nodes. Two architectural variants, NM-Caesar and NM-Carus, are proposed and characterized to target different trade-offs in area efficiency, performance, and flexibility, covering a wide range of embedded microcontrollers. Post-layout simulations show up to $25.8\times$ and $50.0\times$ lower execution time and $23.2\times$ and $33.1\times$ higher energy efficiency at the system level, respectively, compared to executing the same tasks on a state-of-the-art RISC-V CPU (RV32IMC). NM-Carus achieves a peak energy efficiency of $306.7$ GOPS/W in 8-bit matrix multiplications, surpassing recent state-of-the-art in- and near-memory circuits.<|reference_end|>
@article{caon2024scalable,
    title={Scalable and RISC-V Programmable Near-Memory Computing Architectures for
  Edge Nodes},
    author={Michele Caon (1), Cl'ement Chon'e (2), Pasquale Davide Schiavone
  (2), Alexandre Levisse (2), Guido Masera (1), Maurizio Martina (1), David
  Atienza (2) ((1) Politecnico di Torino, (2) 'Ecole Polytechnique
  F'ed'erale de Lausanne (EPFL))},
    journal={arXiv preprint arXiv:2406.14263},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.14263},
    primaryClass={cs.AR}
}