## Rapid and Power-Aware Learned Optimization for Modular Receive Beamforming

Ohad Levy and Nir Shlezinger

Abstract -Multiple-input multiple-output (MIMO) systems play a key role in wireless communication technologies. A widely considered approach to realize scalable MIMO systems involves architectures comprised of multiple separate modules, each with its own beamforming capability. Such models accommodate cellfree massive MIMO and partially connected hybrid MIMO architectures. A core issue with the implementation of modular MIMOarises from the need to rapidly set the beampatterns of the modules, while maintaining their power efficiency. This leads to challenging constrained optimization that should be repeatedly solved on each coherence duration. In this work, we propose a power-oriented optimization algorithm for beamforming in uplink modular hybrid MIMO systems, which learns from data to operate rapidly. We derive our learned optimizer by tackling the rate maximization objective using projected gradient ascent steps with momentum. We then leverage data to tune the hyperparameters of the optimizer, allowing it to operate reliably in a fixed and small number of iterations while completely preserving its interpretable operation. We show how power efficient beamforming can be encouraged by the learned optimizer, via boosting architectures with low-resolution phase shifts and with deactivated analog components. Numerical results show that our learn-to-optimize method notably reduces the number of iterations and computation latency required to reliably tune modular MIMO receivers, and that it allows obtaining desirable balances between power efficient designs and throughput.

## I. INTRODUCTION

Massive multiple-input multiple-output (MIMO) technology is at the core of future wireless communications, with extremely large implementations expected to enable meeting the constantly growing demands in throughput and coverage [2], [3]. However, implementing communications with hundreds or thousands of antenna elements gives rise to several challenges, including issues related to cost, power consumption, deployment, and scalability [4]. To overcome these challenges, a leading approach to massive MIMO adopts modular designs . In such cases, a MIMO array is implemented using many distinct modules, each equipped with a (smaller) antenna array, and possibly possesses local beamforming capabilities. These architectures encompass various forms of emerging MIMO technologies, including extremely large arrays [5], [6], modular low-frequency deployments [7] distributed cell-free massive MIMO [8], centralized interconnections of multiple panels [9], [10], and even radio stripes [11].

While modular implementations of massive MIMO alleviate cost and power issues and support distributed implementation,

Parts of this work were presented in the 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) as the paper [1]. This work was supported by the Israeli Innovation Authority. The authors are with the School of ECE, Ben-Gurion University of the Negev, Israel (email: levyoha@post.bgu.ac.il; nirshl@bgu.ac.il).

they also introduce design and algorithmic challenges. In particular, beamforming is not carried out by a single central processing unit (CPU) that manipulates the signal at each element; instead, it is divided between the CPU and a set of separate arrays termed panels , that are possibly constrained in their hardware capabilities, and are likely to be subject to strict power constraints. Moreover, the setting of the modular beampattern is done on each coherence duration, necessitating rapid adjustments of the modules [12].

Since modular beamforming is divided between a CPU and multiple panels, it can be viewed as a form of hybrid beamforming [13]. Hybrid beamforming divides the processing of the signals between conventional digital processing and an additional constraint antenna interface, typically representing analog hardware [14]. Such hybrid MIMO is often studied in the context of RF chain reduction [15], [16], most commonly assuming phase shifter based analog processing [17]. However, hybrid MIMO can also represent emerging antenna architectures based on true-time-delay [18], vector modulators [19], metasurfaces [20], or leaky waveguides [21].

The main task of hybrid beamforming can be viewed as the conversion of channel state information (CSI) into a beampattern achievable through a divisible architecture [22]. Various methods have been proposed for tackling this task (see, e.g., overview in [23]). As hybrid beamforming can be represented as a constrained optimization problem, a conventional approach achieves this via iterative optimizers, see, e.g., [24]-[26]. However, these approaches typically involve lengthy optimization with numerous iterations, which can be challenging to carry out efficiently within the extremely short time frames required for determining beamforming (e.g., on the order of 0 1 . milliseconds [23]).

To facilitate rapid beamforming setting, recent works proposed using deep learning tools, taking advantage of their ability to learn to tackle challenging optimization problems with fixed and limited latency [27], [28]. This can be achieved by training conventional deep learning architectures, such as convolutional neural networks (CNNs), to map MIMO CSI into analog and digital precoders [29], [30], or by combining optimization with deep learning for hybrid beamformers [31][34] and for fully digital beamformers [35] as a form of modelbased deep learning [36]. However, while hybrid beamforming can be viewed as encompassed by modular beamforming, its associated algorithms are not tailored for exploiting modular structures, and do not account for the limited power considerations imposed in such forms of distributed MIMO systems. Moreover, current learning-aided designs often focus on a given configuration, and the optimizer needs to be retrained

when using a different array (or adding another module), limiting scalability. Finally, existing works typically focus on downlink beamforming, with the uplink being much less studied.

Uplink modular beamforming was considered in [37], [38]. There, the focus was to characterize trade-offs of its decentralization under narrowband communications and sparsity-based power-oriented constraints for loss-less processing, rather than establishing algorithms for tuning modular beamformers. In practice, the regimes of interest are typically those where the distributed and power constrained operation is likely to yield some rate loss compared to centralized fully digital MIMO systems. This gives rise to the need to design methods for tuning hybrid modular receive beamformers for such practical and challenging settings.

In this work, we develop a rapid and power-aware tuning algorithm for setting modular receive MIMO beamformers. Our approach combines principled optimization with machine learning via model-based deep learning [39] to realize uplink modular beamforming optimizers operating reliably with fixed and low latency. By doing so, we are able to utilize data to optimize the optimizer while maintaining its comprehensibility and transferability across different configurations.

We focus on modular beamformers implemented using conventional phase shifters, and leverage the interpretable operation of the optimizer to ( ) i facilitate scalable design, where the same learned optimizer can be utilized with different numbers of modules; and ( ii ) encourage power efficient designs for each panel. The latter is achieved by enabling deactivation and low-resolution implementation of the active phase shifters at each module. We formulate the modular uplink beamforming task as a constrained maximization of the sumrate objective in multiple-access channels. We then specialize projected gradient ascent (PGA) steps with momentum for the considered setting, being a suitable candidate accelerated iterative optimizer for directly optimizing the rate objective, based on which we develop our learning-aided optimizer.

Our main contributions are summarized as follows:

- · First-order optimization for modular receive beamforming: We formulate the receive modular beamforming task as a constrained optimization, and derive the corresponding first-order iterative optimizer based on PGA steps. The resulting optimization formulation differs from previous works that focused on the downlink, namely, transmit beamforming. We specifically characterize the corresponding gradient steps and projection methods, which enable (lengthy) tuning of modular receive beamformers.
- · Rapid and scalable learned optimization: To enable rapid tuning, we convert the identified PGA steps into a machine learning model operating with a fixed and low latency. This is achieved by fixing the number of iterations while using the hyperparameters of PGA with momentum as trainable machine learning parameters. We show that the interpretable operation of the resulting design allows it to scale to different numbers of modules (potentially much larger than those used during training), thus facilitating scalability, and that its training procedure

can be adapted to enhance robustness to noisy channel estimates.

- · Power-aware learned optimization: We leverage the interpretable structure of the resulting machine learning model, comprised of PGA iterations, to incorporate two forms of power-aware considerations: the ability to boost sparse modular architectures with deactivated phase shifters, and the support of low-resolution phase shifters. As the resulting constraints render PGA nondifferentiable, we approximate its operation for learning purposes via surrogate projection mappings that enable its representation as a machine learning architecture.
- · Extensive experimentation: We extensively evaluate our learned optimizer on both synthetic channels and channels obtained from the physically compliant QuasiDeterministic Radio channel Generator (QuaDRiGa) model [40]. Our numerical studies systematically show that learned optimization enables reliable tuning of modular beamformers with reductions of 7 -15 × in iterations compared to conventional optimizers. Moreover, we show that the power-aware design enables efficient operation, typically with only a minor degradation in accuracy compared to unconstrained designs. It is also shown that under some forms of limited designs, our method achieves superior performance in just 10 iterations, significantly outperforming other methods, which required 500 iterations to converge to a suboptimal solution. Additionally, the proposed method exhibits improved robustness under CSI estimation errors, demonstrating a notably softer degradation in performance compared to traditional approaches as the CSI noise variance increases. These results reveal the versatility of our approach, which balances computational efficiency and accuracy, even under challenging power, hardware, or imperfect CSI conditions.

The rest of this paper is organized as follows: Section II presents the system model of uplink modular beamforming and formulates its design problem. Section III presents our learned optimization method without accounting for power considerations, which are introduced into the method in Section IV. Empirical results are reported in Section V, and Section VI concludes the paper.

Throughout this paper, we use boldface lowercase and boldface uppercase letters for column vectors and matrices, respectively, while [ M ] i,j is the ( i, j ) th element of a matrix M . We use calligraphic fonts for sets, while Z and C denote the integer and complex numbers, respectively. The operations ( ) · T and ( ) · H are used for transpose and conjugate transpose, respectively. I N refers to the identity matrix of size N . The gradient of the function f ( ) · with respect to the matrix W is denoted by ∇ W f ( ) · , while δ · , · is the Kronecker delta function, and ∡ ( ) · is the (element-wise) phase operator (in radians).

## II. SYSTEM MODEL

In this section we introduce the system model for receive beamforming with modular hybrid MIMO receivers. We commence with presenting the considered models for the communication channel and the receiver processing in

Subsections II-A-II-B, respectively, after which we formulate the beamforming design problem in Subsection II-C.

## A. Communication System

We consider a multi-band multi-user uplink MIMO system. The setting involves K single antenna users that communicate with a (possibly distributed) MIMO receiver, over B frequency bins. The transmitted signals are received by M antenna elements, that are divided into multiple panels. The channel output at the b th frequency is given by

$$y [ b ] = H [ b ] s [ b ] + w [ b ], \quad b = 1, \dots, B. \quad ( 1 ) \stackrel { \times \dots } { \text{More} }.$$

In (1), H [ b ] ∈ C M K × is the channel matrix at frequency bin b , while s [ b ] ∈ C K represents the transmitted symbols, which are comprised of i.i.d. entries with power ρ s &gt; 0 . The signal w [ b ] ∈ C M is additive white Gaussian noise (AWGN) with variance σ 2 w &gt; 0 .

## B. Modular Hybrid Receive Processing

The signal received by the M antenna elements is processed by a centralized CPU. The resulting digitally processed signal is obtained from the channel output in (1) by undergoing modular receive beamforming , where the M antennas are divided into P panels. This processing, illustrated in Fig. 1, includes two stages: ( ) i Panel-wise beamforming, and ( ii ) Panel-CPU connectivity.

1) Panel-Wise Beamforming: The first stage is composed of receive beamforming performed by each panel separately. Each panel has N antennas and L output ports, where the data processing takes place within the p th antenna panel and is described via a N × L frequency-invariant matrix W p , for each p = 1 , . . . , P . The panels are assumed to be hardware limited, which we model using the set of feasible mappings W ⊂ C N × L , such that W p ∈ W .

We consider the following types of analog constraints:

- C1 Unconstrained Phase Shifters : Here, the analog processing is comprised of phase shifters, where the phase of component can be set arbitrarily, i.e.,

$$\mathcal { W } _ { \text{uph} } = \left \{ W \in \mathbb { C } ^ { N \times L } \colon | [ W ] _ { n, l } | = 1, \forall ( n, l ) \right \}. \ \ ( 2 ) \text{ \ the color}$$

- C2 Sparsified Phase Shifters : As phase shifters are active components with non-negligible power consumption, a candidate approach to maintain power-efficient operation at the panels is to allow some of the phase shifters to be turned off [19]. This type of feasible set is represented as

$$\mathcal { W } _ { \text{sph} } = \left \{ W \in \mathbb { C } ^ { N \times L } \colon | [ W ] _ { n, l } | \in \{ 0, 1 \}, \forall ( n, l ) \right \}. \ ( 3 ) \stackrel { \dots } { \text{ we def} }$$

While the formulation in (3) does not indicate how many phase shifters are inactive, such a requirement can be imposed by constraining the ℓ 0 norm of W to achieve a desired amount of inactive components.

- C3 Quantized Phase Shifters : An alternative approach to limit the power consumption on the panel side is to restrict the phase shifters to support only a discrete set of feasible phases, i.e., support quantized phases shifts [41].

Such a constraint with Q -level quantized phases is modeled by the feasible set

$$\mathcal { W } _ { \text{qps} } ^ { Q } = \{ W \in \mathbb { C } ^ { N \times L } \colon & \frac { \not \leq [ W ] _ { n, l } } { 2 \pi } \cdot Q \in \mathbb { Z }, \\ & | [ W ] _ { n, l } | = 1, \forall ( n, l ) \}. \quad ( 4 )$$

Note that for all considered feasible sets, the phase shifting components remain frequency-agnostic, i.e., W p is invariant of the frequency index b . It is also noted that the constrained form of receive beamforming in general cannot realize conventional simple receive beamformers, such as the zero-forcing of minimal mean squared-error beamformers [42, Ch. 8.3]. Moreover, we note that approaches C2 and C3, which aim to improve the power efficiency of the panels, are complementary. Accordingly, one can restrict the analog processing at the panels side to be both sparse and quantized, i.e., have some of the phase shifters deactivated, while the active ones take discrete phase values.

- 2) Panel-CPU Connectivity: We model the connectivity to the CPU via the binary matrix A ∈ { 0 1 , } L P · × T , with T being the number of CPU inputs. This matrix is also frequency invariant, and its entry [ A ] l p,t · denotes whether the l th output of the p th panel is connected to the t th CPU input. The matrix A represents the physical connections (e.g., wiring) between the panels and the centralized processor, and is thus assumed to fixed by the modular MIMO infrastructure. The CPU input z [ b ] is related to the channel output y [ b ] via

$$z [ b ] = A ^ { H } W ^ { H } y [ b ],$$

where W = blkdiag { W 1 , . . . , W P } . This constraint comes from the decentralized structure of our communication system, which takes place within each panel.

The above model for modular hybrid receive processing accommodates both distributed MIMO settings with separated panels [8], as well as massive MIMO architectures where the panels are collocated on the same platform [10]. The distinction between such settings lies in the resulting channel matrices { H [ b ] } , which we do not constrain to take a specific form. Moreover, our model can be viewed as specializing different forms of hybrid MIMO systems when A is the identity matrix, e.g., having L = 1 in such cases specializes the common form of partially-connected hybrid beamformers, while setting P = 1 realizes fully-connected hybrid beamformers [15].

## C. Problem Formulation

We aim to design the modular receive beamformer detailed in (5) to maximize the achievable rate. To formulate this, we define the equivalent channel at the b th frequency bin as G ≜ WA ∈ C M T × . For the uplink setup detailed in Subsection II-A, the average achievable sum-rate is given by (see, e.g., [43, Thm. 1])

$$\text{ve a } \theta ^ { \cdot } \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \alpha \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \varphi \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \sum \, \left | \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \} \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \xi \, \phi \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \,\lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \, \lambda \,
 \text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text$$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text{$\text$$\text{$\text{$\text{$\text{$\text{$\text{$\text$$\text{$\text$$\text{$\text{$\text{$\text{$\text$$\text{$\text$$\text{$\text$$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text`$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$	\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\test$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$}\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$\text$.} \, \end{}$$

$$| 1 |$$

Fig. 1: Modular hybrid receive processing chain.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-890b0fd7-f436-4796-b854-387c842c6ece.jpg)

Using the rate expression in (6), we can formulate the setup of modular receive beamforming as a constrained optimization problem. Since the matrix A represents the hardware connectivity between the panels, it is assumed to be constant, thus not optimized. Accordingly, for a given channel realization { H [ b ] } B b =1 } , the modular beamforming task is formulated as the recovery of

$$W ^ { * } & = \underset { W = \text{blkdiag} \{ W _ { 1 }, \dots, W _ { P } \} } { \arg \max } R ( W A ; \{ H [ b ] \} ) \quad ( 7 ) \text{ \ \ operator } \\ & \text{subject to } W _ { p } \in \mathcal { W }, \quad \forall p \in \{ 1, \dots, P \}.$$

The problem as it is formulated in (7) considers a generic setting for the feasible panel-wise computation set W . As such, it accommodates both the unstructured setting C1 as well as the power-oriented C2-C3. However, when required to operate with sparse panels C2, one is likely to also impose an additional constraint on the overall number of active phase shifters in W . Similarly, imposing C3 assumes that one operates with a fixed and known resolution dictated by Q .

In some cases (e.g., when T ≥ max( ⌊ M K -L K + 1 ⌋ , K ) , B = 1 , and while allowing W = C N × L ), one can identify the optimal setting [37]. Even in such cases, tackling (7) typically involves an iterative optimization procedures. In practice, the modular beamformer must be set within a coherence duration (which can be of the order of 0 1 . milliseconds [23]). To account for this requirement, we limit the number of iterations for these calculations, allowing at most J iterations. To facilitate identifying an optimizer that can reliably tackle (7) within J iterations, we assume access to a data set D composed of |D| &gt; 0 past channel realizations, i.e.,

$$\mathcal { D } = \left \{ \{ \mathbf H _ { i } [ b ] \} _ { b = 1 } ^ { B } \right \} _ { i = 1 } ^ { | \mathcal { D } | }. \quad \quad \quad ( 8 ) \quad 4 \ \Big |$$

## III. UNCONSTRAINED UNFOLDED MODULAR BEAMFORMING

In this section, we study modular beamforming design while focusing on unconstrained phase shifters , i.e., constraint C1. The unfolded modular beamforming algorithm, which is geared towards enabling rapid adaptation, serves as a starting point for considering the more restrictive constraints C2-C3 in Section IV. In particular, we first formulate our baseline optimizer of PGA with momentum in Subsection III-A. Then, we convert it into a machine learning model in Subsection III-B, and provide a discussion in Subsection III-C.

## A. PGA with Momentum

A direct approach to tackle (7) employs first-order methods [44], e.g., PGA. This scheme starts from some initial guess W 0 , and iteratively takes gradient steps towards the maximization of (6), projected to meet the constraints. PGA relies on the ability to compute the gradient of R ( WA H ; { [ b ] } ) with respect to W , denoted ∇ W R ( W A , ) . The gradient of the rate is stated in Theorem 1.

Theorem 1: The gradient of (6) with respect to W is

$$\intertext { n e o r e m } \colon \, \text{the given $v$} \, \text{$w$ is} \\ \nabla _ { W } R ( W, A ) = \frac { 1 } { B } \sum _ { b = 1 } ^ { B } \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } A \left ( ( G ^ { H } G ) ^ { - 1 } G ^ { H } \\ \times H [ b ] H [ b ] ^ { H } \right ) \left ( I + \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } \left ( G ( G ^ { H } G ) ^ { - 1 } G ^ { H } \\ \text{etup} \\ \text{nec} ^ { - } _ { \dots } } \times H [ b ] H [ b ] ^ { H } \right ) \right ) ^ { - 1 } \left ( I - G ( G ^ { H } G ) ^ { - 1 } G ^ { H } \right ) \right ) ^ { H }.$$

Proof: The proof is given in Appendix A.

In addition to the gradient in (9), one should also be able to project onto the feasible constraints in (7) to formulate PGA. For the non-power-constrained feasible set (2), the projection operator for a matrix W based on C1 is

$$[ \mathcal { P } _ { \mathcal { W } _ { \text{uph} } } ( W ) ] _ { i, j } = \frac { [ W ] _ { i, j } } { | [ W ] _ { i, j } | } \cdot \delta _ { \lfloor \frac { i } { N } \rfloor, \lfloor \frac { i } { L } \rfloor }. \quad ( 1 0 )$$

In (10), the element-wise operation divides each entry of the matrix W by its own magnitude, and then sets it to zero if it falls out of the main block diagonal. This effectively keeps each panel-wise processing made up of phase-shifters only.

Although first-order methods often require a large number of iterations to converge, they can typically be accelerated by introducing momentum. Momentum is also useful for dealing with non-convex objectives, as in (7), since it can prevent getting trapped in local minima and saddle points. The resulting PGA with momentum is summarized as Algorithm 1.

## Algorithm 1: PGA with Momentum

Init: Initialize W -1 as zeros; randomize W 0

.

Set iterations J , hyperparameters { µ , β j j } J -1 j =0 ;.

Input: { H [ b ] } B b =1 , A

$$\stackrel { \mu } { \text{in} } \text{ for } j = 0, 1, \dots, J - 1 \text{ do}$$

- 2 Compute gradient ∇ W R ( W A j , ) via (9);

3

Take gradient step

W

j

+1

←

W

j

+

Add momentum

W

j

+1

←

W

j

+1

5

Project

W

j

+1

+

µ

j

∇

W

β

←P

R

j

W

(

W

uph

(

j

(

W

6 return W J

## B. Unfolded PGA with Momentum

Algorithm 1 allows tackling (7) while meeting the requirement to operate with J iterations. However, iterative optimizers such as PGA are designed to tackle convex optimization problems and to operate with asymptotically large number of iterations. There, convergence can be guaranteed with

W A

j

,

)

;

-

W

j

-

j

+1

1

)

;

)

via (10);

4

Fig. 2: Architecture, trainable parameters marked with red.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-b3b9bb30-c530-455d-a565-c393fd3c571f.jpg)

fixed hyperparameters { µ, β } (i.e., independent of the iteration index j ), which can be tuned manually. In Algorithm 1, we apply this convex optimizer to a non-convex problem (7) while operating with a fixed and small number of iterations J . In such cases, the setting of the hyperparameters { µ , β j j } greatly affects performance [44, Ch. 9]. This motivates leveraging the available data in (8) to tune these hyperparameters, by converting Algorithm 1 into a discriminative machine learning model [45], and proposing a dedicated learning mechanism. We next detail the resulting machine learning architecture, its proposed training procedure, how its trainability can leveraged to increase robustness to CSI errors, and how it can scaled to large modular settings.

1) Architecture: Algorithm 1 operates with exactly J iterations. It can thus be readily converted into a machine learning model via deep unfolding for learning hyperparameters [36]. Here, each iteration is treated as a layer in a multi-layer architecture, whose trainable weights are the hyperparameters.

We increase the abstractness of the trainable architecture by allowing it to use different values of µ and β not just per iteration, but also per entry in W . Accordingly, the scalar values { µ , β j j } that multiply matrix quantities in Algorithm 1 are replaced with block-diagonal matrices α j , β j that multiply the matrix quantities in Algorithm 1 element-wise. The resulting architecture obtained from Algorithm 1 is illustrated in Fig. 2, and has 2 · J · P · N · L trainable parameters, written as

$$\theta = \{ \alpha _ { j }, \beta _ { j } \} _ { j = 0 } ^ { J - 1 }. \quad \quad \ \ ( 1 1 ) \ \overset { \text{zero} } { \text{level} }$$

2) Training: Converting Algorithm 1 into a machine learning model facilitates tuning θ in (11), which are the hyperparameters of Algorithm 1. This is achieved using the dataset D in (8), containing past channel realizations taken from the same communication system. Letting W J ( θ ; { H [ b ] } ) be the modular beamforming matrix computed by Algorithm 1 with parameters θ when applied to channel { H [ b ] } , we seek the hyperparameters

$$\theta ^ { * } = & \arg \max _ { \theta } \sum _ { \{ H [ b ] \} \in \mathcal { D } } R ( W _ { J } ( \theta ; \{ H [ b ] \} ) A ; \{ H [ b ] \} ). \ ( 1 2 ) \quad \text{follows} \colon \\ & \mathcal { L } _ { \mathcal { U } ^ { \sigma } ( E ) } ^ { 2 } ( 6 )$$

The objective in (12) evaluates θ based on the output of the unfolded architecture, i.e., W J . To facilitate the learning of θ , we exploit the interpretability of the architecture, and particularly the fact that each layer should output a gradually improved modular beamformer. Accordingly, we propose a loss measure for optimizing θ that accounts for the output of the intermediate iterations (layers) in a monotonically growing fashion. Specifically, we use a loss function with logarithmic contribution growth between iterations [46], [47], given by

$$\underline { \underline { \beta } } \Big | \quad \begin{array} { c c c c c c } \lambda \\ \mathcal { L } _ { \mathcal { D } } ( \theta ) = - \sum _ { \{ H [ b ] \} \in \mathcal { D } } \sum _ { j = 1 } ^ { J } \frac { \log ( 1 + j ) } { | \mathcal { D } | } \\ \quad \times R ( W _ { j } ( \theta ; \{ H [ b ] \} ) A ; \{ H [ b ] \} ). \quad ( 1 3 ) \\ \quad \end{array} \Big. \quad \dots \quad \dots \quad \dots \quad \dots \quad \dots \quad \dots$$

The resulting training algorithm using mini-batch stochastic gradient descent is stated as Algorithm 2. The negative sign in the loss is added because our objective is to maximize the rate, rather than minimize it.

## Algorithm 2: Learning Hyperparameters

Init: Set θ as fixed hyperparameters

Fix learning rate η &gt; 0 and epochs i max

Input: Training set D

for

i

= 0 1

,

, . . . , i max

-

Randomly divide for

1

2

3

D

1

do into

Q

batches

q

= 1

, . . . , Q

do

4

Apply model with parameters

θ

$$\ s _ { \cdot. } \ \Big | \ \bigsqcup \ U p d a t e \ \theta \leftarrow \theta - \eta \nabla _ { \theta } \mathcal { L } _ { \mathcal { D } _ { q } } ( \theta ) ;$$

6 return θ

3) CSI Estimation Error Robustness: The iterative optimizer presented in this work assumes perfect CSI. However, in practice one may only have access to a noisy estimate of the CSI. The fact that our unfolded PGA is trained from data allows it to also to learn hyperparameters that boost robustness to such noisy CSI, without altering the operation of the optimization algorithm.

The presence of CSI errors leads to having the optimizer applied to perturbed channel realizations, represented as H [ b ] + E [ b ] , rather than the true channel realizations H [ b ] . Here, E [ b ] denotes the CSI estimation error. The trainability of unfolded PGA allows it to be trained with noisy CSI to yield beampatterns that are suitable for the true CSI. To that aim, we model the CSI error as an i.i.d. Gaussian noise matrix with zero mean and variance σ 2 E , which represents the expected level of estimation error. During training, where one has access to the channel realizations as in 8, instead of applying the trainable optimizer to the true channel realizations, we apply it to a noisy version of the channels. To compute the loss during training, the noiseless channels H [ b ] are used to calculate the rate. This approach ensures that the optimizer learns hyperparameters that yield beamformers tailored to the true underlying channels, rather than to their noisy estimates.

Mathematically, the loss function in (13) is updated as follows:

$$\begin{array} { c c }. \ ( 1 2 ) & \text{succeeds}. \\ \text{put of} \\ \text{aring} \\ \text{e, and} & \dots \end{array} \begin{array} { c } \mathcal { L } _ { \mathcal { D } } ^ { \sigma _ { E } ^ { 2 } } ( \theta ) = & - \sum _ { \{ H _ { i } [ b ] \} \in \mathcal { D } } \sum _ { j = 1 } ^ { J } \frac { \log ( 1 + j ) } { | \mathcal { D } | } \\ & \times R ( W _ { j } ( \theta ; \{ H _ { i } [ b ] + E _ { i } [ b ] \} ) A ; \{ H _ { i } [ b ] \} ), \ ( 1 4 ) \end{array}$$

where E i [ b ] iid ∼ N (0 , σ 2 E ) is sampled anew for each forward pass during training. When σ 2 E = 0 , the training procedure

{D }

q

Q

q

to

D

=1

q

;

;

reduces to the noiseless CSI case detailed in Subsection III-B2. The resulting noisy CSI aware training allows achieving improved robustness via hyperparameter learning, as empirically demonstrated in Subsection V-B3.

4) Transferability Across Configurations: Modular beamforming architectures are scalable, stemming from the ability to achieve extremely large MIMO configurations by adding panels. A core gain of our interpretable learning-aided optimizers is the fact that they support such scalability. Specifically, what we learn are hyperparameters of an optimization algorithm, which can be applied to different configurations. This indicates that our unfolded optimizer shares this transferability across configurations, thus inherently supporting large and adaptive scale deployments.

In particular, the architecture and training procedure detailed above are formulated for a given modular configuration. Nonetheless, a learned optimizer is transferable, and a learned optimizer trained for a small configuration can be scaled to applied to much larger ones. Specific scalable parameters of interest are the numbers of users K and of panels P :

- · Scaling K : we note that the learned hyperparameters in (11) are invariant of the number of users. Thus, a learned optimizer trained for a small number of users can be readily applied to a setting with a large number of users.
- · Scaling P : While the setting of the hyperparameters in (11) depends on the number of hyperparameters, as we allow panel-specific hyperparameters, one can scale by reusing hyperparameters across panels [48]. For instance, a learned optimizer trained to set { α j , β j } for a configuration with P panels can be applied to a setting with c · P a positive integer c , by e.g., setting its hyperparameters to be { I c ⊗ α j , I c ⊗ β j } , where ⊗ denotes the Kronecker product, or by assigning the added panels an average of the learned hyperparameters.

The above approaches to transfer a learned optimizer across different configurations are empirically demonstrated to yield effective and scalable optimization in Subsection V-B2.

## C. Discussion

The proposed unfolded PGA is designed to learn from data how to traverse the optimization loss surface, allowing to achieve improved sum-rate within J iterations, as shown in Section V. The resulting learned θ , which represents the periteration hyperparameters used for setting the modular beamformer, may exhibit certain counter-intuitive characteristics, such as negative gradient steps, as means of coping with non-convexity. As the resulting algorithm is a learned implementation of a principled optimizer, we share its scalability, which is highly desirable in modular architectures. While our formulation considers panels comprised phase-shifters, one can consider alternative hardware, such as distributed active metasurfaces [43] and phase-time arrays [49].

Our formulation of the modular hybrid beamforming setting considers the connectivity matrix A to be fixed, representing a given physical infrastructure or wiring. Still, there are scenarios where it is of interest to also optimize A . These including the possibility of optimizing it for each channel alongside W , e.g., when the hardware includes rapidly adaptable switches, or even for having a single A optimized for multiple coherence duration, thus effectively guiding the system design. While both options can be studied based on our proposed learned optimization methodology, we leave these extensions of our work for future study.

The fixed and limited number of iterations impacts the computational complexity of setting the modular beamformers for a given channel realization. To quantify this complexity, we examine a single iteration of Algorithm 1. The computational burden is mainly dominated by the gradient computation step, formulated in (9). This computation has a complexity order (in complex multiplications) of

$$\mathfrak { e } \, \mathrm d e ^ { - } \, \mathcal { O } \left ( B ( T ^ { 3 } + M ^ { 2 } ( T + K ) ) + M ( T ^ { 2 } + L P T + T K ) \right ). \ ( 1 5 )$$

The remaining steps in the algorithm include the update step and the projection step (10). The complexity order of these steps is O ( MLP ) for both, which is negligible compared to the gradient computation step. Considering that optimization procedure operates over B frequency bins, the overall complexity of the PGA+M algorithm with a predefined J iterations, as implemented by the proposed learned optimizer, is of the order of

$$\text{s.o. with your own} \quad \\ \text{s.s.} \\ \text{rs in} \quad \mathcal { C } _ { P G A + M } = \mathcal { O } \left ( J B \Big ( T ^ { 3 } + M ^ { 2 } ( T + K ) \\ \text{e by} \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \ \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \end{ \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \quad \text{ } \$$

The asymptotic complexity characterization in (16) is comprised of multiple summands, where in general none of the terms can be consistently ignored. Nonetheless, in an expected massive modular MIMO setting, where the overall number of antenna elements is larger than both the number of users ( K ) and the number of CPU inputs ( T ), the dominating term is the one growing quadratically with M , and thus C PGA + M ≈ O ( JBTM 2 ) . When delving further into the analysis, it becomes evident that the dominant terms (in complex products) arise from matrix multiplication operations. However, these computations can often be parallelized to reduce computational complexity, making the complexity of matrix inversion, represented by the O ( JBT 3 ) term, the dominant factor. While it is possible to further reduce the number of multiplication operations through techniques such as sparse and low-rank approximations of the gradients, we leave this aspect to future research.

## IV. POWER-AWARE UNFOLDED MODULAR BEAMFORMING

Our analysis in Section III focused on the unconstrained setting C1. In this section, we use the unconstrained design for maximizing the rate (6) as a starting point, on top of which we develop a power-aware design. Specifically, we leverage the interpretability of the solution described in Section III to incorporate constraints C2-C3. We focus on conventional (non-learned) gradient-based optimization subject to C2-C3 in Subsections IV-A and IV-B, respectively. Then, we formulate

PGA with momentum and the unfolded algorithms tailored for these designs in Subsections IV-C and IV-D, respectively, and conclude with a discussion in Subsection IV-E.

## A. Sparsified Modular Beamformer

As detailed in Section II, power efficiency can be enhanced by turning off some of the phase shifters. Supporting deactivated phase shifters can be mathematically accommodated by constraint C2, i.e., as promoting sparsity of the matrix W . To meet this constraint, we rewrite our constrained optimization from (7) as

$$\vec { W } ^ { * } = \underset { W = b l k \text{diag} \{ W _ { 1 }, \dots, W _ { P } \} } { \arg \max } R ( W A ; \{ H [ b ] \} ) \quad ( 1 7 ) \, \underset { W _ { p } \in \mathcal { W } _ { \text{sp} }, \quad \forall p \in \{ 1, \dots, P \}, \quad \text{quantiz} \\ \cdots \, \overset { \cdots } { \cdots } - \, \overset { \cdots } { \cdots } - \, \overset { \cdots } { \cdots } \cdots \, \overset { \cdots } { \cdots } \cdots \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \oversets { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots  \, \colon \, } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdcl } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \ \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots. \, } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots. \, } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { { \cdots } { \vdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \, \overset { \cdots } { \cdots } \,.$$

where S max ≤ N L P · · represents the maximal allowed number of active phase shifters. In (17), each phase shifter can be either active or turned off (by (3)). The ℓ 0 constraint guarantees that at most S max phase shifters are active.

Due to the inherent challenges associated with gradientbased optimization under ℓ 0 constraints, we adopt the common approach of relaxing it into an ℓ 1 constraint (see, e.g., [50, Ch. 1]). The relaxed optimization problem is

$$W ^ { * } = \underset { W = \text{blkdiag} \{ W _ { 1 }, \dots, W _ { P } \} } { \arg \max } R ( W A ; \{ H [ b ] \} ) - \lambda | | W | | _ { 1 } \\ \dots$$

$$( 1 8 )$$

$$\text{subject to } W _ { p } \in \mathcal { W } _ { \text{sph} }, \ \forall p \in \{ 1, \dots, P \}.$$

In (18), λ &gt; 0 is an objective regularization coefficient [36] whose purpose is to encourage the solution to hold the sparsity constraint in (17). Setting the exact value of such hyperparameters to meet a desired sparsity level S max is typically elusive, and involves repeating numerical trials to identify the exact value that strikes a desired trade-off between performance (i.e., rate) and sparsity. Nonetheless, once λ is fixed, the gradient of the relaxed objective in (18) can be computed as

$$\nabla _ { W } \left ( R ( W A ; \{ H [ b ] \} ) - \lambda | | W | | _ { 1 } \right ) & = & \quad \text{projecti} \\ \nabla _ { W } R ( W A ; \{ H [ b ] \} ) - \lambda \cdot e ^ { j \Delta W }. & \quad ( 1 9 ) & \quad \text{Algor} \quad$$

where ∇ W R ( ) · is given in Theorem 1.

Relaxing (17) into (18) enables computing the objective gradients via (19). In order to enable PGA-based optimization, one should also define the corresponding projection on the feasible set W sph . To that end, we adopt a flexible extension of the projection operator in (10) to account for deactivated phase shifters, by introducing a magnitude threshold ζ &gt; 0 . The resulting projection step is given by

$$[ \mathcal { P } _ { \mathcal { W } _ { \text{sph} } } ( W ) ] _ { i, j } = \begin{cases} \left \{ \frac { [ W ] _ { i, j } } { | [ W ] _ { i, j } | } \cdot \delta _ { \lfloor \frac { i } { N } \rfloor, \lfloor \frac { j } { L } \rfloor } } & | [ W ] _ { i, j } | \geq \zeta, \\ 0 & | [ W ] _ { i, j } | < \zeta. \end{cases} ( 2 0 ) \right \} ^ { \mathbf 4 } _ { \mathbf 5 } \, \Big \rfloor ^ { \mathbf 4 } _ { \mathbf P }.$$

Projection via (20) is a crucial step in the tackling the relaxation of (17), ensuring that we set some elements of W to 0 and constrain their magnitude to be either 0 or 1 , as described in C2. At the same time, this step preserves the block diagonal structure of W . A candidate choice of ζ is

ζ = 0 5 . ; Setting ζ = 0 makes this projection step coincide with the projection step in (10).

## B. Quantized Modular Beamformer

A complementary approach to mitigate power consumption of analog modular processing is by discretizing the phase resolution with a few bit representation. Incorporating the resulting constraint C3 into the rate maximization objective (7), yields the resulting constrained optimization formulation

$$& W ^ { * } = \underset { W = \text{blkdiag} \{ W _ { 1 }, \dots, W _ { P } \} } { \arg \max } R ( W A ; \{ H [ b ] \} ) \quad ( 2 1 ) \\ & \text{subject to } W _ { p } \in \mathcal { W } _ { \text{qs} } ^ { Q }, \quad \forall p \in \{ 1, \dots, P \}.$$

In (21), the set of feasible phase shifts is restricted to take Q quantization levels, using the definition of W Q qps in (4).

We note that the objective in (21) is the same as in the unconstrained case (7), and thus its gradient can be obtained from Theorem 1. Consequently, to formulate the suitable PGA steps for tackling (21), one must specify the quantizationaware projection operator. A direct approach to guarantee discrete phase components is by setting each phase element into its nearest discrete value, resulting in

$$[ \mathcal { P } _ { \mathcal { W } ^ { Q } _ { \text{qps} } } ( W ) ] _ { i, j } & = e ^ { j \phi _ { i, j } ^ { * } } \cdot \delta _ { \lfloor \frac { i } { N } \rfloor, \lfloor \frac { j } { Z } \rfloor } \quad & ( 2 2 ) \\ & \text{where $\phi_{i,j}^{*}=\arg\min_{\frac{\phi-\Delta[W]_{i,j}|$.} }$$

The projection operator in (22) can be viewed as uniform scalar quantization of the phase of each element of W .

## C. Power Aware PGA

Here we present a baseline PGA algorithm for the updated set of constraints, as described in C2 and C3. This PGA algorithm is an extension of Algorithm 1, adapted to the power aware objectives described in Subsections IV-A and IV-B. The resulting formulation is summarized as Algorithm 3. There, we integrate the power-aware gradient formulation (19) with the projection steps (20) and (22) to realize PGA.

## Algorithm 3: Power-Aware PGA with Momentum

Init:

Initialize

W

-

1

as zeros; randomize

W

0

;

Choose projection operator P W ( ) · ;

Set iterations J , hyperparameters { µ , β j j } J -1 j =0 , λ ;.

Input: { H [ b ] } B b =1 , A

for

j

= 0 1

,

, . . . , J

-

1

Set gradient

∇

W

(

do

R

Take gradient step

W

j

+1

←

W

j

+

Add momentum

W

j

+1

←

W

j

+1

5

Project

W

j

+1

+

(

W A

µ

j

∇

j

)

W

(

R

β

←P

j

W

(

(

W

W

-

λ

||

W

(

W A

j

-

j

+1

j

)

||

1

-

)

λ

via (19);

||

W

||

1

)

;

W

j

-

)

1

)

;

via (20) or (22);

6 return W J

Algorithm 3 is designed to tackle the maximization problems outlined in (18) and (21) by proper settings of the projection operator and the regularization coefficient. For instance,

1

2

3

4

Fig. 3: Power aware unfolded architecture, trainable parameters marked with red.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-487d6248-5c82-436d-84c9-84e6015b7950.jpg)

by setting the projection to be given in (22) and setting λ = 0 , Algorithm 3 tackles problem (21). Similarly, by using λ &gt; 0 and setting the projection to be (20), it tackles problem (18).

## D. Unfolded Power Aware PGA

In Subsection III-B, we showed how data can be leveraged to tune the hyperparameters of Algorithm 1 to enhance its performance within J iterations, by converting it into a machine learning architecture. Here, we follow this methodology to convert the power-aware Algorithm 3 into a trainable architecture. As opposed to the unconstrained case, where the learned hyperparameters were solely associated with the solver, i.e., with PGA, in the following we also leverage data to tune parameters associated with the optimization objective [36], and particularly the (typically elusive) regularization coefficient λ .

1) Architecture: Following the conversion of PGA with momentum into a machine learning model in Subsection III-B1, we view the iterative algorithm as a multi-layer architecture. This allows using the data (8) to learn hyperparameters that yield desirable settings within a few iterations.

Algorithm 3 introduces another hyperparameter, λ , associated with optimization objective, and particularly the ℓ 1 norm reduction. Here, we increase the abstractness of the trainable architecture by allowing λ to differ from one iteration to another, i.e., have each iteration taking its gradient step over a different loss surface . Furthermore, we turn the scalar regularization coefficient into a matrix with different values for each entry in W . We add these learnable matrices { λ j } J -1 j =0 to the set of trainable parameters θ . Accordingly, we now have 3 · J · P · N · L trainable parameters, written as

$$\theta = \{ \alpha _ { j }, \beta _ { j }, \lambda _ { j } \} _ { j = 0 } ^ { J - 1 }. \quad \quad ( 2 3 ) \quad \stackrel { \cdot \cdot } { ( i i ) }$$

The power aware architecture is visualized in Fig. 3 for a given learned hyperparameters θ . For clarity of presentation, in Fig. 3 we separate the gradient step in Algorithm 3 into two separate steps, each one dependent on a different hyperparameter.

2) Projection: A key issue in deep unfolding is maintaining the forward path differentiable. This allows the optimizer to be represented as a trainable architecture that can be tuned with deep learning techniques based on backpropagation [36]. Algorithm 3 mainly differs from Algorithm 1 in the projection step. The projection step in both (20) and (22) contains continuous-to-discrete mappings that nullify gradients.

To overcome this, we distinguish between the projection step utilized when applying the optimizer, and a differentiable surrogate utilized for evaluating gradients during training. Specifically, we use the following surrogate projections:

- · Approximating P W sph : The projection onto W sph can be viewed as a step function. Accordingly, we approximate it during training using a harp and shifted sigmoid function [51] denoted ˆ P W sph , given by

$$[ \mathcal { P } _ { \mathcal { W } _ { s p h } } ] _ { i, j } = | W _ { i, j } | = \sigma ( s _ { m } ( | W _ { i, j } | - \zeta _ { m } ) ). \quad ( 2 4 )$$

In (24), σ denotes the sigmoid function, s m denotes a sharpness hyperparameter, and ζ m stands for the shift, imitating the threshold ζ from (20).

- · Approximating P W Q qph : For phase approximation with Q quantization levels, we note that the projection operator is a piecewise-constant monotonically increasing function. Following [52], we approximate the quantization levels with sum of Q differently shifted sigmoid functions. The resulting phase projection sets ϕ ⋆ i,k in (22) to be

$$\stackrel { \cdot } { 1 } \\, &,$$

where s p is a sharpness hyperparameter.

This above formulations approximate the projection operators in a differentiable manner, ensuring smooth gradients during training while maintaining the characteristics of the original projection step. The ability of (22)-(25) to approximate their corresponding hard (non-differentiable) projection operators is illustrated in Fig. 4.

3) Loss Function: We assume access to a dataset D , which comprises past channel realizations. This data is leveraged to learn the hyperparameters for solving the following constrained optimization problem:

$$\underset { \overset { J - 1 } { \underset { j = 0 } { \text{to} } } } { \text{uses for} } \quad \theta ^ { * } = \underset { \theta } { \arg \max } \sum _ { \{ H [ b ] \} \in \mathcal { D } } R ( W _ { J } ( \theta ; \{ H [ b ] \} ) A ; \{ H [ b ] \} ) \ ( 2 6 )$$

subject to: W J = blkdiag { W J 1 , . . . , W J P }

$$( i ) \ | W _ { J } | | _ { 0 } \leq S _ { \max }, \ W _ { J _ { p } } \in \mathcal { W } _ { \text{sp} }, \ \forall p \in \{ 1, \dots, P \}.$$

$$2 3 ) \ \ ( i i ) \ \ W _ { J _ { p } } \in \mathcal { W } _ { \text{qps} }, \ \ \forall p \in \{ 1, \dots, P \}.$$

The constraints on W are either ( ) i or ( ii ) , depending on the solved problem, (17) or in (21), respectively.

The learning objective in (26) under ( ) i encapsulates a key difference from the unconstrained one (12). Specifically, for sparse phase shifters, the learning objective stems from (17), namely, maximizing R under the ℓ 0 norm constraint. When formulating the resulting PGA iterations, we relaxed ℓ 0 norm to the ℓ 1 norm, using the coefficient λ to balance between rate maximization ( R ) and sparsification. To translate this into a

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-58d21916-70d0-4e98-b8b9-00233b6a7426.jpg)

(a) Magnitude projection,

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-ca4bc42a-2a3b-4f9f-ae51-1c063f98cfd8.jpg)

ζ

= 0 5

.

.

(b) Phase projection,

Q

= 8

.

Fig. 4: Projection operators for power-aware PGA and their corresponding differentiable approximation.

suitable loss for training that encourages a desired ℓ 1 norm, we introduce the following training loss

$$& \mathcal { L } _ { \mathcal { D } } ( \theta ) = \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \alpha \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \lambda \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \chi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xi \xrightarrow \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cd: \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cdots \, \cd:[ \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ]| \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ] | \alpha ]$$

where γ ≥ 0 is a regularization hyperparameter. The loss (27) is also used with quantized phase shifters, i.e., under ( ii ) , by setting γ = 0 , as constraint ( ii ) is guaranteed to hold when using the projection operator P W Q in modular beamforming.

qph The updated loss function (27) is an extension of the unconstrained loss function (12), adding the squared error between the ℓ 1 norm of W J and S max . The rationale stems from our desire to encourage ∥ W J ∥ 1 (being a differentiable approximation of ∥ W J ∥ 0 ) to approach S max without having to tune different regularization coefficients for different S max . This allows training via, e.g., mini-batch stochastic gradient descent, as in Algorithm 2.

## E. Discussion

The design of the constrained modular beamformer via Algorithm 3 is based on the PGA steps designed for the unconstrained setting in Algorithm 1, leveraging its interpretable operation by introducing dedicated projections. Despite the similarity in inference, the procedure involved in learning the hyperparameters from data substantially differs from the unconstrained case, necessitating differentiable approximations of the projection operators during learning, altering gradient computation, and a dedicated training loss. This allows learning to rapidly set constrained modular beamformers with only a minor degradation in the rate, as shown in Section V.

Once the hyperparameters are learned through the unfolded learning procedure detailed in Subsection IV-D, the setting of the modular beamformer in Algorithm 3 follows the unconstrained PGA in Algorithm 1. The key differences are the additional phase term in the gradient computations via (19), and the modification of the projection operators via (20) or (22). As none of these operations dominates the computational burden, the complexity of the power-aware design is similar to that of the unconstrained case, analyzed in Subsection III-C.

Our power-aware design boosts power efficiency by supporting deactivated and low-resolution phase shifters. The translation of these properties into power savings is highly dependent on the hardware. We opt for a parametric representation of the desired sparsity level and phase shifter resolution, allowing the unfolded optimizer to be useful for different implementations and different power levels by setting of the corresponding parameters, e.g., S max and Q . While our learning procedure utilizes the projection surrogates visualized in Fig. 4, one can consider alternative differentiable approximations of such continuous-to-discrete mappings, see, e.g., [53]. Moreover, additional methods to boost power efficiency by, e.g., deactivating panels rather than phase shifters, can be obtained as extensions to our framework, which are left for future study.

## V. EXPERIMENTAL STUDY

In this section, we numerically evaluate the proposed unfolded algorithm for rapid tuning of uplink modular beamforming 1 . We describe the experimental setup in Subsection V-A, while our results for unconstrained and power-aware settings are reported in Subsections V-B-V-C, respectively.

## A. Experimental Setup

We simulate a communication system, where the channel matrices { H [ b ] } B b =1 are obtained from a Rayleigh fading distribution, as well as physically compliant realizations obtained from the QuaDRiGa model [40]. We treat the number of iterations J as a pre-defined requirement, and train our algorithm to minimize its loss within this number of iterations. The signal-to-noise ratio (SNR) is defined as 1 /σ 2 w .

We compare our unfolded optimizer ( U-PGA+M ) with the following benchmarks:

- · PGA + M: running PGA with momentum (Algorithm 1) with fixed hyperparameters { µ, β } ∀ , j = 1 . . . J , chosen from a discrete grid, to maximize the average R after J = 500 iterations for the entire training set.
- · Line Search: PGA where the hyperparameters { µ , β j j } J -1 j =0 are selected for each iteration through grid search to maximize the achievable rate R at

each step [44]. This method performs an exhaustive search to find the optimal step size for each iteration, independently for each data sample, at the cost of excessive additional processing latency.

- · Manifold Optimization (MO): The optimizer proposed in [24] for centralized architectures, adapted to support modular beamformers. It suggests a relaxed version of the maximization problem (7), taking gradient steps of W toward the fully digital beamformer G opt , trying to minimize the error || WA -G opt || 2 , and projecting the resulted matrix W on the feasible set, using P W ( ) · . As in the Line Search benchmark, it performs an exhaustive line search to choose the best step size for each iteration.
- · CNN: A CNN based on the architecture of [30], trained to map channel realizations { H [ b ] } B b =1 into the phases of W that maximize the channel-rate R . This approach is extremely parameterized. For example, in a system with K = 7 users, M = 8 antennas, and B = 4 frequency bins, the CNN consists of 274088 learned parameters, whereas U-PGA+M has only 960 parameters.

## B. Unconstrained Modular Beamformers

We start the experimental study by considering unconstrained modular beamformers, as described in Subsection III-B. Our evaluation first focuses on small scale MIMO settings, after which we assess transferability to larger systems, and then we examine the performance of our robust algorithm in tackling CSI uncertainty, demonstrating its ability to maintain reliability and efficiency under imperfect channel knowledge.

1) Small-Scale Hybrid Modular MIMO: We first examine two scenarios representing relatively small-scale settings. In Scenario 1 , we set ( T = 5 , P = 2 , L = 4 , N = 20 , B = 2 , K = 20) , and the channel matrices obey Rayleigh fading. Scenario 2 uses QuaDRiGa channels with ( T = 5 , P = 4 , L = 2 , N = 3 , B = 4 , K = 5) .

We use these scenarios to evaluate the ability of our unfolded design to improve the sum-rate achieved within J = 10 iterations. To that aim, we depict in Figs. 5-6 the average sum-rate vs. the iteration index j for Scenarios 1 and 2 , respectively. For fair comparison, we set all optimizationbased algorithms to have J = 10 iterations, with the CNN having 10 layers, and compare the sum-rate to that achieved by PGA+M with J = 500 iterations. We consistently observe that in the considered scenarios with a limited number of iterations, our unfolded PGA outperforms all benchmarks, including the costly and greedy line search hyperparameter setting, and the highly parameterized CNN benchmark. Specifically, the conventional PGA+M requires 6 7 . × (for Rayleigh fading) and 14 7 . × (for QuaDRiGa) more iterations to achieve the performance of our unfolded algorithm. The CNN benchmark particularly struggles in Rayleigh channels, as CNNs tends to capture spatial relationships, and such relationships do not exist under Rayleigh fading. Similarly, the MO optimizer exhibits slow convergence due to the additional modular structure imposed in our setting of modular beamformers.

The results after J iterations illustrated in Figs. 5-6 are also reported in Table I, along with latency of the various

Fig. 5: Sum-rate vs. iteration, Scenario 1 , SNR = 0 dB.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-1e87b5c8-70e9-4ea5-bf37-064099be8463.jpg)

Fig. 6: Sum-rate vs. iteration, Scenario 2 , SNR = 0 dB.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-7238e491-d647-43ac-9fec-c4518228091a.jpg)

methods. The latter is evaluated for all algorithms on the same platform (Google Colab premium). From Table I, we observe that the unfolded algorithm, with J = 10 iterations, achieves a latency of 417 µs . In contrast, optimizers employing line search require 123 ms, which is approximately 300 × higher. Similarly, PGA running J = 500 iterations achieves comparable sum-rate performance but incurs a latency that is 50 × greater. These results highlight the significant efficiency advantage of the proposed unfolded algorithm in achieving rapid convergence. The CNN benchmark has the least latency here, due to the efficient implementation and natural support of such architectures in platforms such as Google Colab. This efficiency persists across multiple scenarios, emphasizing our ability to provide reliable modular beamformers with minimal latency, which can be further enhanced by employing dedicated hardware accelerators.

Figs. 7 and 8 show the resulted sum-rate for each benchmark in a wide range of SNR values, for Scenarios 1 and 2 , respectively. There, we observe that the gains obtained by the unfolded algorithm while using the same number of iterations, are translated into SNR gains of 1 25 . -1 5 . dB compared to the PGA + M algorithm with the same J iterations.

TABLE I: Sum-rate and running time for different Scenarios 1 , 2 , and 3 . In Scenario 3 , U-PGA+M was originally trained on Scenario 4 . Latency relates to the computation time of a single channel realization in Scenario 2 .

| Algorithm   | J      | Scenario 1   | Scenario 2   | Scenario 3   | Latency[ µs ]   |
|-------------|--------|--------------|--------------|--------------|-----------------|
| U-PGA+M     | 10     | 0.95         | 2.28         | 0.414        | 417             |
| PGA+M       | 10 500 | 0.88 0.98    | 2.04 2.33    | 0.407 0.421  | 413 19352       |
| Line Search | 10     | 0.92         | 2.26         | 0.415        | 123705          |
| CNN         | 10     | 0.73         | 2.19         | 0.388        | 290             |
| MO          | 10     | 0.75         | 1.58         | 0.388        | 31767           |

Fig. 7: Sum-rate vs. SNR, Scenario 1 .

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-625dc38b-a77f-463a-a3ef-13b173ca1f71.jpg)

2) Transferable Modular Structures Simulation Results: As explained in Subsection III-B4, one of the key advantages of our learn-to-optimize modular beamforming design is the transferability of learned parameters when scaling the system. Modular structures allow us to train the system with specific settings and then scale it up to a larger number of users or panels without needing to retrain the model.

Scaling the number of users: To demonstrate this, we first evaluate U-PGA+M that was initially trained with a small number of users, K = 5 , and then deployed in a system with a large number of users, K = 50 , using the same

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-23c9bd79-aba9-48c1-b557-a3e782b12d2d.jpg)

Fig. 8: Sum-rate vs. SNR, Scenario 2 .

Fig. 9: Sum-rate vs. SNR, Scenario 4 ( K = 50 users). Here, U-PGA+M was trained on K = 5 users.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-b286d9fc-85d8-4c90-b957-b5a70c861c47.jpg)

Fig. 10: Sum-rate vs. SNR, Scenario 6 . Here, U-PGA+M was trained on M = 8 , and deployed on M = 64 .

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-99f21ccd-bb90-42af-b2d8-f5de8d91e723.jpg)

hyperparameters. This example illustrates the transferability of the unfolded model. For this evaluation, we introduce Scenario 3 : ( T = 5 , P = 8 , N = 4 , B = 2 , K = 50) and Scenario 4 : ( T = 5 , P = 8 , N = 4 , B = 2 , K = 5) . In both scenarios the channel realizations are sampled from a Rayleigh fading distribution. Fig. 9, presents the sum-rates achieved by the various benchmarks on Scenario 3 , along with the performance of the U-PGA+M algorithm, which was trained on Scenario 4 . These results demonstrate the flexibility of the unfolded algorithm and underscore its advantages in adapting to rapidly changing environments. The average rates at SNR of 0 are also reported in Table I.

Scaling the number of panels: Next, we provide an example of scaling up the number of panels. In this example, we use c = 8 as the scaling coefficient, and increase the number of panels from P to c · P , using { α j , β j } = { I c ⊗ α j , I c ⊗ β j } . To this end, we introduce Scenario 5 : ( T = 5 , P = 2 , N = 4 , B = 2 , K = 7) and Scenario 6 : ( T = 5 · 8 , P = 2 · 8 , N = 4 , B = 2 , K = 7) ; both obey Rayleigh fading. Fig. 10 illustrates the results of various

benchmarks trained on Scenario 6 , alongside the performance of the U-PGA+M algorithm that was trained on Scenario 5 . While the gains of our unfolded algorithm (trained for Scenario 5 ) compared to the benchmarks that are all tuned for Scenario 6 are more modest here compared with having it trained for the same setup, the fact that it does not degrade performance, and is even applicable in such different setups without necessitating any form of retraining, is quite nontrivial. These results highlight the flexibility of our design, demonstrating how it can be initially trained on a smaller network, perform straightforward calculations, and then be effectively scaled to much larger and more complex systems.

3) Robustness to CSI Estimation Error Simulation Results: As detailed in Subsection III-B3, the trainabiltiy of our unfolded optimizer can be leveraged to cope with CSI estimation errors caused by e.g., noise or limited pilots. To evaluate the robustness of our unfolded beamforming algorithm, we simulate the impact of CSI estimation errors in Scenario 2 with 0 dB SNR, and analyze its performance in terms of sumrate as the variance of the estimation error increases.

The results, shown in Fig. 11, highlight the comparative robustness of the proposed unfolded PGA algorithm ( UPGA+M ), which operates with solely 10 iterations. While performance degradation is observed for all methods as the estimation error variance ( σ 2 E ) increases, the unfolded PGA algorithm demonstrates a less steep descent compared to the conventional PGA+M approach, even when the latter is executed with 500 iterations. In particular, PGA+M with 10 iterations exhibits the most significant performance degradation, indicating that insufficient optimization steps amplify the sensitivity to CSI estimation errors. In contrast, the PGA+M method with 500 iterations reduces this sensitivity but still underperforms relative to the unfolded algorithm in scenarios with high σ 2 E . This indicates the ability of our unfolded approach in achieving robustness imperfect CSI via dedicated learnin. The unfolded algorithm's performance at lower σ 2 E remains competitive with conventional methods, confirming that the benefits of robustness do not come at the cost of baseline performance. Overall, these findings demonstrate that the proposed unfolded PGA framework not only provides robust performance under realistic channel conditions, but also offers a scalable solution for handling imperfect CSI in modular beamforming systems.

## C. Power-Aware Modular Beamformers

We proceed to evaluating the ability of our unfolded optimizer to encourage power-efficient modular beamformers. We divide our evaluation to boosting efficiency via deactivating phase shifters, and via using low resolution phase shifters.

1) Sparse Modular Beamformers: We evaluate the effect of designing modular beamformers with deactivated phase shifters by boosting sparsity in W . We focus on Scenario 2 , and apply U-PGA+M using Algorithm 3 utilizing the projection step P W ( ) · in (20). We set the parameter S max to be 0 75 . · N L P · · . As the benchmarks detailed in Subsection V-A do not naturally account for such constraints, we compare here U-PGA+M to unconstrained settings that are based on PGA, possibly with line search and/or large number of iterations.

Fig. 11: Sum-rate vs. CSI estimation error variance.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-20f78af2-026d-4358-93ca-0058bf483f4d.jpg)

Fig. 12: Sum-rate vs. iteration, Scenario 2 , SNR = 0 dB.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-50d92c02-4c62-462e-a570-0afca17cc6e3.jpg)

The resulting rates vs. iteration compared to those achieved without such power-aware design are reported in Fig. 12. We observe that by applying Algorithm 3, one achieves a 25% reduction in active components while maintaining a comparable sum-rate and identical running time to unconstrained settings. The unfolded algorithm learns to rapidly compensates for the inactive components by tuning the active phase shifters. Fig. 13 further highlights the advantages of the unfolded power-aware algorithm by evaluating the resulting sum-rate over different SNRs. There, we observe that our power-aware design not only allows accurate operation with 25% of the phase shifters deactivated, but it also offers approximately 1 dB improvement in SNR over the PGA + M benchmark with the same number of iterations.

2) Low-Resolution Modular Beamformers: We conclude our numerical study by evaluating the effect of using quantized phase shifters, and the ability of our power-aware design to account for such constraint when tuning modular beamformers. We consider the power-aware Algorithm 3, utilizing the projection step for P W ( ) · as specified in (22), when the phase shifters can be configured to merely 4 bits in phase, i.e., Q = 16 . The benchmarks detailed in Subsection V-A are

Fig. 13: Sum-rate vs. SNR, Scenario 2 .

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-0a11913b-4d38-4d0d-abfb-c3aba045484d.jpg)

Fig. 14: Sum-rate vs. iteration, Scenario 1 , 4-bit phase shifters, SNR = 0 dB.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-ac9d644b-4b61-497b-aeb5-07e03a300ef5.jpg)

adapted to produce low-resolution phase shifters by altering the projection step (for optimization methods) or quantizing the produced phases (for the CNN).

The resulting sum-rate vs. iteration and vs. SNR for Scenario 1 are illustrated in Figs. 14 and 15, respectively. The results demonstrate that the proposed unfolded algorithm, which is particularly geared to accounting for low-resolution phase shifters, significantly outperforms other benchmarks, including both slow iterative methods that are not trained as machine learning models, and suffer more notable degradation due to quantization, as well as the heavily parameterized CNN. Specifically, while PGA + M struggles to overcome the quantization constraints using gradient steps, and tends to converge to a local maximum even when allowed to run for 500 iterations, the unfolded algorithm effectively learns to traverse the loss surface and projection constraints, achieving a better sum-rate. As shown in Fig. 15, the unfolded algorithm consistently performs better across various SNR values compared to all other benchmarks.

Fig. 15: Sum-rate vs. SNR, Scenario 1 , 4-bit phase shifters.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00439v2-figure-77b450d1-c750-4260-b69e-d9e5bd38d03b.jpg)

## VI. CONCLUSIONS

In this work, we investigated rapid beamforming design for uplink modular MIMO systems under three different sets of constraints: unconstrained phase shifters, sparse phase shifters, and quantized phase shifters. Our proposed algorithm, a momentum-aided gradient-based optimization of the sumrate objective, boosts power efficient settings while operating with a fixed and small number of iterations. By transforming the optimizer into a lightweight, trainable model, we harness data to fine-tune its hyperparameters, enhancing its adaptability to various system conditions. Our experimental results demonstrate a significant improvement in the achieved sum-rate compared to benchmarks operating within the same computational-time constraints, while also surpassing other benchmarks in hardware-aware and power-aware designs.

## APPENDIX

## A. Proof of Theorem 1

For ease of presentation, we define the following auxiliary variables: G † ≜ ( G G H ) -1 G H , P ≜ GG † , Z [ b ] ≜ PH [ b ] H H [ b ] , and Q [ b ] ≜ I k + ρ s σ 2 w Z [ b ] . Using these symbols, the objective with respect to which the derivative is taken is written as R ( G ; { H [ b ] } ) = 1 B ∑ B b =1 log ∣ ∣ Q [ b ] ∣ ∣ . Substituting auxiliary variables, we aim at proving (9) by showing that

$$\colon \, \text{ the} \\ \text{thm}, \quad \nabla _ { W } R ( W, A ) = \\ \text{lution} \\ \text{arks}, \quad \frac { 1 } { B } \sum _ { b = 1 } ^ { B } \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } A G ^ { \dagger } H [ b ] H [ b ] ^ { H } Q ^ { - 1 } ( I - P ) \right ) ^ { H }. \ \ ( A. 1 ) \\ \text{at} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad \text{--} \quad$$

The representation in (A.1) can be derived using the differential method for matrices as described in [54]. In the following proof the sign : denotes the Frobenius inner product, and the derivations are done using chain rule. For brevity we include our derivation for a single frequency bin.

Since R = log ∣ ∣ Q ∣ ∣ when B = 1 , it holds that the differential can be expressed as

$$\underset { \text{ values} } { \underset { d R } { \text{ } = } } \left ( Q ^ { - 1 } \right ) ^ { H } \colon d Q \overset { ( a ) } { = } \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } Q ^ { - 1 } \right ) ^ { H } \colon d P H H ^ { H }, \ \text{ (A.2)}$$

where ( a ) stems from d Q = ✟ ✟ ✟ ✯ 0 d I K + d ρ s σ 2 w Z = ρ s σ 2 w d Z , and from d Z = d PHH H , as H is independent of W .

Next, we substitute P , G † , and G using the chain rule:

$$d R = \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } \, ( H H ^ { H } ) Q ^ { - 1 } \right ) ^ { H } \colon ( I - P ) \, d G \, G ^ { \dagger }. \quad ( \text{A.3} ) \, \begin{array} { c } \underset { \underset { 1 5 | \text{ } S.\colon } { \text{10} } } \end{array}$$

Equation (A.3) can be explained by recalling that P ≜ G G ( H G ) -1 G H , and thus

$$G ( G ^ { \dots } G ) \ \, \not \, G ^ { \dots }, \, \text{and} \, \text{unus} \\ d P & = d G ( G ^ { H } G ) ^ { - 1 } G ^ { H } + G d ( G ^ { H } G ) ^ { - 1 } G ^ { H } \\ & \quad + G ( G ^ { H } G ) ^ { - 1 } d G ^ { H ^ { \dots } } ^ { 0 } \\ & = d G \, G ^ { \dagger } - G ( G ^ { H } G ) ^ { - 1 } \left ( d G ^ { H ^ { \dagger } } G + G ^ { H } d G \right ) G ^ { \dagger } \\ & = ( I - P ) \, d G \, G ^ { \dagger }. \\ \Omega \infty \, \infty \, \text{isational that react of that reason each such}$$

Once (A.3) is achieved, the rest of the proof becomes straight forward, using the chain rule until (A.1) is reached, i.e.,

$$\dots \dots, \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \\ d R = & \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } \, G ^ { \dagger } H H ^ { H } Q ^ { - 1 } ( I - P ) \right ) ^ { H } \colon d G \\ = & \left ( \frac { \rho _ { s } } { \sigma _ { w } ^ { 2 } } \, A G ^ { \dagger } H H ^ { H } Q ^ { - 1 } ( I - P ) \right ) ^ { H } \colon d W, \\ \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \ dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots \dots$$

which concludes that ∇ W R ( W A , ) = ( ρ s σ 2 w AG HH Q † H -1 ( I -P ) ) H , thus proving (9).

## REFERENCES

- [1] O. Levy and N. Shlezinger, 'Rapid hybrid modular receive beamforming via learned optimization,' in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2024, pp. 12 826-12 830.
- [2] Z. Wang, J. Zhang, H. Du, D. Niyato, S. Cui, B. Ai, M. Debbah, K. B. Letaief, and H. V. Poor, 'A tutorial on extremely large-scale MIMO for 6G: Fundamentals, signal processing, and applications,' IEEE Commun. Surveys Tuts. , 2024.
- [3] E. Bj¨ ornson, C.-B. Chae, R. W. Heath Jr, T. L. Marzetta, A. Mezghani, L. Sanguinetti, F. Rusek, M. R. Castellanos, D. Jun, and O. T. Demir, ¨ 'Towards 6G MIMO: Massive spatial multiplexing, dense arrays, and interplay between electromagnetics and processing,' arXiv preprint arXiv:2401.02844 , 2024.
- [4] E. Bj¨ ornson, L. Sanguinetti, H. Wymeersch, J. Hoydis, and T. L. Marzetta, 'Massive MIMO is a reality-what is next?: Five promising research directions for antenna arrays,' Digital Signal Processing , vol. 94, pp. 3-20, 2019.
- [5] X. Li, H. Lu, Y. Zeng, S. Jin, and R. Zhang, 'Near-field modeling and performance analysis of modular extremely large-scale array communications,' IEEE Commun. Lett. , vol. 26, no. 7, pp. 1529-1533, 2022.
- [6] X. Li, Z. Dong, Y. Zeng, S. Jin, and R. Zhang, 'Multi-user modular XL-MIMO communications: Near-field beam focusing pattern and user grouping,' IEEE Trans. Wireless Commun. , vol. 23, no. 10, pp. 13 76613 781, 2024.
- [7] J. Jeon, G. Lee, A. A. Ibrahim, J. Yuan, G. Xu, J. Cho, E. Onggosanusi, Y. Kim, J. Lee, and J. C. Zhang, 'MIMO evolution toward 6G: Modular massive MIMO in low-frequency bands,' IEEE Commun. Mag. , vol. 59, no. 11, pp. 52-58, 2021.
- [8] E. Bj¨ ornson and L. Sanguinetti, 'Scalable cell-free massive MIMO systems,' IEEE Trans. Commun. , vol. 68, no. 7, pp. 4247-4261, 2020.
- [9] S. Malkowsky et al. , 'The world's first real-time testbed for massive MIMO: Design, implementation, and validation,' IEEE Access , vol. 5, pp. 9073-9088, 2017.
- [10] Y. Huang, Y. Li, H. Ren, J. Lu, and W. Zhang, 'Multi-panel MIMO in 5G,' IEEE Commun. Mag. , vol. 56, no. 3, pp. 56-61, 2018.
- [11] O. L. L´ opez, D. Kumar, R. D. Souza, P. Popovski, A. T¨ olli, and M. Latva-Aho, 'Massive MIMO with radio stripes for indoor wireless energy transfer,' IEEE Trans. Wireless Commun. , vol. 21, no. 9, pp. 7088-7104, 2022.
- [12] T. Raviv, S. Park, O. Simeone, Y. C. Eldar, and N. Shlezinger, 'Adaptive and flexible model-based AI for deep receivers in dynamic channels,' IEEE Wireless Commun. , vol. 31, no. 4, pp. 163-169, 2024.
- [13] A. F. Molisch, V. V. Ratnam, S. Han, Z. Li, S. L. H. Nguyen, L. Li, and K. Haneda, 'Hybrid beamforming for massive MIMO: A survey,' IEEE Commun. Mag. , vol. 55, no. 9, pp. 134-141, 2017.
- [14] R. M´ endez-Rial, C. Rusu, N. Gonz´ alez-Prelcic, A. Alkhateeb, and R. W. Heath, 'Hybrid MIMO architectures for millimeter wave communications: Phase shifters or switches?' IEEE Access , vol. 4, pp. 247-267, 2016.
- [15] S. S. Ioushua and Y. C. Eldar, 'A family of hybrid analog-digital beamforming methods for massive MIMO systems,' IEEE Trans. Signal Process. , vol. 67, no. 12, pp. 3243-3257, 2019.
- [16] T. Gong, N. Shlezinger, S. S. Ioushua, M. Namer, Z. Yang, and Y. C. Eldar, 'RF chain reduction for MIMO systems: A hardware prototype,' IEEE Syst. J. , vol. 14, no. 4, pp. 5296-5307, 2020.
- [17] S. Park, A. Alkhateeb, and R. W. Heath, 'Dynamic subarrays for hybrid precoding in wideband mmWave MIMO systems,' IEEE Trans. Wireless Commun. , vol. 16, no. 5, pp. 2907-2920, 2017.
- [18] R. Li, H. Yan, and D. Cabric, 'Rainbow-link: Beam-alignment-free and grant-free mmW multiple access using true-time-delay array,' IEEE J. Sel. Areas Commun. , vol. 40, no. 5, pp. 1692-1705, 2022.
- [19] E. Tasci, T. Zirtiloglu, A. Yasar, Y. C. Eldar, N. Shlezinger, and R. T. Yazicigil, 'Robust task-specific beamforming with low-resolution ADCs for power-efficient hybrid MIMO receivers,' arXiv preprint arXiv:2212.00107 , 2022.
- [20] N. Shlezinger, G. C. Alexandropoulos, M. F. Imani, Y. C. Eldar, and D. R. Smith, 'Dynamic metasurface antennas for 6G extreme massive MIMO communications,' IEEE Wireless Commun. , vol. 28, no. 2, pp. 106-113, 2021.
- [21] Y. Gabay, N. Shlezinger, T. Routtenberg, Y. Ghasempour, G. C. Alexandropoulos, and Y. C. Eldar, 'Leaky waveguide antennas for downlink wideband THz communications,' in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2024, pp. 91119115.
- [22] A. M. Elbir, K. V. Mishra, S. A. Vorobyov, and R. W. Heath Jr, 'Twenty-five years of advances in beamforming: From convex and nonconvex optimization to learning techniques,' IEEE Signal Process. Mag. , vol. 40, no. 4, pp. 118-131, 2023.
- [23] N. Shlezinger, M. Ma, O. Lavi, N. T. Nguyen, Y. C. Eldar, and M. Juntti, 'Artificial intelligence-empowered hybrid multiple-input/multiple-output beamforming: Learning to optimize for high-throughput scalable MIMO,' IEEE Veh. Technol. Mag. , vol. 19, no. 3, pp. 58-67, 2024.
- [24] X. Yu, J.-C. Shen, J. Zhang, and K. B. Letaief, 'Alternating minimization algorithms for hybrid precoding in millimeter wave MIMO systems,' IEEE J. Sel. Topics Signal Process. , vol. 10, no. 3, pp. 485-500, 2016.
- [25] F. Sohrabi and W. Yu, 'Hybrid digital and analog beamforming design for large-scale antenna arrays,' IEEE J. Sel. Topics Signal Process. , vol. 10, no. 3, 2016.
- [26] X. Qiao, Y. Zhang, M. Zhou, and L. Yang, 'Alternating optimization based hybrid precoding strategies for millimeter wave MIMO systems,' IEEE Access , vol. 8, pp. 113 078-113 089, 2020.
- [27] A. Zappone, M. Di Renzo, and M. Debbah, 'Wireless networks design in the era of deep learning: Model-based, AI-based, or both?' IEEE Trans. Commun. , vol. 67, no. 10, pp. 7331-7376, 2019.
- [28] T. Chen, X. Chen, W. Chen, H. Heaton, J. Liu, Z. Wang, and W. Yin, 'Learning to optimize: A primer and a benchmark,' The Journal of Machine Learning Research , vol. 23, no. 1, pp. 8562-8620, 2022.
- [29] A. M. Elbir and A. K. Papazafeiropoulos, 'Hybrid precoding for multiuser millimeter wave massive MIMO systems: A deep learning approach,' IEEE Trans. Veh. Technol. , vol. 69, no. 1, pp. 552-563, 2019.
- [30] P. Dong, H. Zhang, and G. Y. Li, 'Framework on deep learning-based joint hybrid processing for mmWave massive MIMO systems,' IEEE Access , vol. 8, pp. 106 023-106 035, 2020.
- [31] O. Lavi and N. Shlezinger, 'Learn to rapidly and robustly optimize hybrid precoding,' IEEE Trans. Commun. , vol. 71, no. 10, pp. 58145830, 2023.
- [32] N. T. Nguyen, M. Ma, N. Shlezinger, Y. C. Eldar, A. Swindlehurst, and M. Juntti, 'Deep unfolding hybrid beamforming designs for THz massive MIMO systems,' IEEE Trans. Signal Process. , vol. 71, pp. 3788-3804, 2023.
- [33] E. Balevi and J. G. Andrews, 'Unfolded hybrid beamforming with GAN compressed ultra-low feedback overhead,' IEEE Trans. Wireless Commun. , vol. 20, no. 12, pp. 8381-8392, 2021.
- [34] S. Shi, Y. Cai, Q. Hu, B. Champagne, and L. Hanzo, 'Deep-unfolding neural-network aided hybrid beamforming based on symbol-error probability minimization,' IEEE Trans. Veh. Technol. , vol. 72, no. 1, pp. 529-545, 2023.

- [35] L. Pellaco, M. Bengtsson, and J. Jald´ en, 'Matrix-inverse-free deep unfolding of the weighted MMSE beamforming algorithm,' IEEE Open Journal of the Communications Society , vol. 3, pp. 65-81, 2021.
- [36] N. Shlezinger, Y. C. Eldar, and S. P. Boyd, 'Model-based deep learning: On the intersection of deep learning and optimization,' IEEE Access , vol. 10, pp. 115 384-115 398, 2022.
- [37] J. V. Alegr´ ıa, F. Rusek, and O. Edfors, 'Trade-offs in decentralized multi-antenna architectures: The WAX decomposition,' IEEE Trans. Signal Process. , vol. 69, pp. 3627-3641, 2021.
- [38] J. V. Alegr´ ıa and F. Rusek, 'Trade-offs in decentralized multi-antenna architectures: Sparse combining modules for WAX decomposition,' IEEE Trans. Signal Process. , vol. 71, pp. 2879-2894, 2023.
- [39] N. Shlezinger, J. Whang, Y. C. Eldar, and A. G. Dimakis, 'Model-based deep learning,' Proc. IEEE , vol. 111, no. 5, pp. 465-499, 2023.
- [40] S. Jaeckel, L. Raschkowski, K. B¨ orner, and L. Thiele, 'QuaDRiGa: A 3D multi-cell channel model with time evolution for enabling virtual field trials,' IEEE Trans. Antennas Propag. , vol. 62, no. 6, pp. 3242-3256, 2014.
- [41] J. Deng, O. Tirkkonen, and C. Studer, 'MmWave multiuser MIMO precoding with fixed subarrays and quantized phase shifters,' IEEE Trans. Veh. Technol. , vol. 68, no. 11, pp. 11 132-11 145, 2019.
- [42] D. Tse and P. Viswanath, Fundamentals of wireless communication . Cambridge university press, 2005.
- [43] N. Shlezinger, O. Dicker, Y. C. Eldar, I. Yoo, M. F. Imani, and D. R. Smith, 'Dynamic metasurface antennas for uplink massive MIMO systems,' IEEE Trans. Commun. , vol. 67, no. 10, pp. 6829-6843, 2019.
- [44] S. P. Boyd and L. Vandenberghe, Convex optimization . Cambridge university press, 2004.
- [45] N. Shlezinger and T. Routtenberg, 'Discriminative and generative learning for linear estimation of random signals [lecture notes],' IEEE Signal Process. Mag. , vol. 40, no. 6, pp. 75-82, 2023.
- [46] N. Samuel, T. Diskin, and A. Wiesel, 'Learning to detect,' IEEE Trans. Signal Process. , vol. 67, no. 10, pp. 2554-2564, 2019.
- [47] T. Alter and N. Shlezinger, 'Rapid optimization of superposition codes for multi-hop NOMA MANETs via deep unfolding,' arXiv preprint arXiv:2406.05747 , 2024.
- [48] Y. Noah and N. Shlezinger, 'Limited communications distributed optimization via deep unfolded distributed ADMM,' IEEE Trans. Mobile Comput. , 2024, early access.
- [49] V. V. Ratnam, J. Mo, A. Alammouri, B. L. Ng, J. Zhang, and A. F. Molisch, 'Joint phase-time arrays: A paradigm for frequency-dependent analog beamforming in 6G,' IEEE Access , vol. 10, pp. 73 364-73 377, 2022.
- [50] Y. C. Eldar and G. Kutyniok, Compressed sensing: theory and applications . Cambridge University Press, 2012.
- [51] E. Agustsson, F. Mentzer, M. Tschannen, L. Cavigelli, R. Timofte, L. Benini, and L. V. Gool, 'Soft-to-hard vector quantization for endto-end learning compressible representations,' Advances in neural information processing systems , vol. 30, 2017.
- [52] N. Shlezinger, A. Amar, B. Luijten, R. J. Van Sloun, and Y. C. Eldar, 'Deep task-based analog-to-digital conversion,' IEEE Trans. Signal Process. , vol. 70, pp. 6021-6034, 2022.
- [53] N. Lang, I. Assaf, O. Bokobza, and N. Shlezinger, 'Data-driven lattices for vector quantization,' in IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2024, pp. 8080-8084.
- [54] J. R. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics , 2nd ed. John Wiley, 1999.
Ohad Levy Nir Shlezinger
Rapid and Power-Aware Learned Optimization for Modular Receive Beamforming
Multiple-input multiple-output (MIMO) systems play a key role in wireless
communication technologies. A widely considered approach to realize scalable
MIMO systems involves architectures comprised of multiple separate modules,
each with its own beamforming capability. Such models accommodate cell-free
massive MIMO and partially connected hybrid MIMO architectures. A core issue
with the implementation of modular MIMO arises from the need to rapidly set the
beampatterns of the modules, while maintaining their power efficiency. This
leads to challenging constrained optimization that should be repeatedly solved
on each coherence duration. In this work, we propose a power-oriented
optimization algorithm for beamforming in uplink modular hybrid MIMO systems,
which learns from data to operate rapidly. We derive our learned optimizer by
tackling the rate maximization objective using projected gradient ascent steps
with momentum. We then leverage data to tune the hyperparameters of the
optimizer, allowing it to operate reliably in a fixed and small number of
iterations while completely preserving its interpretable operation. We show how
power efficient beamforming can be encouraged by the learned optimizer, via
boosting architectures with low-resolution phase shifts and with deactivated
analog components. Numerical results show that our learn-to-optimize method
notably reduces the number of iterations and computation latency required to
reliably tune modular MIMO receivers, and that it allows obtaining desirable
balances between power efficient designs and throughput.