title: Top Leaderboard Ranking = Top Coding Proficiency, Always? EvoEval: Evolving Coding Benchmarks via LLM

abstract: LLMs have become the go-to choice for code generation tasks, with an exponential increase in the training, development, and usage of LLMs specifically for code generation. To evaluate the ability of LLMs on code, both academic and industry practitioners rely on popular handcrafted benchmarks. However, prior benchmarks contain only a very limited set of problems, both in quantity and variety. Further, due to popularity and age, many benchmarks are prone to data leakage where example solutions can be readily found on the web and thus potentially in training data. Such limitations inevitably lead us to inquire: Is the leaderboard performance on existing benchmarks reliable and comprehensive enough to measure the program synthesis ability of LLMs? To address this, we introduce EvoEval -- a program synthesis benchmark suite created by evolving existing benchmarks into different targeted domains for a comprehensive evaluation of LLM coding abilities. Our study on 51 LLMs shows that compared to the high performance obtained on standard benchmarks like HumanEval, there is a significant drop in performance (on average 39.4%) when using EvoEval. Additionally, the decrease in performance can range from 19.6% to 47.7%, leading to drastic ranking changes amongst LLMs and showing potential overfitting of existing benchmarks. Furthermore, we showcase various insights, including the brittleness of instruction-following models when encountering rewording or subtle changes as well as the importance of learning problem composition and decomposition. EvoEval not only provides comprehensive benchmarks, but can be used to further evolve arbitrary problems to keep up with advances and the ever-changing landscape of LLMs for code. We have open-sourced our benchmarks, tools, and complete LLM generations at https://github.com/evo-eval/evoeval


title: HiRoPE: Length Extrapolation for Code Models

abstract: Addressing the limitation of context length in large language models for code-related tasks is the primary focus of this paper. Existing LLMs are constrained by their pre-trained context lengths, leading to performance issues in handling long complex code sequences. Inspired by how human programmers navigate code, we introduce Hierarchical Rotary Position Embedding (HiRoPE), a novel approach that enhances the traditional rotary position embedding into a hierarchical format based on the hierarchical structure of source code. HiRoPE offers easy integration into existing LLMs without extra training costs. Our method is extensively evaluated with various LLMs, demonstrating stable performance in tasks such as language modeling and long code completion. We also introduce a new long code understanding task with real-world code projects, in hopes of promoting further development in this code-related field. Theoretically and experimentally, we find that HiRoPE also addresses the out-of-distribution issue in position encoding. Our HiRoPE significantly expands the context length capabilities of LLMs, enabling inference at lengths exponentially greater than the training length.


title: MFORT-QA: Multi-hop Few-shot Open Rich Table Question Answering

abstract: In today's fast-paced industry, professionals face the challenge of summarizing a large number of documents and extracting vital information from them on a daily basis. These metrics are frequently hidden away in tables and/or their nested hyperlinks. To address this challenge, the approach of Table Question Answering (QA) has been developed to extract the relevant information. However, traditional Table QA training tasks that provide a table and an answer(s) from a gold cell coordinate(s) for a question may not always ensure extracting the accurate answer(s). Recent advancements in Large Language Models (LLMs) have opened up new possibilities for extracting information from tabular data using prompts. In this paper, we introduce the Multi-hop Few-shot Open Rich Table QA (MFORT-QA) approach, which consists of two major steps. The first step involves Few-Shot Learning (FSL), where relevant tables and associated contexts of hyperlinks are retrieved based on a given question. The retrieved content is then used to construct few-shot prompts as inputs to an LLM, such as ChatGPT. To tackle the challenge of answering complex questions, the second step leverages Chain-of-thought (CoT) prompting to decompose the complex question into a sequential chain of questions and reasoning thoughts in a multi-hop manner. Retrieval-Augmented Generation (RAG) enhances this process by retrieving relevant tables and contexts of hyperlinks that are relevant to the resulting reasoning thoughts and questions. These additional contexts are then used to supplement the prompt used in the first step, resulting in more accurate answers from an LLM. Empirical results from OTT-QA demonstrate that our abstractive QA approach significantly improves the accuracy of extractive Table QA methods.


title: A Faster Algorithm for Pigeonhole Equal Sums

abstract: An important area of research in exact algorithms is to solve Subset-Sum-type problems faster than meet-in-middle. In this paper we study Pigeonhole Equal Sums, a total search problem proposed by Papadimitriou (1994): given $n$ positive integers $w_1,\dots,w_n$ of total sum $\sum_{i=1}^n w_i < 2^n-1$, the task is to find two distinct subsets $A, B \subseteq [n]$ such that $\sum_{i\in A}w_i=\sum_{i\in B}w_i$. Similar to the status of the Subset Sum problem, the best known algorithm for Pigeonhole Equal Sums runs in $O^*(2^{n/2})$ time, via either meet-in-middle or dynamic programming (Allcock, Hamoudi, Joux, Klingelh\"{o}fer, and Santha, 2022). Our main result is an improved algorithm for Pigeonhole Equal Sums in $O^*(2^{0.4n})$ time. We also give a polynomial-space algorithm in $O^*(2^{0.75n})$ time. Unlike many previous works in this area, our approach does not use the representation method, but rather exploits a simple structural characterization of input instances with few solutions.


title: Non-Abelian observable-geometric phases and the Riemann zeros

abstract: The Hilbert-P\'{o}lya conjecture asserts that the imaginary parts of the nontrivial zeros of the Riemann zeta function (the Riemann zeros) are the eigenvalues of a self-adjoint operator (a quantum mechanical Hamiltonian, in the physical sense), as a promising approach to prove the Riemann hypothesis (cf.\cite{SH2011}). Instead of the eigenvalues, in this paper we consider observable-geometric phases as the realization of the Riemann zeros in a periodically driven quantum system, which were introduced in \cite{Chen2020} for the study of geometric quantum computation. To this end, we further introduce the notion of non-Abelian observable-geometric phases, involving which we give an approach to finding a physical system to study the Riemann zeros. Since the observable-geometric phases are connected with the geometry of the observable space according to the evolution of the Heisenberg equation, this sheds some light on the investigation of the Riemann hypothesis.


title: Co-Designing Statistical MIMO Radar and In-band Full-Duplex Multi-User MIMO Communications -- Part II: Joint Precoder, Radar Code, and Receive Filters Design

abstract: We address the challenge of spectral sharing between a statistical multiple-input multiple-output (MIMO) radar and an in-band full-duplex (IBFD) multi-user MIMO (MU-MIMO) communications system operating simultaneously in the same frequency band. Existing research on joint MIMO-radar-MIMO-communications (MRMC) systems has limitations, such as focusing on colocated MIMO radars, half-duplex MIMO communications, single-user scenarios, neglecting practical constraints, or employing separate transmit/receive units for MRMC coexistence. This paper, along with companion papers (Part I and III), proposes a comprehensive MRMC framework that addresses all these challenges. In the previous companion paper (Part I), we presented signal processing techniques for a distributed IBFD MRMC system. In this paper, we introduce joint design of statistical MIMO radar codes, uplink/downlink precoders, and corresponding receive filters using a novel metric called compounded-and-weighted sum mutual information. To solve the resulting highly non-convex problem, we employ a combination of block coordinate descent (BCD) and alternating projection methods. Numerical experiments show convergence of our algorithm, mitigation of uplink interference, and stable data rates under varying noise levels, channel estimate imperfections, and self-interference. The subsequent companion paper (Part III) extends the discussion to multiple targets and evaluates the tracking performance of our MRMC system.


title: Co-Designing Statistical MIMO Radar and In-band Full-Duplex Multi-User MIMO Communications -- Part III: Multi-Target Tracking

abstract: As a next-generation wireless technology, the in-band full-duplex (IBFD) transmission enables simultaneous transmission and reception of signals over the same frequency, thereby doubling spectral efficiency. Further, a continuous up-scaling of wireless network carrier frequencies arising from ever-increasing data traffic is driving research on integrated sensing and communications (ISAC) systems. In this context, we study the co-design of common waveforms, precoders, and filters for an IBFD multi-user (MU) multiple-input multiple-output (MIMO) communications with a distributed MIMO radar. This paper, along with companion papers (Part I and II), proposes a comprehensive MRMC framework that addresses all these challenges. In the companion papers, we developed signal processing and joint design algorithms for this distributed system. In this paper, we tackle multi-target detection, localization, and tracking. This co-design problem that includes practical MU-MIMO constraints on power and quality-of-service is highly non-convex. We propose a low-complexity procedure based on Barzilai-Borwein gradient algorithm to obtain the design parameters and mixed-integer linear program for distributed target localization. Numerical experiments demonstrate the feasibility and accuracy of multi-target sensing of the distributed FD ISAC system. Finally, we localize and track multiple targets by adapting the joint probabilistic data association and extended Kalman filter for this system.


title: Code Comparison Tuning for Code Large Language Models

abstract: We present Code Comparison Tuning (CCT), a simple and effective tuning method for code large language models (Code LLMs) to better handle subtle code errors. Specifically, we integrate the concept of comparison into instruction tuning, both at the token and sequence levels, enabling the model to discern even the slightest deviations in code. To compare the original code with an erroneous version containing manually added code errors, we use token-level preference loss for detailed token-level comparisons. Additionally, we combine code segments to create a new instruction tuning sample for sequence-level comparisons, enhancing the model's bug-fixing capability. Experimental results on the HumanEvalFix benchmark show that CCT surpasses instruction tuning in pass@1 scores by up to 4 points across diverse code LLMs, and extensive analysis demonstrates the effectiveness of our method.


title: Safety-Critical Planning and Control for Dynamic Obstacle Avoidance Using Control Barrier Functions

abstract: Dynamic obstacle avoidance is a challenging topic for optimal control and optimization-based trajectory planning problems, especially when in a tight environment. Many existing works use control barrier functions (CBFs) to enforce safety constraints within control systems. Inside these works, CBFs are usually formulated under model predictive control (MPC) framework to anticipate future states and make informed decisions, or integrated with path planning algorithms as a safety enhancement tool. However, these approaches usually require knowledge of the obstacle boundary equations or have very slow computational efficiency. In this paper, we propose a novel framework to the iterative MPC with discrete-time CBFs (DCBFs) to generate a collision-free trajectory. The DCBFs are obtained from convex polyhedra generated in sequential grid maps, without the need to know the boundary equations of obstacles. Additionally, a path planning algorithm is incorporated into this framework to ensure the global optimality of the generated trajectory. We demonstrate through numerical examples that our framework enables a unicycle robot to safely and efficiently navigate through tight and dynamically changing environments, tackling both convex and nonconvex obstacles with remarkable computing efficiency and reliability in control and trajectory generation.


title: Schr\"odingerisation based computationally stable algorithms for ill-posed problems in partial differential equations

abstract: We introduce a simple and stable computational method for ill-posed partial differential equation (PDE) problems. The method is based on Schr\"odingerization, introduced in [S. Jin, N. Liu and Y. Yu, Phys. Rev. A, 108 (2023), 032603], which maps all linear PDEs into Schr\"odinger-type equations in one higher dimension, for quantum simulations of these PDEs. Although the original problem is ill-posed, the Schr\"odingerized equations are Hamiltonian systems and time-reversible, allowing stable computation both forward and backward in time. The original variable can be recovered by data from suitably chosen domain in the extended dimension. We will use the backward heat equation and the linear convection equation with imaginary wave speed as examples. Error analysis of these algorithms are conducted and verified numerically. The methods are applicable to both classical and quantum computers, and we also lay out quantum algorithms for these methods. Moreover, we introduce a smooth initialization for the Schr\"odingerized equation which will lead to essentially spectral accuracy for the approximation in the extended space, if a spectral method is used. Consequently, the extra qubits needed due to the extra dimension, if a qubit based quantum algorithm is used, for both well-posed and ill-posed problems, becomes almost $\log\log {1/\varepsilon}$ where $\varepsilon$ is the desired precision. This optimizes the complexity of the Schr\"odingerization based quantum algorithms for any non-unitary dynamical system introduced in [S. Jin, N. Liu and Y. Yu, Phys. Rev. A, 108 (2023), 032603].


title: PoCo: A Self-Supervised Approach via Polar Transformation Based Progressive Contrastive Learning for Ophthalmic Disease Diagnosis

abstract: Automatic ophthalmic disease diagnosis on fundus images is important in clinical practice. However, due to complex fundus textures and limited annotated data, developing an effective automatic method for this problem is still challenging. In this paper, we present a self-supervised method via polar transformation based progressive contrastive learning, called PoCo, for ophthalmic disease diagnosis. Specifically, we novelly inject the polar transformation into contrastive learning to 1) promote contrastive learning pre-training to be faster and more stable and 2) naturally capture task-free and rotation-related textures, which provides insights into disease recognition on fundus images. Beneficially, simple normal translation-invariant convolution on transformed images can equivalently replace the complex rotation-invariant and sector convolution on raw images. After that, we develop a progressive contrastive learning method to efficiently utilize large unannotated images and a novel progressive hard negative sampling scheme to gradually reduce the negative sample number for efficient training and performance enhancement. Extensive experiments on three public ophthalmic disease datasets show that our PoCo achieves state-of-the-art performance with good generalization ability, validating that our method can reduce annotation efforts and provide reliable diagnosis. Codes are available at \url{https://github.com/wjh892521292/PoCo}.


title: Generic reduction theory for Fermi sea topology in metallic systems

abstract: Fermi sea in a metal can host exotic quantum topology, which determines its conductance quantization and is characterized by Euler characteristic $\chi_F$. Unlike gapped band topology described by the global feature of wave function, this topology of gapless system is associated with the geometry of Fermi sea, and thus probing and identifying $\chi_F$ are inherently difficult in higher-dimensional systems. Here, we propose a dimensional reduction theory for Fermi sea topology in $d$-dimensional metallic systems, showing that $\chi_F$ can be determined by the feature of so-called reduced critical points on Fermi surfaces, with theoretical simplicity and observational intuitiveness. We also reveal a nontrivial correspondence between the Fermi sea topology and the gapped band topology by using an ingenious mapping, of which $\chi_F$ exactly equals to the topological invariant of gapped topological phases. This provides a potential way to capture $\chi_F$ through the topological superconductors. Our work opens an avenue to characterize and detect the Fermi sea topology using low-dimensional momentum information.


title: Harnessing Data for Accelerating Model Predictive Control by Constraint Removal

abstract: Model predictive control (MPC) solves a receding-horizon optimization problem in real-time, which can be computationally demanding when there are thousands of constraints. To accelerate online computation of MPC, we utilize data to adaptively remove the constraints while maintaining the MPC policy unchanged. Specifically, we design the removal rule based on the Lipschitz continuity of the MPC policy. This removal rule can use the information of historical data according to the Lipschitz constant and the distance between the current state and historical states. In particular, we provide the explicit expression for calculating the Lipschitz constant by the model parameters. Finally, simulations are performed to validate the effectiveness of the proposed method.


title: Decentralizing Coherent Joint Transmission Precoding via Fast ADMM with Deterministic Equivalents

abstract: Inter-cell interference (ICI) suppression is critical for multi-cell multi-user networks. In this paper, we investigate advanced precoding techniques for coordinated multi-point (CoMP) with downlink coherent joint transmission, an effective approach for ICI suppression. Different from the centralized precoding schemes that require frequent information exchange among the cooperating base stations, we propose a decentralized scheme to minimize the total power consumption. In particular, based on the covariance matrices of global channel state information, we estimate the ICI bounds via the deterministic equivalents and decouple the original design problem into sub-problems, each of which can be solved in a decentralized manner. To solve the sub-problems at each base station, we develop a low-complexity solver based on the alternating direction method of multipliers (ADMM) in conjunction with the convex-concave procedure (CCCP). Simulation results demonstrate the effectiveness of our proposed decentralized precoding scheme, which achieves performance similar to the optimal centralized precoding scheme. Besides, our proposed ADMM solver can substantially reduce the computational complexity, while maintaining outstanding performance.


title: OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognition

abstract: Recently, visually-situated text parsing (VsTP) has experienced notable advancements, driven by the increasing demand for automated document understanding and the emergence of Generative Large Language Models (LLMs) capable of processing document-based questions. Various methods have been proposed to address the challenging problem of VsTP. However, due to the diversified targets and heterogeneous schemas, previous works usually design task-specific architectures and objectives for individual tasks, which inadvertently leads to modal isolation and complex workflow. In this paper, we propose a unified paradigm for parsing visually-situated text across diverse scenarios. Specifically, we devise a universal model, called OmniParser, which can simultaneously handle three typical visually-situated text parsing tasks: text spotting, key information extraction, and table recognition. In OmniParser, all tasks share the unified encoder-decoder architecture, the unified objective: point-conditioned text generation, and the unified input & output representation: prompt & structured sequences. Extensive experiments demonstrate that the proposed OmniParser achieves state-of-the-art (SOTA) or highly competitive performances on 7 datasets for the three visually-situated text parsing tasks, despite its unified, concise design. The code is available at https://github.com/AlibabaResearch/AdvancedLiterateMachinery.


title: Stable Object Placing using Curl and Diff Features of Vision-based Tactile Sensors

abstract: Ensuring stable object placement is crucial to prevent objects from toppling over, breaking, or causing spills. When an object makes initial contact to a surface, and some force is exerted, the moment of rotation caused by the instability of the object's placing can cause the object to rotate in a certain direction (henceforth referred to as direction of corrective rotation). Existing methods often employ a Force/Torque (F/T) sensor to estimate the direction of corrective rotation by detecting the moment of rotation as a torque. However, its effectiveness may be hampered by sensor noise and the tension of the external wiring of robot cables. To address these issues, we propose a method for stable object placing using GelSights, vision-based tactile sensors, as an alternative to F/T sensors. Our method estimates the direction of corrective rotation of objects using the displacement of the black dot pattern on the elastomeric surface of GelSight. We calculate the Curl from vector analysis, indicative of the rotational field magnitude and direction of the displacement of the black dots pattern. Simultaneously, we calculate the difference (Diff) of displacement between the left and right fingers' GelSight's black dots. Then, the robot can manipulate the objects' pose using Curl and Diff features, facilitating stable placing. Across experiments, handling 18 differently characterized objects, our method achieves precise placing accuracy (less than 1-degree error) in nearly 100% of cases. An accompanying video is available at the following link: https://youtu.be/fQbmCksVHlU


title: Gamu Blue: A Practical Tool for Game Theory Security Equilibria

abstract: The application of game theory in cybersecurity enables strategic analysis, adversarial modeling, and optimal decision-making to address security threats' complex and dynamic nature. Previous studies by Abraham et al. and Bi\c{c}er et al. presented various definitions of equilibria to examine the security aspects of games involving multiple parties. Nonetheless, these definitions lack practical and easy-to-use implementations. Our primary contribution is addressing this gap by developing Gamu Blue, an easy-to-use tool with implementations for computing the equilibria definitions including k-resiliency, l-repellence, t-immunity, (l, t)-resistance, and m-stability.


title: Long-time dynamics of a competition model with nonlocal diffusion and free boundaries: Vanishing and spreading of the invader

abstract: In this work, we investigate the long-time dynamics of a two species competition model of Lotka-Volterra type with nonlocal diffusions. One of the species, with density $v(t,x)$, is assumed to be a native in the environment (represented by the real line $\R$), while the other species, with density $u(t,x)$, is an invading species which invades the territory of $v$ with two fronts, $x=g(t)$ on the left and $x=h(t)$ on the right. So the population range of $u$ is the evolving interval $[g(t), h(t)]$ and the reaction-diffusion equation for $u$ has two free boundaries, with $g(t)$ decreasing in $t$ and $h(t)$ increasing in $t$, and the limits $h_\infty:=h(\infty)\leq \infty$ and $g_\infty:=g(\infty)\geq -\infty$ thus always exist. We obtain detailed descriptions of the long-time dynamics of the model according to whether $h_\infty-g_\infty$ is $\infty$ or finite. In the latter case, we reveal in what sense the invader $u$ vanishes in the long run and $v$ survives the invasion, while in the former case, we obtain a rather satisfactory description of the long-time asymptotic limit for both $u(t,x)$ and $v(t,x)$ when a certain parameter $k$ in the model is less than 1. This research is continued in a separate work, where sharp criteria are obtained to distinguish the case $h_\infty-g_\infty=\infty$ from the case $h_\infty-g_\infty$ is finite, and new phenomena are revealed for the case $k\geq 1$. The techniques developed in this paper should have applications to other models with nonlocal diffusion and free boundaries.


title: Meta-Heuristic Fronthaul Bit Allocation for Cell-free Massive MIMO Systems

abstract: Limited capacity of fronthaul links in a cell-free massive multiple-input multiple-output (MIMO) system can cause quantization errors at a central processing unit (CPU) during data transmission, complicating the centralized rate optimization problem. Addressing this challenge, we propose a harmony search (HS)-based algorithm that renders the combinatorial non-convex problem tractable. One of the distinctive features of our algorithm is its hierarchical structure: it first allocates resources at the access point (AP) level and subsequently optimizes for user equipment (UE), ensuring a more efficient and structured approach to resource allocation. Our proposed algorithm deals with rigorous conditions, such as asymmetric fronthaul bit allocation and distinct quantization error levels at each AP, which were not considered in previous works. We derive a closed-form expression of signal-to-interference-plusnoise ratio (SINR), in which additive quantization noise model (AQNM) based distortion error is taken into account, to define the mathematical expression of spectral efficiency (SE) for each UE. Also, we provide analyses on computational complexity and convergence to investigate the practicality of proposed algorithm. By leveraging various performance metrics such as total SE and max-min fairness, we demonstrate that the proposed algorithm can adaptively optimize the fronthaul bit allocation depending on system requirements. Finally, simulation results show that the proposed algorithm can achieve satisfactory performance while maintaining low computational complexity, as compared to the exhaustive search method


title: Compression and acceleration of ions by ultra-short ultra-intense azimuthally-polarized light

abstract: An efficient plasma compression scheme by azimuthally-polarized (AP) light is proposed. An AP light possesses a donut-like intensity pattern, enabling it to compress and accelerate ions toward the optical axis across a wide range of parameters. When the light intensity reaches the relativistic regime of $10^{18}$ $\mathrm{W}/\mathrm{cm}^{2}$, and the plasma density is below the critical density, protons can be compressed and accelerated by the toroidal soliton formed by the light. The expansion process of the soliton can be well described by the snow-plow model. Three-dimensional (3D) particle-in-cell (PIC) simulations show that within the soliton regime, despite the ion density surpassing ten times of the critical density, their energy is relatively low for efficient neutron production. When the light intensity increases to $10^{22}$ $\mathrm{W}/\mathrm{cm}^{2}$, and the plasma density is tens of the critical density, deuterium ions can be compressed to thousands of the critical density and meanwhile accelerated to the MeV level by a tightly-focused AP light during the hole-boring (HB) process. This process is far more dramatic compared to the soliton regime, and can produce up to $10^{4}$ neutrons in a few light cycles. Moreover, in the subsequent beam-target stage, neutron yield is assessed to reach over $10^{8}$. Finally, we present a comparison with the results by a radially-polarized (RP) light to examine the influence of light polarization.


title: Long-time dynamics of a competition model with nonlocal diffusion and free boundaries: Chances of successful invasion

abstract: This is a continuation of our work \cite{dns-part1} to investigate the long-time dynamics of a two species competition model of Lotka-Volterra type with nonlocal diffusions, where the territory (represented by the real line $\R$) of a native species with density $v(t,x)$, is invaded by a competitor with density $u(t,x)$, via two fronts, $x=g(t)$ on the left and $x=h(t)$ on the right. So the population range of $u$ is the evolving interval $[g(t), h(t)]$ and the reaction-diffusion equation for $u$ has two free boundaries, with $g(t)$ decreasing in $t$ and $h(t)$ increasing in $t$. Let $h_\infty:=h(\infty)\leq \infty$ and $g_\infty:=g(\infty)\geq -\infty$. In \cite{dns-part1}, we obtained detailed descriptions of the long-time dynamics of the model according to whether $h_\infty-g_\infty$ is $\infty$ or finite. In the latter case, we demonstrated in what sense the invader $u$ vanishes in the long run and $v$ survives the invasion, while in the former case, we obtained a rather satisfactory description of the long-time asymptotic limits of $u(t,x)$ and $v(t,x)$ when the parameter $k$ in the model is less than 1. In the current paper, we obtain sharp criteria to distinguish the case $h_\infty-g_\infty=\infty$ from the case $h_\infty-g_\infty$ is finite. Moreover, for the case $k\geq 1$ and $u$ is a weak competitor, we obtain biologically meaningful conditions that guarantee the vanishing of the invader $u$, and reveal chances for $u$ to invade successfully. In particular, we demonstrate that both $h_\infty=\infty=-g_\infty$ and $h_\infty=\infty$ but $g_\infty$ is finite are possible; the latter seems to be the first example for this kind of population models, with either local or nonlocal diffusion.


title: Streamlining Redundant Layers to Compress Large Language Models

abstract: This paper introduces LLM-Streamline, a novel layer pruning approach for large language models. It is based on the observation that different layers have varying impacts on hidden states, enabling the identification of less important layers. LLMStreamline comprises two parts: layer pruning, which removes consecutive layers with the lowest importance based on target sparsity, and layer replacement, where a lightweight network is trained to replace the pruned layers to mitigate performance loss. Additionally, a new metric called "stability" is proposed to address the limitations of accuracy in evaluating model compression. Experiments show that LLM-Streamline surpasses previous state-of-the-art pruning methods in both accuracy and stability.


title: Quantum focusing conjecture in two-dimensional evaporating black holes

abstract: We consider the quantum focusing conjecture (QFC) for two-dimensional evaporating black holes. The QFC is closely related to the behavior of the generalized entropy -- the sum of the area entropy for a given co-dimension two surface and the entanglement entropy for quantum fields outside the area. In the context of the black hole evaporation, the entanglement entropy of the Hawking radiation is decreasing after the Page time, and therefore it is not obvious whether the QFC holds in the black hole evaporation process especially after the Page time. One of the present authors previously addressed this problem in a four-dimensional spherically symmetric dynamical black hole model and showed that the QFC is satisfied. However the background spacetime considered was approximated by the Vaidya metric, and quantum effects of matters in the semiclassical regime is not fully taken into consideration. It remains to be seen if the QFC in fact holds for exact solutions of the semiclassical Einstein equations. In this paper, we address this problem in a two-dimensional dynamical black hole of the Russo-Susskind-Thorlacius (RST) model, which allows us to solve the semiclassical equations of motion exactly. We first give a suitable definition of the quantum expansion in two-dimensions and then prove that the QFC is satisfied for evaporating black holes in the RST model with the island formation taken into account.


title: CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Models

abstract: Continual learning (CL) aims to help deep neural networks to learn new knowledge while retaining what has been learned. Recently, pre-trained vision-language models such as CLIP, with powerful generalizability, have been gaining traction as practical CL candidates. However, the domain mismatch between the pre-training and the downstream CL tasks calls for finetuning of the CLIP on the latter. The deterministic nature of the existing finetuning methods makes them overlook the many possible interactions across the modalities and deems them unsafe for high-risk CL tasks requiring reliable uncertainty estimation. To address these, our work proposes Continual LeArning with Probabilistic finetuning (CLAP). CLAP develops probabilistic modeling over task-specific modules with visual-guided text features, providing more calibrated finetuning in CL. It further alleviates forgetting by exploiting the rich pre-trained knowledge of CLIP for weight initialization and distribution regularization of task-specific modules. Cooperating with the diverse range of existing prompting methods, CLAP can surpass the predominant deterministic finetuning approaches for CL with CLIP. We conclude with out-of-the-box applications of superior uncertainty estimation abilities of CLAP for novel data detection and exemplar selection within CL setups. Our code is available at \url{https://github.com/srvCodes/clap4clip}.


title: Bertrand types of regular curves and Bertrand framed curves in the Euclidean 3-space

abstract: A Bertrand (respectively, Mannheim) curve is a space curve whose principal normal line is the same as the principal normal (respectively, bi-normal) line of another curve. By definition, another curve is a parallel curve with respect to the direction of the principal normal vector. In this paper, we consider the other cases, that is, a space curve whose tangent (or, principal normal, bi-normal) line is the same as the tangent (or, principal normal, bi-normal) line of another curve, respectively. We say that a Bertrand type curve if there exists such another curve. We clarify that the existence conditions of Bertrand type curves in all cases. There are times when the Bertrand type curve does not exist. On the other hand, since the another curve may have singular points, we also consider curves with singular points. As smooth curves with singular points, it is useful to use the framed curves in the Euclidean space. Then we define and investigate Bertrand framed curves. We also clarify that the existence conditions of the Bertrand framed curves in all cases.


title: Symbiotic Control of Uncertain Dynamical Systems: Harnessing Synergy Between Fixed-Gain Control and Adaptive Learning Architectures

abstract: Both fixed-gain control and adaptive learning architectures aim to mitigate the effects of uncertainties. In particular, fixed-gain control offers more predictable closed-loop system behavior but requires the knowledge of uncertainty bounds. In contrast, while adaptive learning does not necessarily require such knowledge, it often results in less predictable closed-loop system behavior compared to fixed-gain control. To this end, this paper presents a novel symbiotic control framework that offers the strengths of fixed-gain control and adaptive learning architectures. Specifically, this framework synergistically integrates these architectures to mitigate the effects of uncertainties in a more predictable manner as compared to adaptive learning alone and it does not require any knowledge on such uncertainties. Both parametric and nonparametric uncertainties are considered, where we utilize neural networks to approximate the unknown uncertainty basis for the latter case. Counterintuitively, the proposed framework has the ability to achieve a desired level of closed-loop system behavior even with an insufficient number of neurons (e.g., when the neural network approximation error is large) or in the face of injudiciously selected adaptive learning parameters (e.g., high leakage term parameters).


title: QNCD: Quantization Noise Correction for Diffusion Models

abstract: Diffusion models have revolutionized image synthesis, setting new benchmarks in quality and creativity. However, their widespread adoption is hindered by the intensive computation required during the iterative denoising process. Post-training quantization (PTQ) presents a solution to accelerate sampling, aibeit at the expense of sample quality, extremely in low-bit settings. Addressing this, our study introduces a unified Quantization Noise Correction Scheme (QNCD), aimed at minishing quantization noise throughout the sampling process. We identify two primary quantization challenges: intra and inter quantization noise. Intra quantization noise, mainly exacerbated by embeddings in the resblock module, extends activation quantization ranges, increasing disturbances in each single denosing step. Besides, inter quantization noise stems from cumulative quantization deviations across the entire denoising process, altering data distributions step-by-step. QNCD combats these through embedding-derived feature smoothing for eliminating intra quantization noise and an effective runtime noise estimatiation module for dynamicly filtering inter quantization noise. Extensive experiments demonstrate that our method outperforms previous quantization methods for diffusion models, achieving lossless results in W4A8 and W8A8 quantization settings on ImageNet (LDM-4). Code is available at: https://github.com/huanpengchu/QNCD


title: Glassy Dynamics in a Molecular Liquid

abstract: A universal dynamical crossover temperature, Tcr, in glassy liquids, associated with the {\alpha}-\b{eta} bifurcation temperature, TB, has been observed in dielectric spectroscopy and other experiments. Tcr lies significantly above the glass transition temperature. Here, we introduce a new class of glass-forming liquids, binary mixtures of prolate and oblate ellipsoids. This model system exhibits sharp thermodynamic and dynamic anomalies, such as the specific heat jump during heating and a sharp variation in the thermal expansion coefficient around a temperature identified as the glass transition temperature, Tg. The same temperature is obtained from the fit of the calculated relaxation times to the Vogel-Fulcher-Tammann (VFT) form. As the temperature is lowered, the single peak rotational relaxation spectrum splits into two at a temperature TB significantly above the estimated Tg. Similar bifurcation is also observed in the distribution of short-to-intermediate time translational diffusion. Interrogation of the two peaks reveals a lower extent of dynamic heterogeneity in the population of the faster mode. We observe an unexpected appearance of a sharp peak in the product of rotational relaxation time {\tau}2 and diffusion constant D at a temperature Tcr, close to TB, but above the glass transition temperature. Additionally, we coarse-grain the system into cubic boxes, each containing, on average, ~62 particles, to study the average dynamical properties. Clear evidence of large-scale sudden changes in the diffusion coefficient and rotational correlation time signals first-order transitions between low and high-mobility domains.


title: A Tulu Resource for Machine Translation

abstract: We present the first parallel dataset for English-Tulu translation. Tulu, classified within the South Dravidian linguistic family branch, is predominantly spoken by approximately 2.5 million individuals in southwestern India. Our dataset is constructed by integrating human translations into the multilingual machine translation resource FLORES-200. Furthermore, we use this dataset for evaluation purposes in developing our English-Tulu machine translation model. For the model's training, we leverage resources available for related South Dravidian languages. We adopt a transfer learning approach that exploits similarities between high-resource and low-resource languages. This method enables the training of a machine translation system even in the absence of parallel data between the source and target language, thereby overcoming a significant obstacle in machine translation development for low-resource languages. Our English-Tulu system, trained without using parallel English-Tulu data, outperforms Google Translate by 19 BLEU points (in September 2023). The dataset and code are available here: https://github.com/manunarayanan/Tulu-NMT.


title: Tiny Graph Neural Networks for Radio Resource Management

abstract: The surge in demand for efficient radio resource management has necessitated the development of sophisticated yet compact neural network architectures. In this paper, we introduce a novel approach to Graph Neural Networks (GNNs) tailored for radio resource management by presenting a new architecture: the Low Rank Message Passing Graph Neural Network (LR-MPGNN). The cornerstone of LR-MPGNN is the implementation of a low-rank approximation technique that substitutes the conventional linear layers with their low-rank counterparts. This innovative design significantly reduces the model size and the number of parameters. We evaluate the performance of the proposed LR-MPGNN model based on several key metrics: model size, number of parameters, weighted sum rate of the communication system, and the distribution of eigenvalues of weight matrices. Our extensive evaluations demonstrate that the LR-MPGNN model achieves a sixtyfold decrease in model size, and the number of model parameters can be reduced by up to 98%. Performance-wise, the LR-MPGNN demonstrates robustness with a marginal 2% reduction in the best-case scenario in the normalized weighted sum rate compared to the original MPGNN model. Additionally, the distribution of eigenvalues of the weight matrices in the LR-MPGNN model is more uniform and spans a wider range, suggesting a strategic redistribution of weights.


title: MoDiTalker: Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation

abstract: Conventional GAN-based models for talking head generation often suffer from limited quality and unstable training. Recent approaches based on diffusion models aimed to address these limitations and improve fidelity. However, they still face challenges, including extensive sampling times and difficulties in maintaining temporal consistency due to the high stochasticity of diffusion models. To overcome these challenges, we propose a novel motion-disentangled diffusion model for high-quality talking head generation, dubbed MoDiTalker. We introduce the two modules: audio-to-motion (AToM), designed to generate a synchronized lip motion from audio, and motion-to-video (MToV), designed to produce high-quality head video following the generated motion. AToM excels in capturing subtle lip movements by leveraging an audio attention mechanism. In addition, MToV enhances temporal consistency by leveraging an efficient tri-plane representation. Our experiments conducted on standard benchmarks demonstrate that our model achieves superior performance compared to existing models. We also provide comprehensive ablation studies and user study results.


title: The Cartan-Helgason theorem for supersymmetric spaces: spherical weights for Kac-Moody superalgebras

abstract: Let $(\mathfrak{g},\mathfrak{k})$ be a supersymmetric pair arising from a finite-dimensional, symmetrizable Kac-Moody superalgebra $\mathfrak{g}$. An important branching problem is to determine the finite-dimensional highest-weight $\mathfrak{g}$-modules which admit a $\mathfrak{k}$-coinvariant, and thus appear as functions in a corresponding supersymmetric space $\mathcal{G}/\mathcal{K}$. This is the super-analogue of the Cartan-Helgason theorem. We solve this problem via a rank one reduction and an understanding of reflections in singular roots, which generalize odd reflections in the theory of Kac-Moody superalgebras. An explicit presentation of spherical weights is provided for every pair when $\mathfrak{g}$ is indecomposable.


title: Improving the Bit Complexity of Communication for Distributed Convex Optimization

abstract: We consider the communication complexity of some fundamental convex optimization problems in the point-to-point (coordinator) and blackboard communication models. We strengthen known bounds for approximately solving linear regression, $p$-norm regression (for $1\leq p\leq 2$), linear programming, minimizing the sum of finitely many convex nonsmooth functions with varying supports, and low rank approximation; for a number of these fundamental problems our bounds are nearly optimal, as proven by our lower bounds. Among our techniques, we use the notion of block leverage scores, which have been relatively unexplored in this context, as well as dropping all but the ``middle" bits in Richardson-style algorithms. We also introduce a new communication problem for accurately approximating inner products and establish a lower bound using the spherical Radon transform. Our lower bound can be used to show the first separation of linear programming and linear systems in the distributed model when the number of constraints is polynomial, addressing an open question in prior work.


title: Resilience-Oriented Operation of Micro-Grids in both Grid-Connected and Isolated Conditions within Sustainable Active Distribution Networks

abstract: Due to the increasing occurrence of natural disasters, importance of maintaining sustainable energy for cities and society is felt more than ever. On the other hand, power loss reduction is a challenging issue of active distribution networks (ADNs). In this paper, a new convex optimization model is proposed with two objective functions including energy loss reduction in normal operating mode and system load shedding minimization in critical conditions after the occurrence of natural disasters. This purpose is fulfilled through optimal allocation of distributed generation (DG) units from both conventional and renewable types as well as energy storage systems (ESSs). In addition, a new formulation has been derived to form optimal micro-grids (MGs) aiming at energy loss reduction in normal operating condition and resiliency index improvement under emergency situations. The developed model is implemented in GAMS software and the studies have been tested and analyzed on the IEEE 33-bus system. The results verify the effectiveness of the proposed method in terms of energy loss reduction as well as resilience enhancement in extreme operation condition following severe disruptions in the system.


title: GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Education

abstract: This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content that has been modified using techniques designed to evade detection by these tools (n=805). The results demonstrate that the detectors' already low accuracy rates (39.5%) show major reductions in accuracy (17.4%) when faced with manipulated content, with some techniques proving more effective than others in evading detection. The accuracy limitations and the potential for false accusations demonstrate that these tools cannot currently be recommended for determining whether violations of academic integrity have occurred, underscoring the challenges educators face in maintaining inclusive and fair assessment practices. However, they may have a role in supporting student learning and maintaining academic integrity when used in a non-punitive manner. These results underscore the need for a combined approach to addressing the challenges posed by GenAI in academia to promote the responsible and equitable use of these emerging technologies. The study concludes that the current limitations of AI text detectors require a critical approach for any possible implementation in HE and highlight possible alternatives to AI assessment strategies.


title: Topological Cycle Graph Attention Network for Brain Functional Connectivity

abstract: This study, we introduce a novel Topological Cycle Graph Attention Network (CycGAT), designed to delineate a functional backbone within brain functional graph--key pathways essential for signal transmissio--from non-essential, redundant connections that form cycles around this core structure. We first introduce a cycle incidence matrix that establishes an independent cycle basis within a graph, mapping its relationship with edges. We propose a cycle graph convolution that leverages a cycle adjacency matrix, derived from the cycle incidence matrix, to specifically filter edge signals in a domain of cycles. Additionally, we strengthen the representation power of the cycle graph convolution by adding an attention mechanism, which is further augmented by the introduction of edge positional encodings in cycles, to enhance the topological awareness of CycGAT. We demonstrate CycGAT's localization through simulation and its efficacy on an ABCD study's fMRI data (n=8765), comparing it with baseline models. CycGAT outperforms these models, identifying a functional backbone with significantly fewer cycles, crucial for understanding neural circuits related to general intelligence. Our code will be released once accepted.


title: Towards Understanding Dual BN In Hybrid Adversarial Training

abstract: There is a growing concern about applying batch normalization (BN) in adversarial training (AT), especially when the model is trained on both adversarial samples and clean samples (termed Hybrid-AT). With the assumption that adversarial and clean samples are from two different domains, a common practice in prior works is to adopt Dual BN, where BN and BN are used for adversarial and clean branches, respectively. A popular belief for motivating Dual BN is that estimating normalization statistics of this mixture distribution is challenging and thus disentangling it for normalization achieves stronger robustness. In contrast to this belief, we reveal that disentangling statistics plays a less role than disentangling affine parameters in model training. This finding aligns with prior work (Rebuffi et al., 2023), and we build upon their research for further investigations. We demonstrate that the domain gap between adversarial and clean samples is not very large, which is counter-intuitive considering the significant influence of adversarial perturbation on the model accuracy. We further propose a two-task hypothesis which serves as the empirical foundation and a unified framework for Hybrid-AT improvement. We also investigate Dual BN in test-time and reveal that affine parameters characterize the robustness during inference. Overall, our work sheds new light on understanding the mechanism of Dual BN in Hybrid-AT and its underlying justification.


title: Sounds waves and fluctuations in one-dimensional supersolids

abstract: We examine the low-energy excitations of a dilute supersolid state of matter with a one-dimensional crystal structure. A hydrodynamic description is developed based on a Lagrangian, incorporating generalized elastic parameters derived from ground state calculations. The predictions of the hydrodynamic theory are validated against solutions of the Bogoliubov-de Gennes equations, by comparing the speeds of sound, density fluctuations, and phase fluctuations of the two gapless bands. Our results are presented for two distinct supersolid models: a dipolar Bose-Einstein condensate in an infinite tube and a dilute Bose gas of atoms with soft-core interactions. Characteristic energy scales are identified, highlighting that these two models approximately realize the bulk incompressible and rigid lattice supersolid limits.


title: Curvature formulas and curvature strict positivity of direct image bundles

abstract: In this paper, we consider the curvature strict positivity of direct image bundles (vector bundles) associated to a strictly pseudoconvex family of bounded domains. The main result is that the curvature of the direct image bundle (vector bundles) associated to a strictly pseudoconvex family of bounded domains is strictly positive in the sense of Nakano even if the curvature of the original vector bundle is just Nakano positive. Based on our (I and my coauthors) previous results, this result further demonstrates that strictly pseudoconvex domains and pseudoconvex domains have very different geometric properties. To consider the curvature strict positivity, we will first construct the curvature formulas for vector bundles, then the curvature strict positivity of a strictly pseudoconvex family of bounded domains will be a simple consequence of it. As applications to convex analysis, we get a corresponding version of Pr\'ekopa's Theorem, i.e., we get the strict positivity of a strictly convex family of bounded domains.


title: Exploring Holistic HMI Design for Automated Vehicles: Insights from a Participatory Workshop to Bridge In-Vehicle and External Communication

abstract: Human-Machine Interfaces (HMIs) for automated vehicles (AVs) are typically divided into two categories: internal HMIs for interactions within the vehicle, and external HMIs for communication with other road users. In this work, we examine the prospects of bridging these two seemingly distinct domains. Through a participatory workshop with automotive user interface researchers and practitioners, we facilitated a critical exploration of holistic HMI design by having workshop participants collaboratively develop interaction scenarios involving AVs, in-vehicle users, and external road users. The discussion offers insights into the escalation of interface elements as an HMI design strategy, the direct interactions between different users, and an expanded understanding of holistic HMI design. This work reflects a collaborative effort to understand the practical aspects of this holistic design approach, offering new perspectives and encouraging further investigation into this underexplored aspect of automotive user interfaces.


title: STaR-GATE: Teaching Language Models to Ask Clarifying Questions

abstract: When prompting language models to complete a task, users often leave important aspects unsaid. While asking questions could resolve this ambiguity (GATE; Li et al., 2023), models often struggle to ask good questions. We explore a language model's ability to self-improve (STaR; Zelikman et al., 2022) by rewarding the model for generating useful questions-a simple method we dub STaR-GATE. We generate a synthetic dataset of 25,500 unique persona-task prompts to simulate conversations between a pretrained language model-the Questioner-and a Roleplayer whose preferences are unknown to the Questioner. By asking questions, the Questioner elicits preferences from the Roleplayer. The Questioner is iteratively finetuned on questions that increase the probability of high-quality responses to the task, which are generated by an Oracle with access to the Roleplayer's latent preferences. After two iterations of self-improvement, the Questioner asks better questions, allowing it to generate responses that are preferred over responses from the initial model on 72% of tasks. Our results indicate that teaching a language model to ask better questions leads to better personalized responses.


title: First Landau Level Physics in Second Moir\'e Band of $2.1^\circ$ Twisted Bilayer MoTe${}_2$

abstract: The recent experimental discovery of the fractional quantum spin Hall effect in twisted bilayer MoTe$_2$ at a twist angle of 2.1 degrees highlights the unique properties of its second moir\'e band. Inspired by this finding, we conduct a comprehensive theoretical investigation of the half-filled second moir\'e band at this angle, utilizing an effective continuum model. Our analysis reveals that the band not only exhibits characteristics akin to the first Landau level, $K=\int_\mathrm{BZ}\mathrm{d}^2\mathbf{k}\:\mathrm{tr}\:\eta(\mathbf{k}) \approx 3$, but also that its projected Coulomb interaction strikingly mirrors the Haldane pseudopotentials of the first Landau level. They together strongly indicate the potential emergence of a non-Abelian fractional quantum anomalous Hall state at the half-filling under the Coulomb interactions. By performing exact diagonalization calculations, we validate this hypothesis and construct a global phase diagram around this non-Abelian fractional quantum anomalous Hall states. We also introduce a novel metric of 1LL-ness of a band, which quantitatively measures the alignment of the projected Coulomb interaction with the Haldane pseudopotentials in Landau levels. This metric is then compared with the global phase diagram including the non-Abelian fractional quantum anomalous Hall state, revealing its utility in predicting the parameter region of the 1LL-ness. Finally, we discuss the potential implications on experiments.


title: Information Disturbance Tradeoff in Bidirectional QKD

abstract: Making use of the Quantum Network formalism of \textit{Phys. Rev. A,} \textbf{82} (2010) 062305, we present the case for quantum networks with finite outcomes, more specifically one which could distinguish only between specific unitary operators in a given basis for operators. Despite its simplicity, we proceed to build a network derived from the optimal strategy in \textit{Phys. Rev. A,} \textbf{82} (2010) 062305 and show that the information-disturbance tradeoff in distinguishing between two operators acting on qubits, selected from mutually unbiased unitary bases is equal to the case of estimating an operator selected randomly from the set of SU($2$) based on the Haar measure. This suggests that such strategies in distinguishing between mutually unbiased operators is not any easier than estimating an operator derived from an infinite set. We then show how this network can be used as a natural attack strategy against a bidirectional quantum cryptographic protocol.


title: Correlation functions between singular values and eigenvalues

abstract: Exploiting the explicit bijection between the density of singular values and the density of eigenvalues for bi-unitarily invariant complex random matrix ensembles of finite matrix size we aim at finding the induced probability measure on $j$ eigenvalues and $k$ singular values that we coin $j,k$-point correlation measure. We fully derive all $j,k$-point correlation measures in the simplest cases for matrices of size $n=1$ and $n=2$. For $n>2$, we find a general formula for the $1,1$-point correlation measure. This formula reduces drastically when assuming the singular values are drawn from a polynomial ensemble, yielding an explicit formula in terms of the kernel corresponding to the singular value statistics. These expressions simplify even further when the singular values are drawn from a P\'{o}lya ensemble and extend known results between the eigenvalue and singular value statistics of the corresponding bi-unitarily invariant ensemble.


title: Uncertainty-Aware Deep Video Compression with Ensembles

abstract: Deep learning-based video compression is a challenging task, and many previous state-of-the-art learning-based video codecs use optical flows to exploit the temporal correlation between successive frames and then compress the residual error. Although these two-stage models are end-to-end optimized, the epistemic uncertainty in the motion estimation and the aleatoric uncertainty from the quantization operation lead to errors in the intermediate representations and introduce artifacts in the reconstructed frames. This inherent flaw limits the potential for higher bit rate savings. To address this issue, we propose an uncertainty-aware video compression model that can effectively capture the predictive uncertainty with deep ensembles. Additionally, we introduce an ensemble-aware loss to encourage the diversity among ensemble members and investigate the benefits of incorporating adversarial training in the video compression task. Experimental results on 1080p sequences show that our model can effectively save bits by more than 20% compared to DVC Pro.


title: Disentangling Length from Quality in Direct Preference Optimization

abstract: Reinforcement Learning from Human Feedback (RLHF) has been a crucial component in the recent success of Large Language Models. However, RLHF is know to exploit biases in human preferences, such as verbosity. A well-formatted and eloquent answer is often more highly rated by users, even when it is less helpful and objective. A number of approaches have been developed to control those biases in the classical RLHF literature, but the problem remains relatively under-explored for Direct Alignment Algorithms such as Direct Preference Optimization (DPO). Unlike classical RLHF, DPO does not train a separate reward model or use reinforcement learning directly, so previous approaches developed to control verbosity cannot be directly applied to this setting. Our work makes several contributions. For the first time, we study the length problem in the DPO setting, showing significant exploitation in DPO and linking it to out-of-distribution bootstrapping. We then develop a principled but simple regularization strategy that prevents length exploitation, while still maintaining improvements in model quality. We demonstrate these effects across datasets on summarization and dialogue, where we achieve up to 20\% improvement in win rates when controlling for length, despite the GPT4 judge's well-known verbosity bias.


title: Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose Sequence

abstract: Neural rendering techniques have significantly advanced 3D human body modeling. However, previous approaches often overlook dynamics induced by factors such as motion inertia, leading to challenges in scenarios like abrupt stops after rotation, where the pose remains static while the appearance changes. This limitation arises from reliance on a single pose as conditional input, resulting in ambiguity in mapping one pose to multiple appearances. In this study, we elucidate that variations in human appearance depend not only on the current frame's pose condition but also on past pose states. Therefore, we introduce Dyco, a novel method utilizing the delta pose sequence representation for non-rigid deformations and canonical space to effectively model temporal appearance variations. To prevent a decrease in the model's generalization ability to novel poses, we further propose low-dimensional global context to reduce unnecessary inter-body part dependencies and a quantization operation to mitigate overfitting of the delta pose sequence by the model. To validate the effectiveness of our approach, we collected a novel dataset named I3D-Human, with a focus on capturing temporal changes in clothing appearance under approximate poses. Through extensive experiments on both I3D-Human and existing datasets, our approach demonstrates superior qualitative and quantitative performance. In addition, our inertia-aware 3D human method can unprecedentedly simulate appearance changes caused by inertia at different velocities.


title: Improving Vietnamese-English Medical Machine Translation

abstract: Machine translation for Vietnamese-English in the medical domain is still an under-explored research area. In this paper, we introduce MedEV -- a high-quality Vietnamese-English parallel dataset constructed specifically for the medical domain, comprising approximately 360K sentence pairs. We conduct extensive experiments comparing Google Translate, ChatGPT (gpt-3.5-turbo), state-of-the-art Vietnamese-English neural machine translation models and pre-trained bilingual/multilingual sequence-to-sequence models on our new MedEV dataset. Experimental results show that the best performance is achieved by fine-tuning "vinai-translate" for each translation direction. We publicly release our dataset to promote further research.


title: Fast and faithful interpolation of numerical relativity surrogate waveforms using meshfree approximation

abstract: Several theoretical waveform models have been developed over the years to capture the gravitational wave emission from the dynamical evolution of compact binary systems of neutron stars and black holes. As ground-based detectors improve their sensitivity at low frequencies, the real-time computation of these waveforms can become computationally expensive, exacerbating the steep cost of rapidly reconstructing source parameters using Bayesian methods. This paper describes an efficient numerical algorithm for generating high-fidelity interpolated compact binary waveforms at an arbitrary point in the signal manifold by leveraging computational linear algebra techniques such as singular value decomposition and meshfree approximation. The results are presented for the time-domain \texttt{NRHybSur3dq8} inspiral-merger-ringdown (IMR) waveform model that is fine tuned to numerical relativity simulations and parameterized by the two component-masses and two aligned spins. For demonstration, we target a specific region of the intrinsic parameter space inspired by the previously inferred parameters of the \texttt{GW200311\_115853} event -- a binary black hole system whose merger was recorded by the network of advanced-LIGO and Virgo detectors during the third observation run. We show that the meshfree interpolated waveforms can be evaluated in $\sim 2.3$ ms, which is about $\times 38$ faster than its brute-force (frequency-domain tapered) implementation in the \textsc{PyCBC} software package at a median accuracy of $\sim \mathcal{O}(10^{-5})$. The algorithm is computationally efficient and scales favourably with an increasing number of dimensions of the parameter space. This technique may find use in rapid parameter estimation and source reconstruction studies.


title: D'OH: Decoder-Only random Hypernetworks for Implicit Neural Representations

abstract: Deep implicit functions have been found to be an effective tool for efficiently encoding all manner of natural signals. Their attractiveness stems from their ability to compactly represent signals with little to no off-line training data. Instead, they leverage the implicit bias of deep networks to decouple hidden redundancies within the signal. In this paper, we explore the hypothesis that additional compression can be achieved by leveraging the redundancies that exist between layers. We propose to use a novel run-time decoder-only hypernetwork - that uses no offline training data - to better model this cross-layer parameter redundancy. Previous applications of hyper-networks with deep implicit functions have applied feed-forward encoder/decoder frameworks that rely on large offline datasets that do not generalize beyond the signals they were trained on. We instead present a strategy for the initialization of run-time deep implicit functions for single-instance signals through a Decoder-Only randomly projected Hypernetwork (D'OH). By directly changing the dimension of a latent code to approximate a target implicit neural architecture, we provide a natural way to vary the memory footprint of neural representations without the costly need for neural architecture search on a space of alternative low-rate structures.


title: RecDiffusion: Rectangling for Image Stitching with Diffusion Models

abstract: Image stitching from different captures often results in non-rectangular boundaries, which is often considered unappealing. To solve non-rectangular boundaries, current solutions involve cropping, which discards image content, inpainting, which can introduce unrelated content, or warping, which can distort non-linear features and introduce artifacts. To overcome these issues, we introduce a novel diffusion-based learning framework, \textbf{RecDiffusion}, for image stitching rectangling. This framework combines Motion Diffusion Models (MDM) to generate motion fields, effectively transitioning from the stitched image's irregular borders to a geometrically corrected intermediary. Followed by Content Diffusion Models (CDM) for image detail refinement. Notably, our sampling process utilizes a weighted map to identify regions needing correction during each iteration of CDM. Our RecDiffusion ensures geometric accuracy and overall visual appeal, surpassing all previous methods in both quantitative and qualitative measures when evaluated on public benchmarks. Code is released at https://github.com/lhaippp/RecDiffusion.


title: Evaluating Fair Feature Selection in Machine Learning for Healthcare

abstract: With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of feature selection. Traditional feature selection methods identify features for better decision making by removing resource-intensive, correlated, or non-relevant features but overlook how these factors may differ across subgroups. To counter these issues, we evaluate a fair feature selection method that considers equal importance to all demographic groups. We jointly considered a fairness metric and an error metric within the feature selection process to ensure a balance between minimizing both bias and global classification error. We tested our approach on three publicly available healthcare datasets. On all three datasets, we observed improvements in fairness metrics coupled with a minimal degradation of balanced accuracy. Our approach addresses both distributive and procedural fairness within the fair machine learning context.


title: On Ichino-Ikeda type formula of Whittaker periods for unitary groups

abstract: Lapid and Mao conjectured Ichino-Ikeda type formula of Whittaker periods for any quasi-split reductive groups and metaplectic groups. In this paper, we prove this formula for any irreducible cuspidal globally generic automorphic representation of quasi-split unitary groups.


title: Mitigating Misleading Chain-of-Thought Reasoning with Selective Filtering

abstract: Large language models have manifested remarkable capabilities by leveraging chain-of-thought (CoT) reasoning techniques to solve intricate questions through step-by-step reasoning chains. Despite its success, the efficacy of such reasoning is inherently contingent upon the quality of CoT. However, flawless CoT reasoning cannot be guaranteed due to the presence of indecomposable questions and the potential for erroneous reasoning chains, particularly in the case of small-scale language models. To tackle this challenge, we propose a novel approach called the selective filtering reasoner (SelF-Reasoner) that assesses the entailment relationship between the question and the candidate reasoning chain. Then, we proceed with CoT reasoning when the reasoning chain demonstrates confidence; otherwise, we opt to predict the answer directly. SelF-Reasoner improves the fine-tuned T5 baseline consistently over the ScienceQA, ECQA, and LastLetter tasks. Code is available at \texttt{https://github.com/LibroWu/SelF-Reasoner}.


title: Tunable Superconducting Magnetic Levitation with Self-Stability

abstract: Magnetic levitation based on the flux pinning nature of type II superconductors has the merit of self-stability, making it appealing for applications such as high speed bearings, maglev trains, space generators, etc. However, such levitation systems physically rely on the superconductor pre-capturing magnetic flux (i.e. field cooling process) before establishing the levitation state which is nonadjustable afterwards. Moreover, practical type II superconductors in the levitation system inevitably suffer from various sources of energy losses, leading to continuous levitation force decay. These intrinsic drawbacks make superconducting maglev inflexible and impractical for long term operation. Here we propose and demonstrate a new form of superconducting maglev which is tunable and with self-stability. The maglev system uses a closed-loop type II superconducting coil to lock flux of a magnet, establishing self-stable levitation between the two objects. A flux pump is used to modulate the total magnetic flux of the coil without breaking its superconductivity, thus flexibly tuning levitation force and height meanwhile maintaining self-stability. For the first time, we experimentally demonstrate a self-stable type II superconducting maglev system which is able to: counteract long term levitation force decay, adjust levitation force and equilibrium position, and establish levitation under zero field cooling condition. These breakthroughs may bridge the gap between demonstrations and practical applications of type II superconducting maglevs.


title: Static Manifolds with Boundary and Rigidity of Scalar Curvature and Mean Curvature

abstract: On a compact manifold with boundary, the map consisting of the scalar curvature in the interior and the mean curvature on the boundary is a local surjection at generic metrics. Moreover, this result may be localized to compact subdomains in an arbitrary Riemannian manifold with boundary. The non-generic case (also called non-generic domains) corresponds to static manifolds with boundary. We discuss their geometric properties, which also work as the necessary conditions of non-generic metrics. In space forms and the Schwarzschild manifold, we classify simple non-generic domains (with only one boundary component) and show their connection with rigidity theorems and the Schwarzschild photon sphere.


title: X-ray measurement of a high-mass white dwarf and its spin for the intermediate polar IGR J18434-0508

abstract: IGR J18434-0508 is a Galactic Intermediate Polar (IP) type Cataclysmic Variable (CV) previously classified through optical spectroscopy. The source is already known to have a hard Chandra spectrum. In this paper, we have used follow-up XMM-Newton and NuSTAR observations to measure the white dwarf (WD) mass and spin period. We measure a spin period of P = 304.4 +/- 0.3 s based on the combined MOS1, MOS2, and pn light curve. Although this is twice the optical period found previously, we interpret this value to be the true spin period of the WD. The source has an 8 +/- 2% pulsed fraction in the 0.5-10 keV XMM-Newton data and shows strong dips in the soft energy band (0.5-2 keV). The XMM-Newton and NuSTAR joint spectrum is consistent with a thermal bremsstrahlung continuum model with an additional partial covering factor, reflection, and Fe line Gaussian components. Furthermore, we fit the joint spectrum with the post-shock region "ipolar" model which indicates a high WD mass $>$ $\sim$ 1.36 Msun, approaching the Chandrasekhar limit.


title: Mining Bug Repositories for Multi-Fault Programs

abstract: Datasets such as Defects4J and BugsInPy that contain bugs from real-world software projects are necessary for a realistic evaluation of automated debugging tools. However these datasets largely identify only a single bug in each entry, while real-world software projects (including those used in Defects4J and BugsInPy) typically contain multiple bugs at the same time. We lift this limitation and describe an extension to these datasets in which multiple bugs are identified in individual entries. We use test case transplantation and fault location translation, in order to expose and locate the bugs, respectively. We thus provide datasets of true multi-fault versions within real-world software projects, which maintain the properties and usability of the original datasets.


title: Quantum circuit design for mixture and preparation of arbitrary pure and mixed quantum states

abstract: This paper addresses the challenge of preparing arbitrary mixed quantum states, an area that has not been extensively studied compared to pure states. Two circuit design methods are presented: one via a mixture of pure states and the other via purification. A novel strategy utilizing the Cholesky decomposition is proposed to improve both computational efficiency during preprocessing and circuit efficiency in the resulting circuits, offering significant advantages, especially when the targeted density matrix is low-ranked or sparse. By leveraging the incomplete Cholesky decomposition with threshold dropping, we also propose an appealing strategy for generating a high-fidelity approximation of the targeted density matrix, enabling substantial efficiency enhancement at the cost of mild fidelity loss. Additionally, as a closely related issue, we prove the "no-superposing theorem": given a certain number of arbitrary unknown pure states as input, it is impossible to devise an operation that produces an output state as the superposition of the input states with predefined coefficients unless all but one of the coefficients vanish.


title: Algorithm to Obtain Inverse Potentials for $\alpha-\alpha$ Scattering using Variable Phase Approach

abstract: An algorithm$^{\ref{Fig1}}$ has been developed with the purpose of obtaining inverse potentials, where the Riccati-type non-linear differential equation, also called phase equation, has been kept in tandem with the Variational Monte Carlo method. The optimization of Gaussian function parameters is achieved such that the experimental phase shifts are reproduced. The obtained SPS for various $\ ell$ channels has been compared with experimental ones with mean absolute percentage error (MAPE) as a measure. The model parameters have been optimised by suitable optimisation technique by looking for minimum value of MAPE. The results for $\ell$=0$^+$, 2$^+$ and 4$^+$ partial waves have been obtained, to match with experimental SPS, with MAPE values of $2.9$, $4.6$ and $6.2$ respectively for data up to $23$ MeV, while for higher states 6$^+$, 8$^+$ and 10$^+$ has MAPE of $3.2, 4.5$ and $5.9$ respectively for data from $53-120$ MeV. On extrapolation for data in range E$_{\ell ab.}$ = $23-120$ MeV, using the optimised parameters, the SPS are found to be in close agreement with experimental ones for the first three channels.


title: Algorithmic Ways of Seeing: Using Object Detection to Facilitate Art Exploration

abstract: This Research through Design paper explores how object detection may be applied to a large digital art museum collection to facilitate new ways of encountering and experiencing art. We present the design and evaluation of an interactive application called SMKExplore, which allows users to explore a museum's digital collection of paintings by browsing through objects detected in the images, as a novel form of open-ended exploration. We provide three contributions. First, we show how an object detection pipeline can be integrated into a design process for visual exploration. Second, we present the design and development of an app that enables exploration of an art museum's collection. Third, we offer reflections on future possibilities for museums and HCI researchers to incorporate object detection techniques into the digitalization of museums.


title: Toward Practical Benchmarks of Ising Machines: A Case Study on the Quadratic Knapsack Problem

abstract: Combinatorial optimization has wide applications from industry to natural science. Ising machines bring an emerging computing paradigm for efficiently solving a combinatorial optimization problem by searching a ground state of a given Ising model. Current cutting-edge Ising machines achieve fast sampling of near-optimal solutions of the max-cut problem. However, for problems with additional constraint conditions, their advantages have been hardly shown due to difficulties in handling the constraints. The performance of Ising machines on such problems heavily depends on encoding methods of constraints into penalties, but the optimal choice is non-trivial. In this work, we focus on benchmarks of Ising machines on the quadratic knapsack problem (QKP). To bring out their practical performance, we propose to exploit the problem structure upon using Ising machines. Specifically, we apply fast two-stage post-processing to the outputs of Ising machines, which makes handling the constraint easier. Simulation on medium-sized test instances shows that the proposed method substantially improves the solving performance of Ising machines and the improvement is robust to a choice of the encoding methods. We evaluate an Ising machine called Amplify Annealing Engine with the proposed method and found that it achieves comparable results with existing heuristics.


title: Design and Evaluation of a DC Microgrid Testbed for DER Integration and Power Management

abstract: This paper presents a DC microgrid testbed setup that consists of various Distributed Energy Resources (DERs) including solar Photovoltaics (PV), supercapacitors for voltage regulation, and Battery Energy Storage Systems (BESS). The DC microgrid accommodates both non-flexible and flexible loads which can be dynamically adjusted based on PV power availability. The integration of the setup with the Hyphae Autonomous Power Interchange System (APIS) framework automates energy transfer within the BESS, ensuring efficient power management and optimizing the overall efficiency of the DC microgrid. Furthermore, the setup is validated in terms of the efficacy of the proposed model via real-time simulation, facilitated by the Speedgoat baseline real-time target Hardware-in-the-Loop (HIL) machine. The results demonstrate the model's adeptness in efficiently managing power sharing, emphasizing the capabilities of the DC microgrid setup in terms of performance and reliability in dynamic energy scenarios as well as enhancing the resilience of the grid amidst PV uncertainties.


title: Rethinking Information Loss in Medical Image Segmentation with Various-sized Targets

abstract: Medical image segmentation presents the challenge of segmenting various-size targets, demanding the model to effectively capture both local and global information. Despite recent efforts using CNNs and ViTs to predict annotations of different scales, these approaches often struggle to effectively balance the detection of targets across varying sizes. Simply utilizing local information from CNNs and global relationships from ViTs without considering potential significant divergence in latent feature distributions may result in substantial information loss. To address this issue, in this paper, we will introduce a novel Stagger Network (SNet) and argues that a well-designed fusion structure can mitigate the divergence in latent feature distributions between CNNs and ViTs, thereby reducing information loss. Specifically, to emphasize both global dependencies and local focus, we design a Parallel Module to bridge the semantic gap. Meanwhile, we propose the Stagger Module, trying to fuse the selected features that are more semantically similar. An Information Recovery Module is further adopted to recover complementary information back to the network. As a key contribution, we theoretically analyze that the proposed parallel and stagger strategies would lead to less information loss, thus certifying the SNet's rationale. Experimental results clearly proved that the proposed SNet excels comparisons with recent SOTAs in segmenting on the Synapse dataset where targets are in various sizes. Besides, it also demonstrates superiority on the ACDC and the MoNuSeg datasets where targets are with more consistent dimensions.


title: Enhancing Trust and Privacy in Distributed Networks: A Comprehensive Survey on Blockchain-based Federated Learning

abstract: While centralized servers pose a risk of being a single point of failure, decentralized approaches like blockchain offer a compelling solution by implementing a consensus mechanism among multiple entities. Merging distributed computing with cryptographic techniques, decentralized technologies introduce a novel computing paradigm. Blockchain ensures secure, transparent, and tamper-proof data management by validating and recording transactions via consensus across network nodes. Federated Learning (FL), as a distributed machine learning framework, enables participants to collaboratively train models while safeguarding data privacy by avoiding direct raw data exchange. Despite the growing interest in decentralized methods, their application in FL remains underexplored. This paper presents a thorough investigation into Blockchain-based FL (BCFL), spotlighting the synergy between blockchain's security features and FL's privacy-preserving model training capabilities. First, we present the taxonomy of BCFL from three aspects, including decentralized, separate networks, and reputation-based architectures. Then, we summarize the general architecture of BCFL systems, providing a comprehensive perspective on FL architectures informed by blockchain. Afterward, we analyze the application of BCFL in healthcare, IoT, and other privacy-sensitive areas. Finally, we identify future research directions of BCFL.


title: Environmental monitoring using orbital angular momentum mode decomposition enhanced machine learning

abstract: Atmospheric interaction with light has been an area of fascination for many researchers over the last century. Environmental conditions, such as temperature and wind speed, heavily influence the complex and rapidly varying optical distortions propagating optical fields experience. The continuous random phase fluctuations commonly make deciphering the exact origins of specific optical aberrations challenging. The generation of eddies is a major contributor to atmospheric turbulence, similar in geometric structure to optical vortices that sit at the centre of OAM beams. Decomposing the received optical fields into OAM provides a unique spatial similarity that can be used to analyse turbulent channels. In this work, we present a novel mode decomposition assisted machine learning approach that reveals trainable features in the distortions of vortex beams that allow for effective environmental monitoring. This novel technique can be used reliably with Support Vector Machine regression models to measure temperature variations of 0.49C and wind speed variations of 0.029 m/s over a 36m experimental turbulent free-space channels with controllable and verifiable temperature and wind speed with short 3s measurement. The predictable nature of these findings could indicate the presence of an underlying physical relationship between environmental conditions that lead to specific eddy formation and the OAM spiral spectra.

categories: physics.optics physics.ao-ph physics.app-ph physics.data-an


title: A Robust UWOC-assisted Multi-hop Topology for Underwater Sensor Network Nodes

abstract: Underwater environment is substantially less explored territory as compared to earth surface due to lack of robust underwater communication infrastructure. For Internet of Underwater things connectivity, underwater wireless optical communication can play a vital role, compared to conventional radio frequency communication, due to longer range, high data rate, low latency, and unregulated bandwidth. This study proposes underwater wireless optical communication driven local area network UWOC LAN, comprised of multiple network nodes with optical transceivers. Moreover, the temperature sensor data is encapsulated with individual authentication identity to enhance the security of the framework at the user end. The proposed system is evaluated in a specially designed water tank of 4 meters. The proposed system evaluation analysis shows that the system can transmit underwater temperature data reliably in real time. The proposed secure UWOC LAN is tested within a communication range of 16 meters by incorporating multi hop connectivity to monitor the underwater environment.


title: Make Large Language Model a Better Ranker

abstract: Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which are inefficient for LLM-based recommenders due to high computational costs. However, existing list-wise approaches also fall short in ranking tasks due to misalignment between ranking objectives and next-token prediction. Moreover, these LLM-based methods struggle to effectively address the order relation among candidates, particularly given the scale of ratings. To address these challenges, this paper introduces the large language model framework with Aligned Listwise Ranking Objectives (ALRO). ALRO is designed to bridge the gap between the capabilities of LLMs and the nuanced requirements of ranking tasks. Specifically, ALRO employs explicit feedback in a listwise manner by introducing soft lambda loss, a customized adaptation of lambda loss designed for optimizing order relations. This mechanism provides more accurate optimization goals, enhancing the ranking process. Additionally, ALRO incorporates a permutation-sensitive learning mechanism that addresses position bias, a prevalent issue in generative models, without imposing additional computational burdens during inference. Our evaluative studies reveal that ALRO outperforms both existing embedding-based recommendation methods and LLM-based recommendation baselines.


title: Single-Crystal Growth and Characterization of Cuprate Superconductor (Hg,Re)Ba$_2$Ca$_2$Cu$_3$O$_{8+\delta}$

abstract: We grew (Hg,Re)Ba$_2$Ca$_2$Cu$_3$O$_{8+\delta}$ ((Hg,Re)1223) single crystals with good reproducibility via the single-step flux method using monoxides as raw materials. A double-sealing method using a thick-walled quartz tube and a stainless-steel container was adopted for explosion protection. The maximum crystal size was approximately 1 mm x 1 mm in the ab plane and 0.04 mm in thickness. The crystal was square-shaped, reflecting the tetragonal crystal structure of (Hg,Re)1223. Magnetic susceptibility measurements indicated a critical temperature of 130 K. The in-plane resistivity exhibited a linear temperature dependence, indicating that the sample was close to optimal doping level. The out-of-plane resistivity was also measured, and the anisotropy parameter was 250-650 at 300 K.


title: Empirical Analysis for Unsupervised Universal Dependency Parse Tree Aggregation

abstract: Dependency parsing is an essential task in NLP, and the quality of dependency parsers is crucial for many downstream tasks. Parsers' quality often varies depending on the domain and the language involved. Therefore, it is essential to combat the issue of varying quality to achieve stable performance. In various NLP tasks, aggregation methods are used for post-processing aggregation and have been shown to combat the issue of varying quality. However, aggregation methods for post-processing aggregation have not been sufficiently studied in dependency parsing tasks. In an extensive empirical study, we compare different unsupervised post-processing aggregation methods to identify the most suitable dependency tree structure aggregation method.


title: A Constrained Spectral Approximation of Subgrid-Scale Orography on Unstructured Grids

abstract: The representation of subgrid-scale orography is a challenge in the physical parameterization of orographic gravity-wave sources in weather forecasting. A significant hurdle is encoding as much physical information with as simple a representation as possible. Other issues include scale awareness, i.e., the orographic representation has to change according to the grid cell size and usability on unstructured geodesic grids with non-quadrilateral grid cells. This work introduces a novel spectral analysis method approximating a scale-aware spectrum of subgrid-scale orography on unstructured geodesic grids. The dimension of the physical orographic data is reduced by more than two orders of magnitude in its spectral representation. Simultaneously, the power of the approximated spectrum is close to the physical value. The method is based on well-known least-squares spectral analyses. However, it is robust to the choice of the free parameters, and tuning the algorithm is generally unnecessary. Numerical experiments involving an idealized setup show that this novel spectral analysis performs significantly better than a straightforward least-squares spectral analysis in representing the physical energy of a spectrum. Studies involving real-world topographic data are conducted, and reasonable error scores within $\pm 10\%$ error relative to the maximum physical quantity of interest are achieved across different grid sizes and background wind speeds. The deterministic behavior of the method is investigated along with its principal capabilities and potential biases, and it is shown that the error scores can be iteratively improved if an optimization target is known. Discussions on the method's limitations and broader applicability conclude this work.


title: Deep CSI Compression for Dual-Polarized Massive MIMO Channels with Disentangled Representation Learning

abstract: Channel state information (CSI) feedback is critical for achieving the promised advantages of enhancing spectral and energy efficiencies in massive multiple-input multiple-output (MIMO) wireless communication systems. Deep learning (DL)-based methods have been proven effective in reducing the required signaling overhead for CSI feedback. In practical dual-polarized MIMO scenarios, channels in the vertical and horizontal polarization directions tend to exhibit high polarization correlation. To fully exploit the inherent propagation similarity within dual-polarized channels, we propose a disentangled representation neural network (NN) for CSI feedback, referred to as DiReNet. The proposed DiReNet disentangles dual-polarized CSI into three components: polarization-shared information, vertical polarization-specific information, and horizontal polarization-specific information. This disentanglement of dual-polarized CSI enables the minimization of information redundancy caused by the polarization correlation and improves the performance of CSI compression and recovery. Additionally, flexible quantization and network extension schemes are designed. Consequently, our method provides a pragmatic solution for CSI feedback to harness the physical MIMO polarization as a priori information. Our experimental results show that the performance of our proposed DiReNet surpasses that of existing DL-based networks, while also effectively reducing the number of network parameters by nearly one third.


title: Optimization hardness constrains ecological transients

abstract: Living systems operate far from equilibrium, yet few general frameworks provide global bounds on biological transients. Here, we frame equilibration in complex ecosystems as the process of solving an analogue optimization problem. We show that functional redundancies among species in a complex foodweb lead to harder ill-conditioned problems, manifesting as slow modes on a nearly-degenerate solution landscape. Common dimensionality reduction methods precondition ecological dynamics, by isolating fast relaxation from slow solving timescales that exhibit transient chaos for harder problem instances. In evolutionary simulations, we show that selection for steady-state diversity produces ill-conditioning, an effect quantifiable using complexity bounds for constrained optimization. Our results demonstrate the physical toll of computational constraints on biological dynamics.


title: Effective codescent morphisms of $n$-quasigroups and $n$-loops

abstract: Effective codescent morphisms of $n$-quasigroups and of $n$-loops are characterized. To this end, it is proved that, for any $n\geq 1$, every codescent morphism of $n$-quasigroups (resp. $n$-loops) is effective. This statement generalizes our earlier results on qusigroups and loops. Moreover, it is shown that the elements of the amalgamated free products of $n$-quasigroups (resp. $n$-loops) have unique normal forms, and that the varieties of $n$-quasigroups and $n$-loops satisfy the strong amalgamation property. The latter two statements generalize the corresponding old results on quasigroups and loops by Evans.


title: Nonexistence of invariant nodal line and improved $L^2$ restriction bounds for Neumann data on negatively curved surface

abstract: The problem of obtaining the lower bounds on the restriction of Laplacian eigenfunctions to hypersurfaces inside a compact Riemannian manifold $(M,g)$ is challenging and has been attempted by many authors \cite{BR, GRS, Jun, ET}. This paper aims to show that if $(M,g)$ is assumed to be a negatively curved surface then one can get the corresponding restricted lower bounds, as well as quantitative improvement of restricted bounds for Neumann data.


title: Rydberg exciton states and near-infrared light-emitting diode in monolayer MoTe2 devices

abstract: Excitons, or bound electron-hole pairs, play a crucial role in the optical response of monolayer, 2H-phase transition-metal dichalcogenides (TMDs). They hold significant promise for the development of novel quantum opto-electronic devices due to their large binding energies and strong spin-orbit coupling. Among the monolayer TMDs, MoTe2 stands out because of its bandgap in the near-infrared (NIR) regime. Here, we report the experimental observation of NIR Rydberg excitons and conduction band-split charged excitons, in high-quality, boron nitride (BN)-encapsulated monolayer MoTe2 devices, probed by photoluminescence and electroluminescence spectroscopy. By employing a graphite bottom gate, we successfully modulate the emission intensity of various excitonic species. Additionally, our device fabrication process within an argon-filled glove box ensures clean TMD/metal electrode interfaces, enabling the construction of p-n junctions near the electrodes. Our work significantly advances our understanding of excitons in monolayer TMDs and contributes to the application of MoTe2 in NIR quantum opto-electronic devices.