title: Q-adaptive: A Multi-Agent Reinforcement Learning Based Routing on Dragonfly Network

abstract: High-radix interconnects such as Dragonfly and its variants rely on adaptive routing to balance network traffic for optimum performance. Ideally, adaptive routing attempts to forward packets between minimal and non-minimal paths with the least congestion. In practice, current adaptive routing algorithms estimate routing path congestion based on local information such as output queue occupancy. Using local information to estimate global path congestion is inevitably inaccurate because a router has no precise knowledge of link states a few hops away. This inaccuracy could lead to interconnect congestion. In this study, we present Q-adaptive routing, a multi-agent reinforcement learning routing scheme for Dragonfly systems. Q-adaptive routing enables routers to learn to route autonomously by leveraging advanced reinforcement learning technology. The proposed Q-adaptive routing is highly scalable thanks to its fully distributed nature without using any shared information between routers. Furthermore, a new two-level Q-table is designed for Q-adaptive to make it computational lightly and saves 50% of router memory usage compared with the previous Q-routing. We implement the proposed Q-adaptive routing in SST/Merlin simulator. Our evaluation results show that Q-adaptive routing achieves up to 10.5% system throughput improvement and 5.2x average packet latency reduction compared with adaptive routing algorithms. Remarkably, Q-adaptive can even outperform the optimal VALn non-minimal routing under the ADV+1 adversarial traffic pattern with up to 3% system throughput improvement and 75% average packet latency reduction.


title: Chance-Constrained Gaussian Mixture Steering to a Terminal Gaussian Distribution

abstract: We address the problem of finite-horizon control of a discrete-time linear system, where the initial state distribution follows a Gaussian mixture model, the terminal state must follow a specified Gaussian distribution, and the state and control inputs must obey chance constraints. We show that, throughout the time horizon, the state and control distributions are fully characterized by Gaussian mixtures. We then formulate the cost, distributional terminal constraint, and affine/2-norm chance constraints on the state and control, as convex functions of the decision variables. This is leveraged to formulate the chance-constrained path planning problem as a single semidefinite programming problem. A numerical example demonstrates the effectiveness of the proposed method.


title: Large Language Models in Biomedical and Health Informatics: A Bibliometric Review

abstract: Large Language Models (LLMs) have rapidly become important tools in Biomedical and Health Informatics (BHI), enabling new ways to analyze data, treat patients, and conduct research. This bibliometric review aims to provide a panoramic view of how LLMs have been used in BHI by examining research articles and collaboration networks from 2022 to 2023. It further explores how LLMs can improve Natural Language Processing (NLP) applications in various BHI areas like medical diagnosis, patient engagement, electronic health record management, and personalized medicine. To do this, our bibliometric review identifies key trends, maps out research networks, and highlights major developments in this fast-moving field. Lastly, it discusses the ethical concerns and practical challenges of using LLMs in BHI, such as data privacy and reliable medical recommendations. Looking ahead, we consider how LLMs could further transform biomedical research as well as healthcare delivery and patient outcomes. This bibliometric review serves as a resource for stakeholders in healthcare, including researchers, clinicians, and policymakers, to understand the current state and future potential of LLMs in BHI.


title: SoK: An Essential Guide For Using Malware Sandboxes In Security Applications: Challenges, Pitfalls, and Lessons Learned

abstract: Malware sandboxes provide many benefits for security applications, but they are complex. These complexities can overwhelm new users in different research areas and make it difficult to select, configure, and use sandboxes. Even worse, incorrectly using sandboxes can have a negative impact on security applications. In this paper, we address this knowledge gap by systematizing 84 representative papers for using x86/64 malware sandboxes in the academic literature. We propose a novel framework to simplify sandbox components and organize the literature to derive practical guidelines for using sandboxes. We evaluate the proposed guidelines systematically using three common security applications and demonstrate that the choice of different sandboxes can significantly impact the results. Specifically, our results show that the proposed guidelines improve the sandbox observable activities by at least 1.6x and up to 11.3x. Furthermore, we observe a roughly 25% improvement in accuracy, precision, and recall when using the guidelines to help with a malware family classification task. We conclude by affirming that there is no "silver bullet" sandbox deployment that generalizes, and we recommend that users apply our framework to define a scope for their analysis, a threat model, and derive context about how the sandbox artifacts will influence their intended use case. Finally, it is important that users document their experiment, limitations, and potential solutions for reproducibility


title: Electron Thermometry

abstract: The performance and accuracy of quantum electronics is substantially degraded when the temperature of the electrons in the devices is too high. The electron temperature can be reduced with appropriate thermal anchoring and by filtering both the low frequency and radio frequency noise. Ultimately, for high performance filters the electron temperature can approach the phonon temperature (as measured by resistive thermometers) in a dilution refrigerator. In this application note, the method for measuring the electron temperature in a typical quantum electronics device using Coulomb blockade thermometry is described. This technique is applied to find the readily achievable electron temperature in the device when using the QFilter provided by QDevil. With our thermometry measurements, using a single GaAs/AlGaAs quantum dot in an optimized experimental setup, we determined an electron temperature of 28 $\pm$ 2 mK for a dilution refrigerator base temperature of 18 mK.


title: Control-Coherent Koopman Modeling: A Physical Modeling Approach

abstract: The modeling of nonlinear dynamics based on Koopman operator theory, which is originally applicable only to autonomous systems with no control, is extended to non-autonomous control system without approximation to input matrix B. Prevailing methods using a least square estimate of the B matrix may result in an erroneous input matrix, misinforming the controller about the structure of the input matrix in a lifted space. Here, a new method for constructing a Koopman model that comprises the exact input matrix B is presented. A set of state variables are introduced so that the control inputs are linearly involved in the dynamics of actuators. With these variables, a lifted linear model with the exact control matrix, called a Control-Coherent Koopman Model, is constructed by superposing control input terms, which are linear in local actuator dynamics, to the Koopman operator of the associated autonomous nonlinear system. The proposed method is applied to multi degree-of-freedom robotic arms and multi-cable manipulation systems. Model Predictive Control is applied to the former. It is demonstrated that the prevailing Dynamic Mode Decomposition with Control (DMDc) using an approximate control matrix B does not provide a satisfactory result, while the Control-Coherent Koopman Model performs well with the correct B matrix.


title: ANN-Based Adaptive NMPC for Uranium Extraction-Scrubbing Operation in Spent Nuclear Fuel Treatment Process

abstract: This paper addresses the particularities in optimal control of the uranium extraction-scrubbing operation in the PUREX process. The control problem requires optimally stabilizing the system at a desired solvent saturation level, guaranteeing constraints, disturbance rejection, and adapting to set point variations. A qualified simulator named PAREX was developed by the French Alternative Energies and Atomic Energy Commission (CEA) to simulate liquid-liquid extraction operations in the PUREX process. However, since the mathematical model is complex and is described by a system of nonlinear, stiff, high-dimensional differential-algebraic equations (DAE), applying optimal control methods will lead to a large-scale nonlinear programming problem with a huge computational burden. The solution we propose in this work is to train a neural network to predict the process outputs using the measurement history. This neural network architecture, which employs the long short-term memory (LSTM), linear regression and logistic regression networks, allows reducing the number of state variables, thus reducing the complexity of the optimization problems in the control scheme. Furthermore, nonlinear model predictive control (NMPC) and moving horizon estimation (MHE) problems are developed and solved using the PSO (Particle Swarm Optimization) algorithm. Simulation results show that the proposed adaptive optimal control scheme satisfies the requirements of the control problem and provides promise for experimental testing.


title: Standard and Non-Standard Aspects of Neutrino Physics

abstract: This review provides a succinct overview of the basic aspects of neutrino physics. The topics covered include: neutrinos in the standard model and the three-neutrino mixing scheme; the current status of neutrino oscillation measurements and what remains to be determined; the seesaw mechanisms for neutrino mass generation and the associated phenomenology, including the leptogenesis mechanism to explain the observed matter-antimatter asymmetry of the Universe; models for the origin of the pattern of neutrino mixing and lepton masses based on discrete flavour symmetries and modular invariance.


title: Multiplier algebras of $L^p$-operator algebras

abstract: It is known that the multiplier algebra of an approximately unital and nondegenerate $L^p$-operator algebra is again an $L^p$-operator algebra. In this paper we investigate examples that drop both hypotheses. In particular, we show that the multiplier algebra of $T_2^p$, the algebra of strictly upper triangular $2 \times 2$ matrices acting on $\ell_2^p$, is still an $L^p$-operator algebra for any $p$. To contrast this result, we first provide a thorough study of the augmentation ideal of $\ell^1(G)$ for a discrete group $G$. We use this ideal to define a family of non approximately unital degenerate $L^p$-operator algebras, $F_{r,0}^p(\Bbb{Z}/3\Bbb{Z})$, whose multiplier algebras cannot be represented on any $L^q$-space for any $q \in [1, \infty)$ as long as $p \in [1, p_0] \cup [p_0', \infty)$, where $p_0=1.606$ and $p_0'$ is its H\"older conjugate.


title: An infinite family of Type 1 fullerene nanodiscs

abstract: A total coloring of a graph colors all its elements, vertices and edges, with no adjacency conflicts. The Total Coloring Conjecture (TCC) is a sixty year old challenge, says that every graph admits a total coloring with at most maximum degree plus two colors, and many graph parameters have been studied in connection with its validity. If a graph admits a total coloring with maximum degree plus one colors, then it is Type 1, whereas it is Type 2, in case it does not admit a total coloring with maximum degree plus one colors but it does satisfy the TCC. Cavicchioli, Murgolo and Ruini proposed in 2003 the hunting for a Type 2 snark with girth at least 5. Brinkmann, Preissmann and Sasaki in 2015 conjectured that there is no Type 2 cubic graph with girth at least 5. We investigate the total coloring of fullerene nanodiscs, a class of cubic planar graphs with girth 5 arising in Chemistry. We prove that the central layer of an arbitrary fullerene nanodisc is 4-total colorable, a necessary condition for the nanodisc to be Type 1. We extend the obtained 4-total coloring to a 4-total coloring of the whole nanodisc, when the radius satisfies r = 5 + 3k, providing an infinite family of Type 1 nanodiscs.


title: "It Is Easy Using My Apps:" Understanding Technology Use and Needs of Adults with Down Syndrome

abstract: Assistive technologies for adults with Down syndrome (DS) need designs tailored to their specific technology requirements. While prior research has explored technology design for individuals with intellectual disabilities, little is understood about the needs and expectations of adults with DS. Assistive technologies should leverage the abilities and interests of the population, while incorporating age- and context-considerate content. In this work, we interviewed six adults with DS, seven parents of adults with DS, and three experts in speech-language pathology, special education, and occupational therapy to determine how technology could support adults with DS. In our thematic analysis, four main themes emerged, including (1) community vs. home social involvement; (2) misalignment of skill expectations between adults with DS and parents; (3) family limitations in technology support; and (4) considerations for technology development. Our findings extend prior literature by including the voices of adults with DS in how and when they use technology.


title: On Reporting Durable Patterns in Temporal Proximity Graphs

abstract: Finding patterns in graphs is a fundamental problem in databases and data mining. In many applications, graphs are temporal and evolve over time, so we are interested in finding durable patterns, such as triangles and paths, which persist over a long time. While there has been work on finding durable simple patterns, existing algorithms do not have provable guarantees and run in strictly super-linear time. The paper leverages the observation that many graphs arising in practice are naturally proximity graphs or can be approximated as such, where nodes are embedded as points in some high-dimensional space, and two nodes are connected by an edge if they are close to each other. We work with an implicit representation of the proximity graph, where nodes are additionally annotated by time intervals, and design near-linear-time algorithms for finding (approximately) durable patterns above a given durability threshold. We also consider an interactive setting where a client experiments with different durability thresholds in a sequence of queries; we show how to compute incremental changes to result patterns efficiently in time near-linear to the size of the changes.


title: Datasets of Great Britain Primary Substations Integrated with Household Heating Information

abstract: The growing demand for electrified heating, electrified transportation, and power-intensive data centres challenge distribution networks. If electrification projects are carried out without considering electrical distribution infrastructure, there could be unexpected blackouts and financial losses. Datasets containing real-world distribution network information are required to address this. On the other hand, social data, such as household heating composition, are closely coupled with people's lives. Studying the coupling between the energy system and society is important in promoting social welfare. To fill these gaps, this paper introduces two datasets. The first is the main dataset for the distribution networks in Great Britain (GB), collecting information on firm capacity, peak demands, locations, and parent transmission nodes (the Grid Supply Point, namely GSP) for all primary substations (PSs). PSs are a crucial part of the UK distribution network and are at the lowest voltage level (11 kV) with publicly available data for most UK Distribution Network Operators (DNOs). Substation firm capacity and peak demand facilitate an understanding of the remaining room of the existing network. The parent GSP information helps link the dataset of distribution networks to datasets of transmission networks. The second dataset extends the main network dataset, linking each PS to information about the number of households that use different types of central heating recorded in census data. The derivation of the second dataset is based on locations of PSs collected in the main dataset with appropriate assumptions. The derivation process may also be replicated to integrate other social datasets.


title: A Novel exact algorithm for economic lot-sizing with piecewise linear production costs

abstract: In this paper, we study the single-item economic lot-sizing problem with production cost functions that are piecewise linear. The lot-sizing problem stands as a foundational cornerstone within the domain of lot-sizing problems. It is also applicable to a variety of important production planning problems which are special cases to it according to \cite{ou}. The problem becomes intractable when $m$, the number of different breakpoints of the production-cost function is variable as the problem was proven NP-hard by \cite{Florian1980}. For a fixed $m$ an $O(T^{2m+3})$ time algorithm was given by \cite{Koca2014} which was subsequently improved to $O(T^{m+2}\log(T))$ time by \cite{ou} where $T$ is the number of periods in the planning horizon.\newline We introduce a more efficient $O(T^{m+2})$ time algorithm for this problem which improves upon the previous state-of-the-art algorithm by Ou and which is derived using several novel algorithmic techniques that may be of independent interest.


title: Aggregate Frequency Width, Nuclear Hyperfine Coupling and Jahn-Teller Effect of $Cu^{2+}$ Impurity Ion ESR in $SrLaAlO_4$ Dielectric Resonator at $20$ Millikelvin

abstract: The impurity paramagnetic ion, $Cu^{2+}$ substitutes $Al$ in the $SrLaAlO_4$ single crystal lattice, this results in a $CuO_6$ elongated octahedron, the resulting measured g-factors shows four-fold axes variation condition. The aggregate frequency width of the electron spin resonance with the required minimum level of impurity concentration has been evaluated in single crystal $SrLaAlO_4$ at $20$ millikelvin. Measured parallel hyperfine constants, $A_{\scriptscriptstyle\parallel Cu}$, were determined to be $-155.7\times10^{-4}~cm^{-1},~ -163.0\times10^{-4}~cm^{-1},~ -178.3\times10^{-4}~cm^{-1} $ and$~-211.1\times10^{-4}~cm^{-1}$ at $9.072~GHz~(WGH_{4,1,1})$ for the nuclear magnetic quantum number $M_I=+\frac{3}{2},+\frac{1}{2},-\frac{1}{2}$,~and$-\frac{3}{2}$ respectively. The anisotropy of the hyperfine structure reveals a characteristics of static Jahn-Teller effect. The second-order-anisotropy-term, $\sim (\frac{spin-orbit~coupling}{10D_q})^2$, is significant and can not be disregarded, with the local strain dominating over the observed Zeeman-anisotropy-energy difference. The Bohr electron magneton, $\beta=9.23\times 10^{-24} JT^{-1}$, (within $-0.43\%$ so-called experimental error) has been found using the measured spin-Hamiltonian parameters. Measured nuclear dipolar hyperfine structure parameter $P_{\scriptscriptstyle\parallel}=12.3\times10^{-4}~cm^{-1}$ shows that the mean inverse third power of the electron distance from the nucleus is $\langle r^{-3}_q\rangle\simeq 5.23$ a.u. for $Cu^{2+}$ ion in the substituted $Al^{3+}$ ion site assuming nuclear electric quadruple moment $Q=-0.211$ barn.


title: On interpolation categories for the hyperoctahedral group

abstract: Two different types of Deligne categories have been defined to interpolate the finite dimensional complex representations of the hyperoctahedral group. The first one, initially defined by Knop and then further studied by Likeng and Savage, uses a categorical analogue of the permutation representation as a tensor generator. The second one, due to Flake and Maassen, is tensor generated by a categorical analogue of the reflection representation. We construct a symmetric monoidal functor between the two and show that it is an equivalence of symmetric monoidal categories.


title: Optimization on a Finer Scale: Bounded Local Subgradient Variation Perspective

abstract: We initiate the study of nonsmooth optimization problems under bounded local subgradient variation, which postulates bounded difference between (sub)gradients in small local regions around points, in either average or maximum sense. The resulting class of objective functions encapsulates the classes of objective functions traditionally studied in optimization, which are defined based on either Lipschitz continuity of the objective or H\"{o}lder/Lipschitz continuity of its gradient. Further, the defined class contains functions that are neither Lipschitz continuous nor have a H\"{o}lder continuous gradient. When restricted to the traditional classes of optimization problems, the parameters defining the studied classes lead to more fine-grained complexity bounds, recovering traditional oracle complexity bounds in the worst case but generally leading to lower oracle complexity for functions that are not ``worst case.'' Some highlights of our results are that: (i) it is possible to obtain complexity results for both convex and nonconvex problems with the (local or global) Lipschitz constant being replaced by a constant of local subgradient variation and (ii) mean width of the subdifferential set around the optima plays a role in the complexity of nonsmooth optimization, particularly in parallel settings. A consequence of (ii) is that for any error parameter $\epsilon > 0$, parallel oracle complexity of nonsmooth Lipschitz convex optimization is lower than its sequential oracle complexity by a factor $\tilde{\Omega}\big(\frac{1}{\epsilon}\big)$ whenever the objective function is piecewise linear with polynomially many pieces in the input size. This is particularly surprising as existing parallel complexity lower bounds are based on such classes of functions. The seeming contradiction is resolved by considering the region in which the algorithm is allowed to query the objective.


title: AutoInst: Automatic Instance-Based Segmentation of LiDAR 3D Scans

abstract: Recently, progress in acquisition equipment such as LiDAR sensors has enabled sensing increasingly spacious outdoor 3D environments. Making sense of such 3D acquisitions requires fine-grained scene understanding, such as constructing instance-based 3D scene segmentations. Commonly, a neural network is trained for this task; however, this requires access to a large, densely annotated dataset, which is widely known to be challenging to obtain. To address this issue, in this work we propose to predict instance segmentations for 3D scenes in an unsupervised way, without relying on ground-truth annotations. To this end, we construct a learning framework consisting of two components: (1) a pseudo-annotation scheme for generating initial unsupervised pseudo-labels; and (2) a self-training algorithm for instance segmentation to fit robust, accurate instances from initial noisy proposals. To enable generating 3D instance mask proposals, we construct a weighted proxy-graph by connecting 3D points with edges integrating multi-modal image- and point-based self-supervised features, and perform graph-cuts to isolate individual pseudo-instances. We then build on a state-of-the-art point-based architecture and train a 3D instance segmentation model, resulting in significant refinement of initial proposals. To scale to arbitrary complexity 3D scenes, we design our algorithm to operate on local 3D point chunks and construct a merging step to generate scene-level instance segmentations. Experiments on the challenging SemanticKITTI benchmark demonstrate the potential of our approach, where it attains 13.3% higher Average Precision and 9.1% higher F1 score compared to the best-performing baseline. The code will be made publicly available at https://github.com/artonson/autoinst.


title: Erasure codes and Tur\'an hypercube problems

abstract: We observe that several vertex Tur\'an type problems for the hypercube that received a considerable amount of attention in the combinatorial community are equivalent to questions about erasure list-decodable codes. Analyzing a recent construction of Ellis, Ivan and Leader, and determining the Tur\'an density of certain hypergraph augemntations we obtain improved bounds for some of these problems.


title: Single-Motor Robotic Gripper with Multi-Surface Fingers for Variable Grasping Configurations

abstract: This study proposes a novel robotic gripper with variable grasping configurations for grasping various objects. The fingers of the developed gripper incorporate multiple different surfaces. The gripper possesses the function of altering the finger surfaces facing a target object by rotating the fingers in its longitudinal direction. In the proposed design equipped with two fingers, the two fingers incorporate three and four surfaces, respectively, resulting in the nine available grasping configurations by the combination of these finger surfaces. The developed gripper is equipped with the functions of opening/closing its fingers for grasping and rotating its fingers to alter the grasping configuration -all achieved with a single motor. To enable the two motions using a single motor, this study introduces a self-motion switching mechanism utilizing magnets. This mechanism automatically transitions between gripper motions based on the direction of the motor rotation when the gripper is fully opened. In this state, rotating the motor towards closing initiates the finger closing action, while further opening the fingers from the fully opened state activates the finger rotation. This letter presents the gripper design, the mechanics of the self-motion switching mechanism, the control method, and the grasping configuration selection strategy. The performance of the gripper is experimentally demonstrated.


title: Enhancing Quantum Entanglement in Bipartite Systems: Leveraging Optimal Control and Physics-Informed Neural Networks

abstract: Quantum entanglement stands at the forefront of quantum information science, heralding new paradigms in quantum communication, computation, and cryptography. This paper introduces a quantum optimal control approach by focusing on entanglement measures rather than targeting predefined maximally entangled states. Leveraging the indirect Pontryagin Minimum Principle, we formulate an optimal control problem centered on maximizing an enhanced lower bound of the entanglement measure within a shortest timeframe in the presence of input constraints. We derive optimality conditions based on Pontryagin's Minimum Principle tailored for a matrix-valued dynamic control system and tackle the resulting boundary value problem through a Physics-Informed Neural Network, which is adept at handling differential matrix equations. The proposed strategy not only refines the process of generating entangled states but also introduces a method with increased sensitivity in detecting entangled states, thereby overcoming the limitations of conventional concurrence estimation.


title: On the mapping class group action on the homology of surface covers

abstract: Let $\phi \in {\rm Mod}(\Sigma)$ be an arbitrary element of the mapping class group of a closed orientable surface $\Sigma$ of genus at least $2$. For any characteristic cover $\widetilde{\Sigma} \to \Sigma$ one can consider the linear subspace ${\rm H}_1^{f.o.}(\widetilde{\Sigma}, \mathbb{Q})^\phi \subseteq {\rm H}_1(\widetilde{\Sigma}, \mathbb{Q})$ consisting of all homology classes with finite $\phi$-orbit. We prove that $\dim {\rm H}_1^{f.o.}(\widetilde{\Sigma}, \mathbb{Q})^\phi$ can be arbitrary large for any fixed $\phi \in {\rm Mod}(\Sigma)$.


title: Spectral Triples on noncommutative solenoids from the standard spectral triples on quantum tori

abstract: We address the natural question: as noncommutative solenoids are inductive limits of quantum tori, do the standard spectral triples on quantum tori converge to some spectral triple on noncommutative solenoid for the spectral propinquity? We answer this question by showing that, using appropriate bounded perturbation of the spectral triples on quantum tori, such a spectral triple on noncommutative solenoid can be constructed.


title: Minimal Cellular Resolutions of Path Ideals

abstract: In this paper, we prove that the path ideals of both paths and cycles have minimal cellular resolutions. Specifically, these minimal free resolutions coincide with the Barile-Macchia resolutions for paths, and their generalized counterparts for cycles. Furthermore, we identify edge ideals of cycles as a class of ideals that lack a minimal Barile-Macchia resolution, yet have a minimal generalized Barile-Macchia resolution.


title: Accumulated spectrograms for hyperuniform determinantal point processes

abstract: We define the accumulated spectrogram associated to a locally trace class orthogonal projection operator and to a bounded set using the polar decomposition of its restriction on that set and prove a convergence theorem for accumulated spectrograms along an exhaustion in the case when the corresponding determinantal point process is hyperuniform. We prove that a radial determinantal point process on Rd is always hyperuniform along the exhaustion formed by the dilations of a bounded open set, and as a consequence, we obtain that dilations of the corresponding accumulated spectrogram converge to the indicator function of the considered set, establishing thus a universal phenomenon. Our result is a generalisation of a theorem by Abreu-Gr\"ochenig-Romero in [1] concerning time-frequency localization operators.


title: Quadratic residue patterns, algebraic curves and a K3 surface

abstract: Quadratic residue patterns modulo a prime are studied since 19th century. In the first part we extend existing results on the number of consecutive $\ell$-tuples of quadratic residues, studying corresponding algebraic curves and their jacobians, which happen to be products of jacobians of hyperelliptic curves. In the second part we state the last unpublished result of Lydia Goncharova on squares such that their differences are also squares, reformulate it in terms of algebraic geometry of a K3 surface, and prove it. The core of this theorem is an unexpected relation between the number of points on the K3 surface and that on a CM elliptic curve.


title: Artificial Neural Microcircuits as Building Blocks: Concept and Challenges

abstract: Artificial Neural Networks (ANNs) are one of the most widely employed forms of bio-inspired computation. However the current trend is for ANNs to be structurally homogeneous. Furthermore, this structural homogeneity requires the application of complex training and learning tools that produce application specific ANNs, susceptible to pitfalls such as overfitting. In this paper, an new approach is explored, inspired by the role played in biology by Neural Microcircuits, the so called ``fundamental processing elements'' of organic nervous systems. How large neural networks, particularly Spiking Neural Networks (SNNs) can be assembled using Artificial Neural Microcircuits (ANMs), intended as off-the-shelf components, is articulated; the results of initial work to produce a catalogue of such Microcircuits though the use of Novelty Search is shown; followed by efforts to expand upon this initial work, including a discussion of challenges uncovered during these efforts and explorations of methods by which they might be overcome.


title: Uniform-over-dimension convergence with application to location tests for high-dimensional data

abstract: Asymptotic methods for hypothesis testing in high-dimensional data usually require the dimension of the observations to increase to infinity, often with an additional condition on its rate of increase compared to the sample size. On the other hand, multivariate asymptotic methods are valid for fixed dimension only, and their practical implementations in hypothesis testing methodology typically require the sample size to be large compared to the dimension for yielding desirable results. However, in practical scenarios, it is usually not possible to determine whether the dimension of the data at hand conform to the conditions required for the validity of the high-dimensional asymptotic methods, or whether the sample size is large enough compared to the dimension of the data. In this work, a theory of asymptotic convergence is proposed, which holds uniformly over the dimension of the random vectors. This theory attempts to unify the asymptotic results for fixed-dimensional multivariate data and high-dimensional data, and accounts for the effect of the dimension of the data on the performance of the hypothesis testing procedures. The methodology developed based on this asymptotic theory can be applied to data of any dimension. An application of this theory is demonstrated in the two-sample test for the equality of locations. The test statistic proposed is unscaled by the sample covariance, similar to usual tests for high-dimensional data. Using simulated examples, it is demonstrated that the proposed test exhibits better performance compared to several popular tests in the literature for high-dimensional data. Further, it is demonstrated in simulated models that the proposed unscaled test performs better than the usual scaled two-sample tests for multivariate data, including the Hotelling's $T^2$ test for multivariate Gaussian data.


title: Social Deliberation vs. Social Contracts in Self-Governing Voluntary Organisations

abstract: Self-organising multi-agent systems regulate their components' behaviour voluntarily, according to a set of socially-constructed, mutually-agreed, and mutable social arrangements. In some systems, these arrangements may be applied with a frequency, at a scale and within implicit cost constraints such that performance becomes a pressing issue. This paper introduces the \textit{Megabike Scenario}, which consists of a negotiated agreement on a relatively 'large' set of conventional rules, 'frequent' 'democratic' decision-making according to those rules, and a resource-bounded imperative to reach 'correct' decisions. A formalism is defined for effective rule representation and processing in the scenario, and is evaluated against five interleaved socio-functional requirements. System performance is also evaluated empirically through simulation. We conclude that to self-organise their social arrangements, agents need some awareness of their own limitations and the value of compromise.


title: Algorithms of constrained uniform approximation

abstract: We address the problem of the best uniform approximation of a continuous function on a convex domain. The approximation is by linear combinations of a finite system of functions (not necessarily Chebyshev) under arbitrary linear constraints. By modifying the concept of alternance and of the Remez iterative procedure we present a method, which demonstrates its efficiency in numerical problems. The linear rate of convergence is proved under some favourable assumptions. A special attention is paid to systems of complex exponents, Gaussian functions, lacunar algebraic and trigonometric polynomials. Applications to signal processing, linear ODE, switching dynamical systems, and to Markov-Bernstein type inequalities are considered.


title: Modeling Analog Dynamic Range Compressors using Deep Learning and State-space Models

abstract: We describe a novel approach for developing realistic digital models of dynamic range compressors for digital audio production by analyzing their analog prototypes. While realistic digital dynamic compressors are potentially useful for many applications, the design process is challenging because the compressors operate nonlinearly over long time scales. Our approach is based on the structured state space sequence model (S4), as implementing the state-space model (SSM) has proven to be efficient at learning long-range dependencies and is promising for modeling dynamic range compressors. We present in this paper a deep learning model with S4 layers to model the Teletronix LA-2A analog dynamic range compressor. The model is causal, executes efficiently in real time, and achieves roughly the same quality as previous deep-learning models but with fewer parameters.


title: Cosmic Microwave Background Signatures from Current-carrying Cosmic Strings

abstract: We continue our studies of the evolution and cosmological consequences of current-carrying cosmic string networks, described by a charge-velocity-dependent one scale (CVOS) model. We present a detailed calculation of the effects of these networks on the cosmic microwave background (CMB), in the context of this model, and specifically discuss how such current-carrying strings may be distinguished from their uncharged (Nambu-Goto) counterparts by current or forthcoming CMB data. We find that, under the CVOS hypothesis, the constraints on current-carrying strings should not differ much from those of their structureless counterparts in that the impact on the CMB can at most be reduced by a factor of ~25%. Nevertheless, the presence of a current and charge affects the distribution of power among scalar, vector and tensor modes, and also its distribution between small and large scales. It should therefore be possible for future high-sensitivity CMB experiments to distinguish between the two types of strings.


title: Expanding the frontiers of cool-dwarf asteroseismology with ESPRESSO. Detection of solar-like oscillations in the K5 dwarf $\epsilon$ Indi

abstract: Fuelled by space photometry, asteroseismology is vastly benefitting the study of cool main-sequence stars, which exhibit convection-driven solar-like oscillations. Even so, the tiny oscillation amplitudes in K dwarfs continue to pose a challenge to space-based asteroseismology. A viable alternative is offered by the lower stellar noise over the oscillation timescales in Doppler observations. In this letter we present the definite detection of solar-like oscillations in the bright K5 dwarf $\epsilon$ Indi based on time-intensive observations collected with the ESPRESSO spectrograph at the VLT, thus making it the coolest seismic dwarf ever observed. We measured the frequencies of a total of 19 modes of degree $\ell=0$--2 along with $\nu_{\rm max}=5305\pm176\:{\rm \mu Hz}$ and $\Delta\nu=201.25\pm0.16\:{\rm \mu Hz}$. The peak amplitude of radial modes is $2.6\pm0.5\:{\rm cm\,s^{-1}}$, or a mere ${\sim} 14\%$ of the solar value. Measured mode amplitudes are ${\sim} 2$ times lower than predicted from a nominal $L/M$ scaling relation and favour a scaling closer to $(L/M)^{1.5}$ below ${\sim} 5500\:{\rm K}$, carrying important implications for our understanding of the coupling efficiency between pulsations and near-surface convection in K dwarfs. This detection conclusively shows that precise asteroseismology of cool dwarfs is possible down to at least the mid-K regime using next-generation spectrographs on large-aperture telescopes, effectively opening up a new domain in observational asteroseismology.


title: Graphs Generalization under Distribution Shifts

abstract: Traditional machine learning methods heavily rely on the independent and identically distribution assumption, which imposes limitations when the test distribution deviates from the training distribution. To address this crucial issue, out-of-distribution (OOD) generalization, which aims to achieve satisfactory generalization performance when faced with unknown distribution shifts, has made a significant process. However, the OOD method for graph-structured data currently lacks clarity and remains relatively unexplored due to two primary challenges. Firstly, distribution shifts on graphs often occur simultaneously on node attributes and graph topology. Secondly, capturing invariant information amidst diverse distribution shifts proves to be a formidable challenge. To overcome these obstacles, in this paper, we introduce a novel framework, namely Graph Learning Invariant Domain genERation (GLIDER). The goal is to (1) diversify variations across domains by modeling the potential seen or unseen variations of attribute distribution and topological structure and (2) minimize the discrepancy of the variation in a representation space where the target is to predict semantic labels. Extensive experiment results indicate that our model outperforms baseline methods on node-level OOD generalization across domains in distribution shift on node features and topological structures simultaneously.


title: MEDDAP: Medical Dataset Enhancement via Diversified Augmentation Pipeline

abstract: The effectiveness of Deep Neural Networks (DNNs) heavily relies on the abundance and accuracy of available training data. However, collecting and annotating data on a large scale is often both costly and time-intensive, particularly in medical cases where practitioners are already occupied with their duties. Moreover, ensuring that the model remains robust across various scenarios of image capture is crucial in medical domains, especially when dealing with ultrasound images that vary based on the settings of different devices and the manual operation of the transducer. To address this challenge, we introduce a novel pipeline called MEDDAP, which leverages Stable Diffusion (SD) models to augment existing small datasets by automatically generating new informative labeled samples. Pretrained checkpoints for SD are typically based on natural images, and training them for medical images requires significant GPU resources due to their heavy parameters. To overcome this challenge, we introduce USLoRA (Ultrasound Low-Rank Adaptation), a novel fine-tuning method tailored specifically for ultrasound applications. USLoRA allows for selective fine-tuning of weights within SD, requiring fewer than 0.1\% of parameters compared to fully fine-tuning only the UNet portion of SD. To enhance dataset diversity, we incorporate different adjectives into the generation process prompts, thereby desensitizing the classifiers to intensity changes across different images. This approach is inspired by clinicians' decision-making processes regarding breast tumors, where tumor shape often plays a more crucial role than intensity. In conclusion, our pipeline not only outperforms classifiers trained on the original dataset but also demonstrates superior performance when encountering unseen datasets. The source code is available at https://github.com/yasamin-med/MEDDAP.


title: Predictive Inference in Multi-environment Scenarios

abstract: We address the challenge of constructing valid confidence intervals and sets in problems of prediction across multiple environments. We investigate two types of coverage suitable for these problems, extending the jackknife and split-conformal methods to show how to obtain distribution-free coverage in such non-traditional, hierarchical data-generating scenarios. Our contributions also include extensions for settings with non-real-valued responses and a theory of consistency for predictive inference in these general problems. We demonstrate a novel resizing method to adapt to problem difficulty, which applies both to existing approaches for predictive inference with hierarchical data and the methods we develop; this reduces prediction set sizes using limited information from the test environment, a key to the methods' practical performance, which we evaluate through neurochemical sensing and species classification datasets.


title: On solution of tropical discrete best approximation problems

abstract: We consider a discrete best approximation problem formulated in the framework of tropical algebra, which deals with the theory and applications of algebraic systems with idempotent operations. Given a set of samples of input and output of an unknown function, the problem is to construct a generalized tropical Puiseux polynomial that best approximates the function in the sense of a tropical distance function. The construction of an approximate polynomial involves the evaluation of both unknown coefficient and exponent of each monomial in the polynomial. To solve the approximation problem, we first reduce the problem to an equation in unknown vector of coefficients, which is given by a matrix with entries parameterized by unknown exponents. We derive a best approximate solution of the equation, which yields both vector of coefficients and approximation error parameterized by the exponents. Optimal values of exponents are found by minimization of the approximation error, which is transformed into minimization of a function of exponents over all partitions of a finite set. We solve this minimization problem in terms of max-plus algebra by using a computational procedure based on the agglomerative clustering technique. This solution is extended to the minimization problem of finding optimal exponents in the polynomial in terms of max-algebra. The results obtained are applied to develop new solutions for conventional problems of discrete best Chebyshev approximation of real functions by piecewise linear functions and piecewise Puiseux polynomials. We discuss computational complexity of the proposed solution and estimate upper bounds on the computational time. We demonstrate examples of approximation problems solved in terms of max-plus and max-algebra, and give graphical illustrations.


title: Impact of Video Compression Artifacts on Fisheye Camera Visual Perception Tasks

abstract: Autonomous driving systems require extensive data collection schemes to cover the diverse scenarios needed for building a robust and safe system. The data volumes are in the order of Exabytes and have to be stored for a long period of time (i.e., more than 10 years of the vehicle's life cycle). Lossless compression doesn't provide sufficient compression ratios, hence, lossy video compression has been explored. It is essential to prove that lossy video compression artifacts do not impact the performance of the perception algorithms. However, there is limited work in this area to provide a solid conclusion. In particular, there is no such work for fisheye cameras, which have high radial distortion and where compression may have higher artifacts. Fisheye cameras are commonly used in automotive systems for 3D object detection task. In this work, we provide the first analysis of the impact of standard video compression codecs on wide FOV fisheye camera images. We demonstrate that the achievable compression with negligible impact depends on the dataset and temporal prediction of the video codec. We propose a radial distortion-aware zonal metric to evaluate the performance of artifacts in fisheye images. In addition, we present a novel method for estimating affine mode parameters of the latest VVC codec, and suggest some areas for improvement in video codecs for the application to fisheye imagery.


title: What is Entanglement?

abstract: Entanglement, a puzzle since Einstein's time, has become increasingly crucial with the rise of quantum computation. But what exactly is it? Historically , entanglement can be precisely defined, but only negatively. In this article, we explore four interconnected definitions of entangled states.


title: ethraid: A simple method for characterizing long-period companions using Doppler, astrometric, and imaging constraints

abstract: We present \texttt{ethraid}, an open source Python package designed to measure the mass ($m_c$) and separation ($a$) of a bound companion from measurements covering a fraction of the orbital period. \texttt{ethraid} constrains $m_c$ and $a$ by jointly modeling radial velocity (RV), astrometric, and/or direct imaging data in a Bayesian framework. Partial orbit data sets, especially those with highly limited phase coverage, are well-represented by a few method-specific summary statistics. By modeling these statistics rather than the original data, \texttt{ethraid} optimizes computational efficiency with minimal reduction in accuracy. \texttt{ethraid} uses importance sampling to efficiently explore the often broad posteriors that arise from partial orbits. The core computations of \texttt{ethraid} are implemented in Cython for speed. We validate \texttt{ethraid}'s performance by using it to constrain the masses and separations of the planetary companions to HD 117207 and TOI-1694. We designed \texttt{ethraid} to be both fast and simple, and to give broad, "quick look" constraints on companion parameters using minimal data. \texttt{ethraid} is pip installable and available on Github.


title: NonlinearSolve.jl: High-Performance and Robust Solvers for Systems of Nonlinear Equations in Julia

abstract: Efficiently solving nonlinear equations underpins numerous scientific and engineering disciplines, yet scaling these solutions for complex system models remains a challenge. This paper presents NonlinearSolve.jl - a suite of high-performance open-source nonlinear equation solvers implemented natively in the Julia programming language. NonlinearSolve.jl distinguishes itself by offering a unified API that accommodates a diverse range of solver specifications alongside features such as automatic algorithm selection based on runtime analysis, support for GPU-accelerated computation through static array kernels, and the utilization of sparse automatic differentiation and Jacobian-free Krylov methods for large-scale problem-solving. Through rigorous comparison with established tools such as Sundials and MINPACK, NonlinearSolve.jl demonstrates unparalleled robustness and efficiency, achieving significant advancements in solving benchmark problems and challenging real-world applications. The capabilities of NonlinearSolve.jl unlock new potentials in modeling and simulation across various domains, making it a valuable addition to the computational toolkit of researchers and practitioners alike.


title: A generalization of the first Tits construction

abstract: Let $F$ be a field of characteristic not 2 or 3. The first Tits construction is a well-known tripling process to construct separable cubic Jordan algebras, especially Albert algebras. We generalize the first Tits construction by choosing the scalar employed in the tripling process outside of the base field. This yields a new family of nonassociative unital algebras which carry a cubic map, and maps that can be viewed as generalized adjoint and generalized trace maps. These maps display properties often similar to the ones in the classical setup. In particular, the cubic norm map permits some kind of weak Jordan composition law.


title: Percentile Optimization in Wireless Networks- Part II: Beamforming for Cell-Edge Throughput Maximization

abstract: Part I of this two-part paper focused on the formulation of percentile problems, complexity analysis, and development of power control algorithms via the quadratic fractional transform (QFT) and logarithmic fractional transform (LFT) for sum-least-qth-percentile (SLqP) rate maximization problems. In this second part, we first tackle the significantly more challenging problems of optimizing SLqP rate via beamforming in a multiuser, multiple-input multiple-output (MU- MIMO) network to maximize cell-edge throughput. To this end, we first propose an adaptation of the QFT algorithm presented in Part I that enables optimization of the complex-valued multidimensional beamforming weights for the SLqP rate utility function. We also introduce a new class of problems which we term as sum-greatest-qth-percentile weighted mean squared error (SGqP-WMSE) minimization. We show that this class subsumes the well-known sum-weighted mean squared error (WMMSE) minimization and max-WMSE minimization problems. We demonstrate an equivalence between this class of problems and the SLqP rate maximization problems, and show that this correspondence can be exploited to obtain stationary-point solutions for the aforementioned beamforming problem. Next, we develop extensions for the QFT and LFT algorithms from Part I to optimize ergodic long-term average or ergodic SLqP utility. Finally, we also consider related problems which can be solved using the proposed techniques, including hybrid utility functions targeting optimization at specific subsets of users within cellular networks.


title: Percentile Optimization in Wireless Networks- Part I: Power Control for Max-Min-Rate to Sum-Rate Maximization (and Everything in Between)

abstract: Improving throughput for cell-edge users through coordinated resource allocation has been a long-standing driver of research in wireless cellular networks. While a variety of wireless resource management problems focus on sum utility, max-min utility and proportional fair utility, these formulations do not explicitly cater to cell-edge users and can, in fact, be disadvantageous to them. In this two-part paper series, we introduce a new class of optimization problems called percentile programs, which allow us to explicitly formulate problems that target lower-percentile throughput optimization for cell-edge users. Part I focuses on the class of least-percentile throughput maximization through power control. This class subsumes the well-known max-min and max-sum-rate optimization problems as special cases. Apart from these two extremes, we show that least-percentile rate programs are non-convex, non-smooth and strongly NP-hard in general for multiuser interference networks, making optimization extremely challenging. We propose cyclic maximization algorithms that transform the original problems into equivalent block-concave forms, thereby enabling guaranteed convergence to stationary points. Comparisons with state-of-the-art optimization algorithms such as successive convex approximation and sequential quadratic programming reveal that our proposed algorithms achieve superior performance while computing solutions orders of magnitude faster.


title: Enhanced Facet Generation with LLM Editing

abstract: In information retrieval, facet identification of a user query is an important task. If a search service can recognize the facets of a user's query, it has the potential to offer users a much broader range of search results. Previous studies can enhance facet prediction by leveraging retrieved documents and related queries obtained through a search engine. However, there are challenges in extending it to other applications when a search engine operates as part of the model. First, search engines are constantly updated. Therefore, additional information may change during training and test, which may reduce performance. The second challenge is that public search engines cannot search for internal documents. Therefore, a separate search system needs to be built to incorporate documents from private domains within the company. We propose two strategies that focus on a framework that can predict facets by taking only queries as input without a search engine. The first strategy is multi-task learning to predict SERP. By leveraging SERP as a target instead of a source, the proposed model deeply understands queries without relying on external modules. The second strategy is to enhance the facets by combining Large Language Model (LLM) and the small model. Overall performance improves when small model and LLM are combined rather than facet generation individually.


title: Manipulating the direction of one-way steering in an optomechanical ring cavity

abstract: Quantum steering refers to the apparent possibility of exploiting nonseparable quantum correlations to remotely influence the quantum state of an observer via local measurements. Different from entanglement and Bell nonlocality, quantum steering exhibits an inherent asymmetric property, which makes it relevant for many asymmetric quantum information processing tasks. Here, we study Gaussian quantum steering between two mechanical modes in an optomechanical ring cavity. Using experimentally feasible parameters, we show that the state of the two considered modes can exhibit two-way steering and even one-way steering. Instead of using unbalanced losses or noises, we propose a simple practical way to control the direction of one-way steering. A comparative study between the steering and entanglement of the studied modes shows that both steering and entanglement undergo a sudden death-like behavior. In particular, steering is found more fragile against thermal noise remaining constantly upper bounded by entanglement. The proposed scheme may be meaningful for one-sided device-independent quantum key distribution, where the security of such protocol depends fundamentally on the direction of steering.


title: ChatGPT Incorrectness Detection in Software Reviews

abstract: We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but often worry about the truthfulness of ChatGPT responses. We developed a suite of techniques and a tool called CID (ChatGPT Incorrectness Detector) to automatically test and detect the incorrectness in ChatGPT responses. CID is based on the iterative prompting to ChatGPT by asking it contextually similar but textually divergent questions (using an approach that utilizes metamorphic relationships in texts). The underlying principle in CID is that for a given question, a response that is different from other responses (across multiple incarnations of the question) is likely an incorrect response. In a benchmark study of library selection, we show that CID can detect incorrect responses from ChatGPT with an F1-score of 0.74 - 0.75.


title: Quadratic embedding constants of fan graphs and graph joins

abstract: We derive a general formula for the quadratic embedding constant of a graph join $\bar{K}_m+G$, where $\bar{K}_m$ is the empty graph on $m\ge1$ vertices and $G$ is an arbitrary graph. Applying our formula to a fan graph $K_1+P_n$, where $K_1=\bar{K}_1$ is the singleton graph and $P_n$ is the path on $n\ge1$ vertices, we show that $\mathrm{QEC}(K_1+P_n)=-\tilde{\alpha}_n-2$, where $\tilde{\alpha}_n$ is the minimal zero of a new polynomial $\Phi_n(x)$ related to Chebyshev polynomials of the second kind. Moreover, for an even $n$ we have $\tilde{\alpha}_n=\min\mathrm{ev}(A_n)$, where the right-hand side is the An minimal eigenvalue of the adjacency matrix $A_n$ of $P_n$. For an odd $n$ we show that $\min\mathrm{ev}(A_{n+1})\le\tilde{\alpha}_n<\min\mathrm{ev}(A_n)$.


title: A multivariate Berry--Esseen theorem for time-dependent expanding dynamical systems

abstract: We adapt Stein's method to obtain Berry--Esseen type error bounds in the multivariate central limit theorem for non-stationary processes generated by time-dependent compositions of uniformly expanding dynamical systems. In a particular case of random dynamical systems with a strongly mixing base transformation, we derive an error estimate of order $O(N^{-1/2})$ in the quenched multivariate CLT, provided that the covariance matrix "grows linearly" with the number of summands $N$. The error in the normal approximation is estimated for the class of all convex sets.


title: 3D-EffiViTCaps: 3D Efficient Vision Transformer with Capsule for Medical Image Segmentation

abstract: Medical image segmentation (MIS) aims to finely segment various organs. It requires grasping global information from both parts and the entire image for better segmenting, and clinically there are often certain requirements for segmentation efficiency. Convolutional neural networks (CNNs) have made considerable achievements in MIS. However, they are difficult to fully collect global context information and their pooling layer may cause information loss. Capsule networks, which combine the benefits of CNNs while taking into account additional information such as relative location that CNNs do not, have lately demonstrated some advantages in MIS. Vision Transformer (ViT) employs transformers in visual tasks. Transformer based on attention mechanism has excellent global inductive modeling capabilities and is expected to capture longrange information. Moreover, there have been resent studies on making ViT more lightweight to minimize model complexity and increase efficiency. In this paper, we propose a U-shaped 3D encoder-decoder network named 3D-EffiViTCaps, which combines 3D capsule blocks with 3D EfficientViT blocks for MIS. Our encoder uses capsule blocks and EfficientViT blocks to jointly capture local and global semantic information more effectively and efficiently with less information loss, while the decoder employs CNN blocks and EfficientViT blocks to catch ffner details for segmentation. We conduct experiments on various datasets, including iSeg-2017, Hippocampus and Cardiac to verify the performance and efficiency of 3D-EffiViTCaps, which performs better than previous 3D CNN-based, 3D Capsule-based and 3D Transformer-based models. We further implement a series of ablation experiments on the main blocks. Our code is available at: https://github.com/HidNeuron/3D-EffiViTCaps.


title: Anomalous thermal conductivity in 2D silica nanocages of immobilizing noble gas atom

abstract: Noble gas atoms such as Kr and Xe are byproducts of nuclear fission in nuclear plants. How to trap and confine these volatile even radioactive gases is particularly challenging. Recent studies have shown that they can be trapped in nanocages of ultrathin silica. Here, we exhibit with self-consistent phonon theory and four-phonon (4ph) scattering where the adsorption of noble gases results in an anomalous increase in lattice thermal conductivity, while the presence of Cu atoms doping leads to a reduction in lattice thermal conductivity. We trace this behavior in host-guest 2D silica to an interplay of tensile strain, rattling phonon modes, and redistribution of electrons. We also find that 4ph scatterings play indispensable roles in the lattice thermal conductivity of 2D silica. Our work illustrates the microscopic heat transfer mechanism in 2D silica nanocages with the immobilization of noble gas atoms and inspires further exploring materials with the kagome and glasslike lattice thermal conductivity.


title: A note on the convergence of multigrid methods for the Riesz-space equation and an application to image deblurring

abstract: In the past decades, a remarkable amount of research has been carried out regarding fast solvers for large linear systems resulting from various discretizations of fractional differential equations (FDEs). In the current work, we focus on multigrid methods for a Riesz-space FDE whose theoretical convergence analysis of such multigrids is currently limited to the two-grid method. Here we provide a detailed theoretical convergence study in the case of V-cycle and W-cycle. Moreover, we discuss its use combined with a band approximation and we compare the result with both $\tau$ and circulant preconditionings. The numerical tests include 2D problems as well as the extension to the case of a Riesz-FDE with variable coefficients. Finally, we apply the best-performing method to an image deblurring problem with Tikhonov regularization.


title: Energy-Efficient Hybrid Beamforming with Dynamic On-off Control for Integrated Sensing, Communications, and Powering

abstract: This paper investigates the energy-efficient hybrid beamforming design for a multi-functional integrated sensing, communications, and powering (ISCAP) system. In this system, a base station (BS) with a hybrid analog-digital (HAD) architecture sends unified wireless signals to communicate with multiple information receivers (IRs), sense multiple point targets, and wirelessly charge multiple energy receivers (ERs) at the same time. To facilitate the energy-efficient design, we present a novel HAD architecture for the BS transmitter, which allows dynamic on-off control of its radio frequency (RF) chains and analog phase shifters (PSs) through a switch network. We also consider a practical and comprehensive power consumption model for the BS, by taking into account the power-dependent non-linear power amplifier (PA) efficiency, and the on-off non-transmission power consumption model of RF chains and PSs. We jointly design the hybrid beamforming and dynamic on-off control at the BS, aiming to minimize its total power consumption, while guaranteeing the performance requirements on communication rates, sensing Cram\'er-Rao bound (CRB), and harvested power levels. The formulation also takes into consideration the per-antenna transmit power constraint and the constant modulus constraints for the analog beamformer at the BS. The resulting optimization problem for ISCAP is highly non-convex. Please refer to the paper for a complete abstract.


title: ChatDBG: An AI-Powered Debugging Assistant

abstract: This paper presents ChatDBG, the first AI-powered debugging assistant. ChatDBG integrates large language models (LLMs) to significantly enhance the capabilities and user-friendliness of conventional debuggers. ChatDBG lets programmers engage in a collaborative dialogue with the debugger, allowing them to pose complex questions about program state, perform root cause analysis for crashes or assertion failures, and explore open-ended queries like "why is x null?". To handle these queries, ChatDBG grants the LLM autonomy to take the wheel and drive debugging by issuing commands to navigate through stacks and inspect program state; it then reports its findings and yields back control to the programmer. Our ChatDBG prototype integrates with standard debuggers including LLDB, GDB, and WinDBG for native code and Pdb for Python. Our evaluation across a diverse set of code, including C/C++ code with known bugs and a suite of Python code including standalone scripts and Jupyter notebooks, demonstrates that ChatDBG can successfully analyze root causes, explain bugs, and generate accurate fixes for a wide range of real-world errors. For the Python programs, a single query led to an actionable bug fix 67% of the time; one additional follow-up query increased the success rate to 85%. ChatDBG has seen rapid uptake; it has already been downloaded nearly 30,000 times.


title: Quantitative study of the pinning effect of the edge dislocation on domain wall motion in Barium Titanate thin films

abstract: Dislocation is a very important one-dimensional defect in ferroelectrics. This work introduces an easy and flexible model of implementing the edge dislocation by introducing eigenstrain at the interface, and it could be easily extended to incorporate the surface stress to refine the analysis of ferroelectric thin films. The influence of dislocations on the ferroelectric domain wall motion and hysteresis loop including the remanent polarization and coercive field using phase-field simulations is analyzed. The pinning effect of the dislocation on the domain wall motion is discussed and whether the domain wall is pined is the competition between the external loading and the magnitude of the burgers vector of the dislocation. This work could contribute to the understanding of the pining effect of the dislocation and provide guidance for the fabrication of ferroelectric thin films.


title: Bipedal Safe Navigation over Uncertain Rough Terrain: Unifying Terrain Mapping and Locomotion Stability

abstract: We study the problem of bipedal robot navigation in complex environments with uncertain and rough terrain. In particular, we consider a scenario in which the robot is expected to reach a desired goal location by traversing an environment with uncertain terrain elevation. Such terrain uncertainties induce not only untraversable regions but also robot motion perturbations. Thus, the problems of terrain mapping and locomotion stability are intertwined. We evaluate three different kernels for Gaussian process (GP) regression to learn the terrain elevation. We also learn the motion deviation resulting from both the terrain as well as the discrepancy between the reduced-order Prismatic Inverted Pendulum Model used for planning and the full-order locomotion dynamics. We propose a hierarchical locomotion-dynamics-aware sampling-based navigation planner. The global navigation planner plans a series of local waypoints to reach the desired goal locations while respecting locomotion stability constraints. Then, a local navigation planner is used to generate a sequence of dynamically feasible footsteps to reach local waypoints. We develop a novel trajectory evaluation metric to minimize motion deviation and maximize information gain of the terrain elevation map. We evaluate the efficacy of our planning framework on Digit bipedal robot simulation in MuJoCo.


title: Spaces of multiscaled lines with collision

abstract: We study varieties $\mathcal{A}_n$ arising as equivariant compactifications of the space of $n$ points in $\mathbb{C}$ up to overall translation. We define $\mathcal{A}_n$ and examine its basic geometric properties before constructing an isomorphism to an augmented wonderful variety. We show that $\mathcal{A}_n$ is in a canonical way a resolution of the space $\overline{P}_n$ considered by Zahariuc, proving along the way that the resolution constructed by Zahariuc is equivalent to ours.


title: ChebMixer: Efficient Graph Representation Learning with MLP Mixer

abstract: Graph neural networks have achieved remarkable success in learning graph representations, especially graph Transformer, which has recently shown superior performance on various graph mining tasks. However, graph Transformer generally treats nodes as tokens, which results in quadratic complexity regarding the number of nodes during self-attention computation. The graph MLP Mixer addresses this challenge by using the efficient MLP Mixer technique from computer vision. However, the time-consuming process of extracting graph tokens limits its performance. In this paper, we present a novel architecture named ChebMixer, a newly graph MLP Mixer that uses fast Chebyshev polynomials-based spectral filtering to extract a sequence of tokens. Firstly, we produce multiscale representations of graph nodes via fast Chebyshev polynomial-based spectral filtering. Next, we consider each node's multiscale representations as a sequence of tokens and refine the node representation with an effective MLP Mixer. Finally, we aggregate the multiscale representations of nodes through Chebyshev interpolation. Owing to the powerful representation capabilities and fast computational properties of MLP Mixer, we can quickly extract more informative node representations to improve the performance of downstream tasks. The experimental results prove our significant improvements in a variety of scenarios ranging from graph node classification to medical image segmentation.


title: Floquet-Magnus Expansion and Fer Expansion Approaches Revisited to Investigate the Chemical Shift Anisotropy During the Triple Oscillating Field Technique Irradiation in Solid-State NMR

abstract: The Floquet-Magnus and Fer expansion schemes were introduced in solid-state nuclear magnetic resonance (NMR) in 2011 and 2006, respectively. Key features of the Floquet magnus expansion are its ability to account for the calculations developed in a finite-dimensional Hilbert space instead of an infinite-dimensional space within the Floquet theory as well as its use of its distinguishable function from other theories such as average Hamiltonian theory, Floquet theory, and Fer expansion, which facilitates the evaluation of the spin behavior in between the stroboscopic observation points. This article focuses on revisiting the Floquet-Magnus and Fer expansion approaches and applying both methods to calculate the effective Hamiltonians and propagators, which control the spin system evolution during the Triple Oscillating Field Technique radiation experiment (TOFU). The TOFU pulse sequence is an important technique that was shown to avoid the dipolar truncation problem and form a new basis for accurate distance measurement by solid-state NMR. We take advantage of the interaction frequencies and the time modulation arising from the TOFU pulse sequence allowing selective recoupling of specific terms in the Hamiltonian that fulfill determined specific conditions. The work presented unifies and generalizes existing results of the Floquet-Magnus and Fer expansions and delivers illustrations of novel springs that boost previous applications that are based on the classical information. We believe that the revisited approaches of this work and the derived expressions can serve as useful information and numerical tools for time evolution in time-resolved spectroscopy, quantum control, and open system quantum dynamics.


title: Le Conte de la Mesure sur les Complexes Cubiques CAT(0)

abstract: We revisit the topic of probability measures on CAT(0) cube complexes and prove that an amenable group acting on a CAT(0) cube complex, regardless of dimension, necessarily preserves an interval in the Roller compactification. In the finite dimensional case, we prove that there must be an orbit of cardinality $2^N$, where $N$ is bounded by the dimension. This is a slight extension of the author's previous Tits' Alternative.


title: RSTAR: Rotational Streak Artifact Reduction in 4D CBCT using Separable and Circular Convolutions

abstract: Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. As raw projection data are sorted into multiple respiratory phases, there is a limited number of cone-beam projections available for image reconstruction. Consequently, the 4D CBCT images are covered by severe streak artifacts. Although several deep learning-based methods have been proposed to address this issue, most algorithms employ ordinary network models, neglecting the intrinsic structural prior within 4D CBCT images. In this paper, we first explore the origin and appearance of streak artifacts in 4D CBCT images.Specifically, we find that streak artifacts exhibit a periodic rotational motion along with the patient's respiration. This unique motion pattern inspires us to distinguish the artifacts from the desired anatomical structures in the spatiotemporal domain. Thereafter, we propose a spatiotemporal neural network named RSTAR-Net with separable and circular convolutions for Rotational Streak Artifact Reduction. The specially designed model effectively encodes dynamic image features, facilitating the recovery of 4D CBCT images. Moreover, RSTAR-Net is also lightweight and computationally efficient. Extensive experiments substantiate the effectiveness of our proposed method, and RSTAR-Net shows superior performance to comparison methods.


title: AgentFL: Scaling LLM-based Fault Localization to Project-Level Context

abstract: Fault Localization (FL) is an essential step during the debugging process. With the strong capabilities of code comprehension, the recent Large Language Models (LLMs) have demonstrated promising performance in diagnosing bugs in the code. Nevertheless, due to LLMs' limited performance in handling long contexts, existing LLM-based fault localization remains on localizing bugs within a small code scope (i.e., a method or a class), which struggles to diagnose bugs for a large code scope (i.e., an entire software system). To address the limitation, this paper presents AgentFL, a multi-agent system based on ChatGPT for automated fault localization. By simulating the behavior of a human developer, AgentFL models the FL task as a three-step process, which involves comprehension, navigation, and confirmation. Within each step, AgentFL hires agents with diversified expertise, each of which utilizes different tools to handle specific tasks. Particularly, we adopt a series of auxiliary strategies such as Test Behavior Tracking, Document-Guided Search, and Multi-Round Dialogue to overcome the challenges in each step. The evaluation on the widely used Defects4J-V1.2.0 benchmark shows that AgentFL can localize 157 out of 395 bugs within Top-1, which outperforms the other LLM-based approaches and exhibits complementarity to the state-of-the-art learning-based techniques. Additionally, we confirm the indispensability of the components in AgentFL with the ablation study and demonstrate the usability of AgentFL through a user study. Finally, the cost analysis shows that AgentFL spends an average of only 0.074 dollars and 97 seconds for a single bug.


title: Non-relativistic stellar structure in the Fierz--Pauli theory and generic linear massive gravity

abstract: We study the structure of static spherical stars composed of non-relativistic matter in linear massive gravity with or without the Fierz-Pauli (FP) tuning. Adopting a polytropic equation of state, we construct master differential equations for the stellar profile function, which is fourth order in the FP theory or sixth order in generic non-FP theories, where the difference in the differential order reflects the presence of a ghost spin-0 graviton in the latter. In both cases, even when the spin-0 ghost is present, we find exact solutions with finite radius for the polytropic indices n = 0 and 1. Analyzing the dependences of the stellar radius, mass, and Yukawa charge on the graviton masses, we observe that a discontinuous behavior arises in the massless limit of the FP theory similarly to the van Dam-Veltman-Zakharov discontinuity, while it is absent in non-FP theories. We discuss rough observational constraints on the graviton masses.


title: On maximal subgroups of ample groups

abstract: The paper is concerned with maximal subgroups of the ample (better known as topological full) groups of homeomorphisms of totally disconnected compact metrizable topological spaces. We describe all maximal subgroups that are stabilizers of finite sets. Under certain assumptions on the ample group (including minimality), we describe all maximal subgroups that are stabilizers of closed sets or stabilizers of partitions into clopen sets. In particular, our results apply to the ample groups associated with Cantor minimal systems.


title: Generating Potent Poisons and Backdoors from Scratch with Guided Diffusion

abstract: Modern neural networks are often trained on massive datasets that are web scraped with minimal human inspection. As a result of this insecure curation pipeline, an adversary can poison or backdoor the resulting model by uploading malicious data to the internet and waiting for a victim to scrape and train on it. Existing approaches for creating poisons and backdoors start with randomly sampled clean data, called base samples, and then modify those samples to craft poisons. However, some base samples may be significantly more amenable to poisoning than others. As a result, we may be able to craft more potent poisons by carefully choosing the base samples. In this work, we use guided diffusion to synthesize base samples from scratch that lead to significantly more potent poisons and backdoors than previous state-of-the-art attacks. Our Guided Diffusion Poisoning (GDP) base samples can be combined with any downstream poisoning or backdoor attack to boost its effectiveness. Our implementation code is publicly available at: https://github.com/hsouri/GDP .


title: SE(3) Linear Parameter Varying Dynamical Systems for Globally Asymptotically Stable End-Effector Control

abstract: Linear Parameter Varying Dynamical Systems (LPV-DS) encode trajectories into an autonomous first-order DS that enables reactive responses to perturbations, while ensuring globally asymptotic stability at the target. However, the current LPV-DS framework is established on Euclidean data only and has not been applicable to broader robotic applications requiring pose control. In this paper we present an extension to the current LPV-DS framework, named Quaternion-DS, which efficiently learns a DS-based motion policy for orientation. Leveraging techniques from differential geometry and Riemannian statistics, our approach properly handles the non-Euclidean orientation data in quaternion space, enabling the integration with positional control, namely SE(3) LPV-DS, so that the synergistic behaviour within the full SE(3) pose is preserved. Through simulation and real robot experiments, we validate our method, demonstrating its ability to efficiently and accurately reproduce the original SE(3) trajectory while exhibiting strong robustness to perturbations in task space.


title: Quantum Networks Enhanced by Distributed Quantum Memories

abstract: Building large-scale quantum communication networks has its unique challenges. Here, we demonstrate that a network-wide synergistic usage of quantum memories distributed in a quantum communication network offers a fundamental advantage. We first map the problem of quantum communication with local usage of memories into a classical continuum percolation model. Then, we show that this mapping can be improved through a cooperation of entanglement distillation and relay protocols via remote access to distributed memories. This improved mapping, which we term $\alpha$-percolation, can be formulated in terms of graph-merging rules, analogous to the decimation rules of the renormalization group treatment of disordered quantum magnets. These rules can be performed in any order, yielding the same optimal result, which is characterized by the emergence of a ``positive feedback'' mechanism and the formation of spatially disconnected ``hopping'' communication components -- both marking significant improvements in quantum network connectivity.


title: Distilling Semantic Priors from SAM to Efficient Image Restoration Models

abstract: In image restoration (IR), leveraging semantic priors from segmentation models has been a common approach to improve performance. The recent segment anything model (SAM) has emerged as a powerful tool for extracting advanced semantic priors to enhance IR tasks. However, the computational cost of SAM is prohibitive for IR, compared to existing smaller IR models. The incorporation of SAM for extracting semantic priors considerably hampers the model inference efficiency. To address this issue, we propose a general framework to distill SAM's semantic knowledge to boost exiting IR models without interfering with their inference process. Specifically, our proposed framework consists of the semantic priors fusion (SPF) scheme and the semantic priors distillation (SPD) scheme. SPF fuses two kinds of information between the restored image predicted by the original IR model and the semantic mask predicted by SAM for the refined restored image. SPD leverages a self-distillation manner to distill the fused semantic priors to boost the performance of original IR models. Additionally, we design a semantic-guided relation (SGR) module for SPD, which ensures semantic feature representation space consistency to fully distill the priors. We demonstrate the effectiveness of our framework across multiple IR models and tasks, including deraining, deblurring, and denoising.


title: Learning Action-based Representations Using Invariance

abstract: Robust reinforcement learning agents using high-dimensional observations must be able to identify relevant state features amidst many exogeneous distractors. A representation that captures controllability identifies these state elements by determining what affects agent control. While methods such as inverse dynamics and mutual information capture controllability for a limited number of timesteps, capturing long-horizon elements remains a challenging problem. Myopic controllability can capture the moment right before an agent crashes into a wall, but not the control-relevance of the wall while the agent is still some distance away. To address this we introduce action-bisimulation encoding, a method inspired by the bisimulation invariance pseudometric, that extends single-step controllability with a recursive invariance constraint. By doing this, action-bisimulation learns a multi-step controllability metric that smoothly discounts distant state features that are relevant for control. We demonstrate that action-bisimulation pretraining on reward-free, uniformly random data improves sample efficiency in several environments, including a photorealistic 3D simulation domain, Habitat. Additionally, we provide theoretical analysis and qualitative results demonstrating the information captured by action-bisimulation.


title: GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation

abstract: This paper tackles a novel yet challenging problem: how to transfer knowledge from the emerging Segment Anything Model (SAM) -- which reveals impressive zero-shot instance segmentation capacity -- to learn a compact panoramic semantic segmentation model, i.e., student, without requiring any labeled data. This poses considerable challenges due to SAM's inability to provide semantic labels and the large capacity gap between SAM and the student. To this end, we propose a novel framework, called GoodSAM, that introduces a teacher assistant (TA) to provide semantic information, integrated with SAM to generate ensemble logits to achieve knowledge transfer. Specifically, we propose a Distortion-Aware Rectification (DAR) module that first addresses the distortion problem of panoramic images by imposing prediction-level consistency and boundary enhancement. This subtly enhances TA's prediction capacity on panoramic images. DAR then incorporates a cross-task complementary fusion block to adaptively merge the predictions of SAM and TA to obtain more reliable ensemble logits. Moreover, we introduce a Multi-level Knowledge Adaptation (MKA) module to efficiently transfer the multi-level feature knowledge from TA and ensemble logits to learn a compact student model. Extensive experiments on two benchmarks show that our GoodSAM achieves a remarkable +3.75\% mIoU improvement over the state-of-the-art (SOTA) domain adaptation methods. Also, our most lightweight model achieves comparable performance to the SOTA methods with only 3.7M parameters.


title: Uncovering Selective State Space Model's Capabilities in Lifelong Sequential Recommendation

abstract: Sequential Recommenders have been widely applied in various online services, aiming to model users' dynamic interests from their sequential interactions. With users increasingly engaging with online platforms, vast amounts of lifelong user behavioral sequences have been generated. However, existing sequential recommender models often struggle to handle such lifelong sequences. The primary challenges stem from computational complexity and the ability to capture long-range dependencies within the sequence. Recently, a state space model featuring a selective mechanism (i.e., Mamba) has emerged. In this work, we investigate the performance of Mamba for lifelong sequential recommendation (i.e., length>=2k). More specifically, we leverage the Mamba block to model lifelong user sequences selectively. We conduct extensive experiments to evaluate the performance of representative sequential recommendation models in the setting of lifelong sequences. Experiments on two real-world datasets demonstrate the superiority of Mamba. We found that RecMamba achieves performance comparable to the representative model while significantly reducing training duration by approximately 70% and memory costs by 80%. Codes and data are available at \url{https://github.com/nancheng58/RecMamba}.


title: SignSGD with Federated Voting

abstract: Distributed learning is commonly used for accelerating model training by harnessing the computational capabilities of multiple-edge devices. However, in practical applications, the communication delay emerges as a bottleneck due to the substantial information exchange required between workers and a central parameter server. SignSGD with majority voting (signSGD-MV) is an effective distributed learning algorithm that can significantly reduce communication costs by one-bit quantization. However, due to heterogeneous computational capabilities, it fails to converge when the mini-batch sizes differ among workers. To overcome this, we propose a novel signSGD optimizer with \textit{federated voting} (signSGD-FV). The idea of federated voting is to exploit learnable weights to perform weighted majority voting. The server learns the weights assigned to the edge devices in an online fashion based on their computational capabilities. Subsequently, these weights are employed to decode the signs of the aggregated local gradients in such a way to minimize the sign decoding error probability. We provide a unified convergence rate analysis framework applicable to scenarios where the estimated weights are known to the parameter server either perfectly or imperfectly. We demonstrate that the proposed signSGD-FV algorithm has a theoretical convergence guarantee even when edge devices use heterogeneous mini-batch sizes. Experimental results show that signSGD-FV outperforms signSGD-MV, exhibiting a faster convergence rate, especially in heterogeneous mini-batch sizes.


title: A new social welfare function with a number of desirable properties

abstract: By relaxing the dominating set in three ways (e.g., from "each member beats every non-member" to "each member beats or ties every non-member, with an additional requirement that at least one member beat every non-member"), we propose a new social welfare function, which satisfies a number of desirable properties including Condorcet winner principle, Condorcet loser principle, strong Gehrlein-stability (hence Smith set principle), anonymity, neutrality, weak Pareto, strong Pareto, non-dictatorship, and [independence of irrelevant alternatives (IIA) when the pairwise majority relation is an ordering on the alternative set]. If the pairwise majority relation is complete and transitive, the proposed method yields a collective preference relation that coincides with the input majority relation. It thus shares the same collective preference function on the dichotomous domain with the approval voting and the majority voting. It runs in polynomial time and thus possesses a competitive advantage over a number of computationally intractable voting rules such as the Dodgson's rule, the Kemeny's rule, the Slater's rule, the Banks rule, and the Schwartz's tournament equilibrium set (TEQ) rule. When it is used in tournaments, its winner belongs to the uncovered set, the top cycle set, the Smith set, and the Schwartz set. In addition, in a tournament where the number of alternatives is not more than 4, its winner set is a subset, sometimes proper, of the Copeland winner set. Whether this attractive argument is still valid in four-more-alternative tournaments remains an open question.


title: ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving

abstract: Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by vector-based attention, to provide map constraints for social interaction and multi-modal differentiation. However, these methods have to encode all required map rules into the focal agent's feature, so as to retain all possible intentions' paths while at the meantime to adapt to potential social interaction. In this work, a progressive interaction network is proposed to enable the agent's feature to progressively focus on relevant maps, in order to better learn agents' feature representation capturing the relevant map constraints. The network progressively encode the complex influence of map constraints into the agent's feature through graph convolutions at the following three stages: after historical trajectory encoder, after social interaction, and after multi-modal differentiation. In addition, a weight allocation mechanism is proposed for multi-modal training, so that each mode can obtain learning opportunities from a single-mode ground truth. Experiments have validated the superiority of progressive interactions to the existing one-stage interaction, and demonstrate the effectiveness of each component. Encouraging results were obtained in the challenging benchmarks.


title: A Monte Carlo Simulation of the Broad Band X-ray Emission of the Accreting Millisecond X-ray pulsar MAXI J1816-195

abstract: MAXI J1816-195 is an accreting millisecond X-ray pulsar (AMXP) discovered in 2022. According to the Insight-HXMT data, the pulsations of this source extend all the way to over 100 keV, and its pulse profiles change from a single peak in low-energy range to double peaks in high-energy range. In this work, we simulate its energy spectra and pulse profiles with a Compton scattering Monte Carlo program. The simulation results suggest that the low energy X-ray source on the neutron star surface should be pencil-beamed radiations from the magnetic poles, and there should be a boundary layer in a hollow cylinder shape between the accretion disc and the neutron star surface: the up-scattering of the polar radiations in the boundary layer leads to the double peak structure of the high-energy pulse profile. Under this boundary layer geometry, we suggest that the rarity of AMXPs can be caused by the smearing of the boundary layer. To estimate the mass M and radius R of accretion-powered millisecond pulsars whose surface radiations are badly polluted by the accretion disk and boundary layer, the impact of Compton scattering in the boundary layer on the radiation should be removed before employing the X-ray pulse profile modeling method.


title: Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusion

abstract: 360 depth estimation has recently received great attention for 3D reconstruction owing to its omnidirectional field of view (FoV). Recent approaches are predominantly focused on cross-projection fusion with geometry-based re-projection: they fuse 360 images with equirectangular projection (ERP) and another projection type, e.g., cubemap projection to estimate depth with the ERP format. However, these methods suffer from 1) limited local receptive fields, making it hardly possible to capture large FoV scenes, and 2) prohibitive computational cost, caused by the complex cross-projection fusion module design. In this paper, we propose Elite360D, a novel framework that inputs the ERP image and icosahedron projection (ICOSAP) point set, which is undistorted and spatially continuous. Elite360D is superior in its capacity in learning a representation from a local-with-global perspective. With a flexible ERP image encoder, it includes an ICOSAP point encoder, and a Bi-projection Bi-attention Fusion (B2F) module (totally ~1M parameters). Specifically, the ERP image encoder can take various perspective image-trained backbones (e.g., ResNet, Transformer) to extract local features. The point encoder extracts the global features from the ICOSAP. Then, the B2F module captures the semantic- and distance-aware dependencies between each pixel of the ERP feature and the entire ICOSAP feature set. Without specific backbone design and obvious computational cost increase, Elite360D outperforms the prior arts on several benchmark datasets.


title: Real-time Adaptation for Condition Monitoring Signal Prediction using Label-aware Neural Processes

abstract: Building a predictive model that rapidly adapts to real-time condition monitoring (CM) signals is critical for engineering systems/units. Unfortunately, many current methods suffer from a trade-off between representation power and agility in online settings. For instance, parametric methods that assume an underlying functional form for CM signals facilitate efficient online prediction updates. However, this simplification leads to vulnerability to model specifications and an inability to capture complex signals. On the other hand, approaches based on over-parameterized or non-parametric models can excel at explaining complex nonlinear signals, but real-time updates for such models pose a challenging task. In this paper, we propose a neural process-based approach that addresses this trade-off. It encodes available observations within a CM signal into a representation space and then reconstructs the signal's history and evolution for prediction. Once trained, the model can encode an arbitrary number of observations without requiring retraining, enabling on-the-spot real-time predictions along with quantified uncertainty and can be readily updated as more online data is gathered. Furthermore, our model is designed to incorporate qualitative information (i.e., labels) from individual units. This integration not only enhances individualized predictions for each unit but also enables joint inference for both signals and their associated labels. Numerical studies on both synthetic and real-world data in reliability engineering highlight the advantageous features of our model in real-time adaptation, enhanced signal prediction with uncertainty quantification, and joint prediction for labels and signals.


title: Play to Your Strengths: Collaborative Intelligence of Conventional Recommender Models and Large Language Models

abstract: The rise of large language models (LLMs) has opened new opportunities in Recommender Systems (RSs) by enhancing user behavior modeling and content understanding. However, current approaches that integrate LLMs into RSs solely utilize either LLM or conventional recommender model (CRM) to generate final recommendations, without considering which data segments LLM or CRM excel in. To fill in this gap, we conduct experiments on MovieLens-1M and Amazon-Books datasets, and compare the performance of a representative CRM (DCNv2) and an LLM (LLaMA2-7B) on various groups of data samples. Our findings reveal that LLMs excel in data segments where CRMs exhibit lower confidence and precision, while samples where CRM excels are relatively challenging for LLM, requiring substantial training data and a long training time for comparable performance. This suggests potential synergies in the combination between LLM and CRM. Motivated by these insights, we propose Collaborative Recommendation with conventional Recommender and Large Language Model (dubbed \textit{CoReLLa}). In this framework, we first jointly train LLM and CRM and address the issue of decision boundary shifts through alignment loss. Then, the resource-efficient CRM, with a shorter inference time, handles simple and moderate samples, while LLM processes the small subset of challenging samples for CRM. Our experimental results demonstrate that CoReLLa outperforms state-of-the-art CRM and LLM methods significantly, underscoring its effectiveness in recommendation tasks.