title: Designing topology and fractionalization in narrow gap semiconductor films via electrostatic engineering

abstract: We show that topological flat minibands can be engineered in a class of narrow gap semiconductor films using only an external electrostatic superlattice potential. We demonstrate that, for realistic material parameters, these bands are capable of hosting correlated topological phases such as integer and fractional quantum anomalous Hall states and composite Fermi liquid phases at zero magnetic field. Our results provide a path towards the realization of fractionalized topological states in a broad range of materials.


title: Dual Lagrangian Learning for Conic Optimization

abstract: This paper presents Dual Lagrangian Learning (DLL), a principled learning methodology for dual conic optimization proxies. DLL leverages conic duality and the representation power of ML models to provide high-duality, dual-feasible solutions, and therefore valid Lagrangian dual bounds, for linear and nonlinear conic optimization problems. The paper introduces a systematic dual completion procedure, differentiable conic projection layers, and a self-supervised learning framework based on Lagrangian duality. It also provides closed-form dual completion formulae for broad classes of conic problems, which eliminate the need for costly implicit layers. The effectiveness of DLL is demonstrated on linear and nonlinear conic optimization problems. The proposed methodology significantly outperforms a state-of-the-art learning-based method, and achieves 1000x speedups over commercial interior-point solvers with optimality gaps under 0.5\% on average.


title: XNLP-hardness of Parameterized Problems on Planar Graphs

abstract: The class XNLP consists of (parameterized) problems that can be solved nondeterministically in $f(k)n^{O(1)}$ time and $f(k)\log n$ space, where $n$ is the size of the input instance and $k$ the parameter. The class XALP consists of problems that can be solved in the above time and space with access to an additional stack. These two classes are a "natural home" for many standard graph problems and their generalizations. In this paper, we show the hardness of several problems on planar graphs, parameterized by outerplanarity, treewidth and pathwidth, thus strengthening several existing results. In particular, we show the XNLP-hardness of the following problems parameterized by outerplanarity: All-or-Nothing Flow, Target Outdegree Orientation, Capacitated (Red-Blue) Dominating Set, Target Set Selections etc. We also show the XNLP-completeness of Scattered Set parameterized by pathwidth and XALP-completeness parameterized by treewidth and outerplanarity.


title: Locally unitary quantum state evolution is local

abstract: We study the localization properties of bipartite channels, whose action on a subsystem yields a unitary channel. In particular we show that, under such channel, the subsystem must evolve independent of its environment. This point of view is another way to verify certain well-known conservation laws of quantum information in a generalized way. A no-go theorem for non classical conditional semantics in quantum computation is obtained as an intermediate result.


title: Increasing TeraHertz spintronic emission with planar antennas

abstract: Spintronic THz emitters, consisting of Ta/Co/Pt trilayers patterned into rectangles of lateral size in the 10 ${\mu}$m range, have been integrated in planar electromagnetic antennas of various types (dipole, bow-tie, spiral). Antenna dimensions and shapes have been optimized with the help of electromagnetic simulations so as to maximize antenna efficiency in both narrow-band and broad-band geometries at/around 1 THz. The THz emission has been studied using a pump probe free space electro-optic sampling set up, both for a single emitter geometry and for arrays of emitters. Results show an increase of the detected THz signal for all antenna geometries, with enhancement ratios in the range of three to fifteen depending on antenna type and frequency range, together with changes of the emission bandwidth consistent with simulated characteristics.


title: Sampling in quasi shift-invariant spaces and Gabor frames generated by ratios of exponential polynomials

abstract: We introduce two families of generators (functions) $\mathcal{G}$ that consist of entire and meromorphic functions enjoying a certain periodicity property and contain the classical Gaussian and hyperbolic secant generators. Sharp results are proved on the density of separated sets that provide non-uniform sampling for the shift-invariant and quasi shift-invariant spaces generated by elements of these families. As an application, we obtain new sharp results on the density of semi-regular lattices for the Gabor frames generated by elements from these families.


title: Optimal rate of convergence in periodic homogenization of viscous Hamilton-Jacobi equations

abstract: We study the optimal rate of convergence in periodic homogenization of the viscous Hamilton-Jacobi equation $u^\varepsilon_t + H(\frac{x}{\varepsilon},Du^\varepsilon) = \varepsilon \Delta u^\varepsilon$ in $\mathbb R^n\times (0,\infty)$ subject to a given initial datum. We prove that $\|u^\varepsilon-u\|_{L^\infty(\mathbb R^n \times [0,T])} \leq C(1+T) \sqrt{\varepsilon}$ for any given $T>0$, where $u$ is the viscosity solution of the effective problem. Moreover, we show that the $O(\sqrt{\varepsilon})$ rate is optimal for a natural class of $H$ and a Lipschitz continuous initial datum, both theoretically and through numerical experiments. It remains an interesting question to investigate whether the convergence rate can be improved when $H$ is uniformly convex. Finally, we propose a numerical scheme for the approximation of the effective Hamiltonian based on a finite element approximation of approximate corrector problems.


title: Asynchronous dynamics of isomorphic Boolean networks

abstract: A Boolean network is a function $f:\{0,1\}^n\to\{0,1\}^n$ from which several dynamics can be derived, depending on the context. The most classical ones are the synchronous and asynchronous dynamics. Both are digraphs on $\{0,1\}^n$, but the synchronous dynamics (which is identified with $f$) has an arc from $x$ to $f(x)$ while the asynchronous dynamics $\mathcal{A}(f)$ has an arc from $x$ to $x+e_i$ whenever $x_i\neq f_i(x)$. Clearly, $f$ and $\mathcal{A}(f)$ share the same information, but what can be said on these objects up to isomorphism? We prove that if $\mathcal{A}(f)$ is only known up to isomorphism then, with high probability, $f$ can be fully reconstructed up to isomorphism. We then show that the converse direction is far from being true. In particular, if $f$ is only known up to isomorphism, very little can be said on the attractors of $\mathcal{A}(f)$. For instance, if $f$ has $p$ fixed points, then $\mathcal{A}(f)$ has at least $\max(1,p)$ attractors, and we prove that this trivial lower bound is tight: there always exists $h\sim f$ such that $\mathcal{A}(h)$ has exactly $\max(1,p)$ attractors. But $\mathcal{A}(f)$ may often have much more attractors since we prove that, with high probability, there exists $h\sim f$ such that $\mathcal{A}(h)$ has $\Omega(2^n)$ attractors.


title: AI-Enhanced Virtual Reality in Medicine: A Comprehensive Survey

abstract: With the rapid advance of computer graphics and artificial intelligence technologies, the ways we interact with the world have undergone a transformative shift. Virtual Reality (VR) technology, aided by artificial intelligence (AI), has emerged as a dominant interaction media in multiple application areas, thanks to its advantage of providing users with immersive experiences. Among those applications, medicine is considered one of the most promising areas. In this paper, we present a comprehensive examination of the burgeoning field of AI-enhanced VR applications in medical care and services. By introducing a systematic taxonomy, we meticulously classify the pertinent techniques and applications into three well-defined categories based on different phases of medical diagnosis and treatment: Visualization Enhancement, VR-related Medical Data Processing, and VR-assisted Intervention. This categorization enables a structured exploration of the diverse roles that AI-powered VR plays in the medical domain, providing a framework for a more comprehensive understanding and evaluation of these technologies. To our best knowledge, this is the first systematic survey of AI-powered VR systems in medical settings, laying a foundation for future research in this interdisciplinary domain.


title: Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detector

abstract: This paper studies the challenging cross-domain few-shot object detection (CD-FSOD), aiming to develop an accurate object detector for novel domains with minimal labeled examples. While transformer-based open-set detectors, such as DE-ViT, show promise in traditional few-shot object detection, their generalization to CD-FSOD remains unclear: 1) can such open-set detection methods easily generalize to CD-FSOD? 2) If not, how can models be enhanced when facing huge domain gaps? To answer the first question, we employ measures including style, inter-class variance (ICV), and indefinable boundaries (IB) to understand the domain gap. Based on these measures, we establish a new benchmark named CD-FSOD to evaluate object detection methods, revealing that most of the current approaches fail to generalize across domains. Technically, we observe that the performance decline is associated with our proposed measures: style, ICV, and IB. Consequently, we propose several novel modules to address these issues. First, the learnable instance features align initial fixed instances with target categories, enhancing feature distinctiveness. Second, the instance reweighting module assigns higher importance to high-quality instances with slight IB. Third, the domain prompter encourages features resilient to different styles by synthesizing imaginary domains without altering semantic contents. These techniques collectively contribute to the development of the Cross-Domain Vision Transformer for CD-FSOD (CD-ViTO), significantly improving upon the base DE-ViT. Experimental results validate the efficacy of our model. All datasets, codes, and models will be released to the community.


title: Transcending Adversarial Perturbations: Manifold-Aided Adversarial Examples with Legitimate Semantics

abstract: Deep neural networks were significantly vulnerable to adversarial examples manipulated by malicious tiny perturbations. Although most conventional adversarial attacks ensured the visual imperceptibility between adversarial examples and corresponding raw images by minimizing their geometric distance, these constraints on geometric distance led to limited attack transferability, inferior visual quality, and human-imperceptible interpretability. In this paper, we proposed a supervised semantic-transformation generative model to generate adversarial examples with real and legitimate semantics, wherein an unrestricted adversarial manifold containing continuous semantic variations was constructed for the first time to realize a legitimate transition from non-adversarial examples to adversarial ones. Comprehensive experiments on MNIST and industrial defect datasets showed that our adversarial examples not only exhibited better visual quality but also achieved superior attack transferability and more effective explanations for model vulnerabilities, indicating their great potential as generic adversarial examples. The code and pre-trained models were available at https://github.com/shuaili1027/MAELS.git.


title: The $\theta$-dependence of the Yang-Mills spectrum from analytic continuation

abstract: We study the $\theta$-dependence of the string tension and of the lightest glueball mass in four-dimensional $\mathrm{SU}(N)$ Yang-Mills theories. More precisely, we focus on the coefficients parametrizing the $\mathcal{O}(\theta^2)$ dependence of these quantities, which we investigate by means of numerical simulations of the lattice-discretized theory, carried out using imaginary values of the $\theta$ parameter. Topological freezing at large $N$ is avoided using the Parallel Tempering on Boundary Conditions algorithm. We provide controlled continuum extrapolations of such coefficients in the $N=3$ case, and we report the results obtained on two fairly fine lattice spacings for $N=6$.


title: Renormalization of conformal infinity as a stretched horizon

abstract: In this paper, we provide a comprehensive study of asymptotically flat spacetime in even dimensions $d\geq 4$. We analyze the most general boundary condition and asymptotic symmetry compatible with Penrose's definition of asymptotic null infinity $\mathscr{I}$ through conformal compactification. Following Penrose's prescription and using a minimal version of the Bondi-Sachs gauge, we show that $\mathscr{I}$ is naturally equipped with a Carrollian stress tensor whose radial derivative defines the asymptotic Weyl tensor. This analysis describes asymptotic infinity as a stretched horizon in the conformally compactified spacetime. We establish that charge aspects conservation can be written as Carrollian Bianchi identities for the asymptotic Weyl tensor. We then provide a covariant renormalization for the asymptotic symplectic potential, which results in a finite symplectic flux and asymptotic charges. The renormalization scheme works even in the presence of logarithmic anomalies.


title: The Eigenvalue Problem for the Complex Hessian Operator on $m$-Pseudoconvex Manifolds

abstract: We establish $C^{1,1}$-regularity and uniqueness of the first eigenfunction of the complex Hessian operator on strongly $m$-pseudoconvex manifolds, along with a variational formula for the first eigenvalue. From these results, we derive a number of applications, including a bifurcation-type theorem and geometric bounds for the eigenvalue.


title: Intent-based Prompt Calibration: Enhancing prompt optimization with synthetic boundary cases

abstract: Prompt engineering is a challenging and important task due to the high sensitivity of Large Language Models (LLMs) to the given prompt and the inherent ambiguity of a textual task instruction. Automatic prompt engineering is essential to achieve optimized performance from LLMs. Recent studies have demonstrated the capabilities of LLMs to automatically conduct prompt engineering by employing a meta-prompt that incorporates the outcomes of the last trials and proposes an improved prompt. However, this requires a high-quality benchmark to compare different prompts, which is difficult and expensive to acquire in many real-world use cases. In this work, we introduce a new method for automatic prompt engineering, using a calibration process that iteratively refines the prompt to the user intent. During the optimization process, the system jointly generates synthetic data of boundary use cases and optimizes the prompt according to the generated dataset. We demonstrate the effectiveness of our method with respect to strong proprietary models on real-world tasks such as moderation and generation. Our method outperforms state-of-the-art methods with a limited number of annotated samples. Furthermore, we validate the advantages of each one of the system's key components. Our system is built in a modular way, facilitating easy adaptation to other tasks. The code is available $\href{https://github.com/Eladlev/AutoPrompt}{here}$.


title: Inter-city infections and the role of size heterogeneity in containment strategies

abstract: Our goal is to compare the efficiency of strategies applied on a regional scale to control the spread of a pathogen between urban units, in the following called cities. We model the infection dynamics on a random network where each node represents a city. We take the size of a city as a parameter for its connectivity to other cities. Once a certain threshold number of citizens in a city gets infected the city is isolated to prevent further spread. We consider two different strategies to define the threshold depending on the city size. In strategy $(P)$ a proportion $p$ of citizens need to get infected before isolation, while in strategy $(U)$ an uniform threshold $L$ is chosen for all cities. If city sizes were constant both strategies would coincide. However, in reality city size distributions are heavy-tailed. In this case in strategy $(P)$ the infection of a large city can lead to a much larger number of secondary infections of cities than in strategy $(U)$. To quantify the extend to which these infections fuel the epidemic we benchmark the two strategies against each other by comparing the number of individuals that get isolated when the number of individuals that get infected is under both strategies the same. Furthermore, we define and determine a basic reproduction numbers $R^{(U)}_0$ and $R^{(P)}$ for variant (P) and (U) that represent the initial strengths at which the infection spreads between cities. We fit our model to mobility data from France, Japan and Poland to identify the parameter regimes of our model that are empirically relevant. Furthermore, we investigate by means of simulations to which extend the geographic structure of the city distribution (that we neglect in our model) influences the infection dynamics between cities.


title: A flow approach to the generalized KPZ equation

abstract: We show that the flow approach of Duch [Duc21] can be adapted to prove local well-posedness for the generalised KPZ equation. The key step is to extend the flow approach so that it can accommodate semilinear equations involving smooth functions of the solution instead of only polynomials - this is accomplished by introducing coordinates for the flow built out of the elementary differentials associated to the equation.


title: Electron Paramagnetic Resonance spectroscopy of a scheelite crystal using microwave photon counting

abstract: Counting the microwave photons emitted by an ensemble of electron spins when they relax radiatively has recently been introduced as a sensitive new method for electron paramagnetic resonance spectroscopy at millikelvin temperatures. Here, we apply this spin fluorescence method to a scheelite crystal of CaWO4, finding some known ($\mathrm{Er}^{3+}$, $\mathrm{Yb}^{3+}$, $\mathrm{Nd}^{3+}$ and $\mathrm{Fe}^{3+}$) and other unknown paramagnetic impurities. Investigating the zero nuclear spin isotope ($I=0$) transition of $\mathrm{Er}^{3+}:\mathrm{CaWO}_4$ as a model system, we provide a quantitative analysis of the time-dependent photon counting rate following an excitation pulse, as a function of its power. The achieved signal-to-noise ratio is found to be an order of magnitude higher than the one obtained by inductively-detected Hahn echo under identical conditions. Finally, we use spin fluorescence spectroscopy at low excitation power to probe the properties of rare-earth-ions close to a metallic wire deposited on the surface; our data reveal line distortion caused by the mechanical strain imparted by the thermal contractions of the metal relative to the underlying crystal. Coherent oscillations are also observed for the most highly strained ions.


title: Scoped Effects as Parameterized Algebraic Theories

abstract: Notions of computation can be modelled by monads. Algebraic effects offer a characterization of monads in terms of algebraic operations and equational axioms, where operations are basic programming features, such as reading or updating the state, and axioms specify observably equivalent expressions. However, many useful programming features depend on additional mechanisms such as delimited scopes or dynamically allocated resources. Such mechanisms can be supported via extensions to algebraic effects including scoped effects and parameterized algebraic theories. We present a fresh perspective on scoped effects by translation into a variation of parameterized algebraic theories. The translation enables a new approach to equational reasoning for scoped effects and gives rise to an alternative characterization of monads in terms of generators and equations involving both scoped and algebraic operations. We demonstrate the power of our fresh perspective by way of equational characterizations of several known models of scoped effects.


title: High-dimensional Bayesian Optimization via Covariance Matrix Adaptation Strategy

abstract: Bayesian Optimization (BO) is an effective method for finding the global optimum of expensive black-box functions. However, it is well known that applying BO to high-dimensional optimization problems is challenging. To address this issue, a promising solution is to use a local search strategy that partitions the search domain into local regions with high likelihood of containing the global optimum, and then use BO to optimize the objective function within these regions. In this paper, we propose a novel technique for defining the local regions using the Covariance Matrix Adaptation (CMA) strategy. Specifically, we use CMA to learn a search distribution that can estimate the probabilities of data points being the global optimum of the objective function. Based on this search distribution, we then define the local regions consisting of data points with high probabilities of being the global optimum. Our approach serves as a meta-algorithm as it can incorporate existing black-box BO optimizers, such as BO, TuRBO, and BAxUS, to find the global optimum of the objective function within our derived local regions. We evaluate our proposed method on various benchmark synthetic and real-world problems. The results demonstrate that our method outperforms existing state-of-the-art techniques.


title: Reply to: Effects of density and temperature variations on the metallicity of Mrk 71

abstract: In Chen et al., 2023 (C23; arXiv:2304.09898), we introduced a new method to directly measure temperature fluctuations and applied it to a nearby dwarf galaxy, Mrk 71, finding a temperature fluctuation parameter $t^2 = 0.008\pm 0.043$. This result is lower by $\sim 2\sigma$ than the value required to explain the abundance discrepancy (AD) in this object. In the Matters Arising article submitted by Mendez-Delgado et al. (arXiv:2310.01197), the authors claim that using the same data presented in C23 in a different way, it is possible to conclude that the measurements are consistent with a larger $t^2 \simeq 0.1$ inferred indirectly from recombination lines (RLs). However, this requires a higher density such that the infrared [O III] 52 $\mu$m and [O III] 88 $\mu$m lines -- which form the basis of the direct measurement method -- are mutually inconsistent. Moreover, to reach agreement between the direct $t^2$ measurement and the larger $t^2$ value inferred from RLs requires systematically varying four parameters by $\sim 1\sigma$ from their best-determined values, which collectively amount to a $\sim2\sigma$ difference, consistent with the significance ($\sim 2 \sigma$) originally reported in C23. Therefore, we conclude that the results of C23 hold, and that the combined optical and infrared [O III] data disfavour $t^2 \simeq 0.1$ at the $\approx2\sigma$ level in Mrk 71. Future work is nonetheless warranted to better understand the AD associated with both optical and infrared emission line analysis.


title: DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media

abstract: Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media. Existing ToF rendering works have demonstrated notable results, yet they struggle with scenes involving scattering media and camera-warped settings. Other steady-state volumetric rendering methods exhibit significant bias or variance when directly applied to ToF rendering tasks. To address these challenges, we integrate transient diffusion theory into path construction and propose novel sampling methods for free-path distance and scattering direction, via resampled importance sampling and offline tabulation. An elliptical sampling method is further adapted to provide controllable vertex connection satisfying any required photon traversal time. In contrast to the existing temporal uniform sampling strategy, our method is the first to consider the contribution of transient radiance to importance-sample the full path, and thus enables improved temporal path construction under multiple scattering settings. The proposed method can be integrated into both path tracing and photon-based frameworks, delivering significant improvements in quality and efficiency with at least a 5x MSE reduction versus SOTA methods in equal rendering time.


title: Groups generated by pattern avoiding permutations

abstract: We study groups generated by sets of pattern avoiding permutations. In the first part of the paper we prove some general results concerning the structure of such groups. In the second part we carry out a case-by-case analysis of groups generated by permutations avoiding few short patterns.


title: Perceived Vulnerability to Disease Scale: Factorial structure, reliability, and validity in times of Portugal's COVID-19 pandemic lockdown

abstract: The present study examines the factor structure of a Portuguese version of the Perceived Vulnerability to Disease Scale (PVD), designed to assess individual differences in chronic concerns about transmission of infectious diseases. Method: Data from a Portuguese convenience sample (n=1203), collected during the first Covid-19 pandemic lockdown. Results: the scale revealed, through an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA), a slight superiority of a three-factor model over the existing two-factor models of the 15-item original PVD and of the 10-item PVD established with another Portuguese sample (Ferreira et al., 2022). Conclusions: This higher level of differentiation in terms of a perceived resistance to infectious diseases could be explained by the pandemic context which may have differentiated the responses regarding the perception of Resistance. On the other hand, this new factor increases the comprehensive and evaluative dimension and implications of the construct assessed by PVD.


title: Computing with Clocks

abstract: Clocks are a central part of many computing paradigms, and are mainly used to synchronise the delicate operation of switching, necessary to drive modern computational processes. Unfortunately, this synchronisation process is reaching a natural ``apocalypse''. No longer can clock scaling be used as a blunt tool to accelerate computation, we are up against the natural limits of switching and synchronisation across large processors. Therefore, we need to rethink how time is utilised in computation, using it more naturally in the role of representing data. This can be achieved by using a time interval delineated by discrete start and end events, and by re-casting computational operations into the time domain. With this, computer systems can be developed that are naturally scaleable in time and space, and can use ambient time references built to the best effort of the available technology. Our ambition is to better manage the energy/computation time trade-off, and to explicitly embed the resolution of the data in the time domain. We aim to recast calculations into the ``for free'' format that time offers, and in addition, perform these calculations at the highest clock or oscillator resolution possible.


title: Non-Stationary Latent Auto-Regressive Bandits

abstract: We consider the stochastic multi-armed bandit problem with non-stationary rewards. We present a novel formulation of non-stationarity in the environment where changes in the mean reward of the arms over time are due to some unknown, latent, auto-regressive (AR) state of order $k$. We call this new environment the latent AR bandit. Different forms of the latent AR bandit appear in many real-world settings, especially in emerging scientific fields such as behavioral health or education where there are few mechanistic models of the environment. If the AR order $k$ is known, we propose an algorithm that achieves $\tilde{O}(k\sqrt{T})$ regret in this setting. Empirically, our algorithm outperforms standard UCB across multiple non-stationary environments, even if $k$ is mis-specified.


title: Computing roadmaps in unbounded smooth real algebraic sets II: algorithm and complexity

abstract: A roadmap for an algebraic set $V$ defined by polynomials with coefficients in some real field, say $\mathbb{R}$, is an algebraic curve contained in $V$ whose intersection with all connected components of $V\cap\mathbb{R}^{n}$ is connected. These objects, introduced by Canny, can be used to answer connectivity queries over $V\cap \mathbb{R}^{n}$ provided that they are required to contain the finite set of query points $\mathcal{P}\subset V$; in this case,we say that the roadmap is associated to $(V, \mathcal{P})$. In this paper, we make effective a connectivity result we previously proved, to design a Monte Carlo algorithm which, on input (i) a finite sequence of polynomials defining $V$ (and satisfying some regularity assumptions) and (ii) an algebraic representation of finitely many query points $\mathcal{P}$ in $V$, computes a roadmap for $(V, \mathcal{P})$. This algorithm generalizes the nearly optimal one introduced by the last two authors by dropping a boundedness assumption on the real trace of $V$. The output size and running times of our algorithm are both polynomial in $(nD)^{n\log d}$, where $D$ is the maximal degree of the input equations and $d$ is the dimension of $V$. As far as we know, the best previously known algorithm dealing with such sets has an output size and running time polynomial in $(nD)^{n\log^2 n}$.


title: Infrared Spectra Prediction for Diazo Groups Utilizing a Machine Learning Approach with Structural Attention Mechanism

abstract: Infrared (IR) spectroscopy is a pivotal technique in chemical research for elucidating molecular structures and dynamics through vibrational and rotational transitions. However, the intricate molecular fingerprints characterized by unique vibrational and rotational patterns present substantial analytical challenges. Here, we present a machine learning approach employing a Structural Attention Mechanism tailored to enhance the prediction and interpretation of infrared spectra, particularly for diazo compounds. Our model distinguishes itself by honing in on chemical information proximal to functional groups, thereby significantly bolstering the accuracy, robustness, and interpretability of spectral predictions. This method not only demystifies the correlations between infrared spectral features and molecular structures but also offers a scalable and efficient paradigm for dissecting complex molecular interactions.


title: Optimal sampling for stochastic and natural gradient descent

abstract: We consider the problem of optimising the expected value of a loss functional over a nonlinear model class of functions, assuming that we have only access to realisations of the gradient of the loss. This is a classical task in statistics, machine learning and physics-informed machine learning. A straightforward solution is to replace the exact objective with a Monte Carlo estimate before employing standard first-order methods like gradient descent, which yields the classical stochastic gradient descent method. But replacing the true objective with an estimate ensues a ``generalisation error''. Rigorous bounds for this error typically require strong compactness and Lipschitz continuity assumptions while providing a very slow decay with sample size. We propose a different optimisation strategy relying on a natural gradient descent in which the true gradient is approximated in local linearisations of the model class via (quasi-)projections based on optimal sampling methods. Under classical assumptions on the loss and the nonlinear model class, we prove that this scheme converges almost surely monotonically to a stationary point of the true objective and we provide convergence rates.


title: Augmenting Security and Privacy in the Virtual Realm: An Analysis of Extended Reality Devices

abstract: In this work, we present a device-centric analysis of security and privacy attacks and defenses on Extended Reality (XR) devices, highlighting the need for robust and privacy-aware security mechanisms. Based on our analysis, we present future research directions and propose design considerations to help ensure the security and privacy of XR devices.


title: Discovering interpretable models of scientific image data with deep learning

abstract: How can we find interpretable, domain-appropriate models of natural phenomena given some complex, raw data such as images? Can we use such models to derive scientific insight from the data? In this paper, we propose some methods for achieving this. In particular, we implement disentangled representation learning, sparse deep neural network training and symbolic regression, and assess their usefulness in forming interpretable models of complex image data. We demonstrate their relevance to the field of bioimaging using a well-studied test problem of classifying cell states in microscopy data. We find that such methods can produce highly parsimonious models that achieve $\sim98\%$ of the accuracy of black-box benchmark models, with a tiny fraction of the complexity. We explore the utility of such interpretable models in producing scientific explanations of the underlying biological phenomenon.


title: Feature-Action Design Patterns for Storytelling Visualizations with Time Series Data

abstract: We present a method to create storytelling visualization with time series data. Many personal decisions nowadays rely on access to dynamic data regularly, as we have seen during the COVID-19 pandemic. It is thus desirable to construct storytelling visualization for dynamic data that is selected by an individual for a specific context. Because of the need to tell data-dependent stories, predefined storyboards based on known data cannot accommodate dynamic data easily nor scale up to many different individuals and contexts. Motivated initially by the need to communicate time series data during the COVID-19 pandemic, we developed a novel computer-assisted method for meta-authoring of stories, which enables the design of storyboards that include feature-action patterns in anticipation of potential features that may appear in dynamically arrived or selected data. In addition to meta-storyboards involving COVID-19 data, we also present storyboards for telling stories about progress in a machine learning workflow. Our approach is complementary to traditional methods for authoring storytelling visualization, and provides an efficient means to construct data-dependent storyboards for different data-streams of similar contexts.


abstract: We have studied the mass spectra of the P-wave fully charm and fully bottom tetraquark states in the framework of QCD sum rules. We construct the interpolating currents by inserting the covariant derivative operator $\overset{ \leftrightarrow } { \mathcal D }_{ \mu }$ between the S-wave diquark and antidiquark fields. The excitation structures show that the pure $\lambda$-mode excited P-wave fully heavy tetraquarks exist for the quantum numbers $J^{PC}=1^{--}, 1^{-+}, 2^{--}, 2^{-+}$ and $3^{--}$, while it is difficult to separate the $\lambda$-mode and $\rho$-mode excitations in the $0^{-+}$ channel. Within three Lorentz indices, there is no pure $\lambda$-mode excited P-wave fully charm/bottom tetraquark operators with $J^{PC}=0^{--}$ and $3^{-+}$. Our results support that the recent observed $X(6900)$ and $X(7200)$ resonances could be interpreted as the P-wave fully charm $cc \bar c \bar c$ tetraquark states with $J^{PC}=1^{-+}$ and $2^{-+}$, respectively. Some P-wave fully bottom $bb\bar b\bar b$ tetraquark states are predicted to be lower than the di-$\eta_b(1S)$ and di-$\Upsilon(1S)$ mass thresholds. Hopefully our calculations will be useful for identifying the nature of new exotic tetraquark states.


title: Integrating Random Regret Minimization-Based Discrete Choice Models with Mixed Integer Linear Programming for Revenue Optimization

abstract: This paper explores the critical domain of Revenue Management (RM) within Operations Research (OR), focusing on intricate pricing dynamics. Utilizing Mixed Integer Linear Programming (MILP) models, the study enhances revenue optimization by considering product prices as decision variables and emphasizing the interplay between demand and supply. Recent advancements in Discrete Choice Models (DCMs), particularly those rooted in Random Regret Minimization (RRM) theory, are investigated as potent alternatives to established Random Utility Maximization (RUM) based DCMs. Despite the widespread use of DCMs in RM, a significant gap exists between cutting-edge RRM-based models and their practical integration into RM strategies. The study addresses this gap by incorporating an advanced RRM-based DCM into MILP models, addressing pricing challenges in both capacitated and uncapacitated supply scenarios. The developed models demonstrate feasibility and offer diverse interpretations of consumer choice behavior, drawing inspiration from established RUM-based frameworks. This research contributes to bridging the existing gap in the application of advanced DCMs within practical RM implementations.


title: Good Teachers Explain: Explanation-Enhanced Knowledge Distillation

abstract: Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they nonetheless often do not learn the same function. It is, however, often highly desirable that the student's and teacher's functions share similar properties such as basing the prediction on the same input features, as this ensures that students learn the 'right features' from the teachers. In this work, we explore whether this can be achieved by not only optimizing the classic KD loss but also the similarity of the explanations generated by the teacher and the student. Despite the idea being simple and intuitive, we find that our proposed 'explanation-enhanced' KD (e$^2$KD) (1) consistently provides large gains in terms of accuracy and student-teacher agreement, (2) ensures that the student learns from the teacher to be right for the right reasons and to give similar explanations, and (3) is robust with respect to the model architectures, the amount of training data, and even works with 'approximate', pre-computed explanations.


title: Cosmography with next-generation gravitational wave detectors

abstract: Advancements in cosmology through next-generation ground-based gravitational wave observatories will bring in a paradigm shift. We explore the pivotal role that gravitational-wave standard sirens will play in inferring cosmological parameters with next-generation observatories, not only achieving exquisite precision but also opening up unprecedented redshifts. We examine the merits and the systematic biases involved in gravitational-wave standard sirens utilizing binary black holes, binary neutron stars, and neutron star-black hole mergers. Further, we estimate the precision of bright sirens, golden dark sirens, and spectral sirens for these binary coalescences and compare the abilities of various next-generation observatories (A^sharp, Cosmic Explorer, Einstein Telescope, and their possible networks). When combining different sirens, we find sub-percent precision over more than 10 billion years of cosmic evolution for the Hubble expansion rate $H(z)$. This work presents a broad view of opportunities to precisely measure the cosmic expansion rate, decipher the elusive dark energy and dark matter, and potentially discover new physics in the uncharted Universe with next-generation gravitational-wave detectors.


title: Towards multiqudit quantum processor based on a $^{171}$Yb$^{+}$ ion string: Realizing basic quantum algorithms

abstract: We demonstrate a quantum processor based on a 3D linear Paul trap that uses $^{171}$Yb$^{+}$ ions with 8 individually controllable four-level qudits (ququarts), which is computationally equivalent to a 16-qubit quantum processor. The design of the developed ion trap provides high secular frequencies, low heating rate, which together with individual addressing and readout optical systems allows executing quantum algorithms. In each of the 8 ions, we use four electronic levels coupled by E2 optical transition at 435nm for qudit encoding. We present the results of single- and two- qubit operations benchmarking, generation of a 5-particle Greenberger-Horne-Zeilinger entangled state, and realizing basic quantum algorithms, including Bernstein-Vazirani and Grover's search algorithms as well as H$_2$ and LiH molecular simulations. Our results pave the way to scalable qudit-based quantum processors using trapped ions.


title: Design Space Exploration for Particle Detector Read-out Implementations in Matlab and Simulink on the Example of the SHiP SBT

abstract: On a very fundamental level, particle detectors share similar requirements for their read-out chain. This is reflected in the way that typical read-out solutions are developed, where a previous design is taken and modified to fit some changes in requirements. One of the two common approaches is the current-based read-out, where the waveform of the sensor output is sampled in order to later extract information from there. This approach is used in many detector applications using scintillation based detectors, including PET. With this contribution, we will introduce how we use Matlab in order to simulate the read-out electronics of particle detectors. We developed this simulation approach as a base for our ongoing development of software-defined read-out ASICs that cover the requirements of a variety of particle detector types. Simulink was chosen as a base for our developments as it allows simulation of mixed-signal systems and comes with built-in toolkits to aid in developments of such systems. With our approach, we want to take a new look at how we approach designing such a read-out, with a focus on digital signal processing close to the sensor, making use of known signal characteristics and modern methods of communications engineering. We are taking into account the time profile of an event, the bandwidth-limiting properties of the sensor and attached electronics, digitization stages and finally the parameterization of approaches for digital processing of the signal. We will show how we are applying the design approach to the development of a read-out for the proposed SHiP SBT detector, which is a scintillation based detector relying on SiPMs sensors, using this as an example for our modelling approach and show preliminary results.


title: Behavioral transition of a fish school in a crowded environment

abstract: In open water, social fish gather to form schools, in which fish generally align with each other. In this work, we study how this social behavior evolves when perturbed by artificial obstacles. We measure the collective behavior of a group of zebrafish in the presence of a periodic array of pillars. When pillar density is low, the fish regroup with a typical inter-distance and a well-polarized state with parallel orientations, similar to their behavior in open water conditions. Above a critical density of pillars, their social interactions, which are mostly based on vision, are screened and the fish spread randomly through the aquarium, orienting themselves along the free axes of the pillar lattice. The abrupt transition from natural to artificial orientation happens when the pillar inter-distance is comparable to the social distance of the fish, i.e., their most probable inter-distance. We develop a stochastic model of the relative orientation between fish pairs, taking into account alignment, anti-alignment and tumbling, from a distribution biased by the environment. This model provides a good description of the experimental probability distribution of the relative orientation between the fish and captures the behavioral transition. Using the model to fit the experimental data provides qualitative information on the evolution of cognitive parameters, such as the alignment or the tumbling rates, as the pillar density increases. At high pillar density, we find that the artificial environment imposes its geometrical constraints to the fish school, drastically increasing the tumbling rate.


title: Towards Eliminating Hard Label Constraints in Gradient Inversion Attacks

abstract: Gradient inversion attacks aim to reconstruct local training data from intermediate gradients exposed in the federated learning framework. Despite successful attacks, all previous methods, starting from reconstructing a single data point and then relaxing the single-image limit to batch level, are only tested under hard label constraints. Even for single-image reconstruction, we still lack an analysis-based algorithm to recover augmented soft labels. In this work, we change the focus from enlarging batchsize to investigating the hard label constraints, considering a more realistic circumstance where label smoothing and mixup techniques are used in the training process. In particular, we are the first to initiate a novel algorithm to simultaneously recover the ground-truth augmented label and the input feature of the last fully-connected layer from single-input gradients, and provide a necessary condition for any analytical-based label recovery methods. Extensive experiments testify to the label recovery accuracy, as well as the benefits to the following image reconstruction. We believe soft labels in classification tasks are worth further attention in gradient inversion attacks.


title: Shape Manipulation of Bevel-Tip Needles for Prostate Biopsy Procedures: A Comparison of Two Resolved-Rate Controllers

abstract: Prostate cancer diagnosis continues to encounter challenges, often due to imprecise needle placement in standard biopsies. Several control strategies have been developed to compensate for needle tip prediction inaccuracies, however none were compared against each other, and it is unclear whether any of them can be safely and universally applied in clinical settings. This paper compares the performance of two resolved-rate controllers, derived from a mechanics-based and a data-driven approach, for bevel-tip needle control using needle shape manipulation through a template. We demonstrate for a simulated 12-core biopsy procedure under model parameter uncertainty that the mechanics-based controller can better reach desired targets when only the final goal configuration is presented even with uncertainty on model parameters estimation, and that providing a feasible needle path is crucial in ensuring safe surgical outcomes when either controller is used for needle shape manipulation.


title: How Free is Parameter-Free Stochastic Optimization?

abstract: We study the problem of parameter-free stochastic optimization, inquiring whether, and under what conditions, do fully parameter-free methods exist: these are methods that achieve convergence rates competitive with optimally tuned methods, without requiring significant knowledge of the true problem parameters. Existing parameter-free methods can only be considered ``partially'' parameter-free, as they require some non-trivial knowledge of the true problem parameters, such as a bound on the stochastic gradient norms, a bound on the distance to a minimizer, etc. In the non-convex setting, we demonstrate that a simple hyperparameter search technique results in a fully parameter-free method that outperforms more sophisticated state-of-the-art algorithms. We also provide a similar result in the convex setting with access to noisy function values under mild noise assumptions. Finally, assuming only access to stochastic gradients, we establish a lower bound that renders fully parameter-free stochastic convex optimization infeasible, and provide a method which is (partially) parameter-free up to the limit indicated by our lower bound.


title: Nonlinear feedback of the electrostatic instability on the blazar-induced pair beam and GeV cascade

abstract: Relativistic pair beams produced in the cosmic voids by TeV gamma rays from blazars are expected to produce a detectable GeV-scale cascade that is missing in the observations. The suppression of this secondary cascade implies either the deflection of the pair beam by intergalactic magnetic fields or, alternatively, an energy loss of the beam due to the beam-plasma instability. Here, we study how the beam-plasma instability feeds back on the beam, using a realistic two-dimensional beam distribution. We find that the instability broadens the beam opening angles significantly without any significant energy loss, thus confirming a recent feedback study on a simplified one-dimensional beam distribution. However, narrowing diffusion feedback of the beam particles with Lorentz factors less than $10^6$ might become relevant even though initially it is negligible. Finally, when considering the continuous creation of TeV pairs, we find that the beam distribution and the wave spectrum reach a new quasi-steady state, in which the scattering of beam particles persists and the beam opening angle may increase by a factor of hundreds. Understanding the implications on the GeV cascade emission requires accounting for inverse-Compton cooling.


title: Quantum tunneling in the early universe: Stable magnetic monopoles from metastable cosmic strings

abstract: We present a novel mechanism for producing topologically stable monopoles (TSMs) from the quantum mechanical decay of metastable cosmic strings in the early universe. In an $SO(10)$ model this mechanism yields TSMs that carry two units ($4\pi/e$) of Dirac magnetic charge as well as some color magnetic charge which is screened. For a dimensionless string tension parameter $G\mu \approx 10^{-9} - 10^{-5}$, the monopoles are superheavy with masses of order $10^{15} - 10^{17}$ GeV. Monopoles with masses of order $10^8 - 10^{14}$ GeV arise from metastable strings for $G\mu$ values from $\sim 10^{-22}$ to $10^{-10}$. We identify the parameter space for producing these monopoles at an observable level with detectors such as IceCube and KM3NeT. For lower $G\mu$ values the ultra-relativistic monopoles should be detectable at Pierre Auger and ANITA. The stochastic gravitational wave emission arises from metastable strings with $G\mu\sim 10^{-9}-10^{-5}$ and should be accessible at HLVK and future detectors including the Einstein Telescope and Cosmic Explorer. An $E_6$ extension based on this framework would yield TSMs from the quantum mechanical decay of metastable strings that carry three units ($6\pi/e$) of Dirac magnetic charge.


title: Clairaut anti-invariant Riemannian maps to Sasakian manifolds

abstract: In this paper, we investigate the geometry of Clairaut anti-invariant Riemannnian maps whose base space are Sasakian manifolds. We obtain the necessary and sufficient conditions for a curve on a base manifold to be geodesic. We obtain conditions for an anti-invariant Riemannian map to be Clairaut. Further, we discuss the biharmonicity of such maps and construct some illustrative examples.


title: User Centric Evaluation of Code Generation Tools

abstract: With the rapid advance of machine learning (ML) technology, large language models (LLMs) are increasingly explored as an intelligent tool to generate program code from natural language specifications. However, existing evaluations of LLMs have focused on their capabilities in comparison with humans. It is desirable to evaluate their usability when deciding on whether to use a LLM in software production. This paper proposes a user centric method for this purpose. It includes metadata in the test cases of a benchmark to describe their usages, conducts testing in a multi-attempt process that mimics the uses of LLMs, measures LLM generated solutions on a set of quality attributes that reflect usability, and evaluates the performance based on user experiences in the uses of LLMs as a tool. The paper also reports a case study with the method in the evaluation of ChatGPT's usability as a code generation tool for the R programming language. Our experiments demonstrated that ChatGPT is highly useful for generating R program code although it may fail on hard programming tasks. The user experiences are good with overall average number of attempts being 1.61 and the average time of completion being 47.02 seconds. Our experiments also found that the weakest aspect of usability is conciseness, which has a score of 3.80 out of 5.


title: Constrained Decoding for Cross-lingual Label Projection

abstract: Zero-shot cross-lingual transfer utilizing multilingual LLMs has become a popular learning paradigm for low-resource languages with no labeled training data. However, for NLP tasks that involve fine-grained predictions on words and phrases, the performance of zero-shot cross-lingual transfer learning lags far behind supervised fine-tuning methods. Therefore, it is common to exploit translation and label projection to further improve the performance by (1) translating training data that is available in a high-resource language (e.g., English) together with the gold labels into low-resource languages, and/or (2) translating test data in low-resource languages to a high-source language to run inference on, then projecting the predicted span-level labels back onto the original test data. However, state-of-the-art marker-based label projection methods suffer from translation quality degradation due to the extra label markers injected in the input to the translation model. In this work, we explore a new direction that leverages constrained decoding for label projection to overcome the aforementioned issues. Our new method not only can preserve the quality of translated texts but also has the versatility of being applicable to both translating training and translating test data strategies. This versatility is crucial as our experiments reveal that translating test data can lead to a considerable boost in performance compared to translating only training data. We evaluate on two cross-lingual transfer tasks, namely Named Entity Recognition and Event Argument Extraction, spanning 20 languages. The results demonstrate that our approach outperforms the state-of-the-art marker-based method by a large margin and also shows better performance than other label projection methods that rely on external word alignment.


title: Entropy of Singular Suspensions

abstract: In this work, we investigate diffeomorphisms whose positiveness of topological entropy is destroyed by singular suspensions. We show that this phenomenon is rare in the set of $C^1$-diffeomorphisms. Precisely, we prove that for an open and dense set of $C^1$-diffeomorphism positive topological entropy is preserved by singular suspensions, even for suspensions with infinitely many singularities. We prove a similar result to the conservative diffeomorphisms. We apply our techniques to show that every expansive singular suspension $C^{1+\epsilon}$-flow over a three-dimensional manifold has positive topological entropy. Finally, we explore this phenomenon for Anosov dynamics, showing that to nullify the topological entropy for Anosov suspension flow, the set of singularities must capture the non-wandering set.


title: Revivals, or the Talbot effect, for the Airy equation

abstract: We study Dirichlet-type problems for the simplest third-order linear dispersive PDE, often referred to as the Airy equation. Such problems have not been extensively studied, perhaps due to the complexity of the spectral structure of the spatial operator. Our specific interest is to determine whether the peculiar phenomenon of revivals, also known as Talbot effect, is supported by these boundary conditions, which for third order problems are not reducible to periodic ones. We prove that this is the case only for a very special choice of the boundary conditions, for which a new type of weak cusp revival phenomenon has been recently discovered. We also give some new results on the functional class of the solution for other cases.


title: The Patch Topology in Univalent Foundations

abstract: Stone locales together with continuous maps form a coreflective subcategory of spectral locales and perfect maps. A proof in the internal language of an elementary topos was previously given by the second-named author. This proof can be easily translated to univalent type theory using resizing axioms. In this work, we show how to achieve such a translation without resizing axioms, by working with large and locally small frames with small bases. This requires predicative reformulations of several fundamental concepts of locale theory in predicative HoTT/UF, which we investigate systematically.


title: GPU-Accelerated 3D Polygon Visibility Volumes for Synergistic Perception and Navigation

abstract: UAV missions often require specific geometric constraints to be satisfied between ground locations and the vehicle location. Such requirements are typical for contexts where line-of-sight must be maintained between the vehicle location and the ground control location and are also important in surveillance applications where the UAV wishes to be able to sense, e.g., with a camera sensor, a specific region within a complex geometric environment. This problem is further complicated when the ground location is generalized to a convex 2D polygonal region. This article describes the theory and implementation of a system which can quickly calculate the 3D volume that encloses all 3D coordinates from which a 2D convex planar region can be entirely viewed; referred to as a visibility volume. The proposed approach computes visibility volumes using a combination of depth map computation using GPU-acceleration and geometric boolean operations. Solutions to this problem require complex 3D geometric analysis techniques that must execute using arbitrary precision arithmetic on a collection of discontinuous and non-analytic surfaces. Post-processing steps incorporate navigational constraints to further restrict the enclosed coordinates to include both visibility and navigation constraints. Integration of sensing visibility constraints with navigational constraints yields a range of navigable space where a vehicle will satisfy both perceptual sensing and navigational needs of the mission. This algorithm then provides a synergistic perception and navigation sensitive solution yielding a volume of coordinates in 3D that satisfy both the mission path and sensing needs.


title: Mastering Zero-Shot Interactions in Cooperative and Competitive Simultaneous Games

abstract: The combination of self-play and planning has achieved great successes in sequential games, for instance in Chess and Go. However, adapting algorithms such as AlphaZero to simultaneous games poses a new challenge. In these games, missing information about concurrent actions of other agents is a limiting factor as they may select different Nash equilibria or do not play optimally at all. Thus, it is vital to model the behavior of the other agents when interacting with them in simultaneous games. To this end, we propose Albatross: AlphaZero for Learning Bounded-rational Agents and Temperature-based Response Optimization using Simulated Self-play. Albatross learns to play the novel equilibrium concept of a Smooth Best Response Logit Equilibrium (SBRLE), which enables cooperation and competition with agents of any playing strength. We perform an extensive evaluation of Albatross on a set of cooperative and competitive simultaneous perfect-information games. In contrast to AlphaZero, Albatross is able to exploit weak agents in the competitive game of Battlesnake. Additionally, it yields an improvement of 37.6% compared to previous state of the art in the cooperative Overcooked benchmark.


title: Sociolinguistically Informed Interpretability: A Case Study on Hinglish Emotion Classification

abstract: Emotion classification is a challenging task in NLP due to the inherent idiosyncratic and subjective nature of linguistic expression, especially with code-mixed data. Pre-trained language models (PLMs) have achieved high performance for many tasks and languages, but it remains to be seen whether these models learn and are robust to the differences in emotional expression across languages. Sociolinguistic studies have shown that Hinglish speakers switch to Hindi when expressing negative emotions and to English when expressing positive emotions. To understand if language models can learn these associations, we study the effect of language on emotion prediction across 3 PLMs on a Hinglish emotion classification dataset. Using LIME and token level language ID, we find that models do learn these associations between language choice and emotional expression. Moreover, having code-mixed data present in the pre-training can augment that learning when task-specific data is scarce. We also conclude from the misclassifications that the models may overgeneralise this heuristic to other infrequent examples where this sociolinguistic phenomenon does not apply.


title: Just Cluster It: An Approach for Exploration in High-Dimensions using Clustering and Pre-Trained Representations

abstract: In this paper we adopt a representation-centric perspective on exploration in reinforcement learning, viewing exploration fundamentally as a density estimation problem. We investigate the effectiveness of clustering representations for exploration in 3-D environments, based on the observation that the importance of pixel changes between transitions is less pronounced in 3-D environments compared to 2-D environments, where pixel changes between transitions are typically distinct and significant. We propose a method that performs episodic and global clustering on random representations and on pre-trained DINO representations to count states, i.e, estimate pseudo-counts. Surprisingly, even random features can be clustered effectively to count states in 3-D environments, however when these become visually more complex, pre-trained DINO representations are more effective thanks to the pre-trained inductive biases in the representations. Overall, this presents a pathway for integrating pre-trained biases into exploration. We evaluate our approach on the VizDoom and Habitat environments, demonstrating that our method surpasses other well-known exploration methods in these settings.


title: Enhancing Neural Subset Selection: Integrating Background Information into Set Representations

abstract: Learning neural subset selection tasks, such as compound selection in AI-aided drug discovery, have become increasingly pivotal across diverse applications. The existing methodologies in the field primarily concentrate on constructing models that capture the relationship between utility function values and subsets within their respective supersets. However, these approaches tend to overlook the valuable information contained within the superset when utilizing neural networks to model set functions. In this work, we address this oversight by adopting a probabilistic perspective. Our theoretical findings demonstrate that when the target value is conditioned on both the input set and subset, it is essential to incorporate an \textit{invariant sufficient statistic} of the superset into the subset of interest for effective learning. This ensures that the output value remains invariant to permutations of the subset and its corresponding superset, enabling identification of the specific superset from which the subset originated. Motivated by these insights, we propose a simple yet effective information aggregation module designed to merge the representations of subsets and supersets from a permutation invariance perspective. Comprehensive empirical evaluations across diverse tasks and datasets validate the enhanced efficacy of our approach over conventional methods, underscoring the practicality and potency of our proposed strategies in real-world contexts.


title: Locally Lipschitz stability of solutions to a parametric parabolic optimal control problem with mixed pointwise constraints

abstract: A class of parametric optimal control problems governed by semilinear parabolic equations with mixed pointwise constraints is investigated. The perturbations appear in the objective functional, the state equation and in mixed pointwise constraints. By analyzing regularity and establishing stability condition of Lagrange multipliers we prove that, if the strictly second-order sufficient condition for the unperturbed problem is valid, then the solutions of the problems as well as the associated Lagrange multipliers are locally Lipschitz continuous functions of parameters.


title: Boosting Reinforcement Learning with Strongly Delayed Feedback Through Auxiliary Short Delays

abstract: Reinforcement learning (RL) is challenging in the common case of delays between events and their sensory perceptions. State-of-the-art (SOTA) state augmentation techniques either suffer from state space explosion or performance degeneration in stochastic environments. To address these challenges, we present a novel Auxiliary-Delayed Reinforcement Learning (AD-RL) method that leverages auxiliary tasks involving short delays to accelerate RL with long delays, without compromising performance in stochastic environments. Specifically, AD-RL learns a value function for short delays and uses bootstrapping and policy improvement techniques to adjust it for long delays. We theoretically show that this can greatly reduce the sample complexity. On deterministic and stochastic benchmarks, our method significantly outperforms the SOTAs in both sample efficiency and policy performance. Code is available at https://github.com/QingyuanWuNothing/AD-RL.


title: Less is KEN: a Universal and Simple Non-Parametric Pruning Algorithm for Large Language Models

abstract: Neural network pruning has become increasingly crucial due to the complexity of these models and their widespread use in various fields. Existing pruning algorithms often suffer from limitations such as architecture specificity, excessive complexity and reliance on demanding calculations, rendering them impractical for real-world applications. This paper introduces KEN: a straightforward, universal and unstructured pruning algorithm based on Kernel Density Estimation (KDE). KEN aims to construct optimized transformers by selectively preserving the most significant parameters while restoring others to their pre-training state. This strategy preserves model performance while enabling storage of only the optimized subnetwork, leading to substantial memory savings. Extensive evaluations across seven different LLMs demonstrate that KEN achieves equal or better performance than their original unpruned versions, with a minimum parameter reduction of 25%. Furthermore, in-depth comparisons with established pruning and PEFT algorithms confirm KEN effectiveness. We further introduce KEN$_{viz}$, an explainable tool that visualizes the optimized model composition achieved by KEN from different points of view.


title: Scanning tunnelling microscopy and X-ray photoemission studies of NdNiO2 infinite-layer nickelates films

abstract: We report scanning tunnelling microscopy (STM) and x-ray photoemission spectroscopy (XPS) measurements on uncapped and SrTiO3 (STO) capped NdNiO2 realized by pulsed-laser deposition and topotactic reduction process. We find that untreated NdNiO2 surfaces are insulating and contain Ni mostly in a nominal Ni2+ oxidation state. Room temperature STM shows signatures of a striped-like topographic pattern, possibly compatible with recent reports of ordered oxygen vacancies in uncapped nickelates due to incomplete oxygen de-intercalation of the upper layers. A metallic surface and a full Ni1+ oxidation state is recovered by ultra high vacuum annealing at 250 C, as shown by STM and XPS. STO-capped NdNiO2 films, on the other hand, show Ni mostly in Ni1+ configuration, but Nd 3d5/2 core level spectra have a relevant contribution from ligand 4f 4L states, suggesting the formation of a NdTiNiOx layer at the interface with the STO. By in situ unit-cell by unit-cell Ar-ion sputtering removal of the STO capping and of the non stoichiometric interface layer, we were able to address the surface electronic properties of these samples, as shown by high resolution valence band photoemission spectroscopy. The results provide insights in the properties of infinite-layer NdNiO2 thin films prepared by the CaH2 topotactic reduction of perovskite NdNiO3 and suggest methods to improve their surface quality.


title: Computing Generic Fibres of Polynomial Ideals with FGLM and Hensel Lifting

abstract: We describe a version of the FGLM algorithm that can be used to compute generic fibers of positive-dimensional polynomial ideals. It combines the FGLM algorithm with a Hensel lifting strategy. We show that this algorithm has a complexity quasi-linear in the number of lifting steps. Some provided experimental data also demonstrates the practical efficacy of our algorithm. Additionally, we sketch a related Hensel lifting method to compute Gr\"obner bases using so-called tracers.


title: SafEDMD: A certified learning architecture tailored to data-driven control of nonlinear dynamical systems

abstract: The Koopman operator serves as the theoretical backbone for machine learning of dynamical control systems, where the operator is heuristically approximated by extended dynamic mode decomposition (EDMD). In this paper, we propose Stability- and certificate-oriented EDMD (SafEDMD): a novel EDMD-based learning architecture which comes along with rigorous certificates, resulting in a reliable surrogate model generated in a data-driven fashion. To ensure the trustworthiness of SafEDMD, we derive proportional error bounds, which vanish at the origin and are tailored to control tasks, leading to certified controller design based on semi-definite programming. We illustrate the developed method by means of several benchmark examples and highlight the advantages over state-of-the-art methods.


title: A Multi-step Loss Function for Robust Learning of the Dynamics in Model-based Reinforcement Learning

abstract: In model-based reinforcement learning, most algorithms rely on simulating trajectories from one-step models of the dynamics learned on data. A critical challenge of this approach is the compounding of one-step prediction errors as the length of the trajectory grows. In this paper we tackle this issue by using a multi-step objective to train one-step models. Our objective is a weighted sum of the mean squared error (MSE) loss at various future horizons. We find that this new loss is particularly useful when the data is noisy (additive Gaussian noise in the observations), which is often the case in real-life environments. To support the multi-step loss, first we study its properties in two tractable cases: i) uni-dimensional linear system, and ii) two-parameter non-linear system. Second, we show in a variety of tasks (environments or datasets) that the models learned with this loss achieve a significant improvement in terms of the averaged R2-score on future prediction horizons. Finally, in the pure batch reinforcement learning setting, we demonstrate that one-step models serve as strong baselines when dynamics are deterministic, while multi-step models would be more advantageous in the presence of noise, highlighting the potential of our approach in real-world applications.


title: Detecting Scams Using Large Language Models

abstract: Large Language Models (LLMs) have gained prominence in various applications, including security. This paper explores the utility of LLMs in scam detection, a critical aspect of cybersecurity. Unlike traditional applications, we propose a novel use case for LLMs to identify scams, such as phishing, advance fee fraud, and romance scams. We present notable security applications of LLMs and discuss the unique challenges posed by scams. Specifically, we outline the key steps involved in building an effective scam detector using LLMs, emphasizing data collection, preprocessing, model selection, training, and integration into target systems. Additionally, we conduct a preliminary evaluation using GPT-3.5 and GPT-4 on a duplicated email, highlighting their proficiency in identifying common signs of phishing or scam emails. The results demonstrate the models' effectiveness in recognizing suspicious elements, but we emphasize the need for a comprehensive assessment across various language tasks. The paper concludes by underlining the importance of ongoing refinement and collaboration with cybersecurity experts to adapt to evolving threats.


title: Proof Theory and Decision Procedures for Deontic STIT Logics

abstract: This paper addresses the automation of reasoning with deontic STIT logics by means of proof theory. Our methodology consists of leveraging sound and cut-free complete sequent-style calculi to write a proof-search algorithm deciding deontic, multi-agent STIT logics with (un)limited choice. In order to ensure the termination of our proof-search algorithm, we introduce a special loop-checking mechanism. Despite the acknowledged potential for deontic reasoning in the context of autonomous vehicles and other areas of AI, this work is the first to provide a syntactic decision procedure for deontic STIT logics. Our proof-search procedures are designed to provide verifiable witnesses/certificates of the (in)validity of formulae, which permit an analysis of the (non)theoremhood of formulae and act as explanations thereof. We utilize our proof-search algorithm to address agent-based normative reasoning tasks such as compliance checking.


title: A Comparative Analysis of Microrings Based Incoherent Photonic GEMM Accelerators

abstract: Several microring resonator (MRR) based analog photonic architectures have been proposed to accelerate general matrix-matrix multiplications (GEMMs) in deep neural networks with exceptional throughput and energy efficiency. To implement GEMM functions, these MRR-based architectures, in general, manipulate optical signals in five different ways: (i) Splitting (copying) of multiple optical signals to achieve a certain fan-out, (ii) Aggregation (multiplexing) of multiple optical signals to achieve a certain fan-in, (iii) Modulation of optical signals to imprint input values onto analog signal amplitude, (iv) Weighting of modulated optical signals to achieve analog input-weight multiplication, (v) Summation of optical signals. The MRR-based GEMM accelerators undertake the first four ways of signal manipulation in an arbitrary order ignoring the possible impact of the order of these manipulations on their performance. In this paper, we conduct a detailed analysis of accelerator organizations with three different orders of these manipulations: (1) Modulation-Aggregation-Splitting-Weighting (MASW), (2) Aggregation-Splitting-Modulation-Weighting (ASMW), and (3) Splitting-Modulation-Weighting-Aggregation (SMWA). We show that these organizations affect the crosstalk noise and optical signal losses in different magnitudes, which renders these organizations with different levels of processing parallelism at the circuit level, and different magnitudes of throughput and energy-area efficiency at the system level. Our evaluation results for four CNN models show that SMWA organization achieves up to 4.4$\times$, 5$\times$, and 5.2$\times$ better throughput, energy efficiency, and area-energy efficiency, respectively, compared to ASMW and MASW organizations on average.


title: Kleitman's conjecture for central families

abstract: Chv\'{a}tal conjectured that a star is amongst the largest intersecting subfamiles of a finite subset-closed family of sets. Kleitman later strengthened Chv\'{a}tal's conjecture, suggesting that maximal intersecting subfamilies of $2^{[n]}$ when naturally embedded into $\mathbb{R}^{2^{[n]}}$ take on a particular form. We provide a construction which succeeds in expressing certain families as required by Kleitman's conjecture. We then provide a partial characterization of these families, showing central and certain near-central families in particular to be amongst them.


title: Axion-like Quasiparticles and Topological States of Matter: Finite Density Corrections of the Chiral Anomaly Vertex

abstract: We investigate the general structure of the chiral anomaly $AVV/AAA$ and $(LLL, RRR)$ vertices, in the presence of chemical potentials in perturbation theory. The study finds application in anomalous transport, whenever chirally unbalanced matter is present, with propagating external currents that are classically conserved. Examples are topological materials and the chiral magnetic effect in the plasma state of matter of the early universe. We classify the minimal number of form factors of the $AVV$ parameterization, by a complete analysis of the Schouten identities in the presence of a heat bath. We show that the longitudinal (anomaly) sector in the axial-vector channel, for on-shell and off-shell photons, is protected against corrections coming from the insertion of a chemical potential in the fermion loop. When the photons are on-shell, we prove that also the transverse sector, in the same channel, is $\mu$-independent and vanishes. The related effective action is shown to be always described by the exchange of a massless anomaly pole, as in the case of vanishing chemical potentials. The pole is interpreted as an interpolating axion-like quasiparticle generated by the anomaly. In each axial-vector channel, it is predicted to be a correlated fermion/antifermion pseudoscalar (axion-like) quasiparticle appearing in the response function, once the material is subjected to an external chiral perturbation. The cancellation of the $\mu$ dependence extends to any chiral current within the Standard Model, including examples like $B$ (baryon), $L$ (lepton), and $B-L$. This holds true irrespective of whether these currents exhibit anomalies.


title: Rational Maps of Balls and their Associated Groups

abstract: Given a proper, rational map of balls, D'Angelo and Xiao introduced five natural groups encoding properties of the map. We study these groups using a recently discovered normal form for rational maps of balls. Using this normal form, we also provide several new groups associated to the map.


title: Learning solutions of parametric Navier-Stokes with physics-informed neural networks

abstract: We leverage Physics-Informed Neural Networks (PINNs) to learn solution functions of parametric Navier-Stokes Equations (NSE). Our proposed approach results in a feasible optimization problem setup that bypasses PINNs' limitations in converging to solutions of highly nonlinear parametric-PDEs like NSE. We consider the parameter(s) of interest as inputs of PINNs along with spatio-temporal coordinates, and train PINNs on generated numerical solutions of parametric-PDES for instances of the parameters. We perform experiments on the classical 2D flow past cylinder problem aiming to learn velocities and pressure functions over a range of Reynolds numbers as parameter of interest. Provision of training data from generated numerical simulations allows for interpolation of the solution functions for a range of parameters. Therefore, we compare PINNs with unconstrained conventional Neural Networks (NN) on this problem setup to investigate the effectiveness of considering the PDEs regularization in the loss function. We show that our proposed approach results in optimizing PINN models that learn the solution functions while making sure that flow predictions are in line with conservational laws of mass and momentum. Our results show that PINN results in accurate prediction of gradients compared to NN model, this is clearly visible in predicted vorticity fields given that none of these models were trained on vorticity labels.


title: Holonomy operator for spin connection and spatial scalar curvature operator in loop quantum gravity

abstract: In this article we propose a new construction of the spatial scalar curvature operator in (1+3)-dimensional LQG based on the twisted geometry. The starting point of the construction is to express the holonomy of the spin connection on a graph in terms of the twisted geometry variables, and we check that this expression reproduces the spin connection in terms of triads in a certain continuum limit. The spatial scalar curvature in terms of twisted geometry is obtained by considering the composition of the holonomy of the spin connection on the loops. With the twisted geometry parametrization of the holonomy-flux phase space, we further express the holonomy of the spin connection and the spatial scalar curvature on a graph in terms of fluxes. Finally, they are promoted as well-defined operators by replacing the fluxes with ordered flux operators.


title: The second coefficient of the Alexander polynomial as a satellite obstruction

abstract: A set P of links is introduced, containing positive braid links as well as arborescent positive Hopf plumbings. Inspired by work of Ito, it is shown that for links in P, the leading and the second coefficient of the Alexander polynomial have opposite sign. It follows that certain satellite links, such as (n,1)-cables, are not in P.


title: DogSurf: Quadruped Robot Capable of GRU-based Surface Recognition for Blind Person Navigation

abstract: This paper introduces DogSurf - a newapproach of using quadruped robots to help visually impaired people navigate in real world. The presented method allows the quadruped robot to detect slippery surfaces, and to use audio and haptic feedback to inform the user when to stop. A state-of-the-art GRU-based neural network architecture with mean accuracy of 99.925% was proposed for the task of multiclass surface classification for quadruped robots. A dataset was collected on a Unitree Go1 Edu robot. The dataset and code have been posted to the public domain.


title: Trustworthiness of Optimality Condition Violation in Inverse Dynamic Game Methods Based on the Minimum Principle

abstract: In this work, we analyze the applicability of Inverse Dynamic Game (IDG) methods based on the Minimum Principle (MP). The IDG method determines unknown cost functions in a single- or multi-agent setting from observed system trajectories by minimizing the so-called residual error, i.e. the extent to which the optimality conditions of the MP are violated with a current guess of cost functions. The main assumption of the IDG method to recover cost functions such that the resulting trajectories match the observed ones is that the given trajectories are the result of a Dynamic Game (DG) problem with known parameterized cost function structures. However, in practice, when the IDG method is used to identify the behavior of unknown agents, e.g. humans, this assumption cannot be guaranteed. Hence, we introduce the notion of the trustworthiness of the residual error and provide necessary conditions for it to define when the IDG method based on the MP is applicable to such problems. From the necessary conditions, we conclude that the MP-based IDG method cannot be used to validate DG models for unknown agents but can yield under certain conditions robust parameter identifications, e.g. to measurement noise. Finally, we illustrate these conclusions by validating a DG model for the collision avoidance behavior between two mobile robots with human operators.


title: Optimal and Near-Optimal Adaptive Vector Quantization

abstract: Quantization is a fundamental optimization for many machine-learning use cases, including compressing gradients, model weights and activations, and datasets. The most accurate form of quantization is \emph{adaptive}, where the error is minimized with respect to a given input, rather than optimizing for the worst case. However, optimal adaptive quantization methods are considered infeasible in terms of both their runtime and memory requirements. We revisit the Adaptive Vector Quantization (AVQ) problem and present algorithms that find optimal solutions with asymptotically improved time and space complexity. We also present an even faster near-optimal algorithm for large inputs. Our experiments show our algorithms may open the door to using AVQ more extensively in a variety of machine learning applications.


title: State-dependent and state-independent uncertainty relations for skew information and standard deviation

abstract: In this work, we derive state-dependent uncertainty relations (uncertainty equalities) in which commutators of incompatible operators (not necessarily Hermitian) are explicitly present and state-independent uncertainty relations based on the Wigner-Yanase (-Dyson) skew information. We derive uncertainty equality based on standard deviation for incompatible operators with mixed states, a gereralization of previous works in which only pure state was considered. We show that for pure states, the Wigner-Yanase skew information based state-independent uncertainty relations become standard deviation based state-independent uncertainty relations which turn out to be tighter uncertainty relations than the ones given in the work of Giorda \emph{et al.} [Phys. Rev. A 99, 052121 (2019)] for some cases, and we generalize the work of Giorda \emph{et al.} for arbitrary operators. We show that if the coherence of a density operator is measured with respect to a collection of different channels, then there exists a state-independent uncertainty relation for the coherence measures of the density operator with respect to that collection of different channels. We show that state-dependent and state-independent uncertainty relations based on a more general version of skew information called generalized skew information appeared in Yang \emph{et al.} [Phys. Rev. A 106, 052401 (2022)] which includes the Wigner-Yanase (-Dyson) skew information and the Fisher information as special cases hold. In a qubit, we derive tighter state-independent uncertainty inequalities and equalities for different form of generalized skew informations and standard deviations, and discuss in detail. Finally, we provide a scheme to determine the Wigner-Yanase (-Dyson) skew information of an unknown observable which can be performed in experiment using the notion of weak values.


title: Equations of genus $4$ curves from their theta constants

abstract: In this article we give explicit formulas for the equations of a generic genus $4$ curve in terms of its theta constants. The method uses the Prym construction and the beautiful classical geometry around it.


title: Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization

abstract: In light of recent advances in multimodal Large Language Models (LLMs), there is increasing attention to scaling them from image-text data to more informative real-world videos. Compared to static images, video poses unique challenges for effective large-scale pre-training due to the modeling of its spatiotemporal dynamics. In this paper, we address such limitations in video-language pre-training with an efficient video decomposition that represents each video as keyframes and temporal motions. These are then adapted to an LLM using well-designed tokenizers that discretize visual and temporal information as a few tokens, thus enabling unified generative pre-training of videos, images, and text. At inference, the generated tokens from the LLM are carefully recovered to the original continuous pixel space to create various video content. Our proposed framework is both capable of comprehending and generating image and video content, as demonstrated by its competitive performance across 13 multimodal benchmarks in image and video understanding and generation. Our code and models are available at https://video-lavit.github.io.


title: Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion

abstract: Recent text-to-video diffusion models have achieved impressive progress. In practice, users often desire the ability to control object motion and camera movement independently for customized video creation. However, current methods lack the focus on separately controlling object motion and camera movement in a decoupled manner, which limits the controllability and flexibility of text-to-video models. In this paper, we introduce Direct-a-Video, a system that allows users to independently specify motions for multiple objects as well as camera's pan and zoom movements, as if directing a video. We propose a simple yet effective strategy for the decoupled control of object motion and camera movement. Object motion is controlled through spatial cross-attention modulation using the model's inherent priors, requiring no additional optimization. For camera movement, we introduce new temporal cross-attention layers to interpret quantitative camera movement parameters. We further employ an augmentation-based approach to train these layers in a self-supervised manner on a small-scale dataset, eliminating the need for explicit motion annotation. Both components operate independently, allowing individual or combined control, and can generalize to open-domain scenarios. Extensive experiments demonstrate the superiority and effectiveness of our method. Project page and code are available at https://direct-a-video.github.io/.


title: Linguistic features for sentence difficulty prediction in ABSA

abstract: One of the challenges of natural language understanding is to deal with the subjectivity of sentences, which may express opinions and emotions that add layers of complexity and nuance. Sentiment analysis is a field that aims to extract and analyze these subjective elements from text, and it can be applied at different levels of granularity, such as document, paragraph, sentence, or aspect. Aspect-based sentiment analysis is a well-studied topic with many available data sets and models. However, there is no clear definition of what makes a sentence difficult for aspect-based sentiment analysis. In this paper, we explore this question by conducting an experiment with three data sets: "Laptops", "Restaurants", and "MTSC" (Multi-Target-dependent Sentiment Classification), and a merged version of these three datasets. We study the impact of domain diversity and syntactic diversity on difficulty. We use a combination of classifiers to identify the most difficult sentences and analyze their characteristics. We employ two ways of defining sentence difficulty. The first one is binary and labels a sentence as difficult if the classifiers fail to correctly predict the sentiment polarity. The second one is a six-level scale based on how many of the top five best-performing classifiers can correctly predict the sentiment polarity. We also define 9 linguistic features that, combined, aim at estimating the difficulty at sentence level.


title: Decidable Reasoning About Time in Finite-Domain Situation Calculus Theories

abstract: Representing time is crucial for cyber-physical systems and has been studied extensively in the Situation Calculus. The most commonly used approach represents time by adding a real-valued fluent $\mathit{time}(a)$ that attaches a time point to each action and consequently to each situation. We show that in this approach, checking whether there is a reachable situation that satisfies a given formula is undecidable, even if the domain of discourse is restricted to a finite set of objects. We present an alternative approach based on well-established results from timed automata theory by introducing clocks as real-valued fluents with restricted successor state axioms and comparison operators. %that only allow comparisons against fixed rationals. With this restriction, we can show that the reachability problem for finite-domain basic action theories is decidable. Finally, we apply our results on Golog program realization by presenting a decidable procedure for determining an action sequence that is a successful execution of a given program.


title: Risk-Aware MPC for Stochastic Systems with Runtime Temporal Logics

abstract: This paper concerns the risk-aware control of stochastic systems with temporal logic specifications dynamically assigned during runtime. Conventional risk-aware control typically assumes that all specifications are predefined and remain unchanged during runtime. In this paper, we propose a novel, provably correct model predictive control scheme for linear systems with additive unbounded stochastic disturbances that dynamically evaluates the feasibility of runtime signal temporal logic specifications and automatically reschedules the control inputs accordingly. The control method guarantees the probabilistic satisfaction of newly accepted specifications without sacrificing the satisfaction of the previously accepted ones. The proposed control method is validated by a robotic motion planning case study.


title: RRWNet: Recursive Refinement Network for Effective Retinal Artery/Vein Segmentation and Classification

abstract: The caliber and configuration of retinal blood vessels serve as important biomarkers for various diseases and medical conditions. A thorough analysis of the retinal vasculature requires the segmentation of the blood vessels and their classification into arteries and veins, typically performed on color fundus images obtained by retinography. However, manually performing these tasks is labor-intensive and prone to human error. While several automated methods have been proposed to address this task, the current state of art faces challenges due to manifest classification errors affecting the topological consistency of segmentation maps. In this work, we introduce RRWNet, a novel end-to-end deep learning framework that addresses this limitation. The framework consists of a fully convolutional neural network that recursively refines semantic segmentation maps, correcting manifest classification errors and thus improving topological consistency. In particular, RRWNet is composed of two specialized subnetworks: a Base subnetwork that generates base segmentation maps from the input images, and a Recursive Refinement subnetwork that iteratively and recursively improves these maps. Evaluation on three different public datasets demonstrates the state-of-the-art performance of the proposed method, yielding more topologically consistent segmentation maps with fewer manifest classification errors than existing approaches. In addition, the Recursive Refinement module within RRWNet proves effective in post-processing segmentation maps from other methods, further demonstrating its potential. The model code, weights, and predictions will be publicly available at https://github.com/j-morano/rrwnet.


title: Decentralized Bilevel Optimization over Graphs: Loopless Algorithmic Update and Transient Iteration Complexity

abstract: Stochastic bilevel optimization (SBO) is becoming increasingly essential in machine learning due to its versatility in handling nested structures. To address large-scale SBO, decentralized approaches have emerged as effective paradigms in which nodes communicate with immediate neighbors without a central server, thereby improving communication efficiency and enhancing algorithmic robustness. However, current decentralized SBO algorithms face challenges, including expensive inner-loop updates and unclear understanding of the influence of network topology, data heterogeneity, and the nested bilevel algorithmic structures. In this paper, we introduce a single-loop decentralized SBO (D-SOBA) algorithm and establish its transient iteration complexity, which, for the first time, clarifies the joint influence of network topology and data heterogeneity on decentralized bilevel algorithms. D-SOBA achieves the state-of-the-art asymptotic rate, asymptotic gradient/Hessian complexity, and transient iteration complexity under more relaxed assumptions compared to existing methods. Numerical experiments validate our theoretical findings.


title: Enhancing model identification with SINDy via nullcline reconstruction

abstract: Many dynamical systems exhibit oscillatory behavior that can be modeled with differential equations. Recently, these equations have increasingly been derived through data-driven methods, including the transparent technique known as Sparse Identification of Nonlinear Dynamics (SINDy). This paper illustrates the importance of accurately determining the system's limit cycle position in phase space for identifying sparse and effective models. We introduce a method for identifying the limit cycle position and the system's nullclines by applying SINDy to datasets adjusted with various offsets. This approach is evaluated using three criteria: model complexity, coefficient of determination, and generalization error. We applied this method to several models: the oscillatory FitzHugh-Nagumo model, a more complex model consisting of two coupled cubic differential equations with a single stable state, and a multistable model of glycolytic oscillations. Our results confirm that incorporating detailed information about the limit cycle in phase space enhances the accuracy of model identification in oscillatory systems.e space can improve the success of model identification efforts in oscillatory systems.


title: A Random Matrix Approach to Low-Multilinear-Rank Tensor Approximation

abstract: This work presents a comprehensive understanding of the estimation of a planted low-rank signal from a general spiked tensor model near the computational threshold. Relying on standard tools from the theory of large random matrices, we characterize the large-dimensional spectral behavior of the unfoldings of the data tensor and exhibit relevant signal-to-noise ratios governing the detectability of the principal directions of the signal. These results allow to accurately predict the reconstruction performance of truncated multilinear SVD (MLSVD) in the non-trivial regime. This is particularly important since it serves as an initialization of the higher-order orthogonal iteration (HOOI) scheme, whose convergence to the best low-multilinear-rank approximation depends entirely on its initialization. We give a sufficient condition for the convergence of HOOI and show that the number of iterations before convergence tends to $1$ in the large-dimensional limit.