title: Convex Relaxation for Solving Large-Margin Classifiers in Hyperbolic Space

abstract: Hyperbolic spaces have increasingly been recognized for their outstanding performance in handling data with inherent hierarchical structures compared to their Euclidean counterparts. However, learning in hyperbolic spaces poses significant challenges. In particular, extending support vector machines to hyperbolic spaces is in general a constrained non-convex optimization problem. Previous and popular attempts to solve hyperbolic SVMs, primarily using projected gradient descent, are generally sensitive to hyperparameters and initializations, often leading to suboptimal solutions. In this work, by first rewriting the problem into a polynomial optimization, we apply semidefinite relaxation and sparse moment-sum-of-squares relaxation to effectively approximate the optima. From extensive empirical experiments, these methods are shown to perform better than the projected gradient descent approach.


title: Physically Consistent Modeling & Identification of Nonlinear Friction with Dissipative Gaussian Processes

abstract: Friction modeling has always been a challenging problem due to the complexity of real physical systems. Although a few state-of-the-art structured data-driven methods show their efficiency in nonlinear system modeling, deterministic passivity as one of the significant characteristics of friction is rarely considered in these methods. To address this issue, we propose a Gaussian Process based model that preserves the inherent structural properties such as passivity. A matrix-vector physical structure is considered in our approaches to ensure physical consistency, in particular, enabling a guarantee of positive semi-definiteness of the damping matrix. An aircraft benchmark simulation is employed to demonstrate the efficacy of our methodology. Estimation accuracy and data efficiency are increased substantially by considering and enforcing more structured physical knowledge. Also, the fulfillment of the dissipative nature of the aerodynamics is validated numerically.


title: A Mathematical Theory of Integer Quantum Hall Effect in Photonics

abstract: This paper investigates interface modes in a square lattice of photonic crystal composed of gyromagnetic particles with $C_{4v}$ point group symmetry. The study shows that Dirac or linear degenerate points cannot occur at the three high symmetry points in the Brillouin zone where two Bloch bands touch. Instead, a touch point at the M-point has a quadratic degeneracy in the generic case. It is further proved that when a magnetic field is applied to the two sides of an interface in opposite directions, two interface modes that are supported along that interface can be bifurcated from the quadratic degenerate point. The results provide a mathematical foundation for the first experiment realization of the integer quantum Hall effect in the context of photonics.


title: Diagnosing the Compositional Knowledge of Vision Language Models from a Game-Theoretic View

abstract: Compositional reasoning capabilities are usually considered as fundamental skills to characterize human perception. Recent studies show that current Vision Language Models (VLMs) surprisingly lack sufficient knowledge with respect to such capabilities. To this end, we propose to thoroughly diagnose the composition representations encoded by VLMs, systematically revealing the potential cause for this weakness. Specifically, we propose evaluation methods from a novel game-theoretic view to assess the vulnerability of VLMs on different aspects of compositional understanding, e.g., relations and attributes. Extensive experimental results demonstrate and validate several insights to understand the incapabilities of VLMs on compositional reasoning, which provide useful and reliable guidance for future studies. The deliverables will be updated at https://vlms-compositionality-gametheory.github.io/.


title: Efficient multi-prompt evaluation of LLMs

abstract: Most popular benchmarks for comparing LLMs rely on a limited set of prompt templates, which may not fully capture the LLMs' abilities and can affect the reproducibility of results on leaderboards. Many recent works empirically verify prompt sensitivity and advocate for changes in LLM evaluation. In this paper, we consider the problem of estimating the performance distribution across many prompt variants instead of finding a single prompt to evaluate with. We introduce PromptEval, a method for estimating performance across a large set of prompts borrowing strength across prompts and examples to produce accurate estimates under practical evaluation budgets. The resulting distribution can be used to obtain performance quantiles to construct various robust performance metrics (e.g., top 95% quantile or median). We prove that PromptEval consistently estimates the performance distribution and demonstrate its efficacy empirically on three prominent LLM benchmarks: MMLU, BIG-bench Hard, and LMentry. For example, PromptEval can accurately estimate performance quantiles across 100 prompt templates on MMLU with a budget equivalent to two single-prompt evaluations. Our code and data can be found at https://github.com/felipemaiapolo/prompt-eval.


title: Multivariate Mond-Pecaric Method with Applications to Hypercomplex Function Sobolev Embedding

abstract: Mond and Pecaric introduced a method to simplify the determination of complementary inequalities for Jensen's inequality by converting it into a single-variable maximization or minimization problem of continuous functions. This principle has significantly enriched the field of operator inequalities. Our contribution lies in extending the Mond-Pecaric method from single-input operators to multiple-input operators. We commence by defining normalized positive linear maps, accompanied by illustrative examples. Subsequently, we employ the Mond-Pecaric method to derive fundamental inequalities for multivariate hypercomplex functions bounded by linear functions. These foundational inequalities serve as the basis for establishing several multivariate hypercomplex function inequalities, focusing on ratio relationships. Additionally, we present similar results based on difference relationships. Finally, we apply the derived multivariate hypercomplex function inequalities to establish Sobolev embedding via Sobolev inequality for hypercomplex functions with operator inputs.


title: Numerical solution of the boundary value problem of elliptic equation by Levi function scheme

abstract: For boundary value problem of an elliptic equation with variable coefficients describing the physical field distribution in inhomogeneous media, the Levi function can represent the solution in terms of volume and surface potentials, with the drawback that the volume potential involving in the solution expression requires heavy computational costs as well as the solvability of the integral equations with respect to the density pair. We introduce an modified integral expression for the solution to an elliptic equation in divergence form under the Levi function framework. The well-posedness of the linear integral system with respect to the density functions to be determined is rigorously proved. Based on the singularity decomposition for the Levi function, we propose two schemes to deal with the volume integrals so that the density functions can be solved efficiently. One method is an adaptive discretization scheme (ADS) for computing the integrals with continuous integrands, leading to the uniform accuracy of the integrals in the whole domain, and consequently the efficient computations for the density functions. The other method is the dual reciprocity method (DRM) which is a meshless approach converting the volume integrals into boundary integrals equivalently by expressing the volume density as the combination of the radial basis functions determined by the interior grids. The proposed schemes are justified numerically to be of satisfactory computation costs. Numerical examples in 2-dimensional and 3-dimensional cases are presented to show the validity of the proposed schemes.


title: An asymptotic expansion for a Lambert series associated to Siegel cusp forms of degree $n$

abstract: Utilizing inverse Mellin transform of the symmetric square $L$-function attached to Ramanujan tau function, Hafner and Stopple proved a conjecture of Zagier, which states that the constant term of the automorphic function $y^{12}|\Delta(z)|^2$ i.e., the Lambert series $y^{12}\sum_{n=1}^\infty \tau(n)^2 e^{-4 \pi n y}$ can be expressed in terms of the non-trivial zeros of the Riemann zeta function. This study examines certain Lambert series associated to Siegel cusp forms of degree $n$ twisted by a character $\chi$ and observes a similar phenomenon.


title: A Novel Fusion Architecture for PD Detection Using Semi-Supervised Speech Embeddings

abstract: We present a framework to recognize Parkinson's disease (PD) through an English pangram utterance speech collected using a web application from diverse recording settings and environments, including participants' homes. Our dataset includes a global cohort of 1306 participants, including 392 diagnosed with PD. Leveraging the diversity of the dataset, spanning various demographic properties (such as age, sex, and ethnicity), we used deep learning embeddings derived from semi-supervised models such as Wav2Vec 2.0, WavLM, and ImageBind representing the speech dynamics associated with PD. Our novel fusion model for PD classification, which aligns different speech embeddings into a cohesive feature space, demonstrated superior performance over standard concatenation-based fusion models and other baselines (including models built on traditional acoustic features). In a randomized data split configuration, the model achieved an Area Under the Receiver Operating Characteristic Curve (AUROC) of 88.94% and an accuracy of 85.65%. Rigorous statistical analysis confirmed that our model performs equitably across various demographic subgroups in terms of sex, ethnicity, and age, and remains robust regardless of disease duration. Furthermore, our model, when tested on two entirely unseen test datasets collected from clinical settings and from a PD care center, maintained AUROC scores of 82.12% and 78.44%, respectively. This affirms the model's robustness and it's potential to enhance accessibility and health equity in real-world applications.


title: Ultra-precise, sub-picometer tunable free spectral range in a parabolic microresonator induced by optical fiber bending

abstract: Surface Nanoscale Axial Photonic (SNAP) microresonators are fabricated on silica optical fibers, leveraging silica's outstanding material and mechanical properties. These properties allow for precise control over the microresonator dimension, shape, and mode structure, a key feature for reconfigurable photonic circuits. Such circuits find applications in high-speed communications, optical computing, and optical frequency combs (OFC). However, consistently producing SNAP microresonators with equally spaced eigenmodes has remained challenging. In this study, we introduce a method to create a SNAP microresonator with a parabolic profile. We accomplish this by bending a silica optical fiber in a controlled manner using two linear stages. This approach achieves a uniform free spectral range (FSR) as narrow as 1 pm across more than 45 modes. We further demonstrate that the FSR of the SNAP microresonator can be continuously adjusted over a range nearly as wide as one FSR itself, specifically from 1.09 pm to 1.72 pm, with a precision of +/-0.01 pm and high repeatability. Given its compact size and tuning capability, this SNAP microresonator is highly promising for various applications, including the generation of tunable low-repetition-rate OFC and delay lines.


title: Impact and mitigation of spectroscopic systematics on DESI DR1 clustering measurements

abstract: The large scale structure catalogs within DESI Data Release 1 (DR1) use nearly 6 million galaxies and quasars as tracers of the large-scale structure of the universe to measure the expansion history with baryon acoustic oscillations and the growth of structure with redshift-space distortions. In order to take advantage of DESI's unprecedented statistical power, we must ensure that the galaxy clustering measurements are unaffected by non-cosmological density fluctuations. One source of spurious fluctuations comes from variation in galaxy density with spectroscopic observing conditions, lowering the redshift efficiency (and thus galaxy density) in certain areas of the sky. We measure the uniformity of the redshift success rate for DESI luminous red galaxies (LRG), bright galaxies (BGS) and quasars (QSO), complementing the detailed discussion of emission line galaxy (ELG) systematics in a companion paper (Yu et al., 2024). We find small but significant fluctuations of up to 3% in redshift success rate with the effective spectroscopic signal-to-noise, and create and describe weights that remove these fluctuations. We also describe the process to identify and remove data from certain poorly performing fibers from DESI DR1, and measure the stability of the redshift success rate with time. Finally, we find small but significant correlations of redshift success rate with position on the focal plane, survey speed, and number of exposures required, and show the impact of weights correcting these trends on the power spectrum multipoles and on cosmological parameters from BAO and RSD fits. These corrections change the best-fit parameters by $<15\%$ of their statistical errors, and thus contribute negligibly to the overall DESI error budget.


title: How Do Transformers "Do" Physics? Investigating the Simple Harmonic Oscillator

abstract: How do transformers model physics? Do transformers model systems with interpretable analytical solutions, or do they create "alien physics" that are difficult for humans to decipher? We take a step in demystifying this larger puzzle by investigating the simple harmonic oscillator (SHO), $\ddot{x}+2\gamma \dot{x}+\omega_0^2x=0$, one of the most fundamental systems in physics. Our goal is to identify the methods transformers use to model the SHO, and to do so we hypothesize and evaluate possible methods by analyzing the encoding of these methods' intermediates. We develop four criteria for the use of a method within the simple testbed of linear regression, where our method is $y = wx$ and our intermediate is $w$: (1) Can the intermediate be predicted from hidden states? (2) Is the intermediate's encoding quality correlated with model performance? (3) Can the majority of variance in hidden states be explained by the intermediate? (4) Can we intervene on hidden states to produce predictable outcomes? Armed with these two correlational (1,2), weak causal (3) and strong causal (4) criteria, we determine that transformers use known numerical methods to model trajectories of the simple harmonic oscillator, specifically the matrix exponential method. Our analysis framework can conveniently extend to high-dimensional linear systems and nonlinear systems, which we hope will help reveal the "world model" hidden in transformers.


title: Flow control of three-dimensional cylinders transitioning to turbulence via multi-agent reinforcement learning

abstract: Designing active-flow-control (AFC) strategies for three-dimensional (3D) bluff bodies is a challenging task with critical industrial implications. In this study we explore the potential of discovering novel control strategies for drag reduction using deep reinforcement learning. We introduce a high-dimensional AFC setup on a 3D cylinder, considering Reynolds numbers ($Re_D$) from $100$ to $400$, which is a range including the transition to 3D wake instabilities. The setup involves multiple zero-net-mass-flux jets positioned on the top and bottom surfaces, aligned into two slots. The method relies on coupling the computational-fluid-dynamics solver with a multi-agent reinforcement-learning (MARL) framework based on the proximal-policy-optimization algorithm. MARL offers several advantages: it exploits local invariance, adaptable control across geometries, facilitates transfer learning and cross-application of agents, and results in a significant training speedup. For instance, our results demonstrate $21\%$ drag reduction for $Re_D=300$, outperforming classical periodic control, which yields up to $6\%$ reduction. To the authors' knowledge, the present MARL-based framework represents the first time where training is conducted in 3D cylinders. This breakthrough paves the way for conducting AFC on progressively more complex turbulent-flow configurations.


title: Spectral-Refiner: Fine-Tuning of Accurate Spatiotemporal Neural Operator for Turbulent Flows

abstract: Recent advancements in operator-type neural networks have shown promising results in approximating the solutions of spatiotemporal Partial Differential Equations (PDEs). However, these neural networks often entail considerable training expenses, and may not always achieve the desired accuracy required in many scientific and engineering disciplines. In this paper, we propose a new Spatiotemporal Fourier Neural Operator (SFNO) that learns maps between Bochner spaces, and a new learning framework to address these issues. This new paradigm leverages wisdom from traditional numerical PDE theory and techniques to refine the pipeline of commonly adopted end-to-end neural operator training and evaluations. Specifically, in the learning problems for the turbulent flow modeling by the Navier-Stokes Equations (NSE), the proposed architecture initiates the training with a few epochs for SFNO, concluding with the freezing of most model parameters. Then, the last linear spectral convolution layer is fine-tuned without the frequency truncation. The optimization uses a negative Sobolev norm for the first time as the loss in operator learning, defined through a reliable functional-type \emph{a posteriori} error estimator whose evaluation is almost exact thanks to the Parseval identity. This design allows the neural operators to effectively tackle low-frequency errors while the relief of the de-aliasing filter addresses high-frequency errors. Numerical experiments on commonly used benchmarks for the 2D NSE demonstrate significant improvements in both computational efficiency and accuracy, compared to end-to-end evaluation and traditional numerical PDE solvers.


title: A new parametrization of Hubble function and Hubble tension

abstract: We present a new Hubble parameterization method and employ observational data from Hubble, Pantheon, and Baryon Acoustic Oscillations to constrain model parameters. The proposed method is thoroughly validated against these datasets, demonstrating a robust fit to the observational data. The obtained best-fit values are $H_0 = 67.5^{+1.3}_{-1.6}$ $\text{km s}^{-1} \text{Mpc}^{-1}$, $\Omega_{\rm{m0}} = 0.2764\pm{0.0094}$, and $\alpha = 0.33\pm{0.22}$, consistent with the Planck 2018 results, highlighting the existence of Hubble tension.


title: Highly inhomogeneous interactions between background climate and urban warming across typical local climate zones in heatwave and non-heatwave days

abstract: Urban heat island (UHI) in conjunction with heatwave (HW) leads to exacerbation of thermal stress in urban areas. Prior research on UHI and HW has predominantly concentrated on examining the thermal conditions at the surface and near-surface, with few investigations extending to the radiative and dynamical interactions of UHI and HW, particularly with a focus on the inhomogeneities across local climate zones (LCZs). Here, we analyse the temperature disparity between HW and non-HW conditions across LCZs in the Sydney area by quantifying the contributions of individual radiative and dynamical processes using the coupled surface-atmosphere climate feedback-response analysis method (CFRAM). Three HW events in 2017, 2019, and 2020 are simulated using the Weather Research and Forecasting (WRF) model coupled with the Single-Layer Urban Canopy Model (SLUCM). The maximum temperature difference between HW and non-HW days may reach up to 10 K, with the increased net solar radiation during HWs being comparable to the typical level of anthropogenic heat flux in urban areas. It is also found that the reduction of clouds, the presence of vapor, and the increase of sensible heat contribute to the warming effect at different levels, with the contribution of clouds being the most dominant. Conversely, the generation of dry convection and the increase of latent heat flux lead to mitigating effects, with the latter being more dominant and capable of causing up to 10 K surface temperature difference between LCZ1 (compact high-rise) and LCZ9 (sparsely built). The differences in the contributions of climate feedback processes across different LCZs become more evident during more severe and humid HWs. These findings underscore the necessity of implementing local climate zone-tailored heat mitigation strategies.


title: Modelling between- and within-season trajectories in elite athletic performance data

abstract: Athletic performance follows a typical pattern of improvement and decline during a career. This pattern is also often observed within-seasons as athlete aims for their performance to peak at key events such as the Olympic Games or World Championships. A Bayesian hierarchical model is developed to analyse the evolution of athletic sporting performance throughout an athlete's career and separate these effects whilst allowing for confounding factors such as environmental conditions. Our model works in continuous time and estimates both the average performance level of the population, $g(t)$, at age $t$ and how each $i$-th athlete differs from the average $f_i(t)$. We further decompose $f_i(t)$ into changes from season-to-season, termed the between-season performance trajectory, and within-season performance trajectories which are modelled by a constrained Bernstein polynomial. Hence, the specific focus of this project is to identify the differences in performance that exist both between and within-seasons for each athlete. For the implementation of the model an adaptive Metropolis-within-Gibbs algorithm is used. An illustration of algorithm's performance on 100 metres and 200 metres freestyle swimming in both female and male athletes is presented.


title: $L^p$ Hodge theory for bounded subanalytic manifolds

abstract: Given a bounded subanalytic submanifold of $\mathbb{R}^n$, possibly admitting singularities within its closure, we study the cohomology of $L^p$ differential forms having an $L^p$ exterior differential (in the sense of currents) and satisfying Dirichlet or Neumann condition. We show an $L^p$ Hodge decomposition theorem, an $L^p$ de Rham theorem, as well as a Lefschetz duality theorem between $L^p$ and $L^{p'}$ forms (with $\frac{1}{p}+\frac{1}{p'}=1$) in the case where $p$ is large or close to $1$. This is achieved by proving that de Rham's pairing between complementary $L^p$ differential forms induces a pairing between cohomology classes which is nondegenerate (for such $p$). The main difficulty to carry it out is to show the density (in Sobolev spaces of differential forms) of forms that vanish near some singularities and are smooth up to the closure of the underlying manifold in the case $p$ large (Theorem 4.1). This result, which is of independent interest, also makes it possible to give a trace theorem that leads us to some explicit characterizations of Dirichlet and Neumann conditions in terms of traces and residues.


title: Autoformalizing Euclidean Geometry

abstract: Autoformalization involves automatically translating informal math into formal theorems and proofs that are machine-verifiable. Euclidean geometry provides an interesting and controllable domain for studying autoformalization. In this paper, we introduce a neuro-symbolic framework for autoformalizing Euclidean geometry, which combines domain knowledge, SMT solvers, and large language models (LLMs). One challenge in Euclidean geometry is that informal proofs rely on diagrams, leaving gaps in texts that are hard to formalize. To address this issue, we use theorem provers to fill in such diagrammatic information automatically, so that the LLM only needs to autoformalize the explicit textual steps, making it easier for the model. We also provide automatic semantic evaluation for autoformalized theorem statements. We construct LeanEuclid, an autoformalization benchmark consisting of problems from Euclid's Elements and the UniGeo dataset formalized in the Lean proof assistant. Experiments with GPT-4 and GPT-4V show the capability and limitations of state-of-the-art LLMs on autoformalizing geometry problems. The data and code are available at https://github.com/loganrjmurphy/LeanEuclid.


title: Collage is the New Writing: Exploring the Fragmentation of Text and User Interfaces in AI Tools

abstract: This essay proposes and explores the concept of Collage for the design of AI writing tools, transferred from avant-garde literature with four facets: 1) fragmenting text in writing interfaces, 2) juxtaposing voices (content vs command), 3) integrating material from multiple sources (e.g. text suggestions), and 4) shifting from manual writing to editorial and compositional decision-making, such as selecting and arranging snippets. The essay then employs Collage as an analytical lens to analyse the user interface design of recent AI writing tools, and as a constructive lens to inspire new design directions. Finally, a critical perspective relates the concerns that writers historically expressed through literary collage to AI writing tools. In a broad view, this essay explores how literary concepts can help advance design theory around AI writing tools. It encourages creators of future writing tools to engage not only with new technological possibilities, but also with past writing innovations.


title: Quasi-transitive $K_\infty$-minor free graphs

abstract: We prove that every locally finite quasi-transitive graph that does not contain $K_\infty$ as a minor is quasi-isometric to some planar quasi-transitive locally finite graph. This solves a problem of Esperet and Giocanti and improves their recent result that such graphs are quasi-isometric to some planar graph of bounded degree.


title: How likely is the interstellar origin of CNEOS14? On the reliability of the CNEOS database

abstract: This paper investigates the likelihood that the CNEOS 2014-01-08 superbolide (CNEOS14) was caused by an interstellar object. This issue has remained controversial due to lack of information on the capabilities of the classified satellite sensors that recorded the fireball. We critically evaluate previous studies, specifically addressing the reliability of the CNEOS database and the associated measurement uncertainties. With proper statistical analysis of existing data and the addition of a relevant new event (the 2024 Iberian superbolide), we disprove some claims in previous work, such as: a) the existence of a purported correlation between CNEOS velocity errors and bolide speed; b) the presence of large velocity errors of 10-15 km/s in the CNEOS database; and c) the assertion that CNEOS14 is most likely a solar system object with a hyperbolic trajectory due to measurement errors. We present a quantitative estimate of the probability that CNEOS14 is interstellar. If its measurement errors are drawn from the same underlying distribution as the 18 calibrated events, then the probability that CNEOS14 is interstellar is 94.1%. This probability is lower than the 99.7% confidence (3-sigma) generally required to claim a scientific discovery. However, it is sufficiently high to be considered significant and, by far, the most likely explanation for the currently available empirical evidence.


title: RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness

abstract: Learning from feedback reduces the hallucination of multimodal large language models (MLLMs) by aligning them with human preferences. While traditional methods rely on labor-intensive and time-consuming manual labeling, recent approaches employing models as automatic labelers have shown promising results without human intervention. However, these methods heavily rely on costly proprietary models like GPT-4V, resulting in scalability issues. Moreover, this paradigm essentially distills the proprietary models to provide a temporary solution to quickly bridge the performance gap. As this gap continues to shrink, the community is soon facing the essential challenge of aligning MLLMs using labeler models of comparable capability. In this work, we introduce RLAIF-V, a novel framework that aligns MLLMs in a fully open-source paradigm for super GPT-4V trustworthiness. RLAIF-V maximally exploits the open-source feedback from two perspectives, including high-quality feedback data and online feedback learning algorithm. Extensive experiments on seven benchmarks in both automatic and human evaluation show that RLAIF-V substantially enhances the trustworthiness of models without sacrificing performance on other tasks. Using a 34B model as labeler, RLAIF-V 7B model reduces object hallucination by 82.9\% and overall hallucination by 42.1\%, outperforming the labeler model. Remarkably, RLAIF-V also reveals the self-alignment potential of open-source MLLMs, where a 12B model can learn from the feedback of itself to achieve less than 29.5\% overall hallucination rate, surpassing GPT-4V (45.9\%) by a large margin. The results shed light on a promising route to enhance the efficacy of leading-edge MLLMs.


title: Efficient Orchestrated AI Workflows Execution on Scale-out Spatial Architecture

abstract: Given the increasing complexity of AI applications, traditional spatial architectures frequently fall short. Our analysis identifies a pattern of interconnected, multi-faceted tasks encompassing both AI and general computational processes. In response, we have conceptualized "Orchestrated AI Workflows," an approach that integrates various tasks with logic-driven decisions into dynamic, sophisticated workflows. Specifically, we find that the intrinsic Dual Dynamicity of Orchestrated AI Workflows, namely dynamic execution times and frequencies of Task Blocks, can be effectively represented using the Orchestrated Workflow Graph. Furthermore, the intrinsic Dual Dynamicity poses challenges to existing spatial architecture, namely Indiscriminate Resource Allocation, Reactive Load Rebalancing, and Contagious PEA Idleness. To overcome these challenges, we present Octopus, a scale-out spatial architecture and a suite of advanced scheduling strategies optimized for executing Orchestrated AI Workflows, such as the Discriminate Dual-Scheduling Mechanism, Adaptive TBU Scheduling Strategy, and Proactive Cluster Scheduling Strategy. Our evaluations demonstrate that Octopus significantly outperforms traditional architectures in handling the dynamic demands of Orchestrated AI Workflows, and possesses robust scalability in large scale hardware such as wafer-scale chip.


title: A Retrospective of the Tutorial on Opportunities and Challenges of Online Deep Learning

abstract: Machine learning algorithms have become indispensable in today's world. They support and accelerate the way we make decisions based on the data at hand. This acceleration means that data structures that were valid at one moment could no longer be valid in the future. With these changing data structures, it is necessary to adapt machine learning (ML) systems incrementally to the new data. This is done with the use of online learning or continuous ML technologies. While deep learning technologies have shown exceptional performance on predefined datasets, they have not been widely applied to online, streaming, and continuous learning. In this retrospective of our tutorial titled Opportunities and Challenges of Online Deep Learning held at ECML PKDD 2023, we provide a brief overview of the opportunities but also the potential pitfalls for the application of neural networks in online learning environments using the frameworks River and Deep-River.


title: Analysing the interactions between demand side and supply side investment decisions in an oligopolistic electricity market using a stochastic mixed complementarity problem

abstract: To meet carbon emission targets, governments around the world seek electricity consumers to invest in self-sufficiency technologies such as solar photovoltaic and battery storage. Such behaviour is sought in markets typically characterised by an oligopoly amongst generating firms. In this work, we study the interactions between investment decisions on the demand side and the supply side, and we investigate how price-making behaviour on the supply side affects these interactions compared to a situation with perfect competition. To do so, we introduce a novel stochastic mixed complementarity problem to model several players in an oligopolistic electricity market. On the supply side, we consider generating firms who make operational and investment decisions. On the demand side, we consider both industrial and residential consumers, each of whom may invest in self-sufficiency technologies. The uncertainties of wind and solar generation are the sources of the model's stochasticity. We apply the model to a case study of a stylised Irish electricity system in 2030. Our results demonstrate that price-making on the supply side increases investment in self-sufficiency on the demand side, leading to a reduction in prices and carbon emissions. We also find that both market power and self-sufficiency alter the investment and decommissioning decisions made by generation firms. Counter-intuitively, we also observe that the absence of a feed-in premium increases investment in solar generation on the demand side. Our findings highlight the importance of including both demand and supply side investment in models of electricity markets characterised by an oligopoly.


title: The Epistemology behind Covariate Adjustment

abstract: It is often asserted that to control for the effects of confounders, one should include the confounding variables of concern in a statistical model as a covariate. Conversely, it is also asserted that control can only be concluded by design, where the results from an analysis can only be interpreted as evidence of an effect because the design controlled for the cause. To suggest otherwise is said to be a fallacy of cum hoc ergo propter hoc. Obviously, these two assertions create a conundrum: How can the effect of confounder be controlled for with analysis instead of by design without committing cum hoc ergo propter hoc? The present manuscript answers this conundrum.


title: Quantifying the Reliance of Black-Box Decision-Makers on Variables of Interest

abstract: This paper introduces a framework for measuring how much black-box decision-makers rely on variables of interest. The framework adapts a permutation-based measure of variable importance from the explainable machine learning literature. With an emphasis on applicability, I present some of the framework's theoretical and computational properties, explain how reliance computations have policy implications, and work through an illustrative example. In the empirical application to interruptions by Supreme Court Justices during oral argument, I find that the effect of gender is more muted compared to the existing literature's estimate; I then use this paper's framework to compare Justices' reliance on gender and alignment to their reliance on experience, which are incomparable using regression coefficients.


title: On the regularity of the structure of branched immersions

abstract: We show the existence of some special coordinate systems for expressing maps with branch points. These coordinates allow obtaining an explicit representation formula of branch immersions and understanding the regularity of some fundamental elements in the theory of R. D. Gulliver, R. Osserman and H. L. Royden. For conformal maps, we prove that these coordinates exist with certain regularity if and only if the mean curvature vector extends and is in a particular H\"older space. In the general case, we characterize this type of coordinate system. Also, using these coordinates, we study the regularity and behavior of curvatures near branch points.


title: Learning Generic and Dynamic Locomotion of Humanoids Across Discrete Terrains

abstract: This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive control, excel in finding optimal reaction forces and achieving agile locomotion, especially in quadruped, but struggle with the nonlinear hybrid dynamics of legged systems and the real-time computation of step location, timing, and reaction forces. Conversely, RL-based methods show promise in navigating dynamic and rough terrains but are limited by their extensive data requirements. We introduce a novel locomotion architecture that integrates a neural network policy, trained through RL in simplified environments, with a state-of-the-art motion controller combining model-predictive control (MPC) and whole-body impulse control (WBIC). The policy efficiently learns high-level locomotion strategies, such as gait selection and step positioning, without the need for full dynamics simulations. This control architecture enables humanoid robots to dynamically navigate discrete terrains, making strategic locomotion decisions (e.g., walking, jumping, and leaping) based on ground height maps. Our results demonstrate that this integrated control architecture achieves dynamic locomotion with significantly fewer training samples than conventional RL-based methods and can be transferred to different humanoid platforms without additional training. The control architecture has been extensively tested in dynamic simulations, accomplishing terrain height-based dynamic locomotion for three different robots.


title: Antifragility of stochastic transport on networks with damage

abstract: A system is called antifragile when damage acts as a constructive element improving the performance of a global function. In this letter, we analyze the emergence of antifragility in the movement of random walkers on networks with modular structures or communities. The random walker hops considering the capacity of transport of each link, whereas the links are susceptible to random damage that accumulates over time. We show that in networks with communities and high modularity, the localization of damage in specific groups of nodes leads to a global antifragile response of the system improving the capacity of stochastic transport to more easily reach the nodes of a network. Our findings give evidence of the mechanisms behind antifragile response in complex systems and pave the way for their quantitative exploration in different fields.


title: InsigHTable: Insight-driven Hierarchical Table Visualization with Reinforcement Learning

abstract: Embedding visual representations within original hierarchical tables can mitigate additional cognitive load stemming from the division of users' attention. The created hierarchical table visualizations can help users understand and explore complex data with multi-level attributes. However, because of many options available for transforming hierarchical tables and selecting subsets for embedding, the design space of hierarchical table visualizations becomes vast, and the construction process turns out to be tedious, hindering users from constructing hierarchical table visualizations with many data insights efficiently. We propose InsigHTable, a mixed-initiative and insight-driven hierarchical table transformation and visualization system. We first define data insights within hierarchical tables, which consider the hierarchical structure in the table headers. Since hierarchical table visualization construction is a sequential decision-making process, InsigHTable integrates a deep reinforcement learning framework incorporating an auxiliary rewards mechanism. This mechanism addresses the challenge of sparse rewards in constructing hierarchical table visualizations. Within the deep reinforcement learning framework, the agent continuously optimizes its decision-making process to create hierarchical table visualizations to uncover more insights by collaborating with analysts. We demonstrate the usability and effectiveness of InsigHTable through two case studies and sets of experiments. The results validate the effectiveness of the deep reinforcement learning framework and show that InsigHTable can facilitate users to construct hierarchical table visualizations and understand underlying data insights.


title: Synergistic Dynamical Decoupling and Circuit Design for Enhanced Algorithm Performance on Near-Term Quantum Devices

abstract: Dynamical decoupling (DD) is a promising technique for mitigating errors in near term quantum devices. However, its effectiveness depends on both hardware characteristics and algorithm implementation details. This paper explores the synergistic effects of dynamical decoupling and optimized circuit design in maximizing the performance and robustness of algorithms on near term quantum devices. By utilizing eight IBM quantum devices, we analyze how hardware features and algorithm design impact the effectiveness of DD for error mitigation. Our analysis takes into account factors such as circuit fidelity, scheduling duration, and hardware native gate set. We also examine the influence of algorithmic implementation details including specific gate decompositions, DD sequences, and optimization levels. The results reveal an inverse relationship between the effectiveness of DD and the inherent performance of the algorithm. Furthermore, we emphasize the importance of gate directionality and circuit symmetry in improving performance. This study offers valuable insights for optimizing DD protocols and circuit designs, highlighting the significance of a holistic approach that leverages both hardware features and algorithm design for high quality and reliable execution of near term quantum algorithms.


title: Atomically sharp 1D interfaces in 2D lateral heterostructures of VSe$_2$-NbSe$_2$ monolayers

abstract: Van der Waals heterostructures have emerged as an ideal platform for creating engineered artificial electronic states. While vertical heterostructures have been extensively studied, realizing high-quality lateral heterostructures with atomically sharp interfaces remains a major experimental challenge. Here, we advance a one-pot two-step molecular beam lateral epitaxy approach and successfully synthesize atomically well-defined 1T-VSe$_2$ -- 1H-NbSe$_2$ lateral heterostructures. We demonstrate the formation of defect-free lateral heterostructures and characterize their electronic structure using scanning tunnelling microscopy and spectroscopy together with density functional theory calculations. We find additional electronic states at the one-dimensional interface as well as signatures of Kondo resonances in a side-coupled geometry. Our experiments explore the full potential of lateral heterostructures for realizing exotic electronic states in low-dimensional systems for further studies of artificial designer quantum materials.


title: K\"ahler families of Green's functions

abstract: In a remarkable series of works, Guo, Phong, Song, and Sturm have obtained key uniform estimates for the Green's functions associated with certain K\"ahler metrics. In this note, we broaden the scope of their techniques by removing one of their assumptions and allowing the complex structure to vary. We apply our results to various families of canonical K\"ahler metrics.


title: CLAQ: Pushing the Limits of Low-Bit Post-Training Quantization for LLMs

abstract: Parameter quantization for Large Language Models (LLMs) has attracted increasing attentions recently in reducing memory costs and improving computational efficiency. Early approaches have been widely adopted. However, the existing methods suffer from poor performance in low-bit (such as 2 to 3 bits) scenarios. In this paper, we present a novel and effective Column-Level Adaptive weight Quantization (CLAQ) framework by introducing three different types of adaptive strategies for LLM quantization. Firstly, a K-Means clustering based algorithm is proposed that allows dynamic generation of quantization centroids for each column of a parameter matrix. Secondly, we design an outlier-guided adaptive precision search strategy which can dynamically assign varying bit-widths to different columns. Finally, a dynamic outlier reservation scheme is developed to retain some parameters in their original float point precision, in trade off of boosted model performance. Experiments on various mainstream open source LLMs including LLaMA-1, LLaMA-2 and Yi demonstrate that our methods achieve the state-of-the-art results across different bit settings, especially in extremely low-bit scenarios. Code is available at https://github.com/fayuge/CLAQ.


title: Benchmarking General-Purpose In-Context Learning

abstract: In-context learning (ICL) empowers generative models to address new tasks effectively and efficiently on the fly, without relying on any artificially crafted optimization techniques. In this paper, we study extending ICL to address a broader range of tasks with an extended learning horizon and higher improvement potential, namely General-Purpose In-Context Learning (GPICL). To this end, we introduce two lightweight benchmarks specifically crafted to train and evaluate GPICL functionalities. Each benchmark encompasses a vast number of tasks characterized by significant task variance, facilitating meta-training that minimizes inductive bias. These tasks are also crafted to promote long-horizon in-context learning through continuous generation and interaction. These characteristics necessitate the models to leverage contexts and history interactions to enhance their capabilities, across domains such as language modeling, decision-making, and world modeling. Our experiments on the baseline models demonstrate that meta-training with minimal inductive bias and ICL from the ground up is feasible across all the domains we've discussed. Additionally, our findings indicate that the scale of parameters alone may not be crucial for ICL or GPICL, suggesting alternative approaches such as increasing the scale of contexts and memory states.


title: A study of centaur (54598) Bienor from multiple stellar occultations and rotational light curves

abstract: Centaurs, distinguished by their volatile-rich compositions, play a pivotal role in understanding the formation and evolution of the early solar system, as they represent remnants of the primordial material that populated the outer regions. Stellar occultations offer a means to investigate their physical properties, including shape, rotational state, or the potential presence of satellites and rings. This work aims to conduct a detailed study of the centaur (54598) Bienor through stellar occultations and rotational light curves from photometric data collected during recent years. We successfully predicted three stellar occultations by Bienor, which were observed from Japan, Eastern Europe, and the USA. In addition, we organized observational campaigns from Spain to obtain rotational light curves. At the same time, we develop software to generate synthetic light curves from three-dimensional shape models, enabling us to validate the outcomes through computer simulations. We resolve Bienor's projected ellipse for December 26, 2022, determine a prograde sense of rotation, and confirm an asymmetric rotational light curve. We also retrieve the axes of its triaxial ellipsoid shape as a = (127 $\pm$ 5) km, b = (55 $\pm$ 4) km, and c = (45 $\pm$ 4) km. Moreover, we refine the rotation period to 9.1736 $\pm$ 0.0002 hours and determine a geometric albedo of (6.5 $\pm$ 0.5) %, higher than previously determined by other methods. Finally, by comparing our findings with previous results and simulated rotational light curves, we analyze whether an irregular or contact-binary shape, the presence of an additional element such as a satellite, or significant albedo variations on Bienor's surface, may be present.


title: From Text to Blueprint: Leveraging Text-to-Image Tools for Floor Plan Creation

abstract: Artificial intelligence is revolutionizing architecture through text-to-image synthesis, converting textual descriptions into detailed visual representations. We explore AI-assisted floor plan design, focusing on technical background, practical methods, and future directions. Using tools like, Stable Diffusion, AI leverages models such as Generative Adversarial Networks and Variational Autoencoders to generate complex and functional floorplans designs. We evaluates these AI models' effectiveness in generating residential floor plans from text prompts. Through experiments with reference images, text prompts, and sketches, we assess the strengths and limitations of current text-to-image technology in architectural visualization. Architects can use these AI tools to streamline design processes, create multiple design options, and enhance creativity and collaboration. We highlight AI's potential to drive smarter, more efficient floorplan design, contributing to ongoing discussions on AI integration in the design profession and its future impact.


title: Mixing it up: Inflation at risk

abstract: Assessing the contribution of various risk factors to future inflation risks was crucial for guiding monetary policy during the recent high inflation period. However, existing methodologies often provide limited insights by focusing solely on specific percentiles of the forecast distribution. In contrast, this paper introduces a comprehensive framework that examines how economic indicators impact the entire forecast distribution of macroeconomic variables, facilitating the decomposition of the overall risk outlook into its underlying drivers. Additionally, the framework allows for the construction of risk measures that align with central bank preferences, serving as valuable summary statistics. Applied to the recent inflation surge, the framework reveals that U.S. inflation risk was primarily influenced by the recovery of the U.S. business cycle and surging commodity prices, partially mitigated by adjustments in monetary policy and credit spreads.


title: LLM-Assisted Static Analysis for Detecting Security Vulnerabilities

abstract: Software is prone to security vulnerabilities. Program analysis tools to detect them have limited effectiveness in practice. While large language models (or LLMs) have shown impressive code generation capabilities, they cannot do complex reasoning over code to detect such vulnerabilities, especially because this task requires whole-repository analysis. In this work, we propose IRIS, the first approach that systematically combines LLMs with static analysis to perform whole-repository reasoning to detect security vulnerabilities. We curate a new dataset, CWE-Bench-Java, comprising 120 manually validated security vulnerabilities in real-world Java projects. These projects are complex, with an average of 300,000 lines of code and a maximum of up to 7 million. Out of 120 vulnerabilities in CWE-Bench-Java, IRIS detects 69 using GPT-4, while the state-of-the-art static analysis tool only detects 27. Further, IRIS also significantly reduces the number of false alarms (by more than 80% in the best case).


title: The Three Hundred project: Estimating the dependence of gas filaments on the mass of galaxy clusters

abstract: Galaxy clusters are located in the densest areas of the universe and are intricately connected to larger structures through the filamentary network of the Cosmic Web. In this scenario, matter flows from areas of lower density to higher density. As a result, the properties of galaxy clusters are deeply influenced by the filaments that are attached to them, which are quantified by a parameter known as connectivity. We explore the dependence of gas-traced filaments connected to galaxy clusters on the mass and dynamical state of the cluster. Moreover, we evaluate the effectiveness of the cosmic web extraction procedure from the gas density maps of simulated cluster regions. Using the DisPerSE cosmic web finder, we identify filamentary structures from 3D gas particle distribution in 324 simulated regions of $30 \, h^{-1}$ Mpc side from The Three Hundred hydrodynamical simulation at redshifts z=0, 1, and 2. We estimate the connectivity at various apertures for $\sim3000$ groups and clusters spanning a mass range from $10^{13} \, h^{-1} \, M_{\odot}$ to $10^{15} \, h^{-1} \, M_{\odot}$. Relationships between connectivity and cluster properties like radius, mass, dynamical state and hydrostatic mass bias are explored. We show that the connectivity is strongly correlated with the mass of galaxy clusters, with more massive clusters being on average more connected. This finding aligns with previous studies in literature, both from observational and simulated data sets. Additionally, we observe a dependence of the connectivity on the aperture at which it is estimated. We find that connectivity decreases with cosmic time, while no dependencies on the dynamical state and hydrostatic mass bias of the cluster are found. Lastly, we observe a significant agreement between the connectivity measured from gas-traced and mock-galaxies-traced filaments in the simulation.


title: Content-Style Decoupling for Unsupervised Makeup Transfer without Generating Pseudo Ground Truth

abstract: The absence of real targets to guide the model training is one of the main problems with the makeup transfer task. Most existing methods tackle this problem by synthesizing pseudo ground truths (PGTs). However, the generated PGTs are often sub-optimal and their imprecision will eventually lead to performance degradation. To alleviate this issue, in this paper, we propose a novel Content-Style Decoupled Makeup Transfer (CSD-MT) method, which works in a purely unsupervised manner and thus eliminates the negative effects of generating PGTs. Specifically, based on the frequency characteristics analysis, we assume that the low-frequency (LF) component of a face image is more associated with its makeup style information, while the high-frequency (HF) component is more related to its content details. This assumption allows CSD-MT to decouple the content and makeup style information in each face image through the frequency decomposition. After that, CSD-MT realizes makeup transfer by maximizing the consistency of these two types of information between the transferred result and input images, respectively. Two newly designed loss functions are also introduced to further improve the transfer performance. Extensive quantitative and qualitative analyses show the effectiveness of our CSD-MT method. Our code is available at https://github.com/Snowfallingplum/CSD-MT.


title: NeurTV: Total Variation on the Neural Domain

abstract: Recently, we have witnessed the success of total variation (TV) for many imaging applications. However, traditional TV is defined on the original pixel domain, which limits its potential. In this work, we suggest a new TV regularization defined on the neural domain. Concretely, the discrete data is continuously and implicitly represented by a deep neural network (DNN), and we use the derivatives of DNN outputs w.r.t. input coordinates to capture local correlations of data. As compared with classical TV on the original domain, the proposed TV on the neural domain (termed NeurTV) enjoys two advantages. First, NeurTV is not limited to meshgrid but is suitable for both meshgrid and non-meshgrid data. Second, NeurTV can more exactly capture local correlations across data for any direction and any order of derivatives attributed to the implicit and continuous nature of neural domain. We theoretically reinterpret NeurTV under the variational approximation framework, which allows us to build the connection between classical TV and NeurTV and inspires us to develop variants (e.g., NeurTV with arbitrary resolution and space-variant NeurTV). Extensive numerical experiments with meshgrid data (e.g., color and hyperspectral images) and non-meshgrid data (e.g., point clouds and spatial transcriptomics) showcase the effectiveness of the proposed methods.


title: Modulus of Continuity of Solutions to Complex Monge-Amp\`ere Equations on Stein Spaces

abstract: In this paper, we study the modulus of continuity of solutions to Dirichlet problems for complex Monge-Amp\`ere equations with $L^p$ densities on Stein spaces with isolated singularities. In particular, we prove such solutions are H\"older continuous outside singular points if the boundary data is H\"older continuous.


title: Surprise-Adaptive Intrinsic Motivation for Unsupervised Reinforcement Learning

abstract: Both entropy-minimizing and entropy-maximizing (curiosity) objectives for unsupervised reinforcement learning (RL) have been shown to be effective in different environments, depending on the environment's level of natural entropy. However, neither method alone results in an agent that will consistently learn intelligent behavior across environments. In an effort to find a single entropy-based method that will encourage emergent behaviors in any environment, we propose an agent that can adapt its objective online, depending on the entropy conditions by framing the choice as a multi-armed bandit problem. We devise a novel intrinsic feedback signal for the bandit, which captures the agent's ability to control the entropy in its environment. We demonstrate that such agents can learn to control entropy and exhibit emergent behaviors in both high- and low-entropy regimes and can learn skillful behaviors in benchmark tasks. Videos of the trained agents and summarized findings can be found on our project page https://sites.google.com/view/surprise-adaptive-agents


title: Anomalous Entropic Behavior Observed in Quasar 3C 273

abstract: We investigate the flux intensities spanning from radio waves to $\gamma$-rays across 36 light curves of Quasar 3C 273, utilizing publicly available data collected by the Integral Science Data Centre (ISDC) database. Our analysis reveals a consistent adherence of all light curves from this quasar to $q$-Gaussian distribution. This compelling finding strongly suggests a nonextensive behavior exhibited by Quasar 3C 273. Moreover, we derive the $q$ entropic indices for these light curves, providing insights into the degree of nonextensivity, where cases with $q>1$ were primarily observed. Utilizing this index, we estimate the nonextensive entropy ($S_{q}$) and explore its correlation with the energy (in eV) and the $q$ index. Notably, we observe a tendency for the $q$ value to increase as the Tsallis entropy decreases. Remarkably, our most significant observation pertains to the relationship between the entropy $S_{q}$ and the energy of the source. We identify an anomalous behavior in entropy, particularly evident in the infrared and $\gamma$-ray wavebands.


title: Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference

abstract: Transformer-based models have unlocked a plethora of powerful intelligent applications at the edge, such as voice assistant in smart home. Traditional deployment approaches offload the inference workloads to the remote cloud server, which would induce substantial pressure on the backbone network as well as raise users' privacy concerns. To address that, in-situ inference has been recently recognized for edge intelligence, but it still confronts significant challenges stemming from the conflict between intensive workloads and limited on-device computing resources. In this paper, we leverage our observation that many edge environments usually comprise a rich set of accompanying trusted edge devices with idle resources and propose Galaxy, a collaborative edge AI system that breaks the resource walls across heterogeneous edge devices for efficient Transformer inference acceleration. Galaxy introduces a novel hybrid model parallelism to orchestrate collaborative inference, along with a heterogeneity-aware parallelism planning for fully exploiting the resource potential. Furthermore, Galaxy devises a tile-based fine-grained overlapping of communication and computation to mitigate the impact of tensor synchronizations on inference latency under bandwidth-constrained edge environments. Extensive evaluation based on prototype implementation demonstrates that Galaxy remarkably outperforms state-of-the-art approaches under various edge environment setups, achieving up to 2.5x end-to-end latency reduction.


title: Do Molecular Geometries Change Under Vibrational Strong Coupling?

abstract: As pioneering experiments have shown, strong vibrational coupling between molecular vibrations and light modes in an optical cavity can significantly alter molecular properties and even affect chemical reactivity. However, the current theoretical description is limited and far from complete. To explore the origin of this exciting observation, we investigate how the molecular structure changes under strong light-matter coupling using an ab-initio method based on the cavity Born-Oppenheimer Hartree-Fock ansatz. By optimizing H$_2$O and H$_2$O$_2$ resonantly coupled to cavity modes, we study the importance of reorientation and geometric relaxation. In addition, we show that the inclusion of one or two cavity modes can change the observed results. On the basis of our findings, we derive a simple concept to estimate the effect of the cavity interaction on the molecular geometry using the molecular polarizability and the dipole moments.


title: An Introduction to Vision-Language Modeling

abstract: Following the recent popularity of Large Language Models (LLMs), several attempts have been made to extend them to the visual domain. From having a visual assistant that could guide us through unfamiliar environments to generative models that produce images using only a high-level text description, the vision-language model (VLM) applications will significantly impact our relationship with technology. However, there are many challenges that need to be addressed to improve the reliability of those models. While language is discrete, vision evolves in a much higher dimensional space in which concepts cannot always be easily discretized. To better understand the mechanics behind mapping vision to language, we present this introduction to VLMs which we hope will help anyone who would like to enter the field. First, we introduce what VLMs are, how they work, and how to train them. Then, we present and discuss approaches to evaluate VLMs. Although this work primarily focuses on mapping images to language, we also discuss extending VLMs to videos.


title: Transformer In-Context Learning for Categorical Data

abstract: Recent research has sought to understand Transformers through the lens of in-context learning with functional data. We extend that line of work with the goal of moving closer to language models, considering categorical outcomes, nonlinear underlying models, and nonlinear attention. The contextual data are of the form $\textsf{C}=(x_1,c_1,\dots,x_N,c_{N})$ where each $c_i\in\{0,\dots,C-1\}$ is drawn from a categorical distribution that depends on covariates $x_i\in\mathbb{R}^d$. Contextual outcomes in the $m$th set of contextual data, $\textsf{C}_m$, are modeled in terms of latent function $f_m(x)\in\textsf{F}$, where $\textsf{F}$ is a functional class with $(C-1)$-dimensional vector output. The probability of observing class $c\in\{0,\dots,C-1\}$ is modeled in terms of the output components of $f_m(x)$ via the softmax. The Transformer parameters may be trained with $M$ contextual examples, $\{\textsf{C}_m\}_{m=1,M}$, and the trained model is then applied to new contextual data $\textsf{C}_{M+1}$ for new $f_{M+1}(x)\in\textsf{F}$. The goal is for the Transformer to constitute the probability of each category $c\in\{0,\dots,C-1\}$ for a new query $x_{N_{M+1}+1}$. We assume each component of $f_m(x)$ resides in a reproducing kernel Hilbert space (RKHS), specifying $\textsf{F}$. Analysis and an extensive set of experiments suggest that on its forward pass the Transformer (with attention defined by the RKHS kernel) implements a form of gradient descent of the underlying function, connected to the latent vector function associated with the softmax. We present what is believed to be the first real-world demonstration of this few-shot-learning methodology, using the ImageNet dataset.


title: Assessing LLMs Suitability for Knowledge Graph Completion

abstract: Recent work shown the capability of Large Language Models (LLMs) to solve tasks related to Knowledge Graphs, such as Knowledge Graph Completion, even in Zero- or Few-Shot paradigms. However, they are known to hallucinate answers, or output results in a non-deterministic manner, thus leading to wrongly reasoned responses, even if they satisfy the user's demands. To highlight opportunities and challenges in knowledge graphs-related tasks, we experiment with two distinguished LLMs, namely Mixtral-8x7B-Instruct-v0.1, and gpt-3.5-turbo-0125, on Knowledge Graph Completion for static knowledge graphs, using prompts constructed following the TELeR taxonomy, in Zero- and One-Shot contexts, on a Task-Oriented Dialogue system use case. When evaluated using both strict and flexible metrics measurement manners, our results show that LLMs could be fit for such a task if prompts encapsulate sufficient information and relevant examples.


title: "Pass the butter": A study on desktop-classic multitasking robotic arm based on advanced YOLOv7 and BERT

abstract: In recent years, various intelligent autonomous robots have begun to appear in daily life and production. Desktop-level robots are characterized by their flexible deployment, rapid response, and suitability for light workload environments. In order to meet the current societal demand for service robot technology, this study proposes using a miniaturized desktop-level robot (by ROS) as a carrier, locally deploying a natural language model (NLP-BERT), and integrating visual recognition (CV-YOLO) and speech recognition technology (ASR-Whisper) as inputs to achieve autonomous decision-making and rational action by the desktop robot. Three comprehensive experiments were designed to validate the robotic arm, and the results demonstrate excellent performance using this approach across all three experiments. In Task 1, the execution rates for speech recognition and action performance were 92.6% and 84.3%, respectively. In Task 2, the highest execution rates under the given conditions reached 92.1% and 84.6%, while in Task 3, the highest execution rates were 95.2% and 80.8%, respectively. Therefore, it can be concluded that the proposed solution integrating ASR, NLP, and other technologies on edge devices is feasible and provides a technical and engineering foundation for realizing multimodal desktop-level robots.


title: GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping

abstract: Generating novel views from a single image remains a challenging task due to the complexity of 3D scenes and the limited diversity in the existing multi-view datasets to train a model on. Recent research combining large-scale text-to-image (T2I) models with monocular depth estimation (MDE) has shown promise in handling in-the-wild images. In these methods, an input view is geometrically warped to novel views with estimated depth maps, then the warped image is inpainted by T2I models. However, they struggle with noisy depth maps and loss of semantic details when warping an input view to novel viewpoints. In this paper, we propose a novel approach for single-shot novel view synthesis, a semantic-preserving generative warping framework that enables T2I generative models to learn where to warp and where to generate, through augmenting cross-view attention with self-attention. Our approach addresses the limitations of existing methods by conditioning the generative model on source view images and incorporating geometric warping signals. Qualitative and quantitative evaluations demonstrate that our model outperforms existing methods in both in-domain and out-of-domain scenarios. Project page is available at https://GenWarp-NVS.github.io/.


title: Next-to-Next-to-Leading Order Evolution of Polarized Parton Densities in the Larin Scheme

abstract: In many calculations involving polarized twist-2 parton densities to higher order in the strong coupling constant one uses the Larin scheme to describe chiral effects in dimensional regularization. Upon forming observables, the scheme dependence cancels. Still one needs a corresponding regularization scheme to compute the contributing building blocks, like massless and massive Wilson coefficients, as well as the massive 3-loop operator matrix elements used in the variable flavor number scheme. These are matched to the evolved parton distribution functions in the Larin scheme. Starting with suitable input distributions we provide the solution of scale evolution of the different polarized parton distribution functions in Bjorken $x$ space for a wide range of virtualities $Q^2$ in the Larin scheme, at next-to-leading, and to next-to-next-to-leading order for the first time. We also illustrate the deviation between the parton distributions in the Larin and $\overline{\rm MS}$ schemes numerically.


title: Gaussian Embedding of Temporal Networks

abstract: Representing the nodes of continuous-time temporal graphs in a low-dimensional latent space has wide-ranging applications, from prediction to visualization. Yet, analyzing continuous-time relational data with timestamped interactions introduces unique challenges due to its sparsity. Merely embedding nodes as trajectories in the latent space overlooks this sparsity, emphasizing the need to quantify uncertainty around the latent positions. In this paper, we propose TGNE (\textbf{T}emporal \textbf{G}aussian \textbf{N}etwork \textbf{E}mbedding), an innovative method that bridges two distinct strands of literature: the statistical analysis of networks via Latent Space Models (LSM)\cite{Hoff2002} and temporal graph machine learning. TGNE embeds nodes as piece-wise linear trajectories of Gaussian distributions in the latent space, capturing both structural information and uncertainty around the trajectories. We evaluate TGNE's effectiveness in reconstructing the original graph and modelling uncertainty. The results demonstrate that TGNE generates competitive time-varying embedding locations compared to common baselines for reconstructing unobserved edge interactions based on observed edges. Furthermore, the uncertainty estimates align with the time-varying degree distribution in the network, providing valuable insights into the temporal dynamics of the graph. To facilitate reproducibility, we provide an open-source implementation of TGNE at \url{https://github.com/aida-ugent/tgne}.


title: Estimating treatment-effect heterogeneity across sites in multi-site randomized experiments with imperfect compliance

abstract: We consider multi-site randomized controlled trials with a large number of small sites and imperfect compliance, conducted in non-random convenience samples in each site. We show that an Empirical-Bayes (EB) estimator can be used to estimate a lower bound of the variance of intention-to-treat (ITT) effects across sites. We also propose bounds for the coefficient from a regression of site-level ITTs on sites' control-group outcome. Turning to local average treatment effects (LATEs), the EB estimator cannot be used to estimate their variance, because site-level LATE estimators are biased. Instead, we propose two testable assumptions under which the LATEs' variance can be written as a function of sites' ITT and first-stage (FS) effects, thus allowing us to use an EB estimator leveraging only unbiased ITT and FS estimators. We revisit Behaghel et al. (2014), who study the effect of counselling programs on job seekers job-finding rate, in more than 200 job placement agencies in France. We find considerable ITT heterogeneity, and even more LATE heterogeneity: our lower bounds on ITTs' (resp. LATEs') standard deviation are more than three (resp. four) times larger than the average ITT (resp. LATE) across sites. Sites with a lower job-finding rate in the control group have larger ITT effects.


title: Classifying post-Minkowskian geometries for gravitational waves via loop-by-loop Baikov

abstract: We use the loop-by-loop Baikov representation to investigate the geometries in Feynman integrals contributing to the classical dynamics of a black-hole two-body system in the post-Minkowskian expansion of general relativity. These geometries determine the spaces of functions to which the corresponding Feynman diagrams evaluate. As a proof of principle, we provide a full classification of the geometries appearing up to three loops, i.e. fourth post-Minkowskian order, for all diagrams relevant to the conservative as well as the dissipative dynamics, finding full agreement with the literature. Moreover, we show that the non-planar top topology at four loops, which is the most complicated sector with respect to integration-byparts identities, has an algebraic leading singularity and thus can only depend on non-trivial geometries through its subsectors.


title: Emergent asymmetry in confined bioconvection

abstract: Bioconvection is the prototypical active matter system for hydrodynamic instabilities and pattern formation in suspensions of biased swimming microorganisms, particularly at the dilute end of the concentration spectrum where cell-cell interactions typically are neglected. Confinement is an inherent characteristic of such systems, including those that are naturally-occurring or industrially-exploited, so it is important to understand the impact of boundaries on the hydrodynamic instabilities. Despite recent interest in this area we note that commonly-adopted symmetry assumptions in the literature, such as for a vertical channel or pipe, are uncorroborated and potentially unjustified. Therefore, by employing a combination of analytical and numerical techniques, we investigate whether confinement itself can drive asymmetric plume formation in a suspension of bottom-heavy swimming microorganisms (gyrotactic cells). For a class of solutions in a vertical channel we establish the existence of a first integral of motion, and reveal that asymptotic asymmetry is plausible. Furthermore, numerical simulations from both Lagrangian and Eulerian perspectives demonstrate with remarkable agreement that asymmetric solutions can indeed be more stable than symmetric; asymmetric solutions are in fact dominant for a large, practically-important region of parameter space. In addition, we verify the presence of blip and varicose instabilities for an experimentally accessible parameter range. Finally, we extend our study to a vertical Hele-Shaw geometry to explore whether a simple linear drag approximation can be justified. We find that although two-dimensional bioconvective structures and associated bulk properties have some similarities with experimental observations, approximating near wall physics in even the simplest confined systems remains challenging.


title: Surface reconstruction of sampled textiles via Morse theory

abstract: In this work, we study the perception problem for garments using tools from computational topology: the identification of their geometry and position in space from point-cloud samples, as obtained e.g. with 3D scanners. We present a reconstruction algorithm based on a direct topological study of the sampled textile surface that allows us to obtain a cellular decomposition of it via a Morse function. No intermediate triangulation or local implicit equations are used, avoiding reconstruction-induced artifices. No a priori knowledge of the surface topology, density or regularity of the point-sample is required to run the algorithm. The results are a piecewise decomposition of the surface as a union of Morse cells (i.e. topological disks), suitable for tasks such as noise-filtering or mesh-independent reparametrization, and a cell complex of small rank determining the surface topology. This algorithm can be applied to smooth surfaces with or without boundary, embedded in an ambient space of any dimension.


title: $\textit{Trans-LoRA}$: towards data-free Transferable Parameter Efficient Finetuning

abstract: Low-rank adapters (LoRA) and their variants are popular parameter-efficient fine-tuning (PEFT) techniques that closely match full model fine-tune performance while requiring only a small number of additional parameters. These additional LoRA parameters are specific to the base model being adapted. When the base model needs to be deprecated and replaced with a new one, all the associated LoRA modules need to be re-trained. Such re-training requires access to the data used to train the LoRA for the original base model. This is especially problematic for commercial cloud applications where the LoRA modules and the base models are hosted by service providers who may not be allowed to host proprietary client task data. To address this challenge, we propose $\textit{Trans-LoRA}$ -- a novel method for lossless, nearly data-free transfer of LoRAs across base models. Our approach relies on synthetic data to transfer LoRA modules. Using large language models, we design a synthetic data generator to approximate the data-generating process of the $\textit{observed}$ task data subset. Training on the resulting synthetic dataset transfers LoRA modules to new models. We show the effectiveness of our approach using both LLama and Gemma model families. Our approach achieves lossless (mostly improved) LoRA transfer between models within and across different base model families, and even between different PEFT methods, on a wide variety of tasks.


title: The state learner -- a super learner for right-censored data

abstract: In survival analysis, prediction models are needed as stand-alone tools and in applications of causal inference to estimate nuisance parameters. The super learner is a machine learning algorithm which combines a library of prediction models into a meta learner based on cross-validated loss. In right-censored data, the choice of the loss function and the estimation of the expected loss need careful consideration. We introduce the state learner, a new super learner for survival analysis, which simultaneously evaluates libraries of prediction models for the event of interest and the censoring distribution. The state learner can be applied to all types of survival models, works in the presence of competing risks, and does not require a single pre-specified estimator of the conditional censoring distribution. We establish an oracle inequality for the state learner and investigate its performance through numerical experiments. We illustrate the application of the state learner with prostate cancer data, as a stand-alone prediction tool, and, for causal inference, as a way to estimate the nuisance parameter models of a smooth statistical functional.


title: Accelerating Simulation of Two-Phase Flows with Neural PDE Surrogates

abstract: Simulation is a powerful tool to better understand physical systems, but generally requires computationally expensive numerical methods. Downstream applications of such simulations can become computationally infeasible if they require many forward solves, for example in the case of inverse design with many degrees of freedom. In this work, we investigate and extend neural PDE solvers as a tool to aid in scaling simulations for two-phase flow problems, and simulations of oil expulsion from a pore specifically. We extend existing numerical methods for this problem to a more complex setting involving varying geometries of the domain to generate a challenging dataset. Further, we investigate three prominent neural PDE solver methods, namely the UNet, DRN and U-FNO, and extend them for characteristics of the oil-expulsion problem: (1) spatial conditioning on the geometry; (2) periodicity in the boundary; (3) approximate mass conservation. We scale all methods and benchmark their speed-accuracy trade-off, evaluate qualitative properties, and perform an ablation study. We find that the investigated methods can accurately model the droplet dynamics with up to three orders of magnitude speed-up, that our extensions improve performance over the baselines, and that the introduced varying geometries constitute a significantly more challenging setting over the previously considered oil expulsion problem.


title: Does Diffusion Beat GAN in Image Super Resolution?

abstract: There is a prevalent opinion in the recent literature that Diffusion-based models outperform GAN-based counterparts on the Image Super Resolution (ISR) problem. However, in most studies, Diffusion-based ISR models were trained longer and utilized larger networks than the GAN baselines. This raises the question of whether the superiority of Diffusion models is due to the Diffusion paradigm being better suited for the ISR task or if it is a consequence of the increased scale and computational resources used in contemporary studies. In our work, we compare Diffusion-based and GAN-based Super Resolution under controlled settings, where both approaches are matched in terms of architecture, model and dataset size, and computational budget. We show that a GAN-based model can achieve results comparable to a Diffusion-based model. Additionally, we explore the impact of design choices such as text conditioning and augmentation on the performance of ISR models, showcasing their effect on several downstream tasks. We will release the inference code and weights of our scaled GAN.


title: Deep Feature Gaussian Processes for Single-Scene Aerosol Optical Depth Reconstruction

abstract: Remote sensing data provide a low-cost solution for large-scale monitoring of air pollution via the retrieval of aerosol optical depth (AOD), but is often limited by cloud contamination. Existing methods for AOD reconstruction rely on temporal information. However, for remote sensing data at high spatial resolution, multi-temporal observations are often unavailable. In this letter, we take advantage of deep representation learning from convolutional neural networks and propose Deep Feature Gaussian Processes (DFGP) for single-scene AOD reconstruction. By using deep learning, we transform the variables to a feature space with better explainable power. By using Gaussian processes, we explicitly consider the correlation between observed AOD and missing AOD in spatial and feature domains. Experiments on two AOD datasets with real-world cloud patterns showed that the proposed method outperformed deep CNN and random forest, achieving R$^2$ of 0.7431 on MODIS AOD and R$^2$ of 0.9211 on EMIT AOD, compared to deep CNN's R$^2$ of 0.6507 and R$^2$ of 0.8619. The proposed methods increased R$^2$ by over 0.35 compared to the popular random forest in AOD reconstruction. The data and code used in this study are available at \url{https://skrisliu.com/dfgp}.


title: ReStorEdge: An edge computing system with reuse semantics

abstract: This paper investigates an edge computing system where requests are processed by a set of replicated edge servers. We investigate a class of applications where similar queries produce identical results. To reduce processing overhead on the edge servers we store the results of previous computations and return them when new queries are sufficiently similar to earlier ones that produced the results, avoiding the necessity of processing every new query. We implement a similarity-based data classification system, which we evaluate based on real-world datasets of images and voice queries. We evaluate a range of orchestration strategies to distribute queries and cached results between edge nodes and show that the throughput of queries over a system of distributed edge nodes can be increased by 25-33%, increasing its capacity for higher workloads.


title: On the Noise Robustness of In-Context Learning for Text Generation

abstract: Large language models (LLMs) have shown impressive performance on downstream tasks by in-context learning (ICL), which heavily relies on the quality of demonstrations selected from a large set of annotated examples. Recent works claim that in-context learning is robust to noisy demonstrations in text classification. In this work, we show that, on text generation tasks, noisy annotations significantly hurt the performance of in-context learning. To circumvent the issue, we propose a simple and effective approach called Local Perplexity Ranking (LPR), which replaces the "noisy" candidates with their nearest neighbors that are more likely to be clean. Our method is motivated by analyzing the perplexity deviation caused by noisy labels and decomposing perplexity into inherent perplexity and matching perplexity. Our key idea behind LPR is thus to decouple the matching perplexity by performing the ranking among the neighbors in semantic space. Our approach can prevent the selected demonstrations from including mismatched input-label pairs while preserving the effectiveness of the original selection methods. Extensive experiments demonstrate the effectiveness of LPR, improving the EM score by up to 18.75 on common benchmarks with noisy annotations.


title: Assessing uncertainty in Gaussian mixtures-based entropy estimation

abstract: Entropy estimation plays a crucial role in various fields, such as information theory, statistical data science, and machine learning. However, traditional entropy estimation methods often struggle with complex data distributions. Mixture-based estimation of entropy has been recently proposed and gained attention due to its ease of use and accuracy. This paper presents a novel approach to quantify the uncertainty associated with this mixture-based entropy estimation method using weighted likelihood bootstrap. Unlike standard methods, our approach leverages the underlying mixture structure by assigning random weights to observations in a weighted likelihood bootstrap procedure, leading to more accurate uncertainty estimation. The generation of weights is also investigated, leading to the proposal of using weights obtained from a Dirichlet distribution with parameter $\alpha = 0.8137$ instead of the usual $\alpha = 1$. Furthermore, the use of centered percentile intervals emerges as the preferred choice to ensure empirical coverage close to the nominal level. Extensive simulation studies comparing different resampling strategies are presented and results discussed. The proposed approach is illustrated by analyzing the log-returns of daily Gold prices at COMEX for the years 2014--2022, and the Net Rating scores, an advanced statistic used in basketball analytics, for NBA teams with reference to the 2022/23 regular season.


title: Dissociation and isomerization following ionization of ethylene: insights from non-adiabatic dynamics simulations

abstract: Photoionized and electronically excited ethylene \ce{C2H4+} can undergo \ce{H}-loss, \ce{H2}-loss, and ethylene-ethylidene isomerization, where the latter entails a hydrogen migration. Recent pioneering experiments with few-femtosecond extreme ultraviolet pulses and complementary theoretical studies have shed light on the photodynamics of this prototypical organic cation. However, no theoretical investigation based on dynamics simulations reported to date has described the mechanisms and time scales of dissociation and isomerization. Herein, we simulate the coupled electron-nuclear dynamics of ethylene following vertical ionization and electronic excitation to its four lowest-lying cationic states. The electronic structure is treated at the CASSCF level, with an active space large enough to describe bond breaking and formation. The simulations indicate that dissociation and isomerization take place mainly on the cationic ground state and allow the probing of previous hypotheses concerning the correlation between the photochemical outcome and the traversed conical intersections. The results, moreover, support the long-standing view that \ce{H2}-loss may occur from the ethylidene form. However, the ethylene-ethylidene isomerization time predicted by the simulations is considerably longer than those previously inferred from indirect experimental measurements.


title: FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation

abstract: Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data distributions, and limited resources across local clients inevitably cause model performance degradation and a slowdown in convergence speed. However, existing FL methods can only solve some of the above heterogeneous challenges and have obvious performance limitations. Notably, a unified framework has not yet been explored to overcome these challenges. Accordingly, we propose FedHPL, a parameter-efficient unified $\textbf{Fed}$erated learning framework for $\textbf{H}$eterogeneous settings based on $\textbf{P}$rompt tuning and $\textbf{L}$ogit distillation. Specifically, we employ a local prompt tuning scheme that leverages a few learnable visual prompts to efficiently fine-tune the frozen pre-trained foundation model for downstream tasks, thereby accelerating training and improving model performance under limited local resources and data heterogeneity. Moreover, we design a global logit distillation scheme to handle the model heterogeneity and guide the local training. In detail, we leverage logits to implicitly capture local knowledge and design a weighted knowledge aggregation mechanism to generate global client-specific logits. We provide a theoretical guarantee on the generalization error bound for FedHPL. The experiments on various benchmark datasets under diverse settings of models and data demonstrate that our framework outperforms state-of-the-art FL approaches, with less computation overhead and training rounds.


title: Suppressing defection by increasing temptation: the impact of smart cooperators on a social dilemma situation

abstract: In a social dilemma situation, where individual and collective interests are in conflict, it sounds a reasonable assumption that the presence of super or smart players, who simultaneously punish defection and reward cooperation without allowing exploitation, could solve the basic problem. The behavior of such a multi-strategy system, however, is more subtle than it is firstly anticipated. When exploring the complete parameter space, we find that the emergence of cyclic dominance among strategies is rather common, which results in several counter-intuitive phenomena. For example, the defection level can be lowered at higher temptation, or weaker punishment provides better conditions for smart players. Our study indicates that smart cooperators can unexpectedly thrive under high temptation, emphasizing the complexity of strategic interactions. This study suggests that the principles governing these interactions can be applied to other moral behaviors, such as truth-telling and honesty, providing valuable insights for future research in multi-agent systems.


title: Engineered Josephson diode effect in kinked Rashba nanochannels

abstract: The superconducting diode effect, reminiscent of the unidirectional charge transport in semiconductor diodes, is characterized by a nonreciprocal, dissipationless flow of Cooper pairs. This remarkable phenomenon arises from the interplay between symmetry constraints and the inherent quantum behavior of superconductors. Here, we explore the geometric control of the diode effect in a kinked nanostrip Josephson junction based on a two-dimensional electron gas (2DEGs) with Rashba spin-orbit interaction. We provide a comprehensive analysis of the diode effect as a function of the kink angle and the out-of-plane magnetic field. Our analysis reveals a rich phase diagram, showcasing a geometry and field-controlled diode effect. The phase diagram also reveals the presence of an anomalous Josephson effect related to the emergence of trivial zero-energy Andreev bound states, which can evolve into Majorana bound states. Our findings indicate that the exceptional synergy between geometric control of the diode effect and topological phases can be effectively leveraged to design and optimize superconducting devices with tailored transport properties.


title: Towards Accurate Ego-lane Identification with Early Time Series Classification

abstract: Accurate and timely determination of a vehicle's current lane within a map is a critical task in autonomous driving systems. This paper utilizes an Early Time Series Classification (ETSC) method to achieve precise and rapid ego-lane identification in real-world driving data. The method begins by assessing the similarities between map and lane markings perceived by the vehicle's camera using measurement model quality metrics. These metrics are then fed into a selected ETSC method, comprising a probabilistic classifier and a tailored trigger function, optimized via multi-objective optimization to strike a balance between early prediction and accuracy. Our solution has been evaluated on a comprehensive dataset consisting of 114 hours of real-world traffic data, collected across 5 different countries by our test vehicles. Results show that by leveraging road lane-marking geometry and lane-marking type derived solely from a camera, our solution achieves an impressive accuracy of 99.6%, with an average prediction time of only 0.84 seconds.


title: Which Electronic Structure Method to Choose in Trajectory Surface Hopping Dynamics Simulations? Azomethane as a Case Study

abstract: Non-adiabatic dynamics simulations have become a standard approach to explore photochemical reactions. Such simulations require underlying potential energy surfaces and couplings between them, calculated at a chosen level of theory, yet this aspect is rarely assessed. Here, in combination with the popular trajectory surface hopping dynamics method, we use a high-accuracy XMS-CASPT2 electronic structure level as a benchmark for assessing the performances of various post-Hartree-Fock methods (namely CIS, ADC(2), CC2 and CASSCF) and exchange-correlation functionals (PBE, PBE0, CAM-B3LYP) in a TD-DFT/TDA context, using the isomerization around a double bond as test case. Different relaxation pathways are identified, and the ability of the different methods to reproduce their relative importance and timescale is discussed. The results show that multi-reference electronic structure methods should be preferred, when studying non-adiabatic decay between excited and ground states. If not affordable, TD-DFT with TDA and hybrid functionals, and ADC(2) are efficient alternative, but overestimate the non-radiative decay yield and thus may miss deexcitation pathways.


title: DPN: Decoupling Partition and Navigation for Neural Solvers of Min-max Vehicle Routing Problems

abstract: The min-max vehicle routing problem (min-max VRP) traverses all given customers by assigning several routes and aims to minimize the length of the longest route. Recently, reinforcement learning (RL)-based sequential planning methods have exhibited advantages in solving efficiency and optimality. However, these methods fail to exploit the problem-specific properties in learning representations, resulting in less effective features for decoding optimal routes. This paper considers the sequential planning process of min-max VRPs as two coupled optimization tasks: customer partition for different routes and customer navigation in each route (i.e., partition and navigation). To effectively process min-max VRP instances, we present a novel attention-based Partition-and-Navigation encoder (P&N Encoder) that learns distinct embeddings for partition and navigation. Furthermore, we utilize an inherent symmetry in decoding routes and develop an effective agent-permutation-symmetric (APS) loss function. Experimental results demonstrate that the proposed Decoupling-Partition-Navigation (DPN) method significantly surpasses existing learning-based methods in both single-depot and multi-depot min-max VRPs. Our code is available at


title: A Derivation of Geometric Quantization via Feynman's Path Integral on Phase Space

abstract: We derive the geometric quantization program of symplectic manifolds, in the sense of both Kostant-Souriau and Weinstein, from Feynman's path integral formulation on phase space. The state space we use contains states with negative norm and polarized sections determine a Hilbert space. We discuss ambiguities in the definition of path integrals arising from the distinct Riemann sum prescriptions and its consequence on the quantization of symplectomorphisms.


title: Global existence for wave and beam equations with double damping and a new power nonlinearity

abstract: We consider the Cauchy problem in $\mathbb{R}^{n}$ for wave and beam equations with frictional, viscoelastic damping, and a new power nonlinearity. In addition to the solution and its total energy, we define the following quantity: $$Q[u](t):=\|u_{t}(t,\cdot)+(-\Delta)^{\sigma}u(t,\cdot)\|_{L^{2}(\mathbb{R}^{n})}.$$ Our aim is to show that the interaction between frictional and viscoelastic damping in a linear model leads to an exponential decay of $Q[u](t)$ as $t\to \infty$. This decay motivates us to define a new power nonlinearity of the form $N[u]:=|u_{t}+(-\Delta)^{\sigma}u|^{p}$. Surprisingly, $N[u]$ can be considered a small perturbation for any $p>1$, in the sense that, the decay estimates of the unique global solution, the total energy and $Q[u](t)$ coincide with those for solutions to the corresponding linear Cauchy problem with vanishing right-hand side.


title: An extension of Krishnan's central limit theorem to the Brown-Thompson groups

abstract: We extend a central limit theorem, recently established for the Thompson group $F=F_2$ by Krishnan, to the Brown-Thompson groups $F_p$, where $p$ is any integer greater than or equal to $2$. The non-commutative probability space considered is the group algebra $\mathbb{C}[F_p]$, equipped with the canonical trace. The random variables in question are $a_n:= (x_n + x_n^{-1})/\sqrt{2}$, where $\{x_i\}_{i\geq 0}$ represents the standard family of infinite generators. Analogously to the case of $F=F_2$, it is established that the limit distribution of $s_n = (a_0 + \ldots + a_{n-1})/\sqrt{n}$ converges to the standard normal distribution. Furthermore, it is demonstrated that for a state corresponding to Jones's oriented subgroup $\vec{F}$, such a central limit theorem does not hold.