title: Model Interpretation and Explainability: Towards Creating Transparency in Prediction Models

abstract: Explainable AI (XAI) has a counterpart in analytical modeling which we refer to as model explainability. We tackle the issue of model explainability in the context of prediction models. We analyze a dataset of loans from a credit card company and apply three stages: execute and compare four different prediction methods, apply the best known explainability techniques in the current literature to the model training sets to identify feature importance (FI) (static case), and finally to cross-check whether the FI set holds up under what if prediction scenarios for continuous and categorical variables (dynamic case). We found inconsistency in FI identification between the static and dynamic cases. We summarize the state of the art in model explainability and suggest further research to advance the field.


title: InsightSee: Advancing Multi-agent Vision-Language Models for Enhanced Visual Understanding

abstract: Accurate visual understanding is imperative for advancing autonomous systems and intelligent robots. Despite the powerful capabilities of vision-language models (VLMs) in processing complex visual scenes, precisely recognizing obscured or ambiguously presented visual elements remains challenging. To tackle such issues, this paper proposes InsightSee, a multi-agent framework to enhance VLMs' interpretative capabilities in handling complex visual understanding scenarios. The framework comprises a description agent, two reasoning agents, and a decision agent, which are integrated to refine the process of visual information interpretation. The design of these agents and the mechanisms by which they can be enhanced in visual information processing are presented. Experimental results demonstrate that the InsightSee framework not only boosts performance on specific visual tasks but also retains the original models' strength. The proposed framework outperforms state-of-the-art algorithms in 6 out of 9 benchmark tests, with a substantial advancement in multimodal understanding.


title: Regularity of minimal surfaces with capillary boundary conditions

abstract: We prove $\varepsilon$-regularity theorems for varifolds with capillary boundary condition in a Riemannian manifold. These varifolds were first introduced by Kagaya-Tonegawa \cite{KaTo}. We establish a uniform first variation control for all such varifolds (and free-boundary varifolds generally) satisfying a sharp density bound and prove that if a capillary varifold has bounded mean curvature and is close to a capillary half-plane with angle not equal to $\tfrac{\pi}{2}$, then it coincides with a $C^{1,\alpha}$ properly embedded hypersurface. We apply our theorem to deduce regularity at a generic point along the boundary in the region where the density is strictly less than $1$.


title: Ovis: Structural Embedding Alignment for Multimodal Large Language Model

abstract: Current Multimodal Large Language Models (MLLMs) typically integrate a pre-trained LLM with another pre-trained vision transformer through a connector, such as an MLP, endowing the LLM with visual capabilities. However, the misalignment between two embedding strategies in MLLMs -- the structural textual embeddings based on an embedding look-up table and the continuous embeddings generated directly by the vision encoder -- makes challenges for a more seamless fusion of visual and textual information. We propose Ovis, a novel MLLM architecture designed to structurally align visual and textual embeddings. Ovis integrates an additional learnable visual embedding table into the visual encoder's process. To capture rich visual semantics, each image patch indexes the visual embedding table multiple times, resulting in a final visual embedding that is a probabilistic combination of the indexed embeddings. This structural approach mirrors the method used for generating textual embeddings. Empirical evaluations on various multimodal benchmarks show that Ovis outperforms open-source MLLMs of similar parameter scales and even surpasses the proprietary model Qwen-VL-Plus overall. These results highlight the potential of Ovis' structured visual representation for advancing MLLM architectural design and promoting more effective multimodal learning. Code, datasets, and models are available at https://github.com/AIDC-AI/Ovis.


title: Quantum and classical magnetic Bloch points

abstract: A Bloch point represents a three-dimensional hedgehog singularity of a magnetic vector field in which the magnetization vanishes. However, standard micromagnetic theory, developed for magnetic moments of fixed lengths, lacks full applicability in studying such singularities. To address this gap, we study a Bloch point in a quantum Heisenberg model for the case of spin-1/2 particles. Performing an exact diagonalization of the Hamiltonian as well as using density matrix renormalization group techniques, we obtain the ground state, which can be used to recover the corresponding magnetization profile. Our findings demonstrate a variation of the spin length in the quantum model, leading smoothly to zero magnetization at the Bloch point. Our results indicate the necessity of generalizing the classical micromagnetic model by adding the third degree of freedom of the spins: the ability to change its length. To this end, we introduce the micromagnetic $\mathbb{S}_{3}$-model, which enables the description of magnets with and without Bloch point singularities.


title: Rough Transformers: Lightweight Continuous-Time Sequence Modelling with Path Signatures

abstract: Time-series data in real-world settings typically exhibit long-range dependencies and are observed at non-uniform intervals. In these settings, traditional sequence-based recurrent models struggle. To overcome this, researchers often replace recurrent architectures with Neural ODE-based models to account for irregularly sampled data and use Transformer-based architectures to account for long-range dependencies. Despite the success of these two approaches, both incur very high computational costs for input sequences of even moderate length. To address this challenge, we introduce the Rough Transformer, a variation of the Transformer model that operates on continuous-time representations of input sequences and incurs significantly lower computational costs. In particular, we propose \textit{multi-view signature attention}, which uses path signatures to augment vanilla attention and to capture both local and global (multi-scale) dependencies in the input data, while remaining robust to changes in the sequence length and sampling frequency and yielding improved spatial processing. We find that, on a variety of time-series-related tasks, Rough Transformers consistently outperform their vanilla attention counterparts while obtaining the representational benefits of Neural ODE-based models, all at a fraction of the computational time and memory resources.


title: Shape Constraints in Symbolic Regression using Penalized Least Squares

abstract: We study the addition of shape constraints and their consideration during the parameter estimation step of symbolic regression (SR). Shape constraints serve as a means to introduce prior knowledge about the shape of the otherwise unknown model function into SR. Unlike previous works that have explored shape constraints in SR, we propose minimizing shape constraint violations during parameter estimation using gradient-based numerical optimization. We test three algorithm variants to evaluate their performance in identifying three symbolic expressions from a synthetically generated data set. This paper examines two benchmark scenarios: one with varying noise levels and another with reduced amounts of training data. The results indicate that incorporating shape constraints into the expression search is particularly beneficial when data is scarce. Compared to using shape constraints only in the selection process, our approach of minimizing violations during parameter estimation shows a statistically significant benefit in some of our test cases, without being significantly worse in any instance.


title: Myths of German Graphite in World War II, with Original Translations

abstract: We re-examine the common narrative that a 1941 experimental error by physicists Walther Bothe and Peter Jensen led Germany to abandon graphite as a reactor moderator during World War II. We first detail the history of both German and American graphite experiments, noting that the Americans faced similar setbacks but succeeded only at the end of a costly 18-month graphite purification program. We then use Monte Carlo N-Particle simulations to reconstruct Bothe's 1941 experiment. We find the thermal absorption cross section of Bothe's Siemens electrographite to be 12.2 mb, in contrast to his reported 7.9 mb. This discrepancy arises because the neutrons in Bothe's experiment did not reach thermal equilibrium, leading to an underestimation of neutron absorption. Additionally, despite misconceptions that the Germans were unaware of boron impurities, we share evidence that Wilhelm Hanle accurately measured boron and cadmium impurities in the electrographite. To support our findings, we provide 9 excerpted and 3 complete English translations of classified wartime reports by Heisenberg, Joos, Bothe, Jensen, H\"ocker, Hanle, and Kremer. Our work aims to illuminate the rational constraints behind Germany's decision to forgo graphite moderation.


title: First evidence for chiral wobbling of triaxial nuclei

abstract: The appearance of wobbling motion and chirality in rotating triaxial nuclei is explained. The discovery of a new mode, chiral wobbling, in $^{74}$Br, is commented.


title: Star formation across cosmic time

abstract: The interstellar medium of galaxies is composed of multiple phases, including molecular, atomic, and ionized gas, as well as dust. Stars are formed within this medium from cold molecular gas clouds, which collapse due to their gravitational attraction. Throughout their life, stars emit strong radiation fields and stellar winds, and they can also explode as supernovae at the end of their life. These processes contribute to stirring the turbulent interstellar medium and regulate star formation by heating up, ionizing, and expelling part of the gas. However, star formation does not proceed uniformly throughout the history of the Universe and decrease by an order of magnitude in the last ten billion years. To understand this winding-down of star formation and assess possible variations in the efficiency of star formation, it is crucial to probe the molecular gas reservoirs from which stars are formed. In this article following my presentation at the 10th International Conference on Frontiers of Plasma Physics and Technology held in Kathmandu from 13-17 March 2023, I review some aspects of the multiphase interstellar medium and star formation, with an emphasis on the interplay between neutral and ionized phases, and present recent and ongoing observations of the molecular gas content in typical star-forming galaxies across cosmic time and in different environments. I also present some of our understanding of star-forming galaxies from theoretical models and simulations.


title: Reachability and Safety Games under TSO Semantics (Extended Version)

abstract: We consider games played on the transtion graph of concurrent programs running under the Total Store Order (TSO) weak memory model. Games are frequently used to model the interaction between a system and its environment, in this case between the concurrent processes and the nondeterminisitic TSO buffer updates. The game is played by two players, who alternatingly make a move: The process player can execute any enabled instruction of the processes, while the update player takes care of updating the messages in the buffers that are between each process andthe shared memory. We show that the reachability and safety problem of this game reduce to the analysis of single-process (non-concurrent) programs. In particular, they exhibit only finite-state behaviour. Because of this, we introduce different notions of fairness, which force the two players to behave in a more realistic way. Both the reachability and safety problem then become undecidable.


title: Multilingual Text Style Transfer: Datasets & Models for Indian Languages

abstract: Text style transfer (TST) involves altering the linguistic style of a text while preserving its core content. This paper focuses on sentiment transfer, a vital TST subtask (Mukherjee et al., 2022a), across a spectrum of Indian languages: Hindi, Magahi, Malayalam, Marathi, Punjabi, Odia, Telugu, and Urdu, expanding upon previous work on English-Bangla sentiment transfer (Mukherjee et al., 2023). We introduce dedicated datasets of 1,000 positive and 1,000 negative style-parallel sentences for each of these eight languages. We then evaluate the performance of various benchmark models categorized into parallel, non-parallel, cross-lingual, and shared learning approaches, including the Llama2 and GPT-3.5 large language models (LLMs). Our experiments highlight the significance of parallel data in TST and demonstrate the effectiveness of the Masked Style Filling (MSF) approach (Mukherjee et al., 2023) in non-parallel techniques. Moreover, cross-lingual and joint multilingual learning methods show promise, offering insights into selecting optimal models tailored to the specific language and task requirements. To the best of our knowledge, this work represents the first comprehensive exploration of the TST task as sentiment transfer across a diverse set of languages.


title: There and Back Again: The AI Alignment Paradox

abstract: The field of AI alignment aims to steer AI systems toward human goals, preferences, and ethical principles. Its contributions have been instrumental for improving the output quality, safety, and trustworthiness of today's AI models. This perspective article draws attention to a fundamental challenge inherent in all AI alignment endeavors, which we term the "AI alignment paradox": The better we align AI models with our values, the easier we make it for adversaries to misalign the models. We illustrate the paradox by sketching three concrete example incarnations for the case of language models, each corresponding to a distinct way in which adversaries can exploit the paradox. With AI's increasing real-world impact, it is imperative that a broad community of researchers be aware of the AI alignment paradox and work to find ways to break out of it, in order to ensure the beneficial use of AI for the good of humanity.


title: On the Cahn-Hilliard equation with kinetic rate dependent dynamic boundary condition and non-smooth potential: separation property and long-time behavior

abstract: We consider a class of Cahn-Hilliard equation that characterizes phase separation phenomena of binary mixtures in a bounded domain $\Omega \subset \mathbb{R}^d$ $(d\in \{2,3\})$ with non-permeable boundary. The equations in the bulk are subject to kinetic rate dependent dynamic boundary conditions with possible boundary diffusion acting on the boundary chemical potential. For the initial boundary value problem with singular potentials, we prove that any global weak solution exhibits a propagation of regularity in time. In the two dimensional case, we establish the instantaneous strict separation property by a suitable De Giorgi's iteration scheme, which yields that the weak solution stays uniformly away from the pure phases $\pm 1$ from any positive time on. In particular, when the bulk and boundary chemical potentials are in equilibrium, we obtain the instantaneous separation property with or without possible boundary diffusion acting on the boundary chemical potential. Next, in the three dimensional case, we show the eventual strict separation property that holds after a sufficiently large time. These separation properties are obtained in an unified way with respect to the structural parameters. Moreover, they allow us to achieve higher-order regularity of the global weak solution and prove the convergence to a single equilibrium as $t \rightarrow \infty$.


title: Optimally Improving Cooperative Learning in a Social Setting

abstract: We consider a cooperative learning scenario where a collection of networked agents with individually owned classifiers dynamically update their predictions, for the same classification task, through communication or observations of each other's predictions. Clearly if highly influential vertices use erroneous classifiers, there will be a negative effect on the accuracy of all the agents in the network. We ask the following question: how can we optimally fix the prediction of a few classifiers so as maximize the overall accuracy in the entire network. To this end we consider an aggregate and an egalitarian objective function. We show a polynomial time algorithm for optimizing the aggregate objective function, and show that optimizing the egalitarian objective function is NP-hard. Furthermore, we develop approximation algorithms for the egalitarian improvement. The performance of all of our algorithms are guaranteed by mathematical analysis and backed by experiments on synthetic and real data.


title: Equivariant parametrized topological complexity

abstract: In this paper, we define and study an equivariant analogue of Cohen, Farber and Weinberger's parametrized topological complexity. We show that several results in the non-equivariant case can be extended to the equivariant case. For example, we establish the fibrewise equivariant homotopy invariance of the sequential equivariant parametrized topological complexity. We obtain several bounds on sequential equivariant topological complexity involving equivariant category. We also obtain the cohomological lower bound and the dimension-connectivity upper bound on the sequential equivariant parametrized topological complexity. In the end we use these results to compute sequential equivariant parametrized topological complexity of equivariant Fadell-Neuwirth fibrations and some equivariant fibrations involving generalized projective product spaces.


title: Context-aware Difference Distilling for Multi-change Captioning

abstract: Multi-change captioning aims to describe complex and coupled changes within an image pair in natural language. Compared with single-change captioning, this task requires the model to have higher-level cognition ability to reason an arbitrary number of changes. In this paper, we propose a novel context-aware difference distilling (CARD) network to capture all genuine changes for yielding sentences. Given an image pair, CARD first decouples context features that aggregate all similar/dissimilar semantics, termed common/difference context features. Then, the consistency and independence constraints are designed to guarantee the alignment/discrepancy of common/difference context features. Further, the common context features guide the model to mine locally unchanged features, which are subtracted from the pair to distill locally difference features. Next, the difference context features augment the locally difference features to ensure that all changes are distilled. In this way, we obtain an omni-representation of all changes, which is translated into linguistic sentences by a transformer decoder. Extensive experiments on three public datasets show CARD performs favourably against state-of-the-art methods.The code is available at https://github.com/tuyunbin/CARD.


title: Grothendieck-Verdier module categories, Frobenius algebras and relative Serre functors

abstract: We develop the theory of module categories over a Grothendieck-Verdier category, i.e. a monoidal category with a dualizing object and hence a duality structure more general than rigidity. Such a category C comes with two monoidal structures which are related by non-invertible morphisms and which we treat on an equal footing. Quite generally, non-invertible structure morphisms play a dominant role in this theory. In any Grothendieck-Verdier module category M we find two important subcategories M' and M''. The internal End of an object in M' that is a C-generator is an algebra such that its category of modules is equivalent to M as a module category. We also introduce a partially defined relative Serre functor S which furnishes an equivalence between M' and M''. Any isomorphism between an object m of M' and S(m) in M'' endows the internal End of m with the structure of a Grothendieck-Verdier Frobenius algebra.


title: Projective holonomic quantum computation

abstract: Nonadiabatic holonomic quantum computing is a novel and promising framework for the implementation and efficient and robust execution of quantum gates based on purely geometric principles. However, the parallel transport condition that is central to nonadiabatic holonomic quantum computing has shortcomings. In this paper, we address some of these shortcomings and show that a projectivization of the standard gauge theory of nonadiabatic holonomic quantum computation eliminates them. In addition, we extend the isoholonomic inequality to projective gates and establish a minimum execution time-a quantum speed limit-for projective holonomic quantum gates.


title: Unusual Diffusivity in Strongly Disordered Quantum Lattices: Random Dimer Model

abstract: Recent advances in transport properties measurements of disordered materials and lattice simulations, using superconducting qubits, have rekindled interest in Anderson localization, motivating our study of highly disordered quantum lattices. Initially, our statistical analysis of localized eigenstates reveals a distinct transition between weak and strong disorder regimes, suggesting a random distribution of dimers in highly disordered systems. Subsequently, the random dimer model predicts an oscillating diffusivity that decays as $t^{-1/2}$, is inversely proportional to the disorder strength, and maintains a constant frequency with an initial phase shift of $\pi/4$. The first peak exhibits a universal scaling of $\sigma^{-1}$ both in peak time and amplitude. Finally, we find that stochastic noise suppresses these oscillations and induces hopping between localized eigenstates, resulting in constant diffusion over long times. Our predictions challenge the conventional understanding of incoherent hopping under strong disorder. This offers new insights to optimize disordered systems for optoelectrical and quantum information technologies.


title: Hyperrigidity I: operator moments and convergence of subnormal operators

abstract: We show that, the concept of hyperrigidity can be expressed in many ways. We provide four main approaches to this issue. The first one is via semispectral measures in the spirit of the characterizations of spectral measures. The second approach is based on dilation theory and is written in terms of the Stone-von Neumann calculus for normal operators. The third is inspired by Brown's theorem and deals with the weak and strong convergence of sequences of subnormal (or normal) operators. Finally, the fourth approach concerns multiplicativity of UCP maps on $C^*$-subalgebras generated by normal elements. This is inspired by the Petz's theorem and its generalizations established first by Arveson in the finite-dimensional case and then by Brown in general. Next, we will examine, in the case of a unital commutative $C^*$-algebra $\mathscr{A}$ generated by a single element $t$, which subsets $G$ of the set $\{t^{*m}t^n : (m, n) \in \mathbb{Z}^2\}$ are hyperrigid in $\mathscr{A}$.


title: Distributed Simulation for Digital Twins of Large-Scale Real-World DiffServ-Based Networks

abstract: Digital Twin technology facilitates the monitoring and online analysis of large-scale communication networks. Faster predictions of network performance thus become imperative, especially for analysing Quality of Service (QoS) parameters in large-scale city networks. Discrete Event Simulation (DES) is a standard network analysis technology, and can be further optimised with parallel and distributed execution for speedup, referred to as Parallel Discrete Event Simulation (PDES). However, modelling detailed QoS mechanisms such as DiffServ requires complex event handling for each network router, which can involve excessive simulation events. In addition, current PDES for network analysis mostly adopts conservative scheduling, which suffers from excessive global synchronisation to avoid causality problems. The performance analysis of optimistic PDES for real-world large-scale network topology and complex QoS mechanisms is still inadequate. To address these gaps, this paper proposes a simulation toolkit, Quaint, which leverages an optimistic PDES engine ROSS, for detailed modelling of DiffServ-based networks. A novel event-handling model for each network router is also proposed to significantly reduce the number of events in complex QoS modelling. Quaint has been evaluated using a real-world metropolitan-scale network topology with 5,000 routers/switches. Results show that compared to the conventional simulator OMNeT++/INET, even the sequential mode of Quaint can achieve a speedup of 53 times, and the distributed mode has a speedup of 232 times. Scalability characterisation is conducted to portray the efficiency of distributed execution, and the results indicate the future direction for workload-aware model partitioning.


title: Can the symmetric Fermi and eROSITA bubbles be produced by tilted jets?

abstract: The Fermi Gamma-Ray Space Telescope reveals two large bubbles in the Galaxy, extending nearly symmetrically $\sim50^{\circ}$ above and below the Galactic center (GC). Previous simulations of bubble formation invoking active galactic nucleus (AGN) jets have assumed that the jets are vertical to the Galactic disk; however, in general, the jet orientation does not necessarily correlate with the rotational axis of the Galactic disk. Using three-dimensional special relativistic hydrodynamic simulations including cosmic rays (CRs) and thermal gas, we show that the dense clumpy gas within the Galactic disk disrupts jet collimation ("failed jets" hereafter), which causes the failed jets to form hot bubbles. Subsequent buoyancy in the stratified atmosphere renders them vertical to form the symmetric Fermi and eROSITA bubbles (collectively, Galactic bubbles). We find that (1) despite the relativistic jets emanated from the GC are at various angles $\le45^{\circ}$ with respect to the rotational axis of the Galaxy, the Galactic bubbles nonetheless appear aligned with the axis; (2) the edge of the eROSITA bubbles corresponds to a forward shock driven by the hot bubbles; (3) followed by the forward shock is a tangling contact discontinuity corresponding to the edge of the Fermi bubbles; (4) assuming a leptonic model we find that the observed gamma-ray bubbles and microwave haze can be reproduced with a best-fit CR power-law spectral index of 2.4; The agreements between the simulated and the observed multi-wavelength features suggest that forming the Galactic bubbles by oblique AGN failed jets is a plausible scenario.


title: Extremile scalar-on-function regression with application to climate scenarios

abstract: Extremiles provide a generalization of quantiles which are not only robust, but also have an intrinsic link with extreme value theory. This paper introduces an extremile regression model tailored for functional covariate spaces. The estimation procedure turns out to be a weighted version of local linear scalar-on-function regression, where now a double kernel approach plays a crucial role. Asymptotic expressions for the bias and variance are established, applicable to both decreasing bandwidth sequences and automatically selected bandwidths. The methodology is then investigated in detail through a simulation study. Furthermore, we highlight the applicability of the model through the analysis of data sourced from the CH2018 Swiss climate scenarios project, offering insights into its ability to serve as a modern tool to quantify climate behaviour.


title: An iterated learning model of language change that mixes supervised and unsupervised learning

abstract: The iterated learning model is an agent-based model of language change in which language is transmitted from a tutor to a pupil which itself becomes a tutor to a new pupil, and so on. Languages that are stable, expressive, and compositional arise spontaneously as a consequence of a language transmission bottleneck. Previous models have implemented an agent's mapping from signals to meanings using an artificial neural network decoder, but have relied on an unrealistic and computationally expensive process of obversion to implement the associated encoder, mapping from meanings to signals. Here, a new model is presented in which both decoder and encoder are neural networks, trained separately through supervised learning, and trained together through unsupervised learning in the form of an autoencoder. This avoids the substantial computational burden entailed in obversion and introduces a mixture of supervised and unsupervised learning as observed during human development.


title: Heuristic evaluations of back support, shoulder support, hand grip strength support, and sit-stand support exoskeletons using universal design principles

abstract: Occupational exoskeletons promise to reduce the incidence of musculoskeletal injuries; however, we do not know if their designs allow universal use by all workers. We also do not know how easy the tasks of assembling, donning, doffing, and disassembling exoskeletons are. The purpose of our study was to heuristically evaluate a back support, a shoulder support, a handgrip strength support, and a sit-stand exoskeleton for how well they are designed for universal use when assembling, donning, doffing, and disassembling the exoskeleton. Seven evaluators used universal design principles and associated criteria to independently evaluate and rate four exoskeletons when assembling, donning, doffing, and disassembling the devices. The rating scale was a Likert-type scale, where a rating of 1 represented not at all, and a rating of 5 represented an excellent design with respect to the universal design criteria for the task. The results indicate that providing perceptible information to the user, making the design equitable to use for a diverse set of users, making the design simple and intuitive to use with adequate feedback, and designing to prevent user errors, and when errors are made, allowing the user to recover quickly from the errors, were rated poorly. Assembling and donning tasks presented the most challenges.


title: Constrained Dynamics Simulation: More With Less

abstract: Efficient robot dynamics simulation is a fundamental problem key for robot control, identification, design and analysis. This research statement explores my current progress in this field and future research directions.


title: Pursuing Overall Welfare in Federated Learning through Sequential Decision Making

abstract: In traditional federated learning, a single global model cannot perform equally well for all clients. Therefore, the need to achieve the client-level fairness in federated system has been emphasized, which can be realized by modifying the static aggregation scheme for updating the global model to an adaptive one, in response to the local signals of the participating clients. Our work reveals that existing fairness-aware aggregation strategies can be unified into an online convex optimization framework, in other words, a central server's sequential decision making process. To enhance the decision making capability, we propose simple and intuitive improvements for suboptimal designs within existing methods, presenting AAggFF. Considering practical requirements, we further subdivide our method tailored for the cross-device and the cross-silo settings, respectively. Theoretical analyses guarantee sublinear regret upper bounds for both settings: $\mathcal{O}(\sqrt{T \log{K}})$ for the cross-device setting, and $\mathcal{O}(K \log{T})$ for the cross-silo setting, with $K$ clients and $T$ federation rounds. Extensive experiments demonstrate that the federated system equipped with AAggFF achieves better degree of client-level fairness than existing methods in both practical settings. Code is available at https://github.com/vaseline555/AAggFF


title: Inflation Determinants in Argentina (2004-2022)

abstract: This paper analyzes the empirical relationship between the inflation rate and its proximate determinants in Argentina, using quarterly data over the period 2004-2022 and an error-correction vector model approach. Unlike previous literature, this paper uses a theoretical framework to motivate the inclusion of variables that are expected to contribute to explain inflation, thus reducing the risk of omitting relevant variables and formalizing key mechanisms. Inference is performed through Granger causality analysis, impulse response functions and forecast errors variance decomposition. The results suggest that an anti-inflationary plan for Argentina should take into consideration both the greater relevance of the inertial component, the exchange rate and the interest rate in the short-run dynamics of the price level, and the long-run relationship between prices, interest rate and activity level.


title: On cohomological invariants of complex and almost complex manifolds

abstract: Given a compact complex manifold, we develop Hodge theory for the elliptic complex of differential forms defined by Bigolin in 1969 and recently referred as the Schweitzer complex. We exhibits several $L^2$ orthogonal decompositions of spaces of forms and prove a Hodge decomposition for harmonic forms on compact K\"ahler manifolds. Then we compute the cohomology of this complex on the small deformations of the complex structure of the Iwasawa manifold, showing that this cohomology is as powerful as Aeppli and Bott-Chern cohomology, in order to distinguish classes of complex structures. Finally, we partially extend the definition of this complex on almost complex manifolds, providing a new cohomological invariant on 1-forms which is finite dimensional when the manifold is compact.


title: Online Convex Optimisation: The Optimal Switching Regret for all Segmentations Simultaneously

abstract: We consider the classic problem of online convex optimisation. Whereas the notion of static regret is relevant for stationary problems, the notion of switching regret is more appropriate for non-stationary problems. A switching regret is defined relative to any segmentation of the trial sequence, and is equal to the sum of the static regrets of each segment. In this paper we show that, perhaps surprisingly, we can achieve the asymptotically optimal switching regret on every possible segmentation simultaneously. Our algorithm for doing so is very efficient: having a space and per-trial time complexity that is logarithmic in the time-horizon. Our algorithm also obtains novel bounds on its dynamic regret: being adaptive to variations in the rate of change of the comparator sequence.


title: Analysis of clinical, dosimetric and radiomic features for predicting local failure after stereotactic radiotherapy of brain metastases in malignant melanoma

abstract: Background: The aim of this study was to investigate the role of clinical, dosimetric and pretherapeutic magnetic resonance imaging (MRI) features for lesion-specific outcome prediction of stereotactic radiotherapy (SRT) in patients with brain metastases from malignant melanoma (MBM). Methods: In this multicenter, retrospective analysis, we reviewed 517 MBM from 130 patients treated with SRT (single fraction or hypofractionated). For each gross tumor volume (GTV) 1576 radiomic features (RF) were calculated (788 each for the GTV and for a 3 mm margin around the GTV). Clinical parameters, radiation dose and RF from pretherapeutic contrast-enhanced T1-weighted MRI from different institutions were evaluated with a feature processing and elimination pipeline in a nested cross-validation scheme. Results: Seventy-two (72) of 517 lesions (13.9%) showed a local failure (LF) after SRT. The processing pipeline showed clinical, dosimetric and radiomic features providing information for LF prediction. The most prominent ones were the correlation of the gray level co-occurrence matrix of the margin (hazard ratio (HR): 0.37, confidence interval (CI): 0.23-0.58) and systemic therapy before SRT (HR: 0.55, CI: 0.42-0.70). The majority of RF associated with LF was calculated in the margin around the GTV. Conclusions: Pretherapeutic MRI based RF connected with lesion-specific outcome after SRT could be identified, despite multicentric data and minor differences in imaging protocols. Image data analysis of the surrounding metastatic environment may provide therapy-relevant information with the potential to further individualize radiotherapy strategies.


title: Modulation theory of soliton-mean flow in KdV equation with box type initial data

abstract: For the KdV equation with box type initial data, the interaction between a trial soliton and large-scale dispersive mean flow is studied theoretically and numerically. The pure box initial value can cause rarefaction wave and dispersive shock wave, and can create an area of soliton train. The key to the interaction of soliton and mean flow is that the dynamic evolutions of the mean flow and the local soliton can be described by the same modulation system. The soliton modulation system is derived from the degenerations of the two-genus Whitham modulation system. Considering the influence of rarefaction wave, dispersive shock wave and soliton train on the trial soliton, in the framework of Whitham modulation theory, the equation describing the soliton trajectory and the changes in amplitude and phase shift are given explicitly. The predicted results are compared with the numerical simulations, which verifies the corrections of the theoretical analysis. The exotic interaction phenomena between soliton and mean flow found in this work have broad applications to shallow water soliton propagations and real soliton experiments in fluid dynamics.


title: Experimental demonstration of a fault-tolerant qubit encoded on a hyperfine-coupled qudit

abstract: The realization of effective quantum error correction protocols remains a central challenge in the development of scalable quantum computers. Protocols employing redundancy over multiple physical qubits to encode a single error-protected logical qubit are theoretically effective, but imply a large resource overhead. Alternative, more hardware-efficient, approaches seek to deploy higher-dimensional quantum systems known as qudits. Recently, proposals have emerged for exploiting high-spin magnetic nuclei coupled to condensed matter electron spin qubits to implement fault-tolerant memories. Here, we explore experimentally the simplest of these proposals, a logical qubit encoded on the four states of a I=3/2 nuclear spin hyperfine-coupled to a S=1/2 electron spin qubit; the encoding protects against the dominant decoherence mechanism in such systems, fluctuations of the quantizing magnetic field. We implement the encoding using electron-nuclear double resonance within a subspace of the spin levels in an ensemble of highly coherent manganese defects in zinc oxide. We explore the dynamics of the encoded state both under a controlled application of the fluctuation and under natural decoherence processes. Our results confirm the potential of these proposals for practical, implementable, fault tolerant quantum memories.


title: Pattern-based quantum functional testing

abstract: With the growing number of qubits of quantum information processing devices, the task of fully characterizing these processors becomes increasingly unfeasible. From a practical perspective, one wants to find possible errors in the functioning of the device as quickly as possible, or otherwise establish its correct functioning with high confidence. In response to these challenges, we propose a pattern-based approach inspired by classical memory testing algorithms to evaluate the functionality of a quantum memory, based on plausible failure mechanisms. We demonstrate the method's capability to extract pattern dependencies of important qubit characteristics, such as $T_1$ and $T_2$ times, and to identify and analyze interactions between adjacent qubits. Additionally, our approach enables the detection of different types of crosstalk effects and of signatures indicating non-Markovian dynamics in individual qubits.


title: Rethinking Open-World Semi-Supervised Learning: Distribution Mismatch and Inductive Inference

abstract: Open-world semi-supervised learning (OWSSL) extends conventional semi-supervised learning to open-world scenarios by taking account of novel categories in unlabeled datasets. Despite the recent advancements in OWSSL, the success often relies on the assumptions that 1) labeled and unlabeled datasets share the same balanced class prior distribution, which does not generally hold in real-world applications, and 2) unlabeled training datasets are utilized for evaluation, where such transductive inference might not adequately address challenges in the wild. In this paper, we aim to generalize OWSSL by addressing them. Our work suggests that practical OWSSL may require different training settings, evaluation methods, and learning strategies compared to those prevalent in the existing literature.


title: Self-Augmented Preference Optimization: Off-Policy Paradigms for Language Model Alignment

abstract: Traditional language model alignment methods, such as Direct Preference Optimization (DPO), are limited by their dependence on static, pre-collected paired preference data, which hampers their adaptability and practical applicability. To overcome this limitation, we introduce Self-Augmented Preference Optimization (SAPO), an effective and scalable training paradigm that does not require existing paired data. Building on the self-play concept, which autonomously generates negative responses, we further incorporate an off-policy learning pipeline to enhance data exploration and exploitation. Specifically, we employ an Exponential Moving Average (EMA) model in conjunction with a replay buffer to enable dynamic updates of response segments, effectively integrating real-time feedback with insights from historical data. Our comprehensive evaluations of the LLaMA3-8B and Mistral-7B models across benchmarks, including the Open LLM Leaderboard, IFEval, AlpacaEval 2.0, and MT-Bench, demonstrate that SAPO matches or surpasses established offline contrastive baselines, such as DPO and Odds Ratio Preference Optimization, and outperforms offline self-play methods like SPIN. Our code is available at https://github.com/yinyueqin/SAPO


title: Strong propagation of chaos for systems of interacting particles with nearly stable jumps

abstract: We consider a system of $N$ interacting particles, described by SDEs driven by Poisson random measures, where the coefficients depend on the empirical measure of the system. Every particle jumps with a jump rate depending on its position. When this happens, all the other particles of the system receive a small random kick which is distributed according to a heavy tailed random variable belonging to the domain of attraction of an $\alpha-$ stable law and scaled by $N^{-1/\alpha},$ where $0 < \alpha <2 .$ We call these jumps collateral jumps. Moreover, in case $ 0 < \alpha < 1, $ the jumping particle itself undergoes a macroscopic, main jump. Such systems appear in the modeling of large neural networks, such as the human brain. The particular scaling of the collateral jumps implies that the limit of the empirical measures of the system is random and equals the conditional distribution of one typical particle in the limit system, given the source of common noise. Thus the system exhibits the conditional propagation of chaos property. The limit system turns out to be solution of a non-linear SDE, driven by an $ \alpha-$stable process. We prove strong unique existence of the limit system and introduce a suitable coupling to obtain the strong convergence of the finite to the limit system, together with precise error bounds for finite time marginals.


title: Exact real time dynamics with free fermions in disguise

abstract: We consider quantum spin chains with a hidden free fermionic structure, distinct from the Jordan-Wigner transformation and its generalizations. We express selected local operators with the hidden fermions. This way we can exactly solve the real time dynamics in various physical scenarios, including the computation of selected dynamical two point functions and Loschmidt amplitudes, in continuous or discrete time. In the latter case we build quantum circuits that can be implemented on a quantum computer. With this we extend the family of classically simulable quantum many body processes.


title: That's Optional: A Contemporary Exploration of "that" Omission in English Subordinate Clauses

abstract: The Uniform Information Density (UID) hypothesis posits that speakers optimize the communicative properties of their utterances by avoiding spikes in information, thereby maintaining a relatively uniform information profile over time. This paper investigates the impact of UID principles on syntactic reduction, specifically focusing on the optional omission of the connector "that" in English subordinate clauses. Building upon previous research, we extend our investigation to a larger corpus of written English, utilize contemporary large language models (LLMs) and extend the information-uniformity principles by the notion of entropy, to estimate the UID manifestations in the usecase of syntactic reduction choices.


title: Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoning

abstract: Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only models has been extensively explored, its adaptation into multimodal vision-language models remains nascent. Going beyond mere answer generation, the primary goal of multimodal RAG is to cultivate the models' ability to reason in response to relevant queries. To this end, we introduce a novel multimodal RAG framework named RMR (Retrieval Meets Reasoning). The RMR framework employs a bi-modal retrieval module to identify the most relevant question-answer pairs, which then serve as scaffolds for the multimodal reasoning process. This training-free approach not only encourages the model to engage deeply with the reasoning processes inherent in the retrieved content but also facilitates the generation of answers that are precise and richly interpretable. Surprisingly, utilizing solely the ScienceQA dataset, collected from elementary and high school science curricula, RMR significantly boosts the performance of various vision-language models across a spectrum of benchmark datasets, including A-OKVQA, MMBench, and SEED. These outcomes highlight the substantial potential of our multimodal retrieval and reasoning mechanism to improve the reasoning capabilities of vision-language models.


title: Outliers and Calibration Sets have Diminishing Effect on Quantization of Modern LLMs

abstract: Post-Training Quantization (PTQ) enhances the efficiency of Large Language Models (LLMs) by enabling faster operation and compatibility with more accessible hardware through reduced memory usage, at the cost of small performance drops. We explore the role of calibration sets in PTQ, specifically their effect on hidden activations in various notable open-source LLMs. Calibration sets are crucial for evaluating activation magnitudes and identifying outliers, which can distort the quantization range and negatively impact performance. Our analysis reveals a marked contrast in quantization effectiveness across models. The older OPT model, upon which much of the quantization literature is based, shows significant performance deterioration and high susceptibility to outliers with varying calibration sets. In contrast, newer models like Llama-2 7B, Llama-3 8B, Command-R 35B, and Mistral 7B demonstrate strong robustness, with Mistral 7B showing near-immunity to outliers and stable activations. These findings suggest a shift in PTQ strategies might be needed. As advancements in pre-training methods reduce the relevance of outliers, there is an emerging need to reassess the fundamentals of current quantization literature. The emphasis should pivot towards optimizing inference speed, rather than primarily focusing on outlier preservation, to align with the evolving characteristics of state-of-the-art LLMs.


title: Solving partial differential equations with sampled neural networks

abstract: Approximation of solutions to partial differential equations (PDE) is an important problem in computational science and engineering. Using neural networks as an ansatz for the solution has proven a challenge in terms of training time and approximation accuracy. In this contribution, we discuss how sampling the hidden weights and biases of the ansatz network from data-agnostic and data-dependent probability distributions allows us to progress on both challenges. In most examples, the random sampling schemes outperform iterative, gradient-based optimization of physics-informed neural networks regarding training time and accuracy by several orders of magnitude. For time-dependent PDE, we construct neural basis functions only in the spatial domain and then solve the associated ordinary differential equation with classical methods from scientific computing over a long time horizon. This alleviates one of the greatest challenges for neural PDE solvers because it does not require us to parameterize the solution in time. For second-order elliptic PDE in Barron spaces, we prove the existence of sampled networks with $L^2$ convergence to the solution. We demonstrate our approach on several time-dependent and static PDEs. We also illustrate how sampled networks can effectively solve inverse problems in this setting. Benefits compared to common numerical schemes include spectral convergence and mesh-free construction of basis functions.


title: Isotope substitution and polytype control for point defects identification: the case of the ultraviolet color center in hexagonal boron nitride

abstract: Defects in crystals can have a transformative effect on the properties and functionalities of solid-state systems. Dopants in semiconductors are core components in electronic and optoelectronic devices. The control of single color centers is at the basis of advanced applications for quantum technologies. Unintentional defects can also be detrimental to the crystalline structure and hinder the development of novel materials. Whatever the research perspective, the identification of defects is a key but complicated, and often long-standing issue. Here, we present a general methodology to identify point defects by combining isotope substitution and polytype control, with a systematic comparison between experiments and first-principles calculations. We apply this methodology to hexagonal boron nitride (hBN) and its ubiquitous color center emitting in the ultraviolet spectral range. From isotopic purification of the host hBN matrix, a local vibrational mode of the defect is uncovered, and isotope-selective carbon doping proves that this mode belongs to a carbon-based center. Then, by varying the stacking sequence of the host hBN matrix, we unveil different optical responses to hydrostatic pressure for the non-equivalent configurations of this ultraviolet color center. We conclude that this defect is a carbon dimer in the honeycomb lattice of hBN. Our results show that tuning the stacking sequence in different polytypes of a given crystal provides unique fingerprints contributing to the identification of defects in 2D materials.


title: einspace: Searching for Neural Architectures from Fundamental Operations

abstract: Neural architecture search (NAS) finds high performing networks for a given task. Yet the results of NAS are fairly prosaic; they did not e.g. create a shift from convolutional structures to transformers. This is not least because the search spaces in NAS often aren't diverse enough to include such transformations a priori. Instead, for NAS to provide greater potential for fundamental design shifts, we need a novel expressive search space design which is built from more fundamental operations. To this end, we introduce einspace, a search space based on a parameterised probabilistic context-free grammar. Our space is versatile, supporting architectures of various sizes and complexities, while also containing diverse network operations which allow it to model convolutions, attention components and more. It contains many existing competitive architectures, and provides flexibility for discovering new ones. Using this search space, we perform experiments to find novel architectures as well as improvements on existing ones on the diverse Unseen NAS datasets. We show that competitive architectures can be obtained by searching from scratch, and we consistently find large improvements when initialising the search with strong baselines. We believe that this work is an important advancement towards a transformative NAS paradigm where search space expressivity and strategic search initialisation play key roles.


title: Stability in quadratic variation

abstract: Consider a sequence of cadlag processes $\{X^n\}_n$, and some fixed function $f$. If $f$ is continuous then under several modes of convergence $X^n\to X$ implies corresponding convergence of $f(X^n)\to f(X)$, due to continuous mapping. We study conditions (on $f$, $\{X^n\}_n$ and $X$) under which convergence of $X^n\to X$ implies $\left[f(X^n)-f(X)\right]\to 0$. While interesting in its own right, this also directly relates (through integration by parts and the Kunita-Watanabe inequality) to convergence of integrators in the sense $\int_0^t Y_{s-}df(X^n_s)\to\int_0^t Y_{s-}df(X_s)$. We use two different types of quadratic variations, weak sense and strong sense which our two main results deal with. For weak sense quadratic variations we show stability when $f\in C^1$, $\{X^n\}_n,X$ are Dirichlet processes defined as in \cite{NonCont} $X^n\xrightarrow{a.s.}X$, $[X^n-X]\xrightarrow{a.s.}0$ and $\{(X^n)^*_t\}_n$ is bounded in probability. For strong sense quadratic variations we are able to relax the conditions on $f$ to being the primitive function of a cadlag function but with the additional assumption on $X$, that the continuous and discontinuous parts of $X$ are independent stochastic processes (this assumption is not imposed on $\{X^n\}_n$ however), and $\{X^n\}_n,X$ are Dirichlet processes with quadratic variations along any stopping time refining sequence. To prove the result regarding strong sense quadratic variation we prove a new It\^o decomposition for this setting.


title: Convergence rate of the Euler-Maruyama scheme to density dependent SDEs driven by $\alpha$-stable additive noise

abstract: In this paper, we establish the weak convergence rate of density-dependent stochastic differential equations with bounded drift driven by $\alpha$-stable processes with $\alpha\in(1,2)$. The well-posedness of these equations has been previously obtained in \cite{wu2023well}. We derive an explicit convergence rate in total variation for the Euler-Maruyama scheme, employing a technique rooted in \cite{hao2023}.


title: Equidistribution of CM points on a Shimura Curve modulo a ramified prime

abstract: We prove an equidistribution statement for the reduction of Galois orbits of CM points on the special fiber of a Shimura curve over a totally real field attached to some ramified primes. To do so we study the reduction of CM points in the special fiber and we use Ratner's theorem to obtain the desired equidistribution.


title: Compositional Reversible Computation

abstract: Reversible computing is motivated by both pragmatic and foundational considerations arising from a variety of disciplines. We take a particular path through the development of reversible computation, emphasizing compositional reversible computation. We start from a historical perspective, by reviewing those approaches that developed reversible extensions of lambda-calculi, Turing machines, and communicating process calculi. These approaches share a common challenge: computations made reversible in this way do not naturally compose locally. We then turn our attention to computational models that eschew the detour via existing irreversible models. Building on an original analysis by Landauer, the insights of Bennett, Fredkin, and Toffoli introduced a fresh approach to reversible computing in which reversibility is elevated to the status of the main design principle. These initial models are expressed using low-level bit manipulations, however. Abstracting from the low-level of the Bennett-Fredkin-Toffoli models and pursuing more intrinsic, typed, and algebraic models, naturally leads to rig categories as the canonical model for compositional reversible programming. The categorical model reveals connections to type isomorphisms, symmetries, permutations, groups, and univalent universes. This, in turn, paves the way for extensions to reversible programming based on monads and arrows. These extensions are shown to recover conventional irreversible programming, a variety of reversible computational effects, and more interestingly both pure (measurement-free) and measurement-based quantum programming.


title: Charge Transport in Interband Cascade Lasers: An Ab-Initio Self-Consistent Model

abstract: Interband cascade lasers (ICLs) stand out due to their low threshold current and minimal power consumption, rendering them viable sources for compact and mobile devices in the mid-infrared. Since their first demonstration, they experienced major performance improvements. Many of them originate, on one hand, from technological enhancements and, on the other hand, also from restricted numerical analysis. Encouraged by the impact of restricted models, an ICL-specific simulation tool can lead to performance breakthroughs and a better comprehension of governing mechanisms. Drawing from an evaluation of existing tools designed for quantum cascade structures, we implemented a self-consistent density matrix rate equation model generalized to simulate the transport in both conduction and valence band heterostructures. Albeit the extensive inclusion of the quantum effects, special care was taken to maintain a high numerical efficiency. Our charge transport model additionally considers optical field calculations, allowing for predictive calculations of light-current-voltage (LIV) curves. We benchmark the model against well-established ICL designs and demonstrate reliable performance predictability. Additionally, we give detailed insights into device characteristics extracted from our model. This ultimately allows us to deepen our understanding of ICLs and define existing and generate novel designs.


title: Metastable doubly-charged Rydberg molecules

abstract: H$_3^{2+}$ is a one-electron system with three positive nuclei and is known to be unstable in its electronic ground-state. We examine an analogous one-electron system composed of a $^{87}$Rb Rydberg atom interacting with a pair of cations and predict the existence of metastable vibrationally-bound states of $^{87}$Rb$_3^{2+}$. These molecules are long-range trimers whose stability rests on the presence of core-shell electrons and favourable scaling of the Rydberg atom's quadrupole moment with the principal quantum number $n$. Unlike recently observed ion-Rydberg dimers, whose binding is due to internal flipping of the Rydberg atom's dipole moment, the binding of $^{87}$Rb$_3^{2+}$ arises from the interaction of the ions with the Rydberg atom's quadrupole moment. The stability of these trimers is highly sensitive to $n$. We do not expect these states to exist below $n=24$ and for $n \leq 35$, their lifetime is limited by tunnelling of the Rydberg electron. In contrast, at very large $n$ the lifetime will be limited by tunnelling of the vibrational wavepacket. In between these limits, we expect a range of bound states at intermediate $n$ for which both tunnelling rates are smaller than the radiative decay rate of the Rydberg state.


title: Existence of solutions for a system with general Hardy--Sobolev singular criticalities

abstract: In this paper we study a class of Hardy--Sobolev type systems defined in $\mathbb{R}^N$ and coupled by a singular critical Hardy--Sobolev term. The main novelty of this work is that the orders of the singularities are independent and contained in a wide range. By means of variational techniques, we will prove the existence of positive bound and ground states for such a system. In particular, we find solutions as minimizers or Mountain--Pass critical points of the energy functional on the underlying Nehari manifold.


title: Don't Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models

abstract: Image-based advertisements are complex multimodal stimuli that often contain unusual visual elements and figurative language. Previous research on automatic ad understanding has reported impressive zero-shot accuracy of contrastive vision-and-language models (VLMs) on an ad-explanation retrieval task. Here, we examine the original task setup and show that contrastive VLMs can solve it by exploiting grounding heuristics. To control for this confound, we introduce TRADE, a new evaluation test set with adversarial grounded explanations. While these explanations look implausible to humans, we show that they "fool" four different contrastive VLMs. Our findings highlight the need for an improved operationalisation of automatic ad understanding that truly evaluates VLMs' multimodal reasoning abilities. We make our code and TRADE available at https://github.com/dmg-illc/trade .


title: Proportionally dense subgraphs of maximum size in degree-constrained graphs

abstract: A proportionally dense subgraph (PDS) of a graph is an induced subgraph of size at least two such that every vertex in the subgraph has proportionally as many neighbors inside as outside of the subgraph. Then, maxPDS is the problem of determining a PDS of maximum size in a given graph. If we further require that a PDS induces a connected subgraph, we refer to such problem as connected maxPDS. In this paper, we study the complexity of maxPDS with respect to parameters representing the density of a graph and its complement. We consider $\Delta$, representing the maximum degree, $h$, representing the $h$-index, and degen, representing the degeneracy of a graph. We show that maxPDS is NP-hard parameterized by $\Delta,h$ and degen. More specifically, we show that maxPDS is NP-hard on graphs with $\Delta=4$, $h=4$ and degen=2. Then, we show that maxPDS is NP-hard when restricted to dense graphs, more specifically graphs $G$ such that $\Delta(\overline{G})\leq 6$, and graphs $G$ such that $degen(\overline{G}) \leq 2$ and $\overline{G}$ is bipartite, where $\overline{G}$ represents the complement of $G$. On the other hand, we show that maxPDS is polynomial-time solvable on graphs with $h\le2$. Finally, we consider graphs $G$ such that $h(\overline{G})\le 2$ and show that there exists a polynomial-time algorithm for finding a PDS of maximum size in such graphs. This result implies polynomial-time complexity on graphs with $n$ vertices of minimum degree $n-3$, i.e. graphs $G$ such that $\Delta(\overline{G})\le 2$. For each result presented in this paper, we consider connected maxPDS and explain how to extend it when we require connectivity.


title: SLIM: a Scalable Light-weight Root Cause Analysis for Imbalanced Data in Microservice

abstract: The newly deployed service -- one kind of change service, could lead to a new type of minority fault. Existing state-of-the-art methods for fault localization rarely consider the imbalanced fault classification in change service. This paper proposes a novel method that utilizes decision rule sets to deal with highly imbalanced data by optimizing the F1 score subject to cardinality constraints. The proposed method greedily generates the rule with maximal marginal gain and uses an efficient minorize-maximization (MM) approach to select rules iteratively, maximizing a non-monotone submodular lower bound. Compared with existing fault localization algorithms, our algorithm can adapt to the imbalanced fault scenario of change service, and provide interpretable fault causes which are easy to understand and verify. Our method can also be deployed in the online training setting, with only about 15% training overhead compared to the current SOTA methods. Empirical studies showcase that our algorithm outperforms existing fault localization algorithms in both accuracy and model interpretability.


title: Locally Stationary Distributions: A Framework for Analyzing Slow-Mixing Markov Chains

abstract: Many natural Markov chains fail to mix to their stationary distribution in polynomially many steps. Often, this slow mixing is inevitable since it is computationally intractable to sample from their stationary measure. Nevertheless, Markov chains can be shown to always converge quickly to measures that are *locally stationary*, i.e., measures that don't change over a small number of steps. These locally stationary measures are analogous to local minima in continuous optimization, while stationary measures correspond to global minima. While locally stationary measures can be statistically far from stationary measures, do they enjoy provable theoretical guarantees that have algorithmic implications? We study this question in this work and demonstrate three algorithmic applications of locally stationary measures: 1. We show that Glauber dynamics on the hardcore model can be used to find independent sets of size $\Omega\left(\frac{\log d}{d} \cdot n\right)$ in triangle-free graphs of degree at most $d$. 2. Let $W$ be a symmetric real matrix with bounded spectral diameter and $v$ be a unit vector. Given the matrix $M = \lambda vv^\top + W$ with a planted rank-one spike along vector $v$, for sufficiently large constant $\lambda$, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the vector $v$. 3. Let $M = A_{\mathbf{G}} - \frac{d}{n}\mathbf{1}\mathbf{1}^\top$ be a centered version of the adjacency matrix where the graph $\mathbf{G}$ is drawn from a sparse 2-community stochastic block model. We show that for sufficiently large constant $\lambda$, Glauber dynamics on the Ising model defined by $M$ samples vectors $x \in \{\pm 1\}^n$ that have constant correlation with the hidden community vector $\mathbf{\sigma}$.


title: Improving Reward Models with Synthetic Critiques

abstract: Reward models (RM) play a critical role in aligning language models through the process of reinforcement learning from human feedback. RMs are trained to predict a score reflecting human preference, which requires significant time and cost for human annotation. Additionally, RMs tend to quickly overfit on superficial features in the training set, hindering their generalization performance on unseen distributions. We propose a novel approach using synthetic natural language critiques generated by large language models to provide additional feedback, evaluating aspects such as instruction following, correctness, and style. This offers richer signals and more robust features for RMs to assess and score on. We demonstrate that high-quality critiques improve the performance and data efficiency of RMs initialized from different pretrained models. Conversely, we also show that low-quality critiques negatively impact performance. Furthermore, incorporating critiques enhances the interpretability and robustness of RM training.


title: MegActor: Harness the Power of Raw Video for Vivid Portrait Animation

abstract: Despite raw driving videos contain richer information on facial expressions than intermediate representations such as landmarks in the field of portrait animation, they are seldom the subject of research. This is due to two challenges inherent in portrait animation driven with raw videos: 1) significant identity leakage; 2) Irrelevant background and facial details such as wrinkles degrade performance. To harnesses the power of the raw videos for vivid portrait animation, we proposed a pioneering conditional diffusion model named as MegActor. First, we introduced a synthetic data generation framework for creating videos with consistent motion and expressions but inconsistent IDs to mitigate the issue of ID leakage. Second, we segmented the foreground and background of the reference image and employed CLIP to encode the background details. This encoded information is then integrated into the network via a text embedding module, thereby ensuring the stability of the background. Finally, we further style transfer the appearance of the reference image to the driving video to eliminate the influence of facial details in the driving videos. Our final model was trained solely on public datasets, achieving results comparable to commercial models. We hope this will help the open-source community.The code is available at https://github.com/megvii-research/MegFaceAnimate.


title: Towards Spoken Language Understanding via Multi-level Multi-grained Contrastive Learning

abstract: Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, including intent detection and slot filling. Although there are some SLU frameworks joint modeling the two subtasks and achieving high performance, most of them still overlook the inherent relationships between intents and slots and fail to achieve mutual guidance between the two subtasks. To solve the problem, we propose a multi-level multi-grained SLU framework MMCL to apply contrastive learning at three levels, including utterance level, slot level, and word level to enable intent and slot to mutually guide each other. For the utterance level, our framework implements coarse granularity contrastive learning and fine granularity contrastive learning simultaneously. Besides, we also apply the self-distillation method to improve the robustness of the model. Experimental results and further analysis demonstrate that our proposed model achieves new state-of-the-art results on two public multi-intent SLU datasets, obtaining a 2.6 overall accuracy improvement on the MixATIS dataset compared to previous best models.


title: MeshXL: Neural Coordinate Field for Generative 3D Foundation Models

abstract: The polygon mesh representation of 3D data exhibits great flexibility, fast rendering speed, and storage efficiency, which is widely preferred in various applications. However, given its unstructured graph representation, the direct generation of high-fidelity 3D meshes is challenging. Fortunately, with a pre-defined ordering strategy, 3D meshes can be represented as sequences, and the generation process can be seamlessly treated as an auto-regressive problem. In this paper, we validate the Neural Coordinate Field (NeurCF), an explicit coordinate representation with implicit neural embeddings, is a simple-yet-effective representation for large-scale sequential mesh modeling. After that, we present MeshXL, a family of generative pre-trained auto-regressive models, which addresses the process of 3D mesh generation with modern large language model approaches. Extensive experiments show that MeshXL is able to generate high-quality 3D meshes, and can also serve as foundation models for various down-stream applications.


title: Homotopy theory of pre-Calabi-Yau morphisms

abstract: In this article we study the homotopy theory of pre-Calabi-Yau morphisms, viewing them as Maurer-Cartan elements of an $L_{\infty}$-algebra. We give two different notions of homotopy: a notion of weak homotopy for morphisms between $d$-pre-Calabi-Yau categories whose underlying graded quivers on the domain (resp. codomain) are the same, and a notion of homotopy for morphisms between fixed pre-Calabi-Yau categories $(\mathcal{A},s_{d+1}M_{\mathcal{A}})$ and $(\mathcal{B},s_{d+1}M_{\mathcal{B}})$. Then, we show that the notion of homotopy is stable under composition and that homotopy equivalences are quasi-isomorphisms. Finally, we prove that the functor constructed by the author in a previous article between the category of pre-Calabi-Yau categories and the partial category of $A_{\infty}$-categories of the form $\mathcal{A}\oplus\mathcal{A}^*[d-1]$, for $\mathcal{A}$ a graded quiver, together with hat morphisms sends homotopic $d$-pre-Calabi-Yau morphisms to weak homotopic $A_{\infty}$-morphisms.


title: Modified Euler-Heisenberg effective action and Proper-Time Method in Lorentz-Violating Scalar QED

abstract: Quantum photon effects in vacuum provide an interesting setting to test quantum electrodynamics, serving as a source for predictions about physics beyond the Standard Model. In this paper, we investigate these effects by calculating the one-loop Euler-Heisenberg-like effective action within a Lorentz-violating scalar quantum electrodynamics framework. In both CPT-even and CPT-odd scenarios, we obtain the exact result in all orders of the stress tensor $F_{\mu\nu}$ and evaluate explicitly the lower orders of this effective action. We identify the quantum effects coming from Lorentz violation in an explicitly gauge invariant way. Nonlinear Lorentz-violating contributions that may affect photon-photon scattering are explicitly evaluated.


title: Parameter identification in linear non-Gaussian causal models under general confounding

abstract: Linear non-Gaussian causal models postulate that each random variable is a linear function of parent variables and non-Gaussian exogenous error terms. We study identification of the linear coefficients when such models contain latent variables. Our focus is on the commonly studied acyclic setting, where each model corresponds to a directed acyclic graph (DAG). For this case, prior literature has demonstrated that connections to overcomplete independent component analysis yield effective criteria to decide parameter identifiability in latent variable models. However, this connection is based on the assumption that the observed variables linearly depend on the latent variables. Departing from this assumption, we treat models that allow for arbitrary non-linear latent confounding. Our main result is a graphical criterion that is necessary and sufficient for deciding the generic identifiability of direct causal effects. Moreover, we provide an algorithmic implementation of the criterion with a run time that is polynomial in the number of observed variables. Finally, we report on estimation heuristics based on the identification result, explore a generalization to models with feedback loops, and provide new results on the identifiability of the causal graph.


title: Machine Learning Conservation Laws of Dynamical systems

abstract: Conservation laws are of great theoretical and practical interest. We describe a novel approach to machine learning conservation laws of finite-dimensional dynamical systems using trajectory data. It is the first such approach based on kernel methods instead of neural networks which leads to lower computational costs and requires a lower amount of training data. We propose the use of an "indeterminate" form of kernel ridge regression where the labels still have to be found by additional conditions. We use here a simple approach minimising the length of the coefficient vector to discover a single conservation law.


title: CSDO: Enhancing Efficiency and Success in Large-Scale Multi-Vehicle Trajectory Planning

abstract: This paper presents an efficient algorithm, naming Centralized Searching and Decentralized Optimization (CSDO), to find feasible solution for large-scale Multi-Vehicle Trajectory Planning (MVTP) problem. Due to the intractable growth of non-convex constraints with the number of agents, exploring various homotopy classes that imply different convex domains, is crucial for finding a feasible solution. However, existing methods struggle to explore various homotopy classes efficiently due to combining it with time-consuming precise trajectory solution finding. CSDO, addresses this limitation by separating them into different levels and integrating an efficient Multi-Agent Path Finding (MAPF) algorithm to search homotopy classes. It first searches for a coarse initial guess using a large search step, identifying a specific homotopy class. Subsequent decentralized Quadratic Programming (QP) refinement processes this guess, resolving minor collisions efficiently. Experimental results demonstrate that CSDO outperforms existing MVTP algorithms in large-scale, high-density scenarios, achieving up to 95% success rate in 50m $\times$ 50m random scenarios around one second. Source codes are released in https://github.com/YangSVM/CSDOTrajectoryPlanning.


title: clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents

abstract: It has been established in recent work that Large Language Models (LLMs) can be prompted to "self-play" conversational games that probe certain capabilities (general instruction following, strategic goal orientation, language understanding abilities), where the resulting interactive game play can be automatically scored. In this paper, we take one of the proposed frameworks for setting up such game-play environments, and further test its usefulness as an evaluation instrument, along a number of dimensions: We show that it can easily keep up with new developments while avoiding data contamination, we show that the tests implemented within it are not yet saturated (human performance is substantially higher than that of even the best models), and we show that it lends itself to investigating additional questions, such as the impact of the prompting language on performance. We believe that the approach forms a good basis for making decisions on model choice for building applied interactive systems, and perhaps ultimately setting up a closed-loop development environment of system and simulated evaluator.


title: Enhancing Efficiency of Safe Reinforcement Learning via Sample Manipulation

abstract: Safe reinforcement learning (RL) is crucial for deploying RL agents in real-world applications, as it aims to maximize long-term rewards while satisfying safety constraints. However, safe RL often suffers from sample inefficiency, requiring extensive interactions with the environment to learn a safe policy. We propose Efficient Safe Policy Optimization (ESPO), a novel approach that enhances the efficiency of safe RL through sample manipulation. ESPO employs an optimization framework with three modes: maximizing rewards, minimizing costs, and balancing the trade-off between the two. By dynamically adjusting the sampling process based on the observed conflict between reward and safety gradients, ESPO theoretically guarantees convergence, optimization stability, and improved sample complexity bounds. Experiments on the Safety-MuJoCo and Omnisafe benchmarks demonstrate that ESPO significantly outperforms existing primal-based and primal-dual-based baselines in terms of reward maximization and constraint satisfaction. Moreover, ESPO achieves substantial gains in sample efficiency, requiring 25--29% fewer samples than baselines, and reduces training time by 21--38%.


title: Maximum Bipartite Matching in $n^{2+o(1)}$ Time via a Combinatorial Algorithm

abstract: Maximum bipartite matching (MBM) is a fundamental problem in combinatorial optimization with a long and rich history. A classic result of Hopcroft and Karp (1973) provides an $O(m \sqrt{n})$-time algorithm for the problem, where $n$ and $m$ are the number of vertices and edges in the input graph, respectively. For dense graphs, an approach based on fast matrix multiplication achieves a running time of $O(n^{2.371})$. For several decades, these results represented state-of-the-art algorithms, until, in 2013, Madry introduced a powerful new approach for solving MBM using continuous optimization techniques. This line of research led to several spectacular results, culminating in a breakthrough $m^{1+o(1)}$-time algorithm for min-cost flow, that implies an $m^{1+o(1)}$-time algorithm for MBM as well. These striking advances naturally raise the question of whether combinatorial algorithms can match the performance of the algorithms that are based on continuous techniques for MBM. A recent work of the authors (2024) made progress on this question by giving a combinatorial $\tilde{O}(m^{1/3}n^{5/3})$-time algorithm for MBM, thus outperforming both the Hopcroft-Karp algorithm and matrix multiplication based approaches, on sufficiently dense graphs. Still, a large gap remains between the running time of their algorithm and the almost linear-time achievable by algorithms based on continuous techniques. In this work, we take another step towards narrowing this gap, and present a randomized $n^{2+o(1)}$-time combinatorial algorithm for MBM. Thus in dense graphs, our algorithm essentially matches the performance of algorithms that are based on continuous methods. We also obtain a randomized $n^{2+o(1)}$-time combinatorial algorithm for maximum vertex-capacitated $s$-$t$ flow in directed graphs when all vertex capacities are identical, using a standard reduction from this problem to MBM.


title: BackdoorIndicator: Leveraging OOD Data for Proactive Backdoor Detection in Federated Learning

abstract: In a federated learning (FL) system, decentralized data owners (clients) could upload their locally trained models to a central server, to jointly train a global model. Malicious clients may plant backdoors into the global model through uploading poisoned local models, causing misclassification to a target class when encountering attacker-defined triggers. Existing backdoor defenses show inconsistent performance under different system and adversarial settings, especially when the malicious updates are made statistically close to the benign ones. In this paper, we first reveal the fact that planting subsequent backdoors with the same target label could significantly help to maintain the accuracy of previously planted backdoors, and then propose a novel proactive backdoor detection mechanism for FL named BackdoorIndicator, which has the server inject indicator tasks into the global model leveraging out-of-distribution (OOD) data, and then utilizing the fact that any backdoor samples are OOD samples with respect to benign samples, the server, who is completely agnostic of the potential backdoor types and target labels, can accurately detect the presence of backdoors in uploaded models, via evaluating the indicator tasks. We perform systematic and extensive empirical studies to demonstrate the consistently superior performance and practicality of BackdoorIndicator over baseline defenses, across a wide range of system and adversarial settings.


title: ABodyBuilder3: Improved and scalable antibody structure predictions

abstract: Accurate prediction of antibody structure is a central task in the design and development of monoclonal antibodies, notably to understand both their developability and their binding properties. In this article, we introduce ABodyBuilder3, an improved and scalable antibody structure prediction model based on ImmuneBuilder. We achieve a new state-of-the-art accuracy in the modelling of CDR loops by leveraging language model embeddings, and show how predicted structures can be further improved through careful relaxation strategies. Finally, we incorporate a predicted Local Distance Difference Test into the model output to allow for a more accurate estimation of uncertainties.


title: Cartan Geometry and Infinite-Dimensional Kempf-Ness Theory

abstract: We pioneer the development of a rigorous infinite-dimensional framework for the Kempf-Ness theorem, addressing the significant challenge posed by the absence of a complexification for the symmetry group in infinite dimensions, e.g, the diffeomorphism group. We propose a novel approach, based on Cartan bundles, to generalize Kempf-Ness theory to infinite dimensions, invoking the fundamental role played by the Maurer-Cartan form. This approach allows us to define and study objects essential for the Kempf-Ness theorem, such as the complex model for orbits and the Kempf-Ness function, as well as establishing its convexity properties and defining a generalized Futaki character. We show how our framework can be applied to the study of various problems in K\"ahler geometry, deformation quantization, and gauge theory.


title: On alternative formulations of the thermodynamics of scalar-tensor theories

abstract: We explore alternative formulations of the analogy between viable Horndeski gravity and Eckart's first-order thermodynamics. We single out a class of identifications for the effective stress-energy tensor of the scalar field fluid that, upon performing the imperfect fluid decomposition, yields constitutive relations that can be mapped onto Eckart's theory. We then investigate how different couplings to Einstein's gravity, at the level of the field equations, can affect the thermodynamic formalism overall. Lastly, we specialise the discussion to the case of ``traditional'' scalar-tensor theories and identify a specific choice of the coupling function that leads to a significant simplification of the formalism.


title: Poynting flux transport channels formed in polar cap regions of neutron star magnetospheres

abstract: Pair cascades in polar cap regions of neutron stars are considered to be an essential process in various models of coherent radio emissions of pulsars. The cascades produce pair plasma bunch discharges in quasi-periodic spark events. The cascade properties, and therefore also the coherent radiation, depend strongly on the magnetospheric plasma properties and vary significantly across and along the polar cap. It is furthermore still uncertain from where the radio emission emanates in polar cap region. We investigate the generation of electromagnetic waves by pair cascades and their propagation in the polar cap for three representative inclination angles of a magnetic dipole, $0^\circ$, $45^\circ$, and $90^\circ$. 2D particle-in-cell simulations that include quantum-electrodynamic pair cascades are used in a charge limited flow from the star surface. We found that the discharge properties are strongly dependent on the magnetospheric current profile in the polar cap and that transport channels for high intensity Poynting flux are formed along magnetic field lines where the magnetospheric currents approach zero and where the plasma cannot carry the magnetospheric currents. There, the parallel Poynting flux component is efficiently transported away from the star and may eventually escape the magnetosphere as coherent radio waves. The Poynting flux decreases faster with the distance from the star in regions of high magnetospheric currents. Our model shows that no process of energy conversion from particles to waves is necessary for the coherent radio wave emission. Moreover, the pulsar radio beam does not have a cone structure, but rather the radiation generated by the oscillating electric gap fields directly escapes along open magnetic field lines in which no pair creation occurs.


title: Automatic Channel Pruning for Multi-Head Attention

abstract: Despite the strong performance of Transformers, their quadratic computation complexity presents challenges in applying them to vision tasks. Automatic pruning is one of effective methods for reducing computation complexity without heuristic approaches. However, directly applying it to multi-head attention is not straightforward due to channel misalignment. In this paper, we propose an automatic channel pruning method to take into account the multi-head attention mechanism. First, we incorporate channel similarity-based weights into the pruning indicator to preserve more informative channels in each head. Then, we adjust pruning indicator to enforce removal of channels in equal proportions across all heads, preventing the channel misalignment. We also add a reweight module to compensate for information loss resulting from channel removal, and an effective initialization step for pruning indicator based on difference of attention between original structure and each channel. Our proposed method can be used to not only original attention, but also linear attention, which is more efficient as linear complexity with respect to the number of tokens. On ImageNet-1K, applying our pruning method to the FLattenTransformer, which includes both attention mechanisms, shows outperformed accuracy for several MACs compared with previous state-of-the-art efficient models and pruned methods. Code will be available soon.


title: Responsible AI for Earth Observation

abstract: The convergence of artificial intelligence (AI) and Earth observation (EO) technologies has brought geoscience and remote sensing into an era of unparalleled capabilities. AI's transformative impact on data analysis, particularly derived from EO platforms, holds great promise in addressing global challenges such as environmental monitoring, disaster response and climate change analysis. However, the rapid integration of AI necessitates a careful examination of the responsible dimensions inherent in its application within these domains. In this paper, we represent a pioneering effort to systematically define the intersection of AI and EO, with a central focus on responsible AI practices. Specifically, we identify several critical components guiding this exploration from both academia and industry perspectives within the EO field: AI and EO for social good, mitigating unfair biases, AI security in EO, geo-privacy and privacy-preserving measures, as well as maintaining scientific excellence, open data, and guiding AI usage based on ethical principles. Furthermore, the paper explores potential opportunities and emerging trends, providing valuable insights for future research endeavors.


title: Understanding the Throughput Bounds of Reconfigurable Datacenter Networks

abstract: The increasing gap between the growth of datacenter traffic volume and the capacity of electrical switches led to the emergence of reconfigurable datacenter network designs based on optical circuit switching. A multitude of research works, ranging from demand-oblivious (e.g., RotorNet, Sirius) to demand-aware (e.g., Helios, ProjecToR) reconfigurable networks, demonstrate significant performance benefits. Unfortunately, little is formally known about the achievable throughput of such networks. Only recently have the throughput bounds of demand-oblivious networks been studied. In this paper, we tackle a fundamental question: Whether and to what extent can demand-aware reconfigurable networks improve the throughput of datacenters? This paper attempts to understand the landscape of the throughput bounds of reconfigurable datacenter networks. Given the rise of machine learning workloads and collective communication in modern datacenters, we specifically focus on their typical communication patterns, namely uniform-residual demand matrices. We formally establish a separation bound of demand-aware networks over demand-oblivious networks, proving analytically that the former can provide at least $16\%$ higher throughput. Our analysis further uncovers new design opportunities based on periodic, fixed-duration reconfigurations that can harness the throughput benefits of demand-aware networks while inheriting the simplicity and low reconfiguration overheads of demand-oblivious networks. Finally, our evaluations corroborate the theoretical results of this paper, demonstrating that demand-aware networks significantly outperform oblivious networks in terms of throughput. This work barely scratches the surface and unveils several intriguing open questions, which we discuss at the end of this paper.


title: Simultaneous Measurement of Thermal Conductivity and Heat Capacity Across Diverse Materials Using the Square-Pulsed Source (SPS) Technique

abstract: State-of-the-art techniques like dual-frequency Time-Domain Thermoreflectance (TDTR) and Frequency-Domain Thermoreflectance (FDTR) offer superb capability for simultaneous measurements of thermal conductivity and heat capacity with a spatial resolution on the order of 10 {\mu}m. However, their applicability is limited to highly conductive materials with an in-plane thermal conductivity exceeding 10 W/(m*K). In this paper, we introduce the Square-Pulsed Source (SPS) technique, offering a novel approach to concurrently measure thermal conductivity and heat capacity with a 10 {\mu}m spatial resolution, while significantly extending the measurable thermal conductivity range to an unprecedented low of 0.1 W/(m*K), offering enhanced versatility. To demonstrate and validate its efficacy, we conducted measurements on various standard materials--PMMA, silica, sapphire, silicon, and diamond--spanning a wide thermal conductivity range from 0.1 to 2000 W/(m*K). The obtained results exhibit remarkable agreement with literature values, with a typical measurement uncertainty of less than 10% across the entire thermal conductivity range. By providing a unique capability to characterize both highly and lowly conductive materials with micron-scale spatial resolution, the SPS method opens new avenues for understanding and engineering thermal properties across diverse applications.


title: A Nearest-neighbor Expansion of Lepton Flavor Mixing in Powers of the $\mu$-$\tau$ Permutation Symmetry Breaking Effect

abstract: We point out that the observed pattern of lepton flavor mixing can be well described by a proper nearest-neighbor expansion of a constant $3\times 3$ unitary matrix in powers of a small parameter characterizing the fine effect of $\mu$-$\tau$ permutation symmetry breaking. We take an example of this kind for illustration, and provide complete discussions on the usefulness in the study of leptonic CP violation and unitarity triangles in matter.


title: Ultrafast optical switching to a heterochiral charge-density wave state

abstract: Optical control of correlated electronic states promises unprecedented tunability of novel functional materials. Tailored optical excitations can steer a system along non-equilibrium pathways to metastable states with specific structural or electronic properties. A much-desired feature is the reproducible and ultrafast switching to functional states. The light-induced hidden state of 1T-TaS$_{2}$, with its strongly enhanced conductivity and exceptionally long lifetime, represents a unique model system for studying the switching of correlated electronic states using femtosecond optical stimuli. However, despite intense investigation, the switching mechanism and the structural origins of the distinctive electronic properties of the hidden state have not been fully uncovered. Here, we use surface-sensitive electron diffraction in combination with a femtosecond optical quench to reveal coexistent charge-density wave chiralities as a new structural feature of the hidden state. We find that a single-pulse optical quench produces a state with long-range structural order and different weights of the two chiral enantiomorphs of the charge-density wave. Harnessing a double-pulse optical quench, we trace the origin of the mixed chirality to the transient electronic excitation of the host crystal. The coexistent long-range-order of both chiralities suggests the presence of extended heterochiral charge-density wave interfaces, which results in a higher-level, fractal-type moir\'{e} superstructure. Density functional theory simulations for such a charge-density wave moir\'{e} superstructure reveal multiple flat bands, Dirac cones, and a kagome electronic subsystem around the Fermi energy. Our findings shed light on novel electronic properties gained by chiral interface engineering, and create avenues for light-induced moir\'{e} superstructures in quasi-two-dimensional materials.


title: Mutually unbiased bases via complex projective trigonometry

abstract: We give a synthetic construction of a complete system of mutually unbiased bases in $\mathbb{C}^3$.


title: Borromean Hypergraph Formation in Dense Random Rectangles

abstract: We develop a minimal system to study the stochastic formation of Borromean links within topologically entangled networks without requiring the use of knot invariants. Borromean linkages may form in entangled solutions of open polymer chains or in Olympic gel systems such as kinetoplast DNA, but it is challenging to investigate this due to the difficulty of computing three-body link invariants. Here, we investigate randomly oriented rectangles densely packed within a volume, and evaluate them for Hopf linking and Borromean link formation. We show that dense packings of rectangles can form Borromean triplets and larger clusters, and that in high enough density the combination of Hopf and Borromean linking can create a percolating hypergraph through the network. We present data for the percolation threshold of Borromean hypergraphs, and discuss implications for the existence of Borromean connectivity within kinetoplast DNA.


title: Progress on nucleon transition matrix elements with a lattice QCD variational analysis

abstract: Nucleon weak matrix elements can be extracted from nucleon correlation functions with lattice QCD simulations. The signal-to-noise ratio prohibits the analysis at large source-sink separations and as a consequence, excited state contamination affects the extraction of the nucleon matrix elements. Chiral perturbation theory (ChPT) suggests that the dominant contamination in some of these channels is due to $N\pi$ states where the pion carries the same momentum of the current. In this talk, we report updates on the variational analysis with $qqq$-operators (nucleon-like) and $(qqq)(\bar{q}q)$-operators (nucleon-pion-like) where we report for the first time some preliminary results of $\langle N\pi| \mathcal{J}| N \rangle $, modulo some kinematic and volume factors, and we compare the results against ChPT. This pilot study is performed on a CLS ensemble with $N_f=3$, $m_\pi \approx 420~\mathrm{MeV}$, $a\approx 0.1~\mathrm{fm}$ and $T=2L\approx 4.8~\mathrm{fm}$.