title: Bubble Economics

abstract: This article provides a self-contained overview of the theory of rational asset price bubbles. We cover topics from basic definitions, properties, and classical results to frontier research, with an emphasis on bubbles attached to real assets such as stocks, housing, and land. The main message is that bubbles attached to real assets are fundamentally nonstationary phenomena related to unbalanced growth. We present a bare-bones model and draw three new insights: (i) the emergence of asset price bubbles is a necessity, instead of a possibility; (ii) asset pricing implications are markedly different between balanced growth of stationary nature and unbalanced growth of nonstationary nature; and (iii) asset price bubbles occur within larger historical trends involving shifts in industrial structure driven by technological innovation, including the transition from the Malthusian economy to the modern economy.


title: A Physics-Guided Bi-Fidelity Fourier-Featured Operator Learning Framework for Predicting Time Evolution of Drag and Lift Coefficients

abstract: In the pursuit of accurate experimental and computational data while minimizing effort, there is a constant need for high-fidelity results. However, achieving such results often requires significant computational resources. To address this challenge, this paper proposes a deep operator learning-based framework that requires a limited high-fidelity dataset for training. We introduce a novel physics-guided, bi-fidelity, Fourier-featured Deep Operator Network (DeepONet) framework that effectively combines low and high-fidelity datasets, leveraging the strengths of each. In our methodology, we began by designing a physics-guided Fourier-featured DeepONet, drawing inspiration from the intrinsic physical behavior of the target solution. Subsequently, we train this network to primarily learn the low-fidelity solution, utilizing an extensive dataset. This process ensures a comprehensive grasp of the foundational solution patterns. Following this foundational learning, the low-fidelity deep operator network's output is enhanced using a physics-guided Fourier-featured residual deep operator network. This network refines the initial low-fidelity output, achieving the high-fidelity solution by employing a small high-fidelity dataset for training. Notably, in our framework, we employ the Fourier feature network as the Trunk network for the DeepONets, given its proficiency in capturing and learning the oscillatory nature of the target solution with high precision. We validate our approach using a well-known 2D benchmark cylinder problem, which aims to predict the time trajectories of lift and drag coefficients. The results highlight that the physics-guided Fourier-featured deep operator network, serving as a foundational building block of our framework, possesses superior predictive capability for the lift and drag coefficients compared to its data-driven counterparts.


title: Impact of the Ce $4f$ states in the electronic structure of the intermediate-valence superconductor CeIr$_3$

abstract: The electronic structure of the $f$-based superconductor $\mathrm{CeIr_3}$ was studied by photoelectron spectroscopy. The energy distribution of the $\mathrm{Ce}~4f$ states were revealed by the $\mathrm{Ce}~3d-4f$ resonant photoelectron spectroscopy. The $\mathrm{Ce}~4f$ states were mostly distributed in the vicinity of the Fermi energy, suggesting the itinerant character of the $\mathrm{Ce}~4f$ states. The contribution of the $\mathrm{Ce}~4f$ states to the density of states (DOS) at the Fermi energy was estimated to be nearly half of that of the $\mathrm{Ir}~5d$ states, implying that the $\mathrm{Ce}~4f$ states have a considerable contribution to the DOS at the Fermi energy. The $\mathrm{Ce}~3d$ core-level and $\mathrm{Ce}~3d$ X-ray absorption spectra were analyzed based on a single-impurity Anderson model. The number of the $\mathrm{Ce}~4f$ states in the ground state was estimated to be $0.8-0.9$, which is much larger than the values obtained in the previous studies (i.e., $0-0.4$).


title: Spectral Maps for Learning Reduced Representations of Molecular Systems

abstract: Investigating processes in complex molecular systems, which are characterized by many variables, is a crucial problem in computational physics. These systems can be reduced to a few meaningful degrees of freedom known as collective variables (CVs). However, identifying these CVs is a significant challenge, especially for systems with long-lived metastable states. This is because the information about the slow kinetics of rare transitions needs to be encoded in CVs. In this talk, we review recent advances in learning slow CVs and focus mainly on our spectral map technique, a promising deep-learning method that learns CVs based on the slowest timescales. By maximizing the spectral gap between slow and fast eigenvalues of a Markov transition matrix constructed from simulation data, our method effectively captures a simplified representation of alanine dipeptide in solvent. This practical application of our method demonstrates its ability to extract slow CVs, making it a valuable tool for analyzing complex systems.


title: Observation of the Knot Topology of Non-Hermitian Systems in a Single Spin

abstract: The non-Hermiticity of the system gives rise to distinct knot topology that has no Hermitian counterpart. Here, we report a comprehensive study of the knot topology in gapped non-Hermitian systems based on the universal dilation method with a long coherence time nitrogen-vacancy center in a $^{\text{12}}$C isotope purified diamond. Both the braiding patterns of energy bands and the eigenstate topology are revealed. Furthermore, the global biorthogonal Berry phase related to the eigenstate topology has been successfully observed, which identifies the topological invariance for the non-Hermitian system. Our method paves the way for further exploration of the interplay among band braiding, eigenstate topology and symmetries in non-Hermitian quantum systems.


title: Increased light-emission efficiency in disordered InGaN through the correlated reduction of recombination rates

abstract: Experiments have shown that the light-emission efficiency of indium gallium nitride (InGaN) light-emitting diodes improves with increasing indium concentration. It is widely thought that compositional fluctuations due to indium incorporation suppress diffusion of carriers to non-radiative centers, thus leading to defect-insensitive emission. However, recent experiments have challenged this hypothesis by revealing unexpectedly long diffusion lengths at room temperature. Here, we demonstrate an alternative mechanism involving the correlated reduction in radiative and non-radiative recombination rates that explains the increase in light-emission efficiency of InGaN with increasing indium concentration, without invoking the suppression of carrier diffusion. Our analysis challenges the notion that carrier localization gives rise to defect tolerance in InGaN.

categories: physics.optics cond-mat.dis-nn cond-mat.mtrl-sci physics.app-ph


title: BOB: Bayesian Optimized Bootstrap for Uncertainty Quantification in Gaussian Mixture Models

abstract: A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several computational challenges, which have prevented a broader full Bayesian implementation of these models. A growing body of literature has introduced the Weighted Likelihood Bootstrap and the Weighted Bayesian Bootstrap as alternatives to MCMC sampling. The core idea of these methods is to repeatedly compute maximum a posteriori (MAP) estimates on many randomly weighted posterior densities. These MAP estimates then can be treated as approximate posterior draws. Nonetheless, a central question remains unanswered: How to select the random weights under arbitrary sample sizes. We, therefore, introduce the Bayesian Optimized Bootstrap (BOB), a computational method to automatically select these random weights by minimizing, through Bayesian Optimization, a black-box and noisy version of the reverse Kullback-Leibler (KL) divergence between the Bayesian posterior and an approximate posterior obtained via random weighting. Our proposed method outperforms competing approaches in recovering the Bayesian posterior, it provides a better uncertainty quantification, and it retains key asymptotic properties from existing methods. BOB's performance is demonstrated through extensive simulations, along with real-world data analyses.


title: Automated Mathematical Discovery and Verification: Minimizing Pentagons in the Plane

abstract: We present a comprehensive demonstration of how automated reasoning can assist mathematical research, both in the discovery of conjectures and in their verification. Our focus is a discrete geometry problem: What is $\mu_{5}(n)$, the minimum number of convex pentagons induced by $n$ points in the plane? In the first stage toward tackling this problem, automated reasoning tools guide discovery and conjectures: we use SAT-based tools to find abstract configurations of points that would induce few pentagons. Afterward, we use Operations Research tools to find and visualize realizations of these configurations in the plane, if they exist. Mathematical thought and intuition are still vital parts of the process for turning the obtained visualizations into general constructions. A surprisingly simple upper bound follows from our constructions: $\mu_{5}(n) \leq \binom{\lfloor n/2 \rfloor}{5} + \binom{\lceil n/2 \rceil}{5}$, and we conjecture it is optimal. In the second stage, we turn our focus to verifying this conjecture. Using MaxSAT, we confirm that $\mu_5(n)$ matches the conjectured values for $n \leq 16$, thereby improving both the existing lower and upper bounds for $n \in [12, 16]$. Our MaxSAT results rely on two mathematical theorems with pen-and-paper proofs, highlighting once again the rich interplay between automated and traditional mathematics.


title: Secondary Lepton Production, Propagation, and Interactions with NuLeptonSim

abstract: Charged current interactions of neutrinos inside the Earth can result in secondary muons and {\tau} - leptons which are detectable by a large swath of existing and planned neutrino experiments through a wide variety of event topologies. Consideration of such events can improve detector performance and provide unique signatures which help with event reconstruction. In this work, we describe NuLeptonSim, a propagation tool for neutrinos and charged leptons that builds on the fast NuTauSim framework. NuLeptonSim considers energy losses of charged leptons, modelled both continuously for performance or stochastically for accuracy, as well as interaction models for all flavors of neutrinos, including the Glashow resonance. We demonstrate the results from including these effects on the Earth emergence probability of various charged leptons from different flavors of primary neutrino and their corresponding energy distributions. We find that the emergence probability of muons can be higher than that of taus for energies below 100 PeV, whether from a primary muon or {\tau} neutrino, and that the Glashow resonance contributes to a surplus of emerging leptons near the resonant energy.


title: An algebraic formulation of nonassociative quantum mechanics

abstract: We develop a version of quantum mechanics that can handle nonassociative algebras of observables and which reduces to standard quantum theory in the traditional associative setting. Our algebraic approach is naturally probabilistic and is based on using the universal enveloping algebra of a general nonassociative algebra to introduce a generalized notion of associative composition product. We formulate properties of states together with notions of trace, and use them to develop GNS constructions. We describe Heisenberg and Schr\"odinger pictures of completely positive dynamics, and we illustrate our formalism on the explicit examples of finite-dimensional matrix Jordan algebras as well as the octonion algebra.


title: Instruct Me More! Random Prompting for Visual In-Context Learning

abstract: Large-scale models trained on extensive datasets, have emerged as the preferred approach due to their high generalizability across various tasks. In-context learning (ICL), a popular strategy in natural language processing, uses such models for different tasks by providing instructive prompts but without updating model parameters. This idea is now being explored in computer vision, where an input-output image pair (called an in-context pair) is supplied to the model with a query image as a prompt to exemplify the desired output. The efficacy of visual ICL often depends on the quality of the prompts. We thus introduce a method coined Instruct Me More (InMeMo), which augments in-context pairs with a learnable perturbation (prompt), to explore its potential. Our experiments on mainstream tasks reveal that InMeMo surpasses the current state-of-the-art performance. Specifically, compared to the baseline without learnable prompt, InMeMo boosts mIoU scores by 7.35 and 15.13 for foreground segmentation and single object detection tasks, respectively. Our findings suggest that InMeMo offers a versatile and efficient way to enhance the performance of visual ICL with lightweight training. Code is available at https://github.com/Jackieam/InMeMo.


title: Strong electron-phonon coupling in Ba$_{1-x}$Sr$_x$Ni$_2$As$_2$

abstract: The charge density wave (CDW) or nematicity has been found to coexist with superconductivity in many systems. It is thus interesting that the superconducting transition temperature $T_c$ in the doped BaNi$_2$As$_2$ system can be enhanced up to six times as the CDW or nematicity in the undoped compound is suppressed. Here we show that the transverse acoustic phonons of Ba$_{1-x}$Sr$_x$Ni$_2$As$_2$ are strongly damped in a wide doping range and over the whole $Q$ range, which excludes its origin from either CDW or nematicity. The damping of TA phonons can be understood as large electron-phonon coupling and possible strong hybridization between acoustic and optical phonons as shown by the first-principle calculations. The superconductivity can be quantitatively reproduced by the change of electron-phonon coupling constant calculated by the McMillan equation in the BCS framework, which suggests that no quantum fluctuations of any order is needed to promote the superconductivity. On the contrary, the change of $T_c$ in this system should be understood as the six-fold suppression of superconductivity in undoped compounds.


title: Image Generation and Learning Strategy for Deep Document Forgery Detection

abstract: In recent years, document processing has flourished and brought numerous benefits. However, there has been a significant rise in reported cases of forged document images. Specifically, recent advancements in deep neural network (DNN) methods for generative tasks may amplify the threat of document forgery. Traditional approaches for forged document images created by prevalent copy-move methods are unsuitable against those created by DNN-based methods, as we have verified. To address this issue, we construct a training dataset of document forgery images, named FD-VIED, by emulating possible attacks, such as text addition, removal, and replacement with recent DNN-methods. Additionally, we introduce an effective pre-training approach through self-supervised learning with both natural images and document images. In our experiments, we demonstrate that our approach enhances detection performance.


title: SeRO: Self-Supervised Reinforcement Learning for Recovery from Out-of-Distribution Situations

abstract: Robotic agents trained using reinforcement learning have the problem of taking unreliable actions in an out-of-distribution (OOD) state. Agents can easily become OOD in real-world environments because it is almost impossible for them to visit and learn the entire state space during training. Unfortunately, unreliable actions do not ensure that agents perform their original tasks successfully. Therefore, agents should be able to recognize whether they are in OOD states and learn how to return to the learned state distribution rather than continue to take unreliable actions. In this study, we propose a novel method for retraining agents to recover from OOD situations in a self-supervised manner when they fall into OOD states. Our in-depth experimental results demonstrate that our method substantially improves the agent's ability to recover from OOD situations in terms of sample efficiency and restoration of the performance for the original tasks. Moreover, we show that our method can retrain the agent to recover from OOD situations even when in-distribution states are difficult to visit through exploration.


title: Machine Learning Parameterization of the Multi-scale Kain-Fritsch (MSKF) Convection Scheme

abstract: Warm-sector heavy rainfall often occurs along the coast of South China, and it is usually localized and long-lasting, making it challenging to predict. High-resolution numerical weather prediction (NWP) models are increasingly used to better resolve topographic features and forecast such high-impact weather events. However, when the grid spacing becomes comparable to the length scales of convection, known as the gray zone, the turbulent eddies in the atmospheric boundary layer are only partially resolved and parameterized to some extent. Whether using a convection parameterization (CP) scheme in the gray zone remains controversial. Scale-aware CP schemes are developed to enhance the representation of convective transport within the gray zone. The multi-scale Kain-Fritsch (MSKF) scheme includes modifications that allow for its effective implementation at a grid resolution as high as 2 km. In recent years, there has been an increasing application of machine learning (ML) models to various domains of atmospheric sciences, including the replacement of physical parameterizations with ML models. This work proposes a multi-output bidirectional long short-term memory (Bi-LSTM) model as a replace the scale-aware MSKF CP scheme. The Weather Research and Forecast (WRF) model is used to generate training and testing data over South China at a horizontal resolution of 5 km. Furthermore, the WRF model is coupled with the ML based CP scheme and compared with WRF simulations with original MSKF scheme. The results demonstrate that the Bi-LSTM model can achieve high accuracy, indicating the potential use of ML models to substitute the MSKF scheme in the gray zone.


title: On the Performance of LoRa Empowered Communication for Wireless Body Area Networks

abstract: To remotely monitor the physiological status of the human body, long range (LoRa) communication has been considered as an eminently suitable candidate for wireless body area networks (WBANs). Typically, a Rayleigh-lognormal fading channel is encountered by the LoRa links of the WBAN. In this context, we characterize the performance of the LoRa system in WBAN scenarios with an emphasis on the physical (PHY) layer and medium access control (MAC) layer in the face of Rayleigh-lognormal fading channels and the same spreading factor interference. Specifically, closed-form approximate bit error probability (BEP) expressions are derived for the LoRa system. The results show that increasing the SF and reducing the interference efficiently mitigate the shadowing effects. Moreover, in the quest for the most suitable MAC protocol for LoRa based WBANs, three MAC protocols are critically appraised, namely the pure ALOHA, slotted ALOHA, and carrier-sense multiple access. The coverage probability, energy efficiency, throughput, and system delay of the three MAC protocols are analyzed in Rayleigh-lognormal fading channel. Furthermore, the performance of the equal-interval-based and equal-area-based schemes is analyzed to guide the choice of the SF. Our simulation results confirm the accuracy of the mathematical analysis and provide some useful insights for the future design of LoRa based WBANs.


title: Prediction of viral spillover risk based on the mass action principle

abstract: Infectious zoonotic disease emergence, through spillover events, is of global concern and has the potential to cause significant harm to society, as recently demonstrated by COVID-19. More than 70% of the 400 infectious diseases that emerged in the past five decades have a zoonotic origin, including all recent pandemics. There have been several approaches used to predict the risk of spillover through some of the known or suspected infectious disease emergence drivers, largely using correlative approaches. Here, we predict the spatial distribution of spillover risk by approximating general transmission through animal and human interactions. These mass action interactions are approximated through the multiplication of the spatial distribution of zoonotic viral diversity and human population density. Although our results indicate higher risk in regions along the equator and in Southeast Asia where both viral diversity and human population density are high, it should be noted that this is primarily a conceptual exercise. We compared our spillover risk map to key factors, including the model inputs of zoonotic viral diversity estimate map, human population density map, and the spatial distribution of species richness. Despite the limitations of this approach, this viral spillover map is a step towards developing a more comprehensive spillover risk prediction system to inform global monitoring.


title: PUMA: Fully Decentralized Uncertainty-aware Multiagent Trajectory Planner with Real-time Image Segmentation-based Frame Alignment

abstract: Fully decentralized, multiagent trajectory planners enable complex tasks like search and rescue or package delivery by ensuring safe navigation in unknown environments. However, deconflicting trajectories with other agents and ensuring collision-free paths in a fully decentralized setting is complicated by dynamic elements and localization uncertainty. To this end, this paper presents (1) an uncertainty-aware multiagent trajectory planner and (2) an image segmentation-based frame alignment pipeline. The uncertainty-aware planner propagates uncertainty associated with the future motion of detected obstacles, and by incorporating this propagated uncertainty into optimization constraints, the planner effectively navigates around obstacles. Unlike conventional methods that emphasize explicit obstacle tracking, our approach integrates implicit tracking. Sharing trajectories between agents can cause potential collisions due to frame misalignment. Addressing this, we introduce a novel frame alignment pipeline that rectifies inter-agent frame misalignment. This method leverages a zero-shot image segmentation model for detecting objects in the environment and a data association framework based on geometric consistency for map alignment. Our approach accurately aligns frames with only 0.18 m and 2.7 deg of mean frame alignment error in our most challenging simulation scenario. In addition, we conducted hardware experiments and successfully achieved 0.29 m and 2.59 deg of frame alignment error. Together with the alignment framework, our planner ensures safe navigation in unknown environments and collision avoidance in decentralized settings.


title: The impact of selection biases on tests of general relativity with gravitational-wave inspirals

abstract: Tests of general relativity with gravitational wave observations from merging compact binaries continue to confirm Einstein's theory of gravity with increasing precision. However, these tests have so far only been applied to signals that were first confidently detected by matched-filter searches assuming general relativity templates. This raises the question of selection biases: what is the largest deviation from general relativity that current searches can detect, and are current constraints on such deviations necessarily narrow because they are based on signals that were detected by templated searches in the first place? In this paper, we estimate the impact of selection effects for tests of the inspiral phase evolution of compact binary signals with a simplified version of the GstLAL search pipeline. We find that selection biases affect the search for very large values of the deviation parameters, much larger than the constraints implied by the detected signals. Therefore, combined population constraints from confidently detected events are mostly unaffected by selection biases, with the largest effect being a broadening at the $\sim10$ % level for the $-1$PN term. These findings suggest that current population constraints on the inspiral phase are robust without factoring in selection biases. Our study does not rule out a disjoint, undetectable binary population with large deviations from general relativity, or stronger selection effects in other tests or search procedures.


title: 6DVF: Data Visualisation Framework for mHealth Apps

abstract: The widespread of data visualisation tools on smartphones has provided end users an easy way to track their health data, leading designers to put more effort into delivering suitable visualisations. Both academia and industry have developed several frameworks to guide the creation of informative and well-designed charts, such as the visualisation and design framework and Google Material Design. Despite the typical focus on design and chart types in these existing frameworks, our study highlights the need to incorporate additional components when developing data visualisations. The needs of non-expert users, the nature of the data being represented, and the mobile environment are often not prioritised in these frameworks, leading to visualisations that do not meet user needs and expectations. To address these issues, we propose our Six-Dimensions Data Visualisation Framework (6DVF) to assist in the design and evaluation of visualisations on mobile devices. Finally, we present our initial findings from a designer evaluation experiment.


title: The Linear Representation Hypothesis and the Geometry of Large Language Models

abstract: Informally, the 'linear representation hypothesis' is the idea that high-level concepts are represented linearly as directions in some representation space. In this paper, we address two closely related questions: What does "linear representation" actually mean? And, how do we make sense of geometric notions (e.g., cosine similarity or projection) in the representation space? To answer these, we use the language of counterfactuals to give two formalizations of "linear representation", one in the output (word) representation space, and one in the input (sentence) space. We then prove these connect to linear probing and model steering, respectively. To make sense of geometric notions, we use the formalization to identify a particular (non-Euclidean) inner product that respects language structure in a sense we make precise. Using this causal inner product, we show how to unify all notions of linear representation. In particular, this allows the construction of probes and steering vectors using counterfactual pairs. Experiments with LLaMA-2 demonstrate the existence of linear representations of concepts, the connection to interpretation and control, and the fundamental role of the choice of inner product.


title: GNN-Based Beamforming for Sum-Rate Maximization in MU-MISO Networks

abstract: The advantages of graph neural networks (GNNs) in leveraging the graph topology of wireless networks have drawn increasing attentions. This paper studies the GNN-based learning approach for the sum-rate maximization in multiple-user multiple-input single-output (MU-MISO) networks subject to the users' individual data rate requirements and the power budget of the base station. By modeling the MU-MISO network as a graph, a GNN-based architecture named CRGAT is proposed to directly map the channel state information to the beamforming vectors. The attention-enabled aggregation and the residual-assisted combination are adopted to enhance the learning capability and avoid the oversmoothing issue. Furthermore, a novel activation function is proposed for the constraint due to the limited power budget at the base station. The CRGAT is trained in an unsupervised learning manner with two proposed loss functions. An evaluation method is proposed for the learning-based approach, based on which the effectiveness of the proposed CRGAT is validated in comparison with several convex optimization and learning based approaches. Numerical results are provided to reveal the advantages of the CRGAT including the millisecond-level response with limited optimality performance loss, the scalability to different number of users and power budgets, and the adaptability to different system settings.


title: Sampling via F\"ollmer Flow

abstract: We introduce a novel unit-time ordinary differential equation (ODE) flow called the preconditioned F\"{o}llmer flow, which efficiently transforms a Gaussian measure into a desired target measure at time 1. To discretize the flow, we apply Euler's method, where the velocity field is calculated either analytically or through Monte Carlo approximation using Gaussian samples. Under reasonable conditions, we derive a non-asymptotic error bound in the Wasserstein distance between the sampling distribution and the target distribution. Through numerical experiments on mixture distributions in 1D, 2D, and high-dimensional spaces, we demonstrate that the samples generated by our proposed flow exhibit higher quality compared to those obtained by several existing methods. Furthermore, we propose leveraging the F\"{o}llmer flow as a warmstart strategy for existing Markov Chain Monte Carlo (MCMC) methods, aiming to mitigate mode collapses and enhance their performance. Finally, thanks to the deterministic nature of the F\"{o}llmer flow, we can leverage deep neural networks to fit the trajectory of sample evaluations. This allows us to obtain a generator for one-step sampling as a result.


title: Operational risk quantification of power grids using graph neural network surrogates of the DC OPF

abstract: A DC OPF surrogate modeling framework is developed for Monte Carlo (MC) sampling-based risk quantification in power grid operation. MC simulation necessitates solving a large number of DC OPF problems corresponding to the samples of stochastic grid variables (power demand and renewable generation), which is computationally prohibitive. Computationally inexpensive surrogates of OPF provide an attractive alternative for expedited MC simulation. Graph neural network (GNN) surrogates of DC OPF, which are especially suitable to graph-structured data, are employed in this work. Previously developed DC OPF surrogate models have focused on accurate operational decision-making and not on risk quantification. Here, risk quantification-specific aspects of DC OPF surrogate evaluation is the main focus. To this end, the proposed GNN surrogates are evaluated using realistic joint probability distributions, quantification of their risk estimation accuracy, and investigation of their generalizability. Four synthetic grids (Case118, Case300, Case1354pegase, and Case2848rte) are used for surrogate model performance evaluation. It is shown that the GNN surrogates are sufficiently accurate for predicting the (bus-level, branch-level and system-level) grid state and enable fast as well as accurate operational risk quantification for power grids. The article thus develops tools for fast reliability and risk quantification in real-world power grids using GNN-based surrogates.


title: Long range voter models and dynamical fractional Brownian motion

abstract: We study the voter model on $\mathbf{Z}$ with long range interactions, as proposed by Hammond and Sheffield. We show the associated random field converges to a Gaussian random field, which can be seen as a one parameter family of evolving fractional Brownian motions. As a consequence we obtain that in equilibrium the voter model on $\mathbf{Z}$ with suitable long range interactions rescales to fractional Gaussian noise. The argument uses the Lindeberg swapping technique and heat kernel estimates for random walks with jump distributions in the domain of attraction of a stable law.


title: Principles from Clinical Research for NLP Model Generalization

abstract: The NLP community typically relies on performance of a model on a held-out test set to assess generalization. Performance drops observed in datasets outside of official test sets are generally attributed to "out-of-distribution" effects. Here, we explore the foundations of generalizability and study the factors that affect it, articulating lessons from clinical studies. In clinical research, generalizability is an act of reasoning that depends on (a) internal validity of experiments to ensure controlled measurement of cause and effect, and (b) external validity or transportability of the results to the wider population. We demonstrate how learning spurious correlations, such as the distance between entities in relation extraction tasks, can affect a model's internal validity and in turn adversely impact generalization. We, therefore, present the need to ensure internal validity when building machine learning models in NLP. Our recommendations also apply to generative large language models, as they are known to be sensitive to even minor semantic preserving alterations. We also propose adapting the idea of matching in randomized controlled trials and observational studies to NLP evaluation to measure causation.


title: Healthcare Security Breaches in the United States: Insights and their Socio-Technical Implications

abstract: This research examines the pivotal role of human behavior in the realm of healthcare data management, situated at the confluence of technological advancements and human conduct. An in-depth analysis of security breaches in the United States from 2009 to the present elucidates the dominance of human-induced security breaches. While technological weak points are certainly a concern, our study highlights that a significant proportion of breaches are precipitated by human errors and practices, thus pinpointing a conspicuous deficiency in training, awareness, and organizational architecture. In spite of stringent federal mandates, such as the Health Insurance Portability and Accountability Act (HIPAA) and the Health Information Technology for Economic and Clinical Health (HITECH) Act, breaches persist, emphasizing the indispensable role of human factors within this domain. Such oversights not only jeopardize patient data confidentiality but also undermine the foundational trust inherent in the healthcare infrastructure. By probing the socio-technical facets of healthcare security infringements, this article advocates for an integrated, dynamic, and holistic approach to healthcare data security. The findings underscore the imperative of augmenting technological defenses while concurrently elevating human conduct and institutional ethos, thereby cultivating a robust and impervious healthcare data management environment.


title: Faster Algorithms for Cycle Hitting Problems on Disk Graphs

abstract: In this paper, we consider three hitting problems on a disk intersection graph: Triangle Hitting Set, Feedback Vertex Set, and Odd Cycle Transversal. Given a disk intersection graph $G$, our goal is to compute a set of vertices hitting all triangles, all cycles, or all odd cycles, respectively. Our algorithms run in time $2^{\tilde O(k^{4/5})}n^{O(1)}$, $2^{\tilde O(k^{9/10})}n^{O(1)}$, and $2^{\tilde O(k^{19/20})}n^{O(1)}$, respectively, where $n$ denotes the number of vertices of $G$. These do not require a geometric representation of a disk graph. If a geometric representation of a disk graph is given as input, we can solve these problems more efficiently. In this way, we improve the algorithms for those three problem by Lokshtanov et al. [SODA 2022].


title: Stochastic Control with Distributionally Robust Constraints for Cyber-Physical Systems Vulnerable to Attacks

abstract: In this paper, we investigate the control of a cyber-physical system (CPS) while accounting for its vulnerability to external attacks. We formulate a constrained stochastic problem with a robust constraint to ensure robust operation against potential attacks. We seek to minimize the expected cost subject to a constraint limiting the worst-case expected damage an attacker can impose on the CPS. We present a dynamic programming decomposition to compute the optimal control strategy in this robust-constrained formulation and prove its recursive feasibility. We also illustrate the utility of our results by applying them to a numerical simulation.


title: X-ray Polarization Reveals the Precessions of the Neutron Star in Hercules X-1

abstract: In an accreting X-ray pulsar, a neutron star accretes matter from a stellar companion through an accretion disk. The high magnetic field of the rotating neutron star disrupts the inner edge of the disc, funneling the gas to flow onto the magnetic poles on its surface. Hercules X-1 is in many ways the prototypical X-ray pulsar; it shows persistent X-ray emission and it resides with its companion HZ Her, a two-solar-mass star, at about 7~kpc from Earth. Its emission varies on three distinct timescales: the neutron star rotates every 1.2~seconds, it is eclipsed by its companion each 1.7~days, and the system exhibits a superorbital period of 35~days which has remained remarkably stable since its discovery. Several lines of evidence point to the source of this variation as the precession of the accretion disc, the precession of the neutron star or both. Despite the many hints over the past fifty years, the precession of the neutron star itself has yet not been confirmed or refuted. We here present X-ray polarization measurements with the Imaging X-ray Polarimetry Explorer (IXPE) which probe the spin geometry of the neutron star. These observations provide direct evidence that the 35-day-period is set by the free precession of the neutron star crust, which has the important implication that its crust is somewhat asymmetric fractionally by a few parts per ten million. Furthermore, we find indications that the basic spin geometry of the neutron star is altered by torques on timescale of a few hundred days.


title: On arithmetical structures on K9

abstract: We study the arithmetical structures on the complete graph $K_9$. Our method is based on studying the solutions to writing the unit as a sum of 9 unit fractions. We work from the perspective of the Diophantine equation and use some elementary properties on the $p$-adic valuations. The proofs are assisted by trees and automata.


title: Stable Modular Control via Contraction Theory for Reinforcement Learning

abstract: We propose a novel way to integrate control techniques with reinforcement learning (RL) for stability, robustness, and generalization: leveraging contraction theory to realize modularity in neural control, which ensures that combining stable subsystems can automatically preserve the stability. We realize such modularity via signal composition and dynamic decomposition. Signal composition creates the latent space, within which RL applies to maximizing rewards. Dynamic decomposition is realized by coordinate transformation that creates an auxiliary space, within which the latent signals are coupled in the way that their combination can preserve stability provided each signal, that is, each subsystem, has stable self-feedbacks. Leveraging modularity, the nonlinear stability problem is deconstructed into algebraically solvable ones, the stability of the subsystems in the auxiliary space, yielding linear constraints on the input gradients of control networks that can be as simple as switching the signs of network weights. This minimally invasive method for stability allows arguably easy integration into the modular neural architectures in machine learning, like hierarchical RL, and improves their performance. We demonstrate in simulation the necessity and the effectiveness of our method: the necessity for robustness and generalization, and the effectiveness in improving hierarchical RL for manipulation learning.


title: Vertex-removal stability and the least positive value of harmonic measures

abstract: We prove that for $\mathbb{Z}^d$ ($d\ge 2$), the vertex-removal stability of harmonic measures (i.e. it is feasible to remove some vertex while changing the harmonic measure by a bounded factor) holds if and only if $d=2$. The proof mainly relies on geometric arguments, with a surprising use of the discrete Klein bottle. Moreover, a direct application of this stability verifies a conjecture of Calvert, Ganguly and Hammond [9] for the exponential decay of the least positive value of harmonic measures on $\mathbb{Z}^2$. Furthermore, the analogue of this conjecture for $\mathbb{Z}^d$ with $d\ge 3$ is also proved in this paper, despite vertex-removal stability no longer holding.


title: Advances in high-pressure laser floating zone growth: the Laser Optical Kristallmacher II

abstract: The optical floating zone crystal growth technique is a well-established method for obtaining large, high-purity single crystals. While the floating zone method has been constantly evolving for over six decades, the development of high-pressure (up to 1000 bar) growth systems has only recently been realized via the combination of laser-based heating sources with an all-metal chamber. While our inaugural high-pressure laser floating zone furnace design demonstrated the successful growth of new volatile and metastable phases, the furnace design faces several limitations with imaging quality, heating profile control, and chamber cooling power. Here, we present a second-generation design of the high-pressure laser floating zone furnace, "Laser Optical Kristallmacher II" (LOKII), and demonstrate that this redesign facilitates new advances in crystal growth by highlighting several exemplar materials: ${\alpha}$-Fe$_2$O$_3$, $\beta$-Ga$_2$O$_3$, and La$_2$CuO$_{4+{\delta}}$. Notably, for La$_2$CuO$_{4+{\delta}}$, we demonstrate the feasibility and long-term stability of traveling solvent floating zone growth under a record pressure of 700 bar.


title: CBSiMT: Mitigating Hallucination in Simultaneous Machine Translation with Weighted Prefix-to-Prefix Training

abstract: Simultaneous machine translation (SiMT) is a challenging task that requires starting translation before the full source sentence is available. Prefix-to-prefix framework is often applied to SiMT, which learns to predict target tokens using only a partial source prefix. However, due to the word order difference between languages, misaligned prefix pairs would make SiMT models suffer from serious hallucination problems, i.e. target outputs that are unfaithful to source inputs. Such problems can not only produce target tokens that are not supported by the source prefix, but also hinder generating the correct translation by receiving more source words. In this work, we propose a Confidence-Based Simultaneous Machine Translation (CBSiMT) framework, which uses model confidence to perceive hallucination tokens and mitigates their negative impact with weighted prefix-to-prefix training. Specifically, token-level and sentence-level weights are calculated based on model confidence and acted on the loss function. We explicitly quantify the faithfulness of the generated target tokens using the token-level weight, and employ the sentence-level weight to alleviate the disturbance of sentence pairs with serious word order differences on the model. Experimental results on MuST-C English-to-Chinese and WMT15 German-to-English SiMT tasks demonstrate that our method can consistently improve translation quality at most latency regimes, with up to 2 BLEU scores improvement at low latency.


title: A generalized uniqueness theorem for generalized Boolean dynamical systems

abstract: We characterize the canonical diagonal subalgebra of the C*-algebra associated with a generalized Boolean dynamical system. We also introduce a particular commutative subalgebra, which we call the abelian core, in our C*-algebra. We then establish a uniqueness theorem under the assumptions that B and L are countable, which says that a *-homomorphism of our C*-algebra is injective if and only if its restriction to the abelian core is injective.


title: A midsurface elasticity model for a thin, nonlinear, gradient elastic plate

abstract: In this paper, we derive a dynamic surface elasticity model for the two-dimensional midsurface of a thin, three-dimensional, homogeneous, isotropic, nonlinear gradient elastic plate of thickness $h$. The resulting model is parameterized by five, conceivably measurable, physical properties of the plate, and the stored surface energy reduces to Koiter's plate energy in a singular limiting case. The model corrects a theoretical issue found in wave propagation in thin sheets and, when combined with the author's theory of Green elastic bodies possessing gradient elastic material boundary surfaces, removes the singularities present in fracture within traditional/classical models. Our approach diverges from previous research on thin shells and plates, which primarily concentrated on deriving elasticity theories for material surfaces from classical three-dimensional Green elasticity. This work is the first in rigorously developing a surface elasticity model based on a parent nonlinear gradient elasticity theory.


title: Ultra-compact and efficient integrated multichannel mode multiplexer in silicon for few-mode fibers

abstract: Space-division multiplexing (SDM) is one of the key enabling technologies to increase the capacity of fiber communication systems. However, implementing SDM-based systems using multimode fiber has been challenging with the need for compact, low-cost, and scalable mode de/multiplexer (DE/MUX). Here we present a novel integrated mode MUX for few-mode fibers (FMFs) which can launch up to eight spatial and polarization channels. The new design is composed of a two-dimensional multimode grating coupler (MMGC), highly compact mode size converters (MSCs), and adiabatic directional couplers (ADCs). Eight data lanes in FMFs can be selectively launched with integrated optical phase shifters. Experimental results reveal efficient chip-to-fiber coupling with peak efficiencies of -3.8 dB, -5.5 dB, -3.6 dB, and -4.1 dB for LP01, LP11a, LP11b, and LP21b modes, respectively. Meanwhile, the proposed design can efficiently couple all the degenerate LP modes in a two-mode FMF, allowing signal descrambling in the demultiplexer. Thanks to the use of integrated subwavelength Mikaelian lens for mode-independent field size conversion with loss $\leq$0.25 dB, the total footprint of the MMGC and MSCs is only 35x35 $\mu$m$^{2}$. The proposed design shows great potential for densely integrated photonic circuits in future SDM applications.


title: Recursive Filters as Linear Time-Invariant Systems

abstract: Recursive filters are treated as linear time-invariant (LTI) systems but they are not: uninitialised, they have an infinite number of outputs for any given input, while if initialised, they are not time-invariant. This short tutorial article explains how and why they can be treated as LTI systems, thereby allowing tools such as Fourier analysis to be applied. It also explains the origin of the z-transform, why the region of convergence is important, and why the z-transform fails to find an infinite number of solutions.


title: High-Order Harmonic Generation in Helium: A Comparison Study

abstract: We report a detailed study of high-order harmonic generation (HHG) in helium. When comparing predictions from a single-active-electron model with those from all-electron simulations, such as ATTOMESA and R-matrix with time-dependence, which can include different numbers of states in the close-coupling expansion, it seems imperative to generate absolute numbers for the HHG spectrum in a well-defined framework. While qualitative agreement in the overall frequency dependence of the spectrum, including the cut-off frequency predicted by a semi-classical model, can be achieved by many models in arbitrary units, only absolute numbers can be used for benchmark comparisons between different approaches.


title: Classifications of Fermi-LAT unassociated sources in multiple machine learning methods

abstract: The classifications of Fermi-LAT unassociated sources are studied using multiple machine learning (ML) methods. The update data from 4FGL-DR3 are divided into high Galactic latitude (HGL, Galactic latitude $|b|>10^\circ$) and low Galactic latitude (LGL, $|b|\le10^\circ$) regions. In the HGL region, a voting ensemble of four binary ML classifiers achieves a 91$\%$ balanced accuracy. In the LGL region, an additional Bayesian-Gaussian (BG) model with three parameters is introduced to eliminate abnormal soft spectrum AGNs from the training set and ML-identified AGN candidates, a voting ensemble of four ternary ML algorithms reach an 81$\%$ balanced accuracy. And then, a catalog of Fermi-LAT all-sky unassociated sources is constructed. Our classification results show that (i) there are 1037 AGN candidates and 88 pulsar candidates with a balanced accuracy of $0.918 \pm 0.029$ in HGL region, which are consistent with those given in previous all-sky ML approaches; and (ii) there are 290 AGN-like candidates, 135 pulsar-like candidates, and 742 other-like candidates with a balanced accuracy of $0.815 \pm 0.027$ in the LGL region, which are different from those in previous all-sky ML approaches. Additionally, different training sets and class weights were tested for their impact on classifier accuracy and predicted results. The findings suggest that while different training approaches can yield similar model accuracy, the predicted numbers across different categories can vary significantly. Thus, reliable evaluation of the predicted results is deemed crucial in the ML approach for Fermi-LAT unassociated sources.


title: Unsupervised convolutional neural network fusion approach for change detection in remote sensing images

abstract: With the rapid development of deep learning, a variety of change detection methods based on deep learning have emerged in recent years. However, these methods usually require a large number of training samples to train the network model, so it is very expensive. In this paper, we introduce a completely unsupervised shallow convolutional neural network (USCNN) fusion approach for change detection. Firstly, the bi-temporal images are transformed into different feature spaces by using convolution kernels of different sizes to extract multi-scale information of the images. Secondly, the output features of bi-temporal images at the same convolution kernels are subtracted to obtain the corresponding difference images, and the difference feature images at the same scale are fused into one feature image by using 1 * 1 convolution layer. Finally, the output features of different scales are concatenated and a 1 * 1 convolution layer is used to fuse the multi-scale information of the image. The model parameters are obtained by a redesigned sparse function. Our model has three features: the entire training process is conducted in an unsupervised manner, the network architecture is shallow, and the objective function is sparse. Thus, it can be seen as a kind of lightweight network model. Experimental results on four real remote sensing datasets indicate the feasibility and effectiveness of the proposed approach.


title: Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking

abstract: In the pursuit of autonomous spacecraft proximity maneuvers and docking(PMD), we introduce a novel Bayesian actor-critic reinforcement learning algorithm to learn a control policy with the stability guarantee. The PMD task is formulated as a Markov decision process that reflects the relative dynamic model, the docking cone and the cost function. Drawing from the principles of Lyapunov theory, we frame the temporal difference learning as a constrained Gaussian process regression problem. This innovative approach allows the state-value function to be expressed as a Lyapunov function, leveraging the Gaussian process and deep kernel learning. We develop a novel Bayesian quadrature policy optimization procedure to analytically compute the policy gradient while integrating Lyapunov-based stability constraints. This integration is pivotal in satisfying the rigorous safety demands of spaceflight missions. The proposed algorithm has been experimentally evaluated on a spacecraft air-bearing testbed and shows impressive and promising performance.


title: The Iteration Formula of (n,2,d) Full-correlated Multi-component Bell Function and Its Applications

abstract: It is very difficult and important to construct Bell inequalities for n-partite, k-settings of measurement, and d-dimensional (n,k,d) systems. Inspired by the iteration formula form of the Mermin-Ardehali-Belinski{\u{\i}}-Klyshko (MABK) inequality, we generalize the multi-component correlation functions for bipartite d-dimensional systems to n-partite ones, and construct the corresponding Bell inequality. The Collins-Gisin-Linden-Massar-Popescu inequality can be reproduced by this way. The most important result is that for prime d the general Bell function in full-correlated multi-component correlation function form for (n,2,d) systems can be reformulated in iteration formula by two full-correlated multi-component Bell functions for (n-1,2,d) systems. As applications, we recover the MABK inequality and the most robust coincidence Bell inequalities for (3,2,3),(4,2,3),(5,2,3), and (3,2,5) Bell scenarios with this iteration formula. This implies that the iteration formula is an efficient way of constructing multi-partite Bell inequalities. In addition, we also give some new Bell inequalities with the same robustness but inequivalent to the known ones.


title: Incentive Design for Eco-driving in Urban Transportation Networks

abstract: Eco-driving emerges as a cost-effective and efficient strategy to mitigate greenhouse gas emissions in urban transportation networks. Acknowledging the persuasive influence of incentives in shaping driver behavior, this paper presents the `eco-planner,' a digital platform devised to promote eco-driving practices in urban transportation. At the outset of their trips, users provide the platform with their trip details and travel time preferences, enabling the eco-planner to formulate personalized eco-driving recommendations and corresponding incentives, while adhering to its budgetary constraints. Upon trip completion, incentives are transferred to users who comply with the recommendations and effectively reduce their emissions. By comparing our proposed incentive mechanism with a baseline scheme that offers uniform incentives to all users, we demonstrate that our approach achieves superior emission reductions and increased user compliance with a smaller budget.


title: Preventing Arbitrarily High Confidence on Far-Away Data in Point-Estimated Discriminative Neural Networks

abstract: Discriminatively trained, deterministic neural networks are the de facto choice for classification problems. However, even though they achieve state-of-the-art results on in-domain test sets, they tend to be overconfident on out-of-distribution (OOD) data. For instance, ReLU networks - a popular class of neural network architectures - have been shown to almost always yield high confidence predictions when the test data are far away from the training set, even when they are trained with OOD data. We overcome this problem by adding a term to the output of the neural network that corresponds to the logit of an extra class, that we design to dominate the logits of the original classes as we move away from the training data.This technique provably prevents arbitrarily high confidence on far-away test data while maintaining a simple discriminative point-estimate training. Evaluation on various benchmarks demonstrates strong performance against competitive baselines on both far-away and realistic OOD data.


title: Reinforcement learning pulses for transmon qubit entangling gates

abstract: The utility of a quantum computer depends heavily on the ability to reliably perform accurate quantum logic operations. For finding optimal control solutions, it is of particular interest to explore model-free approaches, since their quality is not constrained by the limited accuracy of theoretical models for the quantum processor - in contrast to many established gate implementation strategies. In this work, we utilize a continuous-control reinforcement learning algorithm to design entangling two-qubit gates for superconducting qubits; specifically, our agent constructs cross-resonance and CNOT gates without any prior information about the physical system. Using a simulated environment of fixed-frequency, fixed-coupling transmon qubits, we demonstrate the capability to generate novel pulse sequences that outperform the standard cross-resonance gates in both fidelity and gate duration, while maintaining a comparable susceptibility to stochastic unitary noise. We further showcase an augmentation in training and input information that allows our agent to adapt its pulse design abilities to drifting hardware characteristics, importantly with little to no additional optimization. Our results exhibit clearly the advantages of unbiased adaptive-feedback learning-based optimization methods for transmon gate design.


title: Dynamic Non-monotone Submodular Maximization

abstract: Maximizing submodular functions has been increasingly used in many applications of machine learning, such as data summarization, recommendation systems, and feature selection. Moreover, there has been a growing interest in both submodular maximization and dynamic algorithms. In 2020, Monemizadeh and Lattanzi, Mitrovic, Norouzi{-}Fard, Tarnawski, and Zadimoghaddam initiated developing dynamic algorithms for the monotone submodular maximization problem under the cardinality constraint $k$. Recently, there have been some improvements on the topic made by Banihashem, Biabani, Goudarzi, Hajiaghayi, Jabbarzade, and Monemizadeh. In 2022, Chen and Peng studied the complexity of this problem and raised an important open question: "Can we extend [fully dynamic] results (algorithm or hardness) to non-monotone submodular maximization?". We affirmatively answer their question by demonstrating a reduction from maximizing a non-monotone submodular function under the cardinality constraint $k$ to maximizing a monotone submodular function under the same constraint. Through this reduction, we obtain the first dynamic algorithms to solve the non-monotone submodular maximization problem under the cardinality constraint $k$. Our algorithms maintain an $(8+\epsilon)$-approximate of the solution and use expected amortized $O(\epsilon^{-3}k^3\log^3(n)\log(k))$ or $O(\epsilon^{-1}k^2\log^3(k))$ oracle queries per update, respectively. Furthermore, we showcase the benefits of our dynamic algorithm for video summarization and max-cut problems on several real-world data sets.


title: Scattering matrix for chiral harmonic generation and frequency mixing in nonlinear metasurfaces

abstract: We generalize the concept of optical scattering matrix ($S$-matrix) to characterize harmonic generation and frequency mixing in planar metasurfaces in the limit of undepleted pump approximation. We show that the symmetry properties of such nonlinear $S$-matrix are determined by the microscopic and macroscopic symmetries of the metasurface. We demonstrate that for description of degenerate frequency mixing processes such as optical harmonic generation, the multidimensional $S$-matrix can be replaced with a reduced two-dimensional $S$-matrix. We show that for metasurfaces possessing specific point group symmetries, the selection rules determining the transformation of the reduced nonlinear $S$-matrix are simplified substantially and can be expressed in a compact form. We apply the developed approach to analyse chiral harmonic generation in nonlinear metasurfaces with various symmetries including rotational, in-plane mirror, and out-of-plane mirror symmetries. For each of those symmetries, we confirm the results of the developed analysis by full-wave numerical calculations. We believe our results provide a new paradigm for engineering nonlinear optical properties of metasurfaces which may find applications in active and nonlinear optics, biosensing, and quantum information processing.


title: Dissecting the Runtime Performance of the Training, Fine-tuning, and Inference of Large Language Models

abstract: Large Language Models (LLMs) have seen great advance in both academia and industry, and their popularity results in numerous open-source frameworks and techniques in accelerating LLM pre-training, fine-tuning, and inference. Training and deploying LLMs are expensive as it requires considerable computing resources and memory, hence many efficient approaches have been developed for improving system pipelines as well as operators. However, the runtime performance can vary significantly across hardware and software stacks, which makes it difficult to choose the best configuration. In this work, we aim to benchmark the performance from both macro and micro perspectives. First, we benchmark the end-to-end performance of pre-training, fine-tuning, and serving LLMs in different sizes , i.e., 7, 13, and 70 billion parameters (7B, 13B, and 70B) on three 8-GPU platforms with and without individual optimization techniques, including ZeRO, quantization, recomputation, FlashAttention. Then, we dive deeper to provide a detailed runtime analysis of the sub-modules, including computing and communication operators in LLMs. For end users, our benchmark and findings help better understand different optimization techniques, training and inference frameworks, together with hardware platforms in choosing configurations for deploying LLMs. For researchers, our in-depth module-wise analyses discover potential opportunities for future work to further optimize the runtime performance of LLMs.


title: Generalized Hamming weights and minimal shifts of Orlik-Terao algebras

abstract: In this note we show that the minimum distance of a linear code equals one plus the smallest shift in the first step of the minimal graded free resolution of the Orlik-Terao algebra (i.e., the initial degree of the Orlik-Tearo ideal) constructed from any parity-check matrix of the linear code. We move forward with this connection and we prove that the second generalized Hamming weight equals one or two plus the smallest shift at second step in the minimal graded free resolution of the same algebra. Via a couple of examples we show that this ambivalence is the best result one can get if one uses Orlik-Terao algebras to characterize the second generalized Hamming weight.


title: A note on the convergence of the monotone inclusion version of the primal-dual hybrid gradient algorithm

abstract: The note contains a direct extension of the Chambolle and Pock convergence proof of the primal-dual hybrid gradient (PDHG) algorithm to the case of monotone inclusions.


title: Nonvolatile spin field effect transistor based on VSi2N4/Sc2CO2 multiferroic heterostructure

abstract: In this study, we present first-principles calculations that introduce a novel nonvolatile spin field-effect transistor (Spin-FET) utilizing a van der Waals multiferroic heterostructure, specifically VSi2N4/Sc2CO2. We demonstrate that inverting the ferroelectric polarization in a Sc2CO2 monolayer can effectively modulate the electronic states of a VSi2N4 monolayer, enabling a transition from half-metal to half-semiconductor. This transition significantly alters the electronic transport properties. Furthermore, we construct a Spin-FET device based on this multiferroic heterostructure and observe that the VSi2N4/Sc2CO2-based Spin-FET exhibits exceptional all-electric-controlled performance. Notably, the inversion of the Sc2CO2 ferroelectric polarization yields a substantial on-off current ratio, approximately 650\%, under a minimal bias voltage of 0.02 V. Additionally, we identify a unique spatially-separated spin-polarized transport phenomenon, wherein pure spin-up electrons transport exclusively through VSi2N4, and spin-down electrons through Sc$_2$CO$_2$. Our findings suggest a promising pathway for developing low-energy-dissipation and nonvolatile FET devices.


title: Faraday rotation signal amplification using high-power lasers

abstract: Magnetic fields play an important role in plasma dynamics, yet it is a quantity difficult to measure accurately with physical probes, whose presence disturbs the very field they measure. The Faraday rotation of a polarized beam of light provides a mechanism to measure the magnetic field without disturbing the dynamics, and has been used with great success in astrophysics and high energy density plasma science, where physical probes cannot be used. However, the rotation is typically small, which degrades the accuracy of the measurement. Paradoxically, the main source of error is the probe beam itself. Since polarization cannot be measured directly, detectors rely on a polarizer to measure a small change in beam intensity instead. In this work, we show how suppress the beam intensity that is not part of the Faraday rotation signal by taking forming an optical derivative. Since the rotation measurement is now strictly proportional to the beam intensity, the system allows to amplify the rotation measurement simply by increasing the laser power.


title: Directly Characterizing Dome Seeing: Differential Image Motion Sensor Using Multisources (DIMSUM)

abstract: Image degradation impedes our ability to extract information from astronomical observations. One factor contributing to this degradation is ``dome seeing", the reduction in image quality due to variations in the index of refraction within the observatory dome. Addressing this challenge, we introduce a novel setup-DIMSUM (Differential Image Motion Sensor Using Multisources)-which offers a simple installation and provides direct characterization of local index of refraction variations. This is achieved by measuring differential image motion using strobed imaging that effectively``freezes" the atmosphere, aligning our captured images with the timescale of thermal fluctuations, thereby giving a more accurate representation of dome seeing effects. Our apparatus has been situated within the Auxiliary Telescope of the Vera C. Rubin Observatory. Early results from our setup are encouraging. Not only do we observe a correlation between the characteristic differential image motion (DIM) values and local temperature fluctuations (a leading cause of variations in index of refraction), but also hint at the potential of DIM measures to characterize dome seeing with greater precision in subsequent tests. Our preliminary findings underscore the potential of DIMSUM as a powerful tool for enhancing image quality in ground-based astronomical observations. Further refinement and data collection will likely solidify its place as a useful component for managing dome seeing in major observatories like the Vera C. Rubin Observatory.


title: Notes on unknotting algorithms using normal surface theory

abstract: These notes present two normal surface theory algorithms to detect the unknot and use the split-link algorithm to prove that the figure-eight knot is knotted.


title: Accelerating the Galerkin Reduced-Order Model with the Tensor Decomposition for Turbulent Flows

abstract: Galerkin-based reduced-order models (G-ROMs) have provided efficient and accurate approximations of laminar flows. In order to capture the complex dynamics of the turbulent flows, standard G-ROMs require a relatively large number of reduced basis functions (on the order of hundreds and even thousands). Although the resulting G-ROM is still relatively low-dimensional compared to the full-order model (FOM), its computational cost becomes prohibitive due to the 3rd-order convection tensor contraction. The tensor requires storage of $N^3$ entries with a corresponding work of $2N^3$ operations per timestep, which makes such ROMs impossible to use in realistic applications, such as control of turbulent flows. In this paper, we focus on the scenario where the G-ROM requires large $N$ values and propose a novel approach that utilizes the CANDECOMC/PARAFAC decomposition (CPD), a tensor decomposition technique, to accelerate the G-ROM by approximating the 3rd-order convection tensor by a sum of $R$ rank-1 tensors. In addition, we show that the tensor is partially skew-symmetric and derive two conditions for the CP decomposition for preserving the skew-symmetry. Moreover, we investigate the G-ROM with the singular value decomposition (SVD). The G-ROM with CP decomposition is investigated in several flow configurations from 2D periodic flow to 3D turbulent flows. Our numerical investigation shows CPD-ROM achieves at least a factor of 10 speedup. Additionally, the skew-symmetry preserving CPD-ROM is more stable and allows the usage of smaller rank $R$. Moreover, from the singular value behavior, the advection tensor formed using the $H^1_0$-POD basis has a low-rank structure, and is preserved even in higher Reynolds numbers. Furthermore, for a given level of accuracy, the CP decomposition is more efficient in size and cost than the SVD.


title: Context Shift Reduction for Offline Meta-Reinforcement Learning

abstract: Offline meta-reinforcement learning (OMRL) utilizes pre-collected offline datasets to enhance the agent's generalization ability on unseen tasks. However, the context shift problem arises due to the distribution discrepancy between the contexts used for training (from the behavior policy) and testing (from the exploration policy). The context shift problem leads to incorrect task inference and further deteriorates the generalization ability of the meta-policy. Existing OMRL methods either overlook this problem or attempt to mitigate it with additional information. In this paper, we propose a novel approach called Context Shift Reduction for OMRL (CSRO) to address the context shift problem with only offline datasets. The key insight of CSRO is to minimize the influence of policy in context during both the meta-training and meta-test phases. During meta-training, we design a max-min mutual information representation learning mechanism to diminish the impact of the behavior policy on task representation. In the meta-test phase, we introduce the non-prior context collection strategy to reduce the effect of the exploration policy. Experimental results demonstrate that CSRO significantly reduces the context shift and improves the generalization ability, surpassing previous methods across various challenging domains.


title: Bilingual Corpus Mining and Multistage Fine-Tuning for Improving Machine Translation of Lecture Transcripts

abstract: Lecture transcript translation helps learners understand online courses, however, building a high-quality lecture machine translation system lacks publicly available parallel corpora. To address this, we examine a framework for parallel corpus mining, which provides a quick and effective way to mine a parallel corpus from publicly available lectures on Coursera. To create the parallel corpora, we propose a dynamic programming based sentence alignment algorithm which leverages the cosine similarity of machine-translated sentences. The sentence alignment F1 score reaches 96%, which is higher than using the BERTScore, LASER, or sentBERT methods. For both English--Japanese and English--Chinese lecture translations, we extracted parallel corpora of approximately 50,000 lines and created development and test sets through manual filtering for benchmarking translation performance. Through machine translation experiments, we show that the mined corpora enhance the quality of lecture transcript translation when used in conjunction with out-of-domain parallel corpora via multistage fine-tuning. Furthermore, this study also suggests guidelines for gathering and cleaning corpora, mining parallel sentences, cleaning noise in the mined data, and creating high-quality evaluation splits. For the sake of reproducibility, we have released the corpora as well as the code to create them. The dataset is available at https://github.com/shyyhs/CourseraParallelCorpusMining.


title: Towards Autonomous Crop Monitoring: Inserting Sensors in Cluttered Environments

abstract: We present a contact-based phenotyping robot platform that can autonomously insert nitrate sensors into cornstalks to proactively monitor macronutrient levels in crops. This task is challenging because inserting such sensors requires sub-centimeter precision in an environment which contains high levels of clutter, lighting variation, and occlusion. To address these challenges, we develop a robust perception-action pipeline to detect and grasp stalks, and create a custom robot gripper which mechanically aligns the sensor before inserting it into the stalk. Through experimental validation on 48 unique stalks in a cornfield in Iowa, we demonstrate our platform's capability of detecting a stalk with 94% success, grasping a stalk with 90% success, and inserting a sensor with 60% success. In addition to developing an autonomous phenotyping research platform, we share key challenges and insights obtained from deployment in the field. Our research platform is open-sourced, with additional information available at https://kantor-lab.github.io/cornbot.


title: A Novel Variational Lower Bound for Inverse Reinforcement Learning

abstract: Inverse reinforcement learning (IRL) seeks to learn the reward function from expert trajectories, to understand the task for imitation or collaboration thereby removing the need for manual reward engineering. However, IRL in the context of large, high-dimensional problems with unknown dynamics has been particularly challenging. In this paper, we present a new Variational Lower Bound for IRL (VLB-IRL), which is derived under the framework of a probabilistic graphical model with an optimality node. Our method simultaneously learns the reward function and policy under the learned reward function by maximizing the lower bound, which is equivalent to minimizing the reverse Kullback-Leibler divergence between an approximated distribution of optimality given the reward function and the true distribution of optimality given trajectories. This leads to a new IRL method that learns a valid reward function such that the policy under the learned reward achieves expert-level performance on several known domains. Importantly, the method outperforms the existing state-of-the-art IRL algorithms on these domains by demonstrating better reward from the learned policy.


title: A weighted matching scheme of magnetic coil design for FRC shaping control

abstract: The two-dimentional (2D) separatrix shaping plays a crucial role in the confinement of the Field Reversed Configuration (FRC), and the magnetic coils serve as an effective means for its control. In this work we develop a method to optimize the location, and current amplitude of the coils required for achieving the target separatrix shape. By iteratively calculating the coil currents, the plasma current, and the equilibrium magnetic flux, the equilibrium separatrix progressively converges towards the desired shape. The coil currents are determined through a matching method, and the NIMEQ code is employed to compute the FRC equilibrium with a Rigid Rotor type of plasma distribution. This approach enables the adaption of the equilibrium separatrix into any desired shape, thus offering a potential coil optimization scheme for the device design and the 2D shaping control of FRC plasma.


title: From an amateur PN candidate to the Rosetta Stone of SN Iax research

abstract: On August 25th 2013 Dana Patchick from the "Deep Sky Hunters" (DSH) amateur astronomer group discovered a diffuse nebulosity in the Wide-field Infrared Survey Explorer (WISE) mid-IR image archive that had no optical counterpart but appeared similar to many Planetary Nebulae (PNe) in WISE. As his 30th discovery he named it Pa 30 and it was added to the HASH PN database as a new PN candidate. Little did he know how important his discovery would become. 10 years later this object is the only known bound remnant of a violent double WD merger accompanied by a rare Type Iax SN, observed and recorded by the ancient Chinese and Japanese in 1181 AD. This makes Pa 30 and its central star IRAS 00500+6713 (WD J005311) the only SN Iax remnant in our Galaxy, the only known bound remnant of any SN, and based on the central star's spectrum the only Wolf-Rayet star known that neither has a massive progenitor nor is the central star of a Planetary Nebula. We cover this story and our key role in it.


title: Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptation

abstract: Meta Reinforcement Learning (Meta RL) trains agents that adapt to fast-changing environments and tasks. Current strategies often lose adaption efficiency due to the passive nature of model exploration, causing delayed understanding of new transition dynamics. This results in particularly fast-evolving tasks being impossible to solve. We propose a novel approach, Hypothesis Network Planned Exploration (HyPE), that integrates an active and planned exploration process via the hypothesis network to optimize adaptation speed. HyPE uses a generative hypothesis network to form potential models of state transition dynamics, then eliminates incorrect models through strategically devised experiments. Evaluated on a symbolic version of the Alchemy game, HyPE outpaces baseline methods in adaptation speed and model accuracy, validating its potential in enhancing reinforcement learning adaptation in rapidly evolving settings.


title: Latched Detection of Zeptojoule Spin Echoes with a Kinetic Inductance Parametric Oscillator

abstract: When strongly pumped at twice their resonant frequency, non-linear resonators develop a high-amplitude intracavity field, a phenomenon known as parametric self-oscillations. The boundary over which this instability occurs can be extremely sharp and thereby presents an opportunity for realizing a detector. Here we operate such a device based on a superconducting microwave resonator whose non-linearity is engineered from kinetic inductance. The device indicates the absorption of low-power microwave wavepackets by transitioning to a self-oscillating state. Using calibrated wavepackets we measure the detection efficiency with zeptojoule energy wavepackets. We then apply it to measurements of electron spin resonance, using an ensemble of $^{209}$Bi donors in silicon that are inductively coupled to the resonator. We achieve a latched-readout of the spin signal with an amplitude that is five hundred times greater than the underlying spin echoes.


title: Practical Performance Guarantees for Pipelined DNN Inference

abstract: We optimize pipeline parallelism for deep neural network (DNN) inference by partitioning model graphs into $k$ stages and minimizing the running time of the bottleneck stage, including communication. We give practical and effective algorithms for this NP-hard problem, but our emphasis is on tackling the practitioner's dilemma of deciding when a solution is good enough. To this end, we design novel mixed-integer programming (MIP) relaxations for proving lower bounds. Applying these methods to a diverse testbed of 369 production models, for $k \in \{2, 4, 8, 16, 32, 64\}$, we empirically show that these lower bounds are strong enough to be useful in practice. Our lower bounds are substantially stronger than standard combinatorial bounds. For example, evaluated via geometric means across a production testbed with $k = 16$ pipeline stages, our MIP formulations raise the lower bound from 0.4598 to 0.9452, expressed as a fraction of the best partition found. In other words, our improved lower bounds close the optimality gap by a factor of 9.855x.


title: Hierarchical Bayesian Inference of Globular Cluster Properties

abstract: We present a hierarchical Bayesian inference approach to estimating the structural properties and the phase space center of a globular cluster (GC) given the spatial and kinematic information of its stars based on lowered isothermal cluster models. As a first step towards more realistic modelling of GCs, we built a differentiable, accurate emulator of the lowered isothermal distribution function using interpolation. The reliable gradient information provided by the emulator allows the use of Hamiltonian Monte Carlo methods to sample large Bayesian models with hundreds of parameters, thereby enabling inference on hierarchical models. We explore the use of hierarchical Bayesian modelling to address several issues encountered in observations of GC including an unknown GC center, incomplete data, and measurement errors. Our approach not only avoids the common technique of radial binning but also incorporates the aforementioned uncertainties in a robust and statistically consistent way. Through demonstrating the reliability of our hierarchical Bayesian model on simulations, our work lays out the foundation for more realistic and complex modelling of real GC data.


title: Efficient Bottom-Up Synthesis for Programs with Local Variables

abstract: We propose a new synthesis algorithm that can efficiently search programs with local variables (e.g., those introduced by lambdas). Prior bottom-up synthesis algorithms are not able to evaluate programs with free local variables, and therefore cannot effectively reduce the search space of such programs (e.g., using standard observational equivalence reduction techniques), making synthesis slow. Our algorithm can reduce the space of programs with local variables. The key idea, dubbed lifted interpretation, is to lift up the program interpretation process, from evaluating one program at a time to simultaneously evaluating all programs from a grammar. Lifted interpretation provides a mechanism to systematically enumerate all binding contexts for local variables, thereby enabling us to evaluate and reduce the space of programs with local variables. Our ideas are instantiated in the domain of web automation. The resulting tool, Arborist, can automate a significantly broader range of challenging tasks more efficiently than state-of-the-art techniques including WebRobot and Helena.


title: Parallelized Conflict Graph Cut Generation

abstract: A conflict graph represents logical relations between binary variables, and effective use of the graph can significantly accelerate branch-and-cut solvers for mixed-integer programming (MIP). In this paper we develop efficient parallel conflict graph management: conflict detection; maximal clique generation; clique extension; and clique merging. We leverage parallel computing in order to intensify computational effort on the conflict graph, thereby generating a much larger pool of cutting planes than what can be practically achieved in serial. Computational experiments demonstrate that the expanded pool of cuts enabled by parallel computing lead to substantial reductions in total MIP solve time, especially for more challenging cases.


title: The NeurIPS 2022 Neural MMO Challenge: A Massively Multiagent Competition with Specialization and Trade

abstract: In this paper, we present the results of the NeurIPS-2022 Neural MMO Challenge, which attracted 500 participants and received over 1,600 submissions. Like the previous IJCAI-2022 Neural MMO Challenge, it involved agents from 16 populations surviving in procedurally generated worlds by collecting resources and defeating opponents. This year's competition runs on the latest v1.6 Neural MMO, which introduces new equipment, combat, trading, and a better scoring system. These elements combine to pose additional robustness and generalization challenges not present in previous competitions. This paper summarizes the design and results of the challenge, explores the potential of this environment as a benchmark for learning methods, and presents some practical reinforcement learning training approaches for complex tasks with sparse rewards. Additionally, we have open-sourced our baselines, including environment wrappers, benchmarks, and visualization tools for future research.


title: Endomorphism monoid and automorphism group of residually finite and profinite quandles

abstract: We explore residually finite and profinite quandles. We prove that the endomorphism monoid and the automorphism group of finitely generated residually finite quandles are residually finite. In fact, we establish the similar result for a broad class of residually finite quandles. We provide a topological characterization of profinite quandles. We establish necessary and sufficient conditions for profinite quandles ensuring that their endomorphism monoids and automorphism groups are profinite.


title: Geodesic Envelopes in the Thurston Metric on Teichmuller space

abstract: The Thurston metric on Teichmuller space, first introduced by W. P. Thurston is an asymmetric metric on Teichmuller space defined by $d_{Th}(X,Y) = \frac12 log\sup_{\alpha} \frac{l_{\alpha}(Y)}{l_{\alpha}(X)}$. This metric is geodesic, but geodesics are far from unique. In this thesis, we show that in the once-punctured torus, and in the four-times punctured sphere, geodesics stay a uniformly-bounded distance from each other. In other words, we show that the \textbf{width} of the geodesic envelope, E(X,Y) between any pair of points $X,Y \in T(S)$ (where $S = S_{1,1}$ or $S = S_{0,4}$) is bounded uniformly. To do this, we first identify extremal geodesics in Env(X,Y), and show that these correspond to stretch vectors, proving a conjecture of Huang, Ohshika and Papadopoulos. We then compute Fenchel-Nielsen twisting along these paths, and use these computations, along with estimates on earthquake path lengths, to prove the main theorem.


title: Slow-mode rarefaction and compression fronts in the Hermean magnetosphere: From MESSENGER insights to future BepiColombo observations

abstract: Context. Standing slow-mode rarefaction and compression front structures may appear in the Mercury magnetosheath under particular solar wind conditions. Aims. The aim of the study is to identify the wind conditions required for the formation of slow-mode structures (SMS) in the Mercury magnetosphere by comparing MESSENGER magnetometer data and magnetohydrodynamics simulations. Methods. We used the magnetohydrodynamics code PLUTO in spherical coordinates to reproduce the interaction of the solar wind with the Mercury magnetosphere. First, the optimal wind conditions for the SMS formation were identified with respect to the orientation of the interplanetary magnetic field (IMF) and dynamic pressure. Next, the magnetic field calculated in the simulations along the MESSENGER trajectory was compared to MESSENGER magnetometer data to identify tracers of the satellite encounter with the SMS. Results. Optimal wind conditions for the formation of SMS require that the IMF is oriented in the northward or radial directions. The MESSENGER orbit on 8th September 2011 takes place during wind conditions that are close to the optimal configuration for SMS formation near the north pole, leading to the possible intersection of the satellite trajectory with the SMS. MESSENGER magnetometer data show a rather strong decrease in the magnetic field module after the satellite crossed nearby the compression front that is observed in the simulation, providing indirect evidence of the SMS.


title: Mitigating Estimation Errors by Twin TD-Regularized Actor and Critic for Deep Reinforcement Learning

abstract: We address the issue of estimation bias in deep reinforcement learning (DRL) by introducing solution mechanisms that include a new, twin TD-regularized actor-critic (TDR) method. It aims at reducing both over and under-estimation errors. With TDR and by combining good DRL improvements, such as distributional learning and long N-step surrogate stage reward (LNSS) method, we show that our new TDR-based actor-critic learning has enabled DRL methods to outperform their respective baselines in challenging environments in DeepMind Control Suite. Furthermore, they elevate TD3 and SAC respectively to a level of performance comparable to that of D4PG (the current SOTA), and they also improve the performance of D4PG to a new SOTA level measured by mean reward, convergence speed, learning success rate, and learning variance.


title: Contributions of Individual Generators to Nodal Carbon Emissions

abstract: Recent shifts toward sustainable energy systems have witnessed the fast deployment of carbon-free and carbon-efficient generations across the power networks. However, the benefits of carbon reduction are not experienced evenly throughout the grid. Each generator can have distinct carbon emission rates. Due to the existence of physical power flows, nodal power consumption is met by a combination of a set of generators, while such combination is determined by network topology, generators' characteristics and power demand. This paper describes a technique based on physical power flow model, which can efficiently compute the nodal carbon emissions contributed by each single generator given the generation and power flow information. We also extend the technique to calculate both the nodal average carbon emission and marginal carbon emission rates. Simulation results validate the effectiveness of the calculations, while our technique provides a fundamental tool for applications such as carbon auditing, carbon-oriented demand management and future carbon-oriented capacity expansion.


title: Multimodal deep representation learning for quantum cross-platform verification

abstract: Cross-platform verification, a critical undertaking in the realm of early-stage quantum computing, endeavors to characterize the similarity of two imperfect quantum devices executing identical algorithms, utilizing minimal measurements. While the random measurement approach has been instrumental in this context, the quasi-exponential computational demand with increasing qubit count hurdles its feasibility in large-qubit scenarios. To bridge this knowledge gap, here we introduce an innovative multimodal learning approach, recognizing that the formalism of data in this task embodies two distinct modalities: measurement outcomes and classical description of compiled circuits on explored quantum devices, both enriched with unique information. Building upon this insight, we devise a multimodal neural network to independently extract knowledge from these modalities, followed by a fusion operation to create a comprehensive data representation. The learned representation can effectively characterize the similarity between the explored quantum devices when executing new quantum algorithms not present in the training data. We evaluate our proposal on platforms featuring diverse noise models, encompassing system sizes up to 50 qubits. The achieved results demonstrate a three-orders-of-magnitude improvement in prediction accuracy compared to the random measurements and offer compelling evidence of the complementary roles played by each modality in cross-platform verification. These findings pave the way for harnessing the power of multimodal learning to overcome challenges in wider quantum system learning tasks.


title: Loss Balancing for Fair Supervised Learning

abstract: Supervised learning models have been used in various domains such as lending, college admission, face recognition, natural language processing, etc. However, they may inherit pre-existing biases from training data and exhibit discrimination against protected social groups. Various fairness notions have been proposed to address unfairness issues. In this work, we focus on Equalized Loss (EL), a fairness notion that requires the expected loss to be (approximately) equalized across different groups. Imposing EL on the learning process leads to a non-convex optimization problem even if the loss function is convex, and the existing fair learning algorithms cannot properly be adopted to find the fair predictor under the EL constraint. This paper introduces an algorithm that can leverage off-the-shelf convex programming tools (e.g., CVXPY) to efficiently find the global optimum of this non-convex optimization. In particular, we propose the ELminimizer algorithm, which finds the optimal fair predictor under EL by reducing the non-convex optimization to a sequence of convex optimization problems. We theoretically prove that our algorithm finds the global optimal solution under certain conditions. Then, we support our theoretical results through several empirical studies.


title: Devaney chaos of multiple mappings from a set-valued view

abstract: In this paper, we introduce the definitions of periodic point, transitivity, sensitivity and Devaney chaos of multiple mappings from a set-valued perspective. We study the relation between multiple mappings and its continuous self-maps and show that multiple mappings and its continuous self-maps do not imply each other in terms of periodic point or transitivity. While the sufficient condition for multiple mappings to have periodic points, to be transitive and sensitive is provided separately. And we show that transitivity plus dense periodic point set implies sensitivity. Also, a sufficient condition for multiple mappings to be Devaney chaotic is given.


title: LLM as an Art Director (LaDi): Using LLMs to improve Text-to-Media Generators

abstract: Recent advancements in text-to-image generation have revolutionized numerous fields, including art and cinema, by automating the generation of high-quality, context-aware images and video. However, the utility of these technologies is often limited by the inadequacy of text prompts in guiding the generator to produce artistically coherent and subject-relevant images. In this paper, We describe the techniques that can be used to make Large Language Models (LLMs) act as Art Directors that enhance image and video generation. We describe our unified system for this called "LaDi". We explore how LaDi integrates multiple techniques for augmenting the capabilities of text-to-image generators (T2Is) and text-to-video generators (T2Vs), with a focus on constrained decoding, intelligent prompting, fine-tuning, and retrieval. LaDi and these techniques are being used today in apps and platforms developed by Plai Labs.


title: Surface density of states and tunneling spectroscopy of a spin-3/2 superconductor with Bogoliubov Fermi Surfaces

abstract: Bogoliubov Fermi surfaces of superconducting states arise from point or line nodes by breaking time-reversal symmetry. Because line and point nodes often accompany topologically protected zero-energy surface Andreev bound states (ASBSs) and thereby lead to a characteristic zero-bias conductance peak (ZBCP) in tunneling spectroscopy, we investigate how these properties change when the line and point nodes deform into BFSs. In this paper, we consider spin-quintet $J_{\rm pair}=2$ pairing states of spin-3/2 electrons with BFSs and calculate the surface density of states and the charge conductance. Comparing the obtained results with the cases of spin-singlet $d$-wave pairing states having the same symmetry, we find that the ZBCP associated with point and/or line nodes is blunted or split in accordance with the appearance of the BFSs. On the other hand, when the spin-singlet $d$-wave state has point nodes but does not have SABS on the surface, we obtain a nonzero small electron conductivity at zero bias through the zero-energy states on the BFSs.


title: Update on gravitational wave signals from post-inflationary phase transitions

abstract: In view of recent interest in high-frequency detectors, broad features of gravitational wave signals from phase transitions taking place soon after inflation are summarized. The influence of the matter domination era that follows the slow-roll stage is quantified in terms of two equilibration rates. Turning to the highest-frequency part of the spectrum, we show how it is constrained by the fact that the bubble distance scale must exceed the mean free path.


title: Refining resource estimation for the quantum computation of vibrational molecular spectra through Trotter error analysis

abstract: Accurate simulations of vibrational molecular spectra are expensive on conventional computers. Compared to the electronic structure problem, the vibrational structure problem with quantum computers is less investigated. In this work we accurately estimate quantum resources, such as number of qubits and quantum gates, required for vibrational structure calculations on a programmable quantum computer. Our approach is based on quantum phase estimation and focuses on fault-tolerant quantum devices. In addition to asymptotic estimates for generic chemical compounds, we present a more detailed analysis of the quantum resources needed for the simulation of the Hamiltonian arising in the vibrational structure calculation of acetylene-like polyynes of interest. Leveraging nested commutators, we provide an in-depth quantitative analysis of trotter errors compared to the prior investigations. Ultimately, this work serves as a guide for analyzing the potential quantum advantage within vibrational structure simulations.