title: Mean field coupled dynamical systems: Bifurcations and phase transitions

abstract: We develop a bifurcation theory for infinite dimensional systems satisfying abstract hypotheses that are tailored for applications to mean field coupled chaotic maps. Our abstract theory can be applied to many cases, from globally coupled expanding maps to globally coupled Axiom A attractors. To illustrate the range of applicability, we analyze an explicit example consisting of globally coupled Anosov diffeomorphisms. For such an example, we classify all the invariant measures as the coupling strength varies; we show which invariant measures are physical, and we prove that the existence of multiple invariant physical measures is a purely infinite dimensional phenomenon, i.e., the model exhibits phase transitions in the sense of statistical mechanics.

categories: math.DS cond-mat.stat-mech math-ph math.MP nlin.CD


title: Optimizing Dynamic Aperture Studies with Active Learning

abstract: Dynamic aperture is an important concept for the study of non-linear beam dynamics in circular accelerators. It describes the extent of the phase-space region where a particle's motion remains bounded over a given number of turns. Understanding the features of dynamic aperture is crucial for the design and operation of such accelerators, as it provides insights into nonlinear effects and the possibility of optimising beam lifetime. The standard approach to calculate the dynamic aperture requires numerical simulations of several initial conditions densely distributed in phase space for a sufficient number of turns to probe the time scale corresponding to machine operations. This process is very computationally intensive and practically outside the range of today's computers. In our study, we introduced a novel method to estimate dynamic aperture rapidly and accurately by utilising a Deep Neural Network model. This model was trained with simulated tracking data from the CERN Large Hadron Collider and takes into account variations in accelerator parameters such as betatron tune, chromaticity, and the strength of the Landau octupoles. To enhance its performance, we integrate the model into an innovative Active Learning framework. This framework not only enables retraining and updating of the computed model, but also facilitates efficient data generation through smart sampling. Since chaotic motion cannot be predicted, traditional tracking simulations are incorporated into the Active Learning framework to deal with the chaotic nature of some initial conditions. The results demonstrate that the use of the Active Learning framework allows faster scanning of the configuration parameters without compromising the accuracy of the dynamic aperture estimates.


title: Model Editing by Standard Fine-Tuning

abstract: Standard fine-tuning is considered not as effective as specialized methods for model editing due to its comparatively poor performance. However, it is simple, agnostic to the architectural details of the model being edited, and able to leverage advances in standard training techniques with no additional work (e.g., black-box PEFT for computational efficiency), making it an appealing choice for a model editor. In this work, we show that standard fine-tuning alone can yield competitive model editing performance with two minor modifications. First, we optimize the conditional likelihood rather than the full likelihood. Second, in addition to the typical practice of training on randomly paraphrased edit prompts to encourage generalization, we also train on random or similar unedited facts to encourage locality. Our experiments on the ZsRE and CounterFact datasets demonstrate that these simple modifications allow standard fine-tuning to match or outperform highly specialized editors in terms of edit score.


title: Aging properties of the voter model with long-range interactions

abstract: We investigate the aging properties of the one-dimensional voter model with long-range interactions in its ordering kinetics. In this system, an agent $S_i=\pm 1$ positioned at a lattice vertex $i$, copies the state of another one located at a distance $r$, selected randomly with a probability $P(r) \propto r^{-\alpha}$. Employing both analytical and numerical methods, we compute the two-time correlation function $G(r;t,s)$ ($t\ge s$) between the state of a variable $S_i$ at time $s$ and that of another one, at distance $r$, at time $t$. At time $t$, the memory of an agent of its former state at time $s$, expressed by the {\it autocorrelation function} $A(t,s)=G(r=0;t,s)$, decays algebraically for $\alpha >1$ as $[L(t)/L(s)]^{-\lambda}$, where $L$ is a time-increasing coherence length and $\lambda $ is the Fisher-Huse exponent. We find $\lambda =1$ for $\alpha >2$, and $\lambda =1/(\alpha-1)$ for $1<\alpha \le 2$. For $\alpha \le 1$, instead, there is an exponential decay, as in mean-field. Then, at variance with what is known for the related Ising model, here we find that $\lambda $ increases upon decreasing $\alpha$. The space-dependent correlation $G(r;t,s)$ obeys a scaling symmetry $G(r;t,s)=g[r/L(s);L(t)/L(s)]$ for $\alpha >2$. Similarly, for $1<\alpha \le 2$ one has $G(r;t,s)=g[r/{\cal L}(t);{\cal L}(t)/{\cal L}(s)] $, where now the length ${\cal L}$ regulating two-time correlations differs from the coherence length as ${\cal L}\propto L^\delta$, with $\delta=1+2(2-\alpha)$.


title: Lieb-Robinson correlation function for the quantum transverse field Ising model

abstract: The Lieb-Robinson correlation function is the norm of a commutator between local operators acting on separate subsystems at different times. This provides a useful state-independent measure for characterizing the specifically quantum interaction between spatially separated qubits. The finite propagation velocity for this correlator defines a "light-cone" of quantum influence. We calculate the Lieb-Robinson correlation function for one-dimensional qubit arrays described by the transverse field Ising model. Direct calculations of this correlation function have been limited by the exponential increase in the size of the state space with the number of qubits. We introduce a new technique that avoids this barrier by transforming the calculation to a sum over Pauli walks which results in linear scaling with system size. We can then explore propagation in arrays of hundreds of qubits and observe the effects of the quantum phase transition in the system. We observe the emergence of two distinct velocities of propagation: a correlation front velocity, which is affected by the phase transition, and the Lieb-Robinson velocity which is not. The correlation front velocity is equal to the maximum group velocity of single quasiparticle excitations. The Lieb-Robinson velocity describes the extreme leading edge of correlations when the value of the correlation function itself is still very small. For the semi-infinite chain of qubits at the quantum critical point, we derive an analytical result for the correlation function.


title: Families of elliptic curves over the four-pointed configuration space and exceptional sequences for the braid group on four strands

abstract: We show that the configuration space of four unordered points in $\mathbb{C}$ with barycenter 0 is isomorphic to the space of triples $(E,Q,\omega)$, where $E$ is an elliptic curve, $Q\in E^\circ$ a nonzero point, and $\omega$ a nonzero holomorphic differential on $E$. At the level of fundamental groups, our construction unifies two classical exceptional exact sequences involving the braid group $B_4$: namely, the sequence $1\rightarrow F_2\rightarrow B_4\rightarrow B_3\rightarrow 1$, where $F_2$ is a free group of rank 2, related to Ferrari's solution of the quartic, and the sequence $1\rightarrow \mathbb{Z} \rightarrow B_4\rightarrow\operatorname{Aut}^+(F_2)\rightarrow 1$ of Dyer-Formanek-Grossman.


title: The AI Security Pyramid of Pain

abstract: We introduce the AI Security Pyramid of Pain, a framework that adapts the cybersecurity Pyramid of Pain to categorize and prioritize AI-specific threats. This framework provides a structured approach to understanding and addressing various levels of AI threats. Starting at the base, the pyramid emphasizes Data Integrity, which is essential for the accuracy and reliability of datasets and AI models, including their weights and parameters. Ensuring data integrity is crucial, as it underpins the effectiveness of all AI-driven decisions and operations. The next level, AI System Performance, focuses on MLOps-driven metrics such as model drift, accuracy, and false positive rates. These metrics are crucial for detecting potential security breaches, allowing for early intervention and maintenance of AI system integrity. Advancing further, the pyramid addresses the threat posed by Adversarial Tools, identifying and neutralizing tools used by adversaries to target AI systems. This layer is key to staying ahead of evolving attack methodologies. At the Adversarial Input layer, the framework addresses the detection and mitigation of inputs designed to deceive or exploit AI models. This includes techniques like adversarial patterns and prompt injection attacks, which are increasingly used in sophisticated attacks on AI systems. Data Provenance is the next critical layer, ensuring the authenticity and lineage of data and models. This layer is pivotal in preventing the use of compromised or biased data in AI systems. At the apex is the tactics, techniques, and procedures (TTPs) layer, dealing with the most complex and challenging aspects of AI security. This involves a deep understanding and strategic approach to counter advanced AI-targeted attacks, requiring comprehensive knowledge and planning.


title: VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

abstract: Visual Question Answering (VQA) is a fundamental task in computer vision and natural language process fields. Although the ``pre-training & finetuning'' learning paradigm significantly improves the VQA performance, the adversarial robustness of such a learning paradigm has not been explored. In this paper, we delve into a new problem: using a pre-trained multimodal source model to create adversarial image-text pairs and then transferring them to attack the target VQA models. Correspondingly, we propose a novel VQAttack model, which can iteratively generate both image and text perturbations with the designed modules: the large language model (LLM)-enhanced image attack and the cross-modal joint attack module. At each iteration, the LLM-enhanced image attack module first optimizes the latent representation-based loss to generate feature-level image perturbations. Then it incorporates an LLM to further enhance the image perturbations by optimizing the designed masked answer anti-recovery loss. The cross-modal joint attack module will be triggered at a specific iteration, which updates the image and text perturbations sequentially. Notably, the text perturbation updates are based on both the learned gradients in the word embedding space and word synonym-based substitution. Experimental results on two VQA datasets with five validated models demonstrate the effectiveness of the proposed VQAttack in the transferable attack setting, compared with state-of-the-art baselines. This work reveals a significant blind spot in the ``pre-training & fine-tuning'' paradigm on VQA tasks. Source codes will be released.


title: The Competition Complexity of Prophet Inequalities

abstract: We study the classic single-choice prophet inequality problem through a resource augmentation lens. Our goal is to bound the $(1-\varepsilon)$-competition complexity of different types of online algorithms. This metric asks for the smallest $k$ such that the expected value of the online algorithm on $k$ copies of the original instance, is at least a $(1-\varepsilon)$-approximation to the expected offline optimum on a single copy. We show that block threshold algorithms, which set one threshold per copy, are optimal and give a tight bound of $k = \Theta(\log \log 1/\varepsilon)$. This shows that block threshold algorithms approach the offline optimum doubly-exponentially fast. For single threshold algorithms, we give a tight bound of $k = \Theta(\log 1/\varepsilon)$, establishing an exponential gap between block threshold algorithms and single threshold algorithms. Our model and results pave the way for exploring resource-augmented prophet inequalities in combinatorial settings. In line with this, we present preliminary findings for bipartite matching with one-sided vertex arrivals, as well as in XOS combinatorial auctions. Our results have a natural competition complexity interpretation in mechanism design and pricing applications.


title: Kerr nonlinearity and parametric amplification with an Al-InAs superconductor-semiconductor Josephson junction

abstract: Nearly quantum limited Josephson parametric amplifiers (JPAs) are essential components in superconducting quantum circuits. However, higher order nonlinearities of the Josephson cosine potential are known to cause gain compression, therefore limiting scalability. In an effort to reduce the fourth order, or Kerr nonlinearity, we realize a parametric amplifier with an Al-InAs superconductor-semiconductor hybrid Josephson junction (JJ). We extract the Kerr nonlinearity of the Al-InAs JJ from two different devices and show that it is three orders of magnitude lower compared to an Al-$\text{AlO}_\text{X}$ junction with identical Josephson inductance. We then demonstrate a four-wave-mixing (4WM) parametric amplifier made with an Al-InAs junction that achieves more than 20 dB of gain and -119 dBm of compression power, that outperforms single resonant JPAs based on Al junctions.


title: A note on the inverse problem for finite differential Galois groups

abstract: In this paper we revisit the following inverse problem: given a curve invariant under an irreducible finite linear algebraic group, can we construct an ordinary linear differential equation whose Schwarz map parametrizes it? We present an algorithmic solution to this problem under the assumption that we are given the function field of the quotient curve. The result provides a generalization and an efficient implementation of the solution to the inverse problem exposed by M. van der Put, C. Sanabria and J.Top [19]. As an application, we show that there is no hypergeometric equation with differential Galois group isomorphic to $H_{72}^{SL_3}$, thus completing Beuker and Heckman's answer [4] to the question of which irreducible finite subgroup of $SL_3(\mathbb{C})$ are the monodromy of a hypergeometric equation.


title: Distinct Composition-Dependent Topological Hall Effect in Mn2-xZnxSb

abstract: Spintronics, an evolving interdisciplinary field at the intersection of magnetism and electronics, explores innovative applications of electron charge and spin properties for advanced electronic devices. The topological Hall effect, a key component in spintronics, has gained significance due to emerging theories surrounding noncoplanar chiral spin textures. This study focuses on Mn2-xZnxSb, a material crystalizing in centrosymmetric space group with rich magnetic phases tunable by Zn contents. Through comprehensive magnetic and transport characterizations, we found that the high-Zn (x>0.6) samples display THE which is enhanced with decreasing temperature, while THE in the low-Zn (x<0.6) samples show an opposite trend. The coexistence of those distinct temperature dependences for THE suggests very different magnetic interactions/structure for different compositions and underscores the strong coupling between magnetism and transport in Mn2-xZnxSb. Our findings contribute to understanding topological magnetism in centrosymmetric tetragonal lattices, establishing Mn2-xZnxSb as a unique platform for exploring tunable transport effects and opening avenues for further exploration in the realm of spintronics.


title: Properties and maximum likelihood estimation of the gamma-normal and related probability distributions

abstract: This paper presents likelihood-based inference methods for the family of univariate gamma-normal distributions GN({\alpha}, r, {\mu}, {\sigma}^2 ) that result from summing independent gamma({\alpha}, r) and N({\mu}, {\sigma}^2 ) random variables. First, the probability density function of a gamma-normal variable is provided in compact form with the use of parabolic cylinder functions, along with key properties. We then provide analytic expressions for the maximum-likelihood score equations and the Fisher information matrix, and discuss inferential methods for the gamma-normal distribution. Given the widespread use of the two constituting distributions, the gamma-normal distribution is a general purpose tool for a variety of applications. In particular, we discuss two distributions that are obtained as special cases and that are featured in a variety of statistical applications: the exponential-normal distribution and the chi-squared-normal (or overdispersed chi-squared) distribution.


title: The Male CEO and the Female Assistant: Gender Biases in Text-To-Image Generation of Dual Subjects

abstract: Recent large-scale T2I models like DALLE-3 have made progress on improving fairness in single-subject generation, i.e. generating a one-person image. However, we reveal that these improved models still demonstrate considerable biases when simply generating two people. To systematically evaluate T2I models in this challenging generation setting, we propose the Paired Stereotype Test (PST) framework, established as a dual-subject generation task, i.e. generating two people in the same image. The setting in PST is especially challenging, as the two individuals are described with social identities that are male-stereotyped and female-stereotyped, respectively, e.g. "a CEO" and "an Assistant". It is easy for T2I models to unfairly follow gender stereotypes in this contrastive setting. We establish a metric, Stereotype Score (SS), to quantitatively measure the adherence to gender stereotypes in generated images. Using PST, we evaluate two aspects of gender biases in DALLE-3 -- the widely-identified bias in gendered occupation, as well as a novel aspect: bias in organizational power. Results show that despite generating seemingly fair or even anti-stereotype single-person images, DALLE-3 still shows notable biases under PST -- for instance, in experiments on gender-occupational stereotypes, over 74% model generations demonstrate biases. Moreover, compared to single-person settings, DALLE-3 is more likely to perpetuate male-associated stereotypes under PST. Our work pioneers the research on bias in dual-subject generation, and our proposed PST framework can be easily extended for further experiments, establishing a valuable contribution.


title: Non adiabatic dynamics of photoexcited cyclobutanone: predicting structural measurements from trajectory surface hopping with XMS-CASPT2 simulations

abstract: For years, theoretical calculations and scalable computer simulations have complemented ultrafast experiments as they offer the advantage to overcome experimental restrictions and have access to the whole dynamics. This synergy between theory and experiment promises to yield a deeper understanding of photochemical processes, offering valuable insights into the behavior of complex systems at the molecular level. However, the capacity of theoretical models to predict ultrafast experimental outcomes has remained largely unexplored. In this work, we aim to predict the electron diffraction signals of an upcoming ultrafast photochemical experiment using high-level electronic structure calculations and non adiabatic dynamics simulations. In particular, we perform trajectory surface hopping with XMSCASPT2 simulations for understanding mechanistic photodissociation of cyclobutanone upon excitation at 200 nm.


title: A Novel Multivariate Skew-Normal Mixture Model and Its Application in Path-Planning for Very-Large-Scale Robotic Systems

abstract: This paper addresses the path-planning challenge for very large-scale robotic systems (VLSR) operating in complex and cluttered environments. VLSR systems consist of numerous cooperative agents or robots working together autonomously. Traditionally, many approaches for VLSR systems are developed based on Gaussian mixture models (GMMs), where the GMMs represent agents' evolving spatial distribution, serving as a macroscopic view of the system's state. However, our recent research into VLSR systems has unveiled limitations in using GMMs to represent agent distributions, especially in cluttered environments. To overcome these limitations, we propose a novel model called the skew-normal mixture model (SNMM) for representing agent distributions. Additionally, we present a parameter learning algorithm designed to estimate the SNMM's parameters using sample data. Furthermore, we develop two SNMM-based path-planning algorithms to guide VLSR systems through complex and cluttered environments. Our simulation results demonstrate the effectiveness and superiority of these algorithms compared to GMM-based path-planning methods.


title: Adaptive Weight Learning for Multiple Outcome Optimization With Continuous Treatment

abstract: To promote precision medicine, individualized treatment regimes (ITRs) are crucial for optimizing the expected clinical outcome based on patient-specific characteristics. However, existing ITR research has primarily focused on scenarios with categorical treatment options and a single outcome. In reality, clinicians often encounter scenarios with continuous treatment options and multiple, potentially competing outcomes, such as medicine efficacy and unavoidable toxicity. To balance these outcomes, a proper weight is necessary, which should be learned in a data-driven manner that considers both patient preference and clinician expertise. In this paper, we present a novel algorithm for developing individualized treatment regimes (ITRs) that incorporate continuous treatment options and multiple outcomes, utilizing observational data. Our approach assumes that clinicians are optimizing individualized patient utilities with sub-optimal treatment decisions that are at least better than random assignment. Treatment assignment is assumed to directly depend on the true underlying utility of the treatment rather than patient characteristics. The proposed method simultaneously estimates the weighting of composite outcomes and the decision-making process, allowing for construction of individualized treatment regimes with continuous doses. The proposed estimators can be used for inference and variable selection, facilitating the identification of informative treatment assignments and preference-associated variables. We evaluate the finite sample performance of our proposed method via simulation studies and apply it to a real data application of radiation oncology analysis.


title: Modular Graph Extraction for Handwritten Circuit Diagram Images

abstract: As digitization in engineering progressed, circuit diagrams (also referred to as schematics) are typically developed and maintained in computer-aided engineering (CAE) systems, thus allowing for automated verification, simulation and further processing in downstream engineering steps. However, apart from printed legacy schematics, hand-drawn circuit diagrams are still used today in the educational domain, where they serve as an easily accessible mean for trainees and students to learn drawing this type of diagrams. Furthermore, hand-drawn schematics are typically used in examinations due to legal constraints. In order to harness the capabilities of digital circuit representations, automated means for extracting the electrical graph from raster graphics are required. While respective approaches have been proposed in literature, they are typically conducted on small or non-disclosed datasets. This paper describes a modular end-to-end solution on a larger, public dataset, in which approaches for the individual sub-tasks are evaluated to form a new baseline. These sub-tasks include object detection (for electrical symbols and texts), binary segmentation (drafter's stroke vs. background), handwritten character recognition and orientation regression for electrical symbols and texts. Furthermore, computer-vision graph assembly and rectification algorithms are presented. All methods are integrated in a publicly available prototype.


title: Word Embeddings Revisited: Do LLMs Offer Something New?

abstract: Learning meaningful word embeddings is key to training a robust language model. The recent rise of Large Language Models (LLMs) has provided us with many new word/sentence/document embedding models. Although LLMs have shown remarkable advancement in various NLP tasks, it is still unclear whether the performance improvement is merely because of scale or whether underlying embeddings they produce significantly differ from classical encoding models like Sentence-BERT (SBERT) or Universal Sentence Encoder (USE). This paper systematically investigates this issue by comparing classical word embedding techniques against LLM-based word embeddings in terms of their latent vector semantics. Our results show that LLMs tend to cluster semantically related words more tightly than classical models. LLMs also yield higher average accuracy on the Bigger Analogy Test Set (BATS) over classical methods. Finally, some LLMs tend to produce word embeddings similar to SBERT, a relatively lighter classical model.


title: GIM: Learning Generalizable Image Matcher From Internet Videos

abstract: Image matching is a fundamental computer vision problem. While learning-based methods achieve state-of-the-art performance on existing benchmarks, they generalize poorly to in-the-wild images. Such methods typically need to train separate models for different scene types and are impractical when the scene type is unknown in advance. One of the underlying problems is the limited scalability of existing data construction pipelines, which limits the diversity of standard image matching datasets. To address this problem, we propose GIM, a self-training framework for learning a single generalizable model based on any image matching architecture using internet videos, an abundant and diverse data source. Given an architecture, GIM first trains it on standard domain-specific datasets and then combines it with complementary matching methods to create dense labels on nearby frames of novel videos. These labels are filtered by robust fitting, and then enhanced by propagating them to distant frames. The final model is trained on propagated data with strong augmentations. We also propose ZEB, the first zero-shot evaluation benchmark for image matching. By mixing data from diverse domains, ZEB can thoroughly assess the cross-domain generalization performance of different methods. Applying GIM consistently improves the zero-shot performance of 3 state-of-the-art image matching architectures; with 50 hours of YouTube videos, the relative zero-shot performance improves by 8.4%-18.1%. GIM also enables generalization to extreme cross-domain data such as Bird Eye View (BEV) images of projected 3D point clouds (Fig. 1(c)). More importantly, our single zero-shot model consistently outperforms domain-specific baselines when evaluated on downstream tasks inherent to their respective domains. The video presentation is available at https://www.youtube.com/watch?v=FU_MJLD8LeY.


title: On a problem of E. Meckes for the unitary eigenvalue process on an arc

abstract: We study the problem originally communicated by E. Meckes on the asymptotics for the eigenvalues of the kernel of the unitary eigenvalue process of a random $n \times n$ matrix. The eigenvalues $p_{j}$ of the kernel are, in turn, associated with the discrete prolate spheroidal wave functions. We consider the eigenvalue counting function $|G(x,n)|:=\#\{j:p_j>Ce^{-x n}\}$, ($C>0$ here is a fixed constant) and establish the asymptotic behavior of its average over the interval $x \in (\lambda-\varepsilon, \lambda+\varepsilon)$ by relating the function $|G(x,n)|$ to the solution $J(y)$ of the following energy problem on the unit circle $S^{1}$, which is of independent interest. Namely, for given $\theta$, $0<\theta< 2 \pi$, and given $q$, $0<q<1$, we determine the function $J(q) =\inf \{I(\mu): \mu \in \mathcal{P}(S^{1}), \mu(A_{\theta}) = q\}$, where $I(\mu):= \iint \log\frac{1}{|z - \zeta|} d\mu(z) d\mu(\zeta)$ is the logarithmic energy of a probability measure $\mu$ supported on the unit circle and $A_{\theta}$ is the arc from $e^{-i \theta/2}$ to $e^{i \theta/2}$.


title: Interpolating many-body wave functions for accelerated molecular dynamics on near-exact electronic surfaces

abstract: While there have been many developments in computational probes of both strongly-correlated molecular systems and machine-learning accelerated molecular dynamics, there remains a significant gap in capabilities between them, where it is necessary to describe the accurate electronic structure over timescales in which atoms move. We describe a practical approach to bridge these fields by interpolating the correlated many-electron state through chemical space, whilst avoiding the exponential complexity of these underlying states. With a small number of accurate correlated wave function calculations as a training set, we demonstrate provable convergence to near-exact potential energy surfaces for subsequent dynamics with propagation of a valid many-body wave function and inference of its variational energy at all points, whilst retaining a mean-field computational scaling. This represents a profoundly different paradigm to the direct interpolation of properties through chemical space in established machine-learning approaches. It benefits from access to all electronic properties of interest from the same model without relying on local descriptors, and demonstrates improved performance compared to the direct training on energies themselves. We combine this with modern systematically-improvable electronic structure methods to resolve the molecular dynamics for a number of correlated electron problems, including the proton dynamics of a Zundel cation trajectory, where we highlight the qualitative improvement from traditional machine learning or ab initio dynamics on mean-field surfaces.

categories: physics.chem-ph cond-mat.str-el physics.comp-ph quant-ph


title: Search for a scalar or pseudoscalar dilepton resonance produced in association with a massive vector boson or top quark-antiquark pair in multilepton events at $\sqrt{s}$ = 13 TeV

abstract: A search for beyond the standard model spin-0 bosons, $\phi$, that decay into pairs of electrons, muons, or tau leptons is presented. The search targets the associated production of such bosons with a W or Z gauge boson, or a top quark-antiquark pair, and uses events with three or four charged leptons, including hadronically decaying tau leptons. The proton-proton collision data set used in the analysis was collected at the LHC from 2016 to 2018 at a center-of-mass energy of 13 TeV, and corresponds to an integrated luminosity of 138 fb$^{-1}$. The observations are consistent with the predictions from standard model processes. Upper limits are placed on the product of cross sections and branching fractions of such new particles over the mass range of 15 to 350 GeV with scalar, pseudoscalar, or Higgs-boson-like couplings, as well as on the product of coupling parameters and branching fractions. Several model-dependent exclusion limits are also presented. For a Higgs-boson-like $\phi$ model, limits are set on the mixing angle of the Higgs boson with the $\phi$ boson. For the associated production of a $\phi$ boson with a top quark-antiquark pair, limits are set on the coupling to top quarks. Finally, limits are set for the first time on a fermiophilic dilaton-like model with scalar couplings and a fermiophilic axion-like model with pseudoscalar couplings.


title: Enhancing Quantum Optimization with Parity Network Synthesis

abstract: This paper examines QAOA in the context of parity network synthesis. We propose a pair of algorithms for parity network synthesis and linear circuit inversion. Together, these algorithms can build the diagonal component of the QAOA circuit, generally the most expensive in terms of two qubit gates. We compare the CNOT count of our strategy to off-the-shelf compiler tools for random, full, and graph-based optimization problems and find that ours outperforms the alternatives.


title: When LLMs Meet Cunning Texts: A Fallacy Understanding Benchmark for Large Language Models

abstract: Recently, Large Language Models (LLMs) make remarkable evolutions in language understanding and generation. Following this, various benchmarks for measuring all kinds of capabilities of LLMs have sprung up. In this paper, we challenge the reasoning and understanding abilities of LLMs by proposing a FaLlacy Understanding Benchmark (FLUB) containing cunning texts that are easy for humans to understand but difficult for models to grasp. Specifically, the cunning texts that FLUB focuses on mainly consist of the tricky, humorous, and misleading texts collected from the real internet environment. And we design three tasks with increasing difficulty in the FLUB benchmark to evaluate the fallacy understanding ability of LLMs. Based on FLUB, we investigate the performance of multiple representative and advanced LLMs, reflecting our FLUB is challenging and worthy of more future study. Interesting discoveries and valuable insights are achieved in our extensive experiments and detailed analyses. We hope that our benchmark can encourage the community to improve LLMs' ability to understand fallacies. Our data and codes are available at https://github.com/THUKElab/FLUB.


title: Physics-based material parameters extraction from perovskite experiments via Bayesian optimization

abstract: The ability to extract material parameters of perovskite from quantitative experimental analysis is essential for rational design of photovoltaic and optoelectronic applications. However, the difficulty of this analysis increases significantly with the complexity of the theoretical model and the number of material parameters for perovskite. Here we use Bayesian optimization to develop an analysis platform that can extract up to 8 fundamental material parameters of an organometallic perovskite semiconductor from a transient photoluminescence experiment, based on a complex full physics model that includes drift-diffusion of carriers and dynamic defect occupation. An example study of thermal degradation reveals that the carrier mobility and trap-assisted recombination coefficient are reduced noticeably, while the defect energy level remains nearly unchanged. The reduced carrier mobility can dominate the overall effect on thermal degradation of perovskite solar cells by reducing the fill factor, despite the opposite effect of the reduced trap-assisted recombination coefficient on increasing the fill factor. In future, this platform can be conveniently applied to other experiments or to combinations of experiments, accelerating materials discovery and optimization of semiconductor materials for photovoltaics and other applications.


title: Universal Design Methodology for Printable Microstructural Materials via a New Deep Generative Learning Model: Application to a Piezocomposite

abstract: We devised a general heterogeneous microstructural design methodology applied to a specific material system, elasto-electro-active piezoelectric ceramic embedded plastics, which has great potential in sensing, 5G communication, and energy harvesting. Due to the multiphysics interactions of the studied material system, we have developed an accurate and efficient FFT-based numerical method to find the multifunctional properties of diverse cellular microstructures generated by our HetMiGen code. To mine this big dataset, we used our customized physics-aware generative neural network in the format of a VAE with convolutional neural layers augmented by a vision transformer to learn long-distance features which may affect the properties of the 3D voxelized microstructures. In training, the decoder learns how to map the property distribution to the appropriate high-dimensional distribution of 3D microstructures. Therefore, it can be considered an online material designer within the explored design space during its inference phase.


title: Toward Learning Latent-Variable Representations of Microstructures by Optimizing in Spatial Statistics Space

abstract: In Materials Science, material development involves evaluating and optimizing the internal structures of the material, generically referred to as microstructures. Microstructures structure is stochastic, analogously to image textures. A particular microstructure can be well characterized by its spatial statistics, analogously to image texture being characterized by the response to a Fourier-like filter bank. Material design would benefit from low-dimensional representation of microstructures Paulson et al. (2017). In this work, we train a Variational Autoencoders (VAE) to produce reconstructions of textures that preserve the spatial statistics of the original texture, while not necessarily reconstructing the same image in data space. We accomplish this by adding a differentiable term to the cost function in order to minimize the distance between the original and the reconstruction in spatial statistics space. Our experiments indicate that it is possible to train a VAE that minimizes the distance in spatial statistics space between the original and the reconstruction of synthetic images. In future work, we will apply the same techniques to microstructures, with the goal of obtaining low-dimensional representations of material microstructures.


title: Computing Voting Rules with Elicited Incomplete Votes

abstract: Motivated by the difficulty of specifying complete ordinal preferences over a large set of $m$ candidates, we study voting rules that are computable by querying voters about $t < m$ candidates. Generalizing prior works that focused on specific instances of this problem, our paper fully characterizes the set of positional scoring rules that can be computed for any $1 \leq t < m$, which notably does not include plurality. We then extend this to show a similar impossibility result for single transferable vote (elimination voting). These negative results are information-theoretic and agnostic to the number of queries. Finally, for scoring rules that are computable with limited-sized queries, we give parameterized upper and lower bounds on the number of such queries a deterministic or randomized algorithm must make to determine the score-maximizing candidate. While there is no gap between our bounds for deterministic algorithms, identifying the exact query complexity for randomized algorithms is a challenging open problem, of which we solve one special case.


title: Magic Mirror on the Wall, How to Benchmark Quantum Error Correction Codes, Overall ?

abstract: Quantum Error Correction Codes (QECCs) are pivotal in advancing quantum computing by protecting quantum states against the adverse effects of noise and errors. With a variety of QECCs developed, including new developments and modifications of existing ones, selecting an appropriate QECC tailored to specific conditions is crucial. Despite significant improvements in the field of QECCs, a unified methodology for evaluating them on a consistent basis has remained elusive. Addressing this gap, this paper presents the first benchmarking framework for QECCs, introducing a set of universal parameters. By evaluating eight prominent QECCs, we propose a comprehensive suite of eight parameters for their analysis. Our methodology establishes a universal benchmarking approach and highlights the complexity of quantum error correction, indicating that the choice of a QECC depends on the unique requirements and limitations of each scenario. Furthermore, we develop a systematic strategy for selecting QECCs that adapts to the specific requirements of a given scenario, facilitating a tailored approach to quantum error correction. Additionally, we introduce a novel QECC recommendation tool that assesses the characteristics of a given scenario provided by the user, subsequently recommending a spectrum of QECCs from most to least suitable, along with the maximum achievable distance for each code. This tool is designed to be adaptable, allowing for the inclusion of new QECCs and the modification of their parameters with minimal effort, ensuring its relevance in the evolving landscape of quantum computing.


title: The commuting variety of $\mathfrak{pgl}_n$

abstract: We are considering the commuting variety of the Lie algebra $\mathfrak{pgl}_n$ over an algebraically closed field of characteristic $p >0$, namely the set of pairs $ \{ (A,B) \in \mathfrak{pgl}_n \times \mathfrak{pgl}_n \mid [A,B]=0 \} $. We prove that if $n=pr$, then there are precisely two irreducible components, of dimensions $n^2+r-1$ and $n^2+n-2$. We also prove that the variety $\{ (x,y) \in GL_n(k) \times GL_n(k) \mid [x,y]=\zeta I \}$ is irreducible of dimension $n^2 +n/d$, where $\zeta$ is a root of unity of order $d$ with $d$ dividing $n$.


title: Dynamic nowcast of the New Zealand greenhouse gas inventory

abstract: As efforts to mitigate the effects of climate change grow, reliable and thorough reporting of greenhouse gas emissions are essential for measuring progress towards international and domestic emissions reductions targets. New Zealand's national emissions inventories are currently reported between 15 to 27 months out-of-date. We present a machine learning approach to nowcast (dynamically estimate) national greenhouse gas emissions in New Zealand in advance of the national emissions inventory's release, with just a two month latency due to current data availability. Key findings include an estimated 0.2% decrease in national gross emissions since 2020 (as at July 2022). Our study highlights the predictive power of a dynamic view of emissions intensive activities. This methodology is a proof of concept that a machine learning approach can make sub-annual estimates of national greenhouse gas emissions by sector with a relatively low error that could be of value for policy makers.


title: Fourier and small ball estimates for word maps on unitary groups

abstract: To a non-trivial word $w(x_{1},...,x_{r})$ in a free group $F_{r}$ on $r$ elements and a group $G$, one can associate the word map $w_{G}:G^{r}\rightarrow G$ that takes an $r$-tuple $(g_{1},...,g_{r})$ in $G^{r}$ to $w(g_{1},...,g_{r})$. If $G$ is compact, we further associate the word measure $\tau_{w,G}$, defined as the distribution of $w_{G}(\mathsf{X}_{1},...,\mathsf{X}_{r})$, where $\mathsf{X}_{1},...,\mathsf{X}_{r}$ are independent and Haar-random elements in $G$. In this paper we study word maps and word measures on the family of special unitary groups $\left\{ \mathrm{SU}_{n}\right\} _{n\geq2}$. Our first result is a small ball estimate for $w_{\mathrm{SU}_{n}}$. We show that for every $w\in F_{r}\smallsetminus\left\{ 1\right\} $ there are $\epsilon(w),\delta(w)>0$ such that if $B\subseteq\mathrm{SU}_{n}$ is a ball of radius at most $\delta(w)\mathrm{diam}(\mathrm{SU}_{n})$ in the Hilbert-Schmidt metric, then $\tau_{w,\mathrm{SU}_{n}}(B)\leq(\mu_{\mathrm{SU}_{n}}(B))^{\epsilon(w)}$, where $\mu_{\mathrm{SU}_{n}}$ is the Haar probability measure. Our second main result is about the random walks generated by $\tau_{w,\mathrm{SU}_{n}}$. We provide exponential upper bounds on the large Fourier coefficients of $\tau_{w,\mathrm{SU}_{n}}$, and as a consequence we show there exists $t(w)\in\mathbb{N}$, such that $\tau_{w,\mathrm{SU}_{n}}^{*t}$ has bounded density for every $t\geq t(w)$ and every $n\geq2$, answering a conjecture by the first two authors. As a key step in the proof, we establish, for every large irreducible character $\rho$ of $\mathrm{SU}_{n}$, an exponential upper bound of the form $\left|\rho(g)\right|<\rho(1)^{1-\epsilon}$, for elements $g$ in $\mathrm{SU}_{n}$ whose eigenvalues are sufficiently spread out on the unit circle in $\mathbb{C^{\times}}$.


title: Online Flexible Busy Time Scheduling on Heterogeneous Machines

abstract: We study the online busy time scheduling model on heterogeneous machines. In our setting, unit-length jobs arrive online with a deadline that is known to the algorithm at the job's arrival time. An algorithm has access to machines, each with different associated capacities and costs. The goal is to schedule jobs on machines before their deadline, so that the total cost incurred by the scheduling algorithm is minimized. Relatively little is known about online busy time scheduling when machines are heterogeneous (i.e., have different costs and capacities), despite this being the most practical model for clients using cloud computing services. We make significant progress in understanding this model by designing an 8-competitive algorithm for the problem on unit-length jobs, and providing a lower bound on the competitive ratio of 2. We further prove that our lower bound is tight in the natural setting when jobs have agreeable deadlines.


title: The weak relationship between ankle proprioception and gait speed after stroke a robotic assessment study

abstract: Ankle proprioceptive deficits are common after stroke and occur independently of ankle motor impairments. Despite this independence, some studies have found that ankle proprioceptive deficits predict gait function, consistent with the concept that somatosensory input plays a key role in gait control. Other studies, however, have not found a relationship, possibly because of variability in proprioception assessments. Robotic assessments of proprioception offer improved consistency and sensitivity. Here we relationships between ankle proprioception, ankle motor impairment, and gait function after stroke using robotic assessments of ankle proprioception. We quantified ankle proprioception using two different robotic tests (Joint Position Reproduction and Crisscross) in 39 persons in the chronic phase of stroke. We analyzed the extent to which these robotic proprioception measures predicted gait speed, measured over a long distance (6-minute walk test) and a short distance (10-meter walk test). We also studied the relationship between robotic proprioception measures and lower extremity motor impairment, quantified with measures of ankle strength, active range of motion, and the lower extremity Fugl-Meyer exam. Impairment in ankle proprioception was present in 87% of the participants. Ankle proprioceptive acuity measured with JPR was weakly correlated with 6MWT gait speed (\r{ho} = -0.34, p = 0.039) but not 10mWT (\r{ho} = -0.29, p = 0.08). Ankle proprioceptive acuity was not correlated with lower extremity motor impairment (p > 0.2). These results confirm the presence of a weak relationship between ankle proprioception and gait after stroke that is independent of motor impairment.


title: Language Models as Science Tutors

abstract: NLP has recently made exciting progress toward training language models (LMs) with strong scientific problem-solving skills. However, model development has not focused on real-life use-cases of LMs for science, including applications in education that require processing long scientific documents. To address this, we introduce TutorEval and TutorChat. TutorEval is a diverse question-answering benchmark consisting of questions about long chapters from STEM textbooks, written by experts. TutorEval helps measure real-life usability of LMs as scientific assistants, and it is the first benchmark combining long contexts, free-form generation, and multi-disciplinary scientific knowledge. Moreover, we show that fine-tuning base models with existing dialogue datasets leads to poor performance on TutorEval. Therefore, we create TutorChat, a dataset of 80,000 long synthetic dialogues about textbooks. We use TutorChat to fine-tune Llemma models with 7B and 34B parameters. These LM tutors specialized in math have a 32K-token context window, and they excel at TutorEval while performing strongly on GSM8K and MATH. Our datasets build on open-source materials, and we release our models, data, and evaluations.


title: Quantum Soft Covering and Decoupling with Relative Entropy Criterion

abstract: We propose quantum soft covering problems for fully quantum channels and classical-quantum (CQ) channels using relative entropy as a criterion of operator closeness. We prove covering lemmas by deriving one-shot bounds on the rates in terms of smooth min-entropies and smooth max-divergences, respectively. In the asymptotic regime, we show that for quantum channels, the rate infimum defined as the logarithm of the minimum rank of the input state is the coherent information between the reference and output state; for CQ channels, the rate infimum defined as the logarithm of the minimum number of input codewords is the Helovo information between the input and output state. Furthermore, we present a one-shot quantum decoupling theorem with relative entropy criterion. Our results based on the relative-entropy criterion are tighter than the corresponding results based on the trace norm considered in the literature due to the Pinsker inequality.


title: The multi-wavelength phase curves of small bodies: Phase coloring

abstract: Context. Small bodies change their brightness due to different motives: Rotation along their axis or axes, combined with irregular shapes and/or changing surface properties, or changes in the geometry of observations. In this work, we tackle the problem of Phase curves, which show the change in brightness due to changes in the fraction of illuminated surface as seen by the observer. Aims. We aim to study the effect of the phase curves in the five wavelengths of the Sloan Digital Sky Survey in scores of objects (several tens of thousands), focusing particularly on the spectral slopes and the colors and their changes with phase angle. Methods. We used a Bayesian inference method and Monte Carlo techniques to retrieve the absolute magnitudes in five wavelengths, using the results to study the phase coloring effect in different bins of the semi-major axis. Results. We obtained absolute magnitudes in the five filters for over 40 000 objects. Although some outliers are identified, most of the usual color-color space is recovered by the data presented. We also detect a dual behavior in the spectral slopes, with a change at ${\alpha\approx}$ 5 deg.


title: Whose Emotions and Moral Sentiments Do Language Models Reflect?

abstract: Language models (LMs) are known to represent the perspectives of some social groups better than others, which may impact their performance, especially on subjective tasks such as content moderation and hate speech detection. To explore how LMs represent different perspectives, existing research focused on positional alignment, i.e., how closely the models mimic the opinions and stances of different groups, e.g., liberals or conservatives. However, human communication also encompasses emotional and moral dimensions. We define the problem of affective alignment, which measures how LMs' emotional and moral tone represents those of different groups. By comparing the affect of responses generated by 36 LMs to the affect of Twitter messages, we observe significant misalignment of LMs with both ideological groups. This misalignment is larger than the partisan divide in the U.S. Even after steering the LMs towards specific ideological perspectives, the misalignment and liberal tendencies of the model persist, suggesting a systemic bias within LMs.


title: Transverse linear stability of one-dimensional solitary gravity water waves

abstract: In this paper, we establish the transverse linear asymptotic stability of one-dimensional small-amplitude solitary waves of the gravity water-waves system. More precisely, we show that the semigroup of the linearized operator about the solitary wave decays exponentially within a spectral subspace supplementary to the space generated by the spectral projection on continuous resonant modes. The key element of the proof is to establish suitable uniform resolvent estimates. To achieve this, we use different arguments depending on the size of the transverse frequencies. For high transverse frequencies, we use reductions based on pseudodifferential calculus, for intermediate ones, we use an energy-based approach relying on the design of various appropriate energy functionals for different regimes of longitudinal frequencies and for low frequencies, we use the KP-II approximation. As a corollary of our main result, we also get the spectral stability in the unweighted energy space.


title: Thermodynamically consistent Cahn-Hilliard-Navier-Stokes equations using the metriplectic dynamics formalism

abstract: Cahn-Hilliard-Navier-Stokes (CHNS) systems describes flows with two-phases, e.g., a liquid with bubbles. Obtaining constitutive relations for general dissipative processes for such a systems, which are thermodynamically consistent, can be a challenge. We show how the metriplectic 4-bracket formalism achieves this in a straightforward, in fact algorithmic, manner. First, from the noncanonical Hamiltonian formulation for the ideal part of a CHNS system we obtain an appropriate Casimir to serve as the entropy in the metriplectic formalism that describes the dissipation (e.g. viscosity, heat conductivity and diffusion effects). General thermodynamics with the thermodynamic conjugates of concentration and chemical potential are included. Having expressions for the Hamiltonian (energy), entropy, and Poisson bracket, we describe a procedure for obtaining a metriplectic 4-bracket that describes thermodynamically consistent dissipative effects. The 4-bracket formalism leads naturally to a general CHNS system that allows for anisotropic surface energy effects. This general CHNS system reduces to cases in the literature, to which we can compare.


title: Tuning properties of phase-separated magnetic fluid with temperature

abstract: Phase-separated magnetic fluids provide a very strong magnetic response ($\mu>25$) in a liquid state material. Even small fields can cause a notable material response, but this depends on its properties, which are often difficult to control. Here, we investigate how temperature affects the properties of the system, where phase separation is induced by an increase in ionic strength. Following the deformations of individual microscopic droplets, we can extract surface tension, magnetic permeability, and viscosity. We find that the temperature increase does not affect the surface tension, while the magnetic permeability and viscosity increase. Applying this knowledge to induce a shape instability for a drop only using temperature shows the potential of applicability of our findings.


title: Tic-Tac-Toe on Designs

abstract: We consider playing the game of Tic-Tac-Toe on block designs BIBD($v, k, \lambda$) and transversal designs TD($k, n$). Players take turns choosing points and the first player to complete a block wins the game. We show that triple systems, BIBD($v, 3, \lambda$), are a first player win if and only if $v \geq 5$. Further, we show that for $k = 2, 3$, TD($k, n$) is a first player win if and only if $n \geq k$. We also consider a weak version of the game, called Maker-Breaker, in which the second player wins if they can stop the first player from winning. In this case, we adapt known bounds for when either the first or second player can win on BIBD($v, k, 1$) and TD($k, n$), and show that for Maker-Breaker, BIBD($v, 4, 1$) is a first player win if and only if $v \geq 16$. We show that TD($4, 4$) is a second player win, and so the second player can force a draw in the regular game by playing the same strategy.


title: Private PAC Learning May be Harder than Online Learning

abstract: We continue the study of the computational complexity of differentially private PAC learning and how it is situated within the foundations of machine learning. A recent line of work uncovered a qualitative equivalence between the private PAC model and Littlestone's mistake-bounded model of online learning, in particular, showing that any concept class of Littlestone dimension $d$ can be privately PAC learned using $\mathrm{poly}(d)$ samples. This raises the natural question of whether there might be a generic conversion from online learners to private PAC learners that also preserves computational efficiency. We give a negative answer to this question under reasonable cryptographic assumptions (roughly, those from which it is possible to build indistinguishability obfuscation for all circuits). We exhibit a concept class that admits an online learner running in polynomial time with a polynomial mistake bound, but for which there is no computationally-efficient differentially private PAC learner. Our construction and analysis strengthens and generalizes that of Bun and Zhandry (TCC 2016-A), who established such a separation between private and non-private PAC learner.


title: DART: A Principled Approach to Adversarially Robust Unsupervised Domain Adaptation

abstract: Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively under-explored. In this work, we study the problem of adversarial robustness under a common setting of distribution shift - unsupervised domain adaptation (UDA). Specifically, given a labeled source domain $D_S$ and an unlabeled target domain $D_T$ with related but different distributions, the goal is to obtain an adversarially robust model for $D_T$. The absence of target domain labels poses a unique challenge, as conventional adversarial robustness defenses cannot be directly applied to $D_T$. To address this challenge, we first establish a generalization bound for the adversarial target loss, which consists of (i) terms related to the loss on the data, and (ii) a measure of worst-case domain divergence. Motivated by this bound, we develop a novel unified defense framework called Divergence Aware adveRsarial Training (DART), which can be used in conjunction with a variety of standard UDA methods; e.g., DANN [Ganin and Lempitsky, 2015]. DART is applicable to general threat models, including the popular $\ell_p$-norm model, and does not require heuristic regularizers or architectural changes. We also release DomainRobust: a testbed for evaluating robustness of UDA models to adversarial attacks. DomainRobust consists of 4 multi-domain benchmark datasets (with 46 source-target pairs) and 7 meta-algorithms with a total of 11 variants. Our large-scale experiments demonstrate that on average, DART significantly enhances model robustness on all benchmarks compared to the state of the art, while maintaining competitive standard accuracy. The relative improvement in robustness from DART reaches up to 29.2% on the source-target domain pairs considered.


title: Solving Third Order Linear Difference Equations in Terms of Second Order Equations

abstract: We present two algorithms for computing what we call the absolute factorization of a difference operator. We also give an algorithm to solve third order difference equations in terms of second order equations, together with applications to OEIS sequences. The latter algorithm is similar to existing algorithms for differential equations.


title: Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models

abstract: Memory Editing (ME) has emerged as an efficient method to modify erroneous facts or inject new facts into Large Language Models (LLMs). Two mainstream ME methods exist: parameter-modifying ME and parameter-preserving ME (integrating extra modules while preserving original parameters). Regrettably, previous studies on ME evaluation have two critical limitations: (i) evaluating LLMs with single edit only, neglecting the need for continuous editing, and (ii) evaluations focusing solely on basic factual triples, overlooking broader LLM capabilities like logical reasoning and reading understanding. This study addresses these limitations with contributions threefold: (i) We explore how ME affects a wide range of fundamental capabilities of LLMs under sequential editing. Experimental results reveal an intriguing phenomenon: Most parameter-modifying ME consistently degrade performance across all tasks after a few sequential edits. In contrast, parameter-preserving ME effectively maintains LLMs' fundamental capabilities but struggles to accurately recall edited knowledge presented in a different format. (ii) We extend our evaluation to different editing settings, such as layers to edit, model size, instruction tuning, etc. Experimental findings indicate several strategies that can potentially mitigate the adverse effects of ME. (iii) We further explain why parameter-modifying ME damages LLMs from three dimensions: parameter changes after editing, language modeling capability, and the in-context learning capability. Our in-depth study advocates more careful use of ME in real-world scenarios.


title: Optimizing Warfarin Dosing Using Contextual Bandit: An Offline Policy Learning and Evaluation Method

abstract: Warfarin, an anticoagulant medication, is formulated to prevent and address conditions associated with abnormal blood clotting, making it one of the most prescribed drugs globally. However, determining the suitable dosage remains challenging due to individual response variations, and prescribing an incorrect dosage may lead to severe consequences. Contextual bandit and reinforcement learning have shown promise in addressing this issue. Given the wide availability of observational data and safety concerns of decision-making in healthcare, we focused on using exclusively observational data from historical policies as demonstrations to derive new policies; we utilized offline policy learning and evaluation in a contextual bandit setting to establish the optimal personalized dosage strategy. Our learned policies surpassed these baseline approaches without genotype inputs, even when given a suboptimal demonstration, showcasing promising application potential.


title: Implicit Causal Representation Learning via Switchable Mechanisms

abstract: Learning causal representations from observational and interventional data in the absence of known ground-truth graph structures necessitates implicit latent causal representation learning. Implicit learning of causal mechanisms typically involves two categories of interventional data: hard and soft interventions. In real-world scenarios, soft interventions are often more realistic than hard interventions, as the latter require fully controlled environments. Unlike hard interventions, which directly force changes in a causal variable, soft interventions exert influence indirectly by affecting the causal mechanism. However, the subtlety of soft interventions impose several challenges for learning causal models. One challenge is that soft intervention's effects are ambiguous, since parental relations remain intact. In this paper, we tackle the challenges of learning causal models using soft interventions while retaining implicit modeling. Our approach models the effects of soft interventions by employing a \textit{causal mechanism switch variable} designed to toggle between different causal mechanisms. In our experiments, we consistently observe improved learning of identifiable, causal representations, compared to baseline approaches.


title: See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot

abstract: While there is no replacement for the learned expertise, devotion, and social benefits of a guide dog, there are cases in which a robot navigation assistant could be helpful for individuals with blindness or low vision (BLV). This study investigated the potential for an industrial agile robot to perform guided navigation tasks. We developed two interface prototypes that allowed for spatial information between a human-robot pair: a voice-based app and a flexible, responsive handle. The participants (n=21) completed simple navigation tasks and a post-study survey about the prototype functionality and their trust in the robot. All participants successfully completed the navigation tasks and demonstrated the interface prototypes were able to pass spatial information between the human and the robot. Future work will include expanding the voice-based app to allow the robot to communicate obstacles to the handler and adding haptic signals to the handle design.


title: Kolmogorov n-Widths for Multitask Physics-Informed Machine Learning (PIML) Methods: Towards Robust Metrics

abstract: Physics-informed machine learning (PIML) as a means of solving partial differential equations (PDE) has garnered much attention in the Computational Science and Engineering (CS&E) world. This topic encompasses a broad array of methods and models aimed at solving a single or a collection of PDE problems, called multitask learning. PIML is characterized by the incorporation of physical laws into the training process of machine learning models in lieu of large data when solving PDE problems. Despite the overall success of this collection of methods, it remains incredibly difficult to analyze, benchmark, and generally compare one approach to another. Using Kolmogorov n-widths as a measure of effectiveness of approximating functions, we judiciously apply this metric in the comparison of various multitask PIML architectures. We compute lower accuracy bounds and analyze the model's learned basis functions on various PDE problems. This is the first objective metric for comparing multitask PIML architectures and helps remove uncertainty in model validation from selective sampling and overfitting. We also identify avenues of improvement for model architectures, such as the choice of activation function, which can drastically affect model generalization to "worst-case" scenarios, which is not observed when reporting task-specific errors. We also incorporate this metric into the optimization process through regularization, which improves the models' generalizability over the multitask PDE problem.


title: Q-Embroidery: A Study on Weaving Quantum Error Correction into the Fabric of Quantum Classifiers

abstract: Quantum computing holds transformative potential for various fields, yet its practical application is hindered by the susceptibility to errors. This study makes a pioneering contribution by applying quantum error correction codes (QECCs) for complex, multi-qubit classification tasks. We implement 1-qubit and 2-qubit quantum classifiers with QECCs, specifically the Steane code, and the distance 3 & 5 surface codes to analyze 2-dimensional and 4-dimensional datasets. This research uniquely evaluates the performance of these QECCs in enhancing the robustness and accuracy of quantum classifiers against various physical errors, including bit-flip, phase-flip, and depolarizing errors. The results emphasize that the effectiveness of a QECC in practical scenarios depends on various factors, including qubit availability, desired accuracy, and the specific types and levels of physical errors, rather than solely on theoretical superiority.


title: Strain activation of localized states in WSe2

abstract: We explore strain-activated emission centers formed by atomic force microscopy (AFM) indentation in monolayer \ce{WSe2} on a flexible polymer substrate. In the indented areas, we observe sharp new photoluminescence (PL) peaks characterized by sublinear power dependence in the spectral regions 1.62 $-$ 1.66 eV and 1.70 $-$ 1.73 eV. After low-temperature thermal annealing ($< 120$ $^{\circ}$C), \ce{WSe2} experiences strain relaxation, leading to a blue shift of the peaks' spectral position and their ultimate disappearance. Our analysis of peaks' position vs. strain allows drawing multiple conclusions regarding the nature of these emission centers. We elucidate the roles of excitonic confinement and hybridization between free excitons and defect-related states, a process activated by the level of strain. Overall, our approach suggests that the energy of localized emitters may be controlled via strain engineering.

categories: physics.app-ph cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering

abstract: Retrieval-augmented Large Language Models (LLMs) offer substantial benefits in enhancing performance across knowledge-intensive scenarios. However, these methods often face challenges with complex inputs and encounter difficulties due to noisy knowledge retrieval, notably hindering model effectiveness. To address this issue, we introduce BlendFilter, a novel approach that elevates retrieval-augmented LLMs by integrating query generation blending with knowledge filtering. BlendFilter proposes the blending process through its query generation method, which integrates both external and internal knowledge augmentation with the original query, ensuring comprehensive information gathering. Additionally, our distinctive knowledge filtering module capitalizes on the intrinsic capabilities of the LLM, effectively eliminating extraneous data. We conduct extensive experiments on three open-domain question answering benchmarks, and the findings clearly indicate that our innovative BlendFilter surpasses state-of-the-art baselines significantly.


title: Depth-dependent study of time-reversal symmetry-breaking in the kagome superconductor $A$V$_{3}$Sb$_{5}$

abstract: The breaking of time-reversal symmetry (TRS) in the normal state of kagome superconductors $A$V$_{3}$Sb$_{5}$ stands out as a significant feature. Yet the extent to which this effect can be tuned remains uncertain, a crucial aspect to grasp in light of the varying details of TRS breaking observed through different techniques. Here, we employ the unique low-energy muon spin rotation technique combined with local field numerical analysis to study the TRS breaking response as a function of depth from the surface in single crystals of RbV$_{3}$Sb$_{5}$ with charge order and Cs(V$_{0.86}$Ta$_{0.14}$)$_{3}$Sb$_{5}$ without charge order. In the bulk (i.e., > 33 nm from the surface) of RbV$_{3}$Sb$_{5}$, we have detected a notable increase in the internal magnetic field width experienced by the muon ensemble. This increase occurs only within the charge ordered state. Intriguingly, the muon spin relaxation rate is significantly enhanced near the surface (i.e., < 33 nm from the surface) of RbV$_{3}$Sb$_{5}$, and this effect commences at temperatures significantly higher than the onset of charge order. Conversely, in Cs(V$_{0.86}$Ta$_{0.14}$)$_{3}$Sb$_{5}$, we do not observe a similar enhancement in the internal field width, neither in the bulk nor near the surface. These observations indicate a strong connection between charge order and TRS breaking on one hand, and on the other hand, suggest that TRS breaking can occur prior to long-range charge order. This research offers compelling evidence for depth-dependent magnetism in $A$V$_{3}$Sb$_{5}$ superconductors in the presence of charge order. Such findings are likely to elucidate the intricate microscopic mechanisms that underpin the TRS breaking phenomena in these materials.


title: Speculative Streaming: Fast LLM Inference without Auxiliary Models

abstract: Speculative decoding is a prominent technique to speed up the inference of a large target language model based on predictions of an auxiliary draft model. While effective, in application-specific settings, it often involves fine-tuning both draft and target models to achieve high acceptance rates. As the number of downstream tasks grows, these draft models add significant complexity to inference systems. We propose Speculative Streaming, a single-model speculative decoding method that fuses drafting into the target model by changing the fine-tuning objective from next token prediction to future n-gram prediction. Speculative Streaming speeds up decoding by 1.8 - 3.1X in a diverse set of tasks, such as Summarization, Structured Queries, and Meaning Representation, without sacrificing generation quality. Additionally, Speculative Streaming is parameter-efficient. It achieves on-par/higher speed-ups than Medusa-style architectures while using ~10000X fewer extra parameters, making it well-suited for resource-constrained devices.


title: Evolution of strictly localized states in non-interacting quantum field theories with background fields

abstract: We investigate the construction of spin-1/2 fermionic and spin-0 bosonic wave-packets having compact spatial support in the framework of a computational quantum field theory (QFT) scheme offering space-time solutions of the relativistic wave equations in background fields. In order to construct perfectly localized wave-packets, we introduce a spatial density operator accounting for particles of both positive and negative charge. We examine properties of the vacuum and single-particle expectation values of this operator and compare them to the standard QFT particle and anti-particle spatial densities. The formalism is illustrated by computing numerically the Klein tunneling dynamics of strictly localized wave-packets impinging on a supercritical electrostatic step. The density operator introduced here could be useful to model situations in which it is desirable to avoid dealing with the infinite spatial tails intrinsic to pure particle or anti-particle wave-packets.


title: Two-Sample Hypothesis Testing for Large Random Graphs of Unequal Size

abstract: Two-sample hypothesis testing for large graphs is popular in cognitive science, probabilistic machine learning and artificial intelligence. While numerous methods have been proposed in the literature to address this problem, less attention has been devoted to scenarios involving graphs of unequal size or situations where there are only one or a few samples of graphs. In this article, we propose a Frobenius test statistic tailored for small sample sizes and unequal-sized random graphs to test whether they are generated from the same model or not. Our approach involves an algorithm for generating bootstrapped adjacency matrices from estimated community-wise edge probability matrices, forming the basis of the Frobenius test statistic. We derive the asymptotic distribution of the proposed test statistic and validate its stability and efficiency in detecting minor differences in underlying models through simulations. Furthermore, we explore its application to fMRI data where we are able to distinguish brain activity patterns when subjects are exposed to sentences and pictures for two different stimuli and the control group.


title: Functional Partial Least-Squares: Optimal Rates and Adaptation

abstract: We consider the functional linear regression model with a scalar response and a Hilbert space-valued predictor, a well-known ill-posed inverse problem. We propose a new formulation of the functional partial least-squares (PLS) estimator related to the conjugate gradient method. We shall show that the estimator achieves the (nearly) optimal convergence rate on a class of ellipsoids and we introduce an early stopping rule which adapts to the unknown degree of ill-posedness. Some theoretical and simulation comparison between the estimator and the principal component regression estimator is provided.

categories: math.ST econ.EM stat.CO stat.ME stat.ML stat.TH


title: Number of homogeneous components of counterexamples to the Dixmier conjecture

abstract: Assume that $P$ and $Q$ are elements of $A_1$ satisfying $[P,Q] = 1$. The Dixmier Conjecture for $A_1$ says that they always generate $A_1$. We show that if $P$ is a sum of not more than~$4$ homogeneous elements of $A_1$ then $P$ and $Q$ generate $A_1$, which generalizes the main result in arXiv:2210.00257.


title: Interbank network reconstruction enforcing density and reciprocity

abstract: Networks of financial exposures are the key propagators of risk and distress among banks, but their empirical structure is not publicly available because of confidentiality. This limitation has triggered the development of methods of network reconstruction from partial, aggregate information. Unfortunately, even the best methods available fail in replicating the number of directed cycles, which on the other hand play a crucial role in determining graph spectra and hence the degree of network stability and systemic risk. Here we address this challenge by exploiting the hypothesis that the statistics of higher-order cycles is strongly constrained by that of the shortest ones, i.e. by the amount of dyads with reciprocated links. First, we provide a detailed analysis of link reciprocity on the e-MID dataset of Italian banks, finding that correlations between reciprocal links systematically increase with the temporal resolution, typically changing from negative to positive around a timescale of up to 50 days. Then, we propose a new network reconstruction method capable of enforcing, only from the knowledge of aggregate interbank assets and liabilities, both a desired sparsity and a desired link reciprocity. We confirm that the addition of reciprocity dramatically improves the prediction of several structural and spectral network properties, including the largest real eigenvalue and the eccentricity of the elliptical distribution of the other eigenvalues in the complex plane. These results illustrate the importance of correctly addressing the temporal resolution and the resulting level of reciprocity in the reconstruction of financial networks.


title: TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks

abstract: While tabular classification has traditionally relied on from-scratch training, a recent breakthrough called prior-data fitted networks (PFNs) challenges this approach. Similar to large language models, PFNs make use of pretraining and in-context learning to achieve strong performance on new tasks in a single forward pass. However, current PFNs have limitations that prohibit their widespread adoption. Notably, TabPFN achieves very strong performance on small tabular datasets but is not designed to make predictions for datasets of size larger than 1000. In this work, we overcome these limitations and substantially improve the performance of PFNs by developing context optimization techniques for PFNs. Specifically, we propose TuneTables, a novel prompt-tuning strategy that compresses large datasets into a smaller learned context. TuneTables scales TabPFN to be competitive with state-of-the-art tabular classification methods on larger datasets, while having a substantially lower inference time than TabPFN. Furthermore, we show that TuneTables can be used as an interpretability tool and can even be used to mitigate biases by optimizing a fairness objective.


title: Contrastive Instruction Tuning

abstract: Instruction tuning has been used as a promising approach to improve the performance of large language models (LLMs) on unseen tasks. However, current LLMs exhibit limited robustness to unseen instructions, generating inconsistent outputs when the same instruction is phrased with slightly varied forms or language styles. This behavior indicates LLMs' lack of robustness to textual variations and generalizability to unseen instructions, potentially leading to trustworthiness issues. Accordingly, we propose Contrastive Instruction Tuning, which maximizes the similarity between the hidden representations of semantically equivalent instruction-instance pairs while minimizing the similarity between semantically different ones. To facilitate this approach, we augment the existing FLAN collection by paraphrasing task instructions. Experiments on the PromptBench benchmark show that CoIN consistently improves LLMs' robustness to unseen instructions with variations across character, word, sentence, and semantic levels by an average of +2.5% in accuracy. Code is available at https://github.com/luka-group/CoIN.


title: LiGNN: Graph Neural Networks at LinkedIn

abstract: In this paper, we present LiGNN, a deployed large-scale Graph Neural Networks (GNNs) Framework. We share our insight on developing and deployment of GNNs at large scale at LinkedIn. We present a set of algorithmic improvements to the quality of GNN representation learning including temporal graph architectures with long term losses, effective cold start solutions via graph densification, ID embeddings and multi-hop neighbor sampling. We explain how we built and sped up by 7x our large-scale training on LinkedIn graphs with adaptive sampling of neighbors, grouping and slicing of training data batches, specialized shared-memory queue and local gradient optimization. We summarize our deployment lessons and learnings gathered from A/B test experiments. The techniques presented in this work have contributed to an approximate relative improvements of 1% of Job application hearing back rate, 2% Ads CTR lift, 0.5% of Feed engaged daily active users, 0.2% session lift and 0.1% weekly active user lift from people recommendation. We believe that this work can provide practical solutions and insights for engineers who are interested in applying Graph neural networks at large scale.


title: Boosting of Thoughts: Trial-and-Error Problem Solving with Large Language Models

abstract: The reasoning performance of Large Language Models (LLMs) on a wide range of problems critically relies on chain-of-thought prompting, which involves providing a few chain of thought demonstrations as exemplars in prompts. Recent work, e.g., Tree of Thoughts, has pointed out the importance of exploration and self-evaluation in reasoning step selection for complex problem solving. In this paper, we present Boosting of Thoughts (BoT), an automated prompting framework for problem solving with LLMs by iteratively exploring and self-evaluating many trees of thoughts in order to acquire an ensemble of trial-and-error reasoning experiences, which will serve as a new form of prompting to solve the complex problem. Starting from a simple prompt without requiring examples, BoT iteratively explores and evaluates a large collection of reasoning steps, and more importantly, uses error analysis obtained from the LLM on them to explicitly revise prompting, which in turn enhances reasoning step generation, until a final answer is attained. Our experiments with GPT-4 and Llama2 across extensive complex mathematical problems demonstrate that BoT consistently achieves higher or comparable problem-solving rates than other advanced prompting approaches.


title: Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review

abstract: This review thoroughly examines the role of semantically-aware Neural Radiance Fields (NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It explores how NeRFs adeptly infer 3D representations for both stationary and dynamic objects in a scene. This capability is pivotal for generating high-quality new viewpoints, completing missing scene details (inpainting), conducting comprehensive scene segmentation (panoptic segmentation), predicting 3D bounding boxes, editing 3D scenes, and extracting object-centric 3D models. A significant aspect of this study is the application of semantic labels as viewpoint-invariant functions, which effectively map spatial coordinates to a spectrum of semantic labels, thus facilitating the recognition of distinct objects within the scene. Overall, this survey highlights the progression and diverse applications of semantically-aware neural radiance fields in the context of visual scene interpretation.


title: Grasping the Essentials: Tailoring Large Language Models for Zero-Shot Relation Extraction

abstract: Relation extraction (RE), a crucial task in NLP, aims to identify semantic relationships between entities mentioned in texts. Despite significant advancements in this field, existing models typically rely on extensive annotated data for training, which can be both costly and time-consuming to acquire. Moreover, these models often struggle to adapt to new or unseen relationships. In contrast, few-shot learning settings, which aim to reduce annotation requirements, may offer incomplete and biased supervision for understanding target relation semantics, leading to degraded and unstable performance. To provide the model with accurate and explicit descriptions of the relations types and meanwhile minimize the annotation requirements, we study the definition only zero-shot RE setting where only relation definitions expressed in natural language are used to train a RE model. Motivated by the strong synthetic data generation power of LLMs, we propose a framework REPaL which consists of three stages: (1) We utilize LLMs to generate initial seed instances based on relation definitions and an unlabeled corpora. (2) We fine-tune a bidirectional Small Language Model (SLM) using these initial seeds to learn the relations for the target domain. (3) We enhance pattern coverage and mitigate bias resulting from the limited number of initial seeds by incorporating feedback acquired from SLM's predictions on unlabeled corpora. To accomplish this, we leverage the multi-turn conversation ability of LLMs to generate new instances in follow-up dialogues. Experiments on two datasets show REPaL achieves better zero-shot performance with large margins over baseline methods.


title: Foundation Models for Recommender Systems: A Survey and New Perspectives

abstract: Recently, Foundation Models (FMs), with their extensive knowledge bases and complex architectures, have offered unique opportunities within the realm of recommender systems (RSs). In this paper, we attempt to thoroughly examine FM-based recommendation systems (FM4RecSys). We start by reviewing the research background of FM4RecSys. Then, we provide a systematic taxonomy of existing FM4RecSys research works, which can be divided into four different parts including data characteristics, representation learning, model type, and downstream tasks. Within each part, we review the key recent research developments, outlining the representative models and discussing their characteristics. Moreover, we elaborate on the open problems and opportunities of FM4RecSys aiming to shed light on future research directions in this area. In conclusion, we recap our findings and discuss the emerging trends in this field.


title: Saint-Venant Estimates and Liouville-Type Theorems for the Stationary Navier-Stokes Equation in $\mathbb{R}^3$

abstract: We prove two Liouville type theorems for the stationary Navier-Stokes equations in $\mathbb{R}^3$ under some assumptions on 1) the growth of the $L^s$ mean oscillation of a potential function of the velocity field, or 2) the relative decay of the head pressure and the square of the velocity field at infinity. The main idea is to use Saint-Venant type estimates to characterize the growth of Dirichlet energy of nontrivial solutions. These assumptions are weaker than those previously known of a similar nature.


title: Supporting Experts with a Multimodal Machine-Learning-Based Tool for Human Behavior Analysis of Conversational Videos

abstract: Multimodal scene search of conversations is essential for unlocking valuable insights into social dynamics and enhancing our communication. While experts in conversational analysis have their own knowledge and skills to find key scenes, a lack of comprehensive, user-friendly tools that streamline the processing of diverse multimodal queries impedes efficiency and objectivity. To solve it, we developed Providence, a visual-programming-based tool based on design considerations derived from a formative study with experts. It enables experts to combine various machine learning algorithms to capture human behavioral cues without writing code. Our study showed its preferable usability and satisfactory output with less cognitive load imposed in accomplishing scene search tasks of conversations, verifying the importance of its customizability and transparency. Furthermore, through the in-the-wild trial, we confirmed the objectivity and reusability of the tool transform experts' workflow, suggesting the advantage of expert-AI teaming in a highly human-contextual domain.


title: On dp-minimal expansions of the integers II

abstract: We first prove that if $\mathcal{Z}$ is a dp-minimal expansion of $\left(\mathbb{Z},+,0,1\right)$ which is not interdefinable with $\left(\mathbb{Z},+,0,1,<\right)$, then every infinite subset of $\mathbb{Z}$ definable in $\mathcal{Z}$ is generic in $\mathbb{Z}$. Using this, we prove that if $\mathcal{Z}$ is a dp-minimal expansion of $\left(\mathbb{Z},+,0,1\right)$ with monster model $G$ such that $G^{00}\neq G^{0}$, then for some $\alpha\in\mathbb{R}\backslash\mathbb{Q}$, the cyclic order on $\mathbb{Z}$ induced by the embedding $n\mapsto n\alpha+\mathbb{Z}$ of $\mathbb{Z}$ in $\mathbb{R}\big/\mathbb{Z}$ is definable in $\mathcal{Z}$. The proof employs the Gleason-Yamabe theorem for abelian groups.


title: Dense Core Collisions in Molecular Clouds: Formation of Streamers and Binary Stars

abstract: Dense core collisions, previously regarded as minor in star formation, are proposed to play a significant role in structure formation around protostellar envelopes and binary formation. Using archival data of nearby star-forming regions, we determine the frequencies of core collisions. Our calculations reveal that a typical core is likely to undergo multiple interactions with other cores throughout its lifetime. To further investigate the core collision process, we employ adaptive mesh refinement hydrodynamic simulations with sink particles. Our simulations demonstrate that following the formation of a protostar within a gravitationally-unstable core, the merging core's accreting gas gives rise to a rotationally-supported circumstellar disk. Meanwhile, the region compressed by the shock between the cores develops into asymmetric arms that connect with the disk. Gas along these arms tends to migrate inward, ultimately falling toward the protostar. One of the arms, a remnant of the shock-compressed region, dominates over the second core gas, potentially exhibiting a distinct chemical composition. This is consistent with recent findings of large-scale streamers around protostars. Additionally, we found that collisions with velocities of $\sim$ 1.5 km s$^{-1}$ result in the formation of a binary system, as evidenced by the emergence of a sink particle within the dense section of the shocked layer. Overall, dense core collisions are highlighted as a critical process in creating $10^3$ au-scale streamers around protostellar systems and binary stars.


title: Knowledge Distillation Based on Transformed Teacher Matching

abstract: As a technique to bridge logit matching and probability distribution matching, temperature scaling plays a pivotal role in knowledge distillation (KD). Conventionally, temperature scaling is applied to both teacher's logits and student's logits in KD. Motivated by some recent works, in this paper, we drop instead temperature scaling on the student side, and systematically study the resulting variant of KD, dubbed transformed teacher matching (TTM). By reinterpreting temperature scaling as a power transform of probability distribution, we show that in comparison with the original KD, TTM has an inherent R\'enyi entropy term in its objective function, which serves as an extra regularization term. Extensive experiment results demonstrate that thanks to this inherent regularization, TTM leads to trained students with better generalization than the original KD. To further enhance student's capability to match teacher's power transformed probability distribution, we introduce a sample-adaptive weighting coefficient into TTM, yielding a novel distillation approach dubbed weighted TTM (WTTM). It is shown, by comprehensive experiments, that although WTTM is simple, it is effective, improves upon TTM, and achieves state-of-the-art accuracy performance. Our source code is available at https://github.com/zkxufo/TTM.


title: Indications and implications of a borehole seismic monitoring result of the San Andreas Fault foresee future earthquake prediction

abstract: The Parkfield M6 earthquake predicted from 1985 by the USGS to happen by 1993 happened 11 years later in 2004 instead. Till today, satisfactory answers to why this earthquake was mis-predicted have not been found. Seven months after the earthquake, we deployed a seismic array in the SAFOD main hole to monitor the San Andreas Fault. During a 13 days period, we recorded 220 earthquake events. By analyzing the projected hypocenters of 100 earthquake events, we found three main active sub-faults, namely SAF1, SAF2, and SAF3, with SAF1 being the normally regarded SAF. During the monitoring period, there was an earthquake migration trend that shows the move of SAF1 drags SAF2, which in turn drags SAF3, to slip and dip downwards. This could be reflected by the result of a geological trenching across the SAF. On SAF1, the smaller earthquakes tended to occur earlier in southeast and the larger earthquakes tended to occur later in northwest, which could indicate the existence of strong asperities. However, the new earthquakes on SAF2 were overall remarkably smaller, which could indicate that during the 2004 M6 earthquake the main underground rupture took place on SAF2, which could extend with a bend near Parkfield town to the Southwest Fracture Zone, and further to include the seemingly isolated 2004 M6 hypocenter. The possible prevailing of this triple active sub-faults model in the Parkfield area may account for 12, 24 or 36 (instead of a single 22 years as previously believed) recurring years of M6 earthquakes, depending on how many of these active sub-faults have basically absorbed the tectonic stress. In less than 0.1% of the earthquake's last intermission time, and at just one location, our borehole seismic monitoring has revealed so much insightful information that earthquake prediction may be feasible if the fault is monitored in boreholes at more locations and for longer periods of time.


title: A Relativistic Framework to Establish Coordinate Time on the Moon and Beyond

abstract: As humanity aspires to explore the solar system and investigate distant worlds such as the Moon, Mars, and beyond, there is a growing need to establish and broaden coordinate time references that depend on the rate of standard clocks. According to Einstein's theory of relativity, the rate of a standard clock is influenced by the gravitational potential at the location of the clock and the relative motion of the clock. A coordinate time reference is established by a grid of synchronized clocks traceable to an ideal clock at a predetermined point in space. This allows for the comparison of local time variations of clocks due to gravitational and kinematic effects. We present a relativistic framework to introduce a coordinate time for the Moon. This framework also establishes a relationship between the coordinate times for the Moon and the Earth as determined by standard clocks located on the Earth's geoid and the Moon's equator. A clock near the Moon's equator ticks faster than one near the Earth's equator, accumulating an extra 56.02 microseconds per day over the duration of a lunar orbit. This formalism is then used to compute the clock rates at Earth-Moon Lagrange points. Accurate estimation of the rate differences of coordinate times across celestial bodies and their inter-comparisons using clocks onboard orbiters at relatively stable Lagrange points as time transfer links is crucial for establishing reliable communications infrastructure. This understanding also underpins precise navigation in cislunar space and on celestial bodies' surfaces, thus playing a pivotal role in ensuring the interoperability of various position, navigation, and timing (PNT) systems spanning from Earth to the Moon and to the farthest regions of the inner solar system.


title: A Landscape Study of Open Source and Proprietary Tools for Software Bill of Materials (SBOM)

abstract: Modern software applications heavily rely on diverse third-party components, libraries, and frameworks sourced from various vendors and open source repositories, presenting a complex challenge for securing the software supply chain. To address this complexity, the adoption of a Software Bill of Materials (SBOM) has emerged as a promising solution, offering a centralized repository that inventories all third-party components and dependencies used in an application. Recent supply chain breaches, exemplified by the SolarWinds attack, underscore the urgent need to enhance software security and mitigate vulnerability risks, with SBOMs playing a pivotal role in this endeavor by revealing potential vulnerabilities, outdated components, and unsupported elements. This research paper conducts an extensive empirical analysis to assess the current landscape of open-source and proprietary tools related to SBOM. We investigate emerging use cases in software supply chain security and identify gaps in SBOM technologies. Our analysis encompasses 84 tools, providing a snapshot of the current market and highlighting areas for improvement.