title: Learning to Guide Multiple Heterogeneous Actors from a Single Human Demonstration via Automatic Curriculum Learning in StarCraft II

abstract: Traditionally, learning from human demonstrations via direct behavior cloning can lead to high-performance policies given that the algorithm has access to large amounts of high-quality data covering the most likely scenarios to be encountered when the agent is operating. However, in real-world scenarios, expert data is limited and it is desired to train an agent that learns a behavior policy general enough to handle situations that were not demonstrated by the human expert. Another alternative is to learn these policies with no supervision via deep reinforcement learning, however, these algorithms require a large amount of computing time to perform well on complex tasks with high-dimensional state and action spaces, such as those found in StarCraft II. Automatic curriculum learning is a recent mechanism comprised of techniques designed to speed up deep reinforcement learning by adjusting the difficulty of the current task to be solved according to the agent's current capabilities. Designing a proper curriculum, however, can be challenging for sufficiently complex tasks, and thus we leverage human demonstrations as a way to guide agent exploration during training. In this work, we aim to train deep reinforcement learning agents that can command multiple heterogeneous actors where starting positions and overall difficulty of the task are controlled by an automatically-generated curriculum from a single human demonstration. Our results show that an agent trained via automated curriculum learning can outperform state-of-the-art deep reinforcement learning baselines and match the performance of the human expert in a simulated command and control task in StarCraft II modeled over a real military scenario.


title: Real-Time Packet Loss Concealment With Mixed Generative and Predictive Model

abstract: As deep speech enhancement algorithms have recently demonstrated capabilities greatly surpassing their traditional counterparts for suppressing noise, reverberation and echo, attention is turning to the problem of packet loss concealment (PLC). PLC is a challenging task because it not only involves real-time speech synthesis, but also frequent transitions between the received audio and the synthesized concealment. We propose a hybrid neural PLC architecture where the missing speech is synthesized using a generative model conditioned using a predictive model. The resulting algorithm achieves natural concealment that surpasses the quality of existing conventional PLC algorithms and ranked second in the Interspeech 2022 PLC Challenge. We show that our solution not only works for uncompressed audio, but is also applicable to a modern speech codec.


title: Beyond Barren Plateaus: Quantum Variational Algorithms Are Swamped With Traps

abstract: One of the most important properties of classical neural networks is how surprisingly trainable they are, though their training algorithms typically rely on optimizing complicated, nonconvex loss functions. Previous results have shown that unlike the case in classical neural networks, variational quantum models are often not trainable. The most studied phenomenon is the onset of barren plateaus in the training landscape of these quantum models, typically when the models are very deep. This focus on barren plateaus has made the phenomenon almost synonymous with the trainability of quantum models. Here, we show that barren plateaus are only a part of the story. We prove that a wide class of variational quantum models -- which are shallow, and exhibit no barren plateaus -- have only a superpolynomially small fraction of local minima within any constant energy from the global minimum, rendering these models untrainable if no good initial guess of the optimal parameters is known. We also study the trainability of variational quantum algorithms from a statistical query framework, and show that noisy optimization of a wide variety of quantum models is impossible with a sub-exponential number of queries. Finally, we numerically confirm our results on a variety of problem instances. Though we exclude a wide variety of quantum algorithms here, we give reason for optimism for certain classes of variational algorithms and discuss potential ways forward in showing the practical utility of such algorithms.


title: Bridging Model-based Safety and Model-free Reinforcement Learning through System Identification of Low Dimensional Linear Models

abstract: Bridging model-based safety and model-free reinforcement learning (RL) for dynamic robots is appealing since model-based methods are able to provide formal safety guarantees, while RL-based methods are able to exploit the robot agility by learning from the full-order system dynamics. However, current approaches to tackle this problem are mostly restricted to simple systems. In this paper, we propose a new method to combine model-based safety with model-free reinforcement learning by explicitly finding a low-dimensional model of the system controlled by a RL policy and applying stability and safety guarantees on that simple model. We use a complex bipedal robot Cassie, which is a high dimensional nonlinear system with hybrid dynamics and underactuation, and its RL-based walking controller as an example. We show that a low-dimensional dynamical model is sufficient to capture the dynamics of the closed-loop system. We demonstrate that this model is linear, asymptotically stable, and is decoupled across control input in all dimensions. We further exemplify that such linearity exists even when using different RL control policies. Such results point out an interesting direction to understand the relationship between RL and optimal control: whether RL tends to linearize the nonlinear system during training in some cases. Furthermore, we illustrate that the found linear model is able to provide guarantees by safety-critical optimal control framework, e.g., Model Predictive Control with Control Barrier Functions, on an example of autonomous navigation using Cassie while taking advantage of the agility provided by the RL-based controller.


title: Hybrid ab initio method for examining thermal properties in magnetic materials

abstract: A hybrid ab initio theoretical approach for examining thermal properties in magnetic systems of unknown entropy is presented. Commonly used theoretical approaches interrogate thermal properties from Gibbs/Helmholtz free energies, which require an accurate model of magnetic interactions. The present approach avoids this requirement by instead calculating system pressure from thermally disordered microstates that properly incorporate vibrational and spin subsystems at each temperature as well as the coupling between these subsystems. In place of a specific model for magnetic interactions, the approach integrates measurements of temperature dependent magnetization of the studied material. We apply the approach to calculate phonon modes and to investigate the anomalously low thermal expansion of the classical Invar alloy, Fe_0.65Ni_0.35. The calculated phonon dispersions for Invar are in excellent agreement with measured data. The Invar thermal expansion is shown to remain small between 50 K and room temperature, consistent with the experimentally observed low thermal expansion value in this same temperature range. This anomalously small thermal expansion is directly connected to a small positive contribution from lattice thermal disorder that is nearly canceled by a large negative magnetic disorder contribution. By contrast, calculations for bcc Fe show a much larger thermal expansion, consistent with experiment, which is dominated by a large contribution from lattice thermal disorder that is reduced only slightly by a small negative contribution from that of magnetism. These findings give insights into the unusual nature of magnetism and spin-lattice coupling in Invar and Fe, and they support the presented new methodology as a complementary way to investigate thermal properties of magnetic materials.


title: RITA: a Study on Scaling Up Generative Protein Sequence Models

abstract: In this work we introduce RITA: a suite of autoregressive generative models for protein sequences, with up to 1.2 billion parameters, trained on over 280 million protein sequences belonging to the UniRef-100 database. Such generative models hold the promise of greatly accelerating protein design. We conduct the first systematic study of how capabilities evolve with model size for autoregressive transformers in the protein domain: we evaluate RITA models in next amino acid prediction, zero-shot fitness, and enzyme function prediction, showing benefits from increased scale. We release the RITA models openly, to the benefit of the research community.


title: Minimal model for active particles confined in a two-state micropattern

abstract: We propose a minimal model, based on active Brownian particles, for the dynamics of cells confined in a two-state micropattern, composed of two rectangular boxes connected by a bridge, and investigate the transition statistics. A transition between boxes occurs when the active particle crosses the center of the bridge, and the time between subsequent transitions is the dwell time. By assuming that the rotational diffusion time $\tau$ is a function of the position, the main features of the transition statistics observed experimentally are recovered. $\tau$ controls the transition from a ballistic regime at short time scales to a diffusive regime at long time scales, with an effective diffusion coefficient proportional to $\tau$. For small values of $\tau$, the dwell time is determined by the characteristic diffusion timescale which decays with $\tau$. For large values of $\tau$, the interaction with the walls dominates and the particle stays mostly at the corners of the boxes increasing the dwell time. We find that there is an optimal $\tau$ for which the dwell time is minimal and its value can be tuned by changing the geometry of the pattern.


title: Calabi-Yau/Landau-Ginzburg Correspondence for Weil-Peterson Metrics and $tt^*$ Structures

abstract: The aim of this paper is to rigorously establish the Calabi-Yau/Landau-Ginzburg (CY/LG) correspondence for the $tt^*$ geometry structure--a generalized version of variation of Hodge structures. Although it is well-known that there exists a map between Hodge structures on the LG and CY's sides that preserves the Hodge filtration and bilinear form, it remains unclear whether the real structures are also preserved. In our paper, we conduct a detailed analysis of two period integrals on the LG's side. Based on this analysis, we modify the real structure proposed by Cecotti on LG's side, and show that the aforementioned map is also preserved under the modified real structure. As a result, we establish full CY/LG correspondence for $tt^*$ structures.


title: Approximately Strongly Regular Graphs

abstract: We give variants of the Krein bound and the absolute bound for graphs with a spectrum similar to that of a strongly regular graph. In particular, we investigate what we call approximately strongly regular graphs. We apply our results to extremal problems. Among other things, we show the following: (1) Caps in $\mathrm{PG}(n, q)$ for which the number of secants on exterior points does not vary too much, have size at most $O(q^{\frac34 n})$ (as $q \rightarrow \infty$ or as $n \rightarrow \infty$). (2) Optimally pseudorandom $K_m$-free graphs of order $v$ and degree $k$ for which the induced subgraph on the common neighborhood of a clique of size $i \leq m-3$ is similar to a strongly regular graph, have $k = O(v^{1 - \frac{1}{3m-2i-5}})$.


title: Robustness Guarantees for Credal Bayesian Networks via Constraint Relaxation over Probabilistic Circuits

abstract: In many domains, worst-case guarantees on the performance (e.g., prediction accuracy) of a decision function subject to distributional shifts and uncertainty about the environment are crucial. In this work we develop a method to quantify the robustness of decision functions with respect to credal Bayesian networks, formal parametric models of the environment where uncertainty is expressed through credal sets on the parameters. In particular, we address the maximum marginal probability (MARmax) problem, that is, determining the greatest probability of an event (such as misclassification) obtainable for parameters in the credal set. We develop a method to faithfully transfer the problem into a constrained optimization problem on a probabilistic circuit. By performing a simple constraint relaxation, we show how to obtain a guaranteed upper bound on MARmax in linear time in the size of the circuit. We further theoretically characterize this constraint relaxation in terms of the original Bayesian network structure, which yields insight into the tightness of the bound. We implement the method and provide experimental evidence that the upper bound is often near tight and demonstrates improved scalability compared to other methods.


title: Deep-Learned Generators of Porosity Distributions Produced During Metal Additive Manufacturing

abstract: Laser Powder Bed Fusion has become a widely adopted method for metal Additive Manufacturing (AM) due to its ability to mass produce complex parts with increased local control. However, AM produced parts can be subject to undesirable porosity, negatively influencing the properties of printed components. Thus, controlling porosity is integral for creating effective parts. A precise understanding of the porosity distribution is crucial for accurately simulating potential fatigue and failure zones. Previous research on generating synthetic porous microstructures have succeeded in generating parts with high density, isotropic porosity distributions but are often inapplicable to cases with sparser, boundary-dependent pore distributions. Our work bridges this gap by providing a method that considers these constraints by deconstructing the generation problem into its constitutive parts. A framework is introduced that combines Generative Adversarial Networks with Mallat Scattering Transform-based autocorrelation methods to construct novel realizations of the individual pore geometries and surface roughness, then stochastically reconstruct them to form realizations of a porous printed part. The generated parts are compared to the existing experimental porosity distributions based on statistical and dimensional metrics, such as nearest neighbor distances, pore volumes, pore anisotropies and scattering transform based auto-correlations.


title: Algebraic Machine Learning with an Application to Chemistry

abstract: As datasets used in scientific applications become more complex, studying the geometry and topology of data has become an increasingly prevalent part of the data analysis process. This can be seen for example with the growing interest in topological tools such as persistent homology. However, on the one hand, topological tools are inherently limited to providing only coarse information about the underlying space of the data. On the other hand, more geometric approaches rely predominately on the manifold hypothesis, which asserts that the underlying space is a smooth manifold. This assumption fails for many physical models where the underlying space contains singularities. In this paper we develop a machine learning pipeline that captures fine-grain geometric information without having to rely on any smoothness assumptions. Our approach involves working within the scope of algebraic geometry and algebraic varieties instead of differential geometry and smooth manifolds. In the setting of the variety hypothesis, the learning problem becomes to find the underlying variety using sample data. We cast this learning problem into a Maximum A Posteriori optimization problem which we solve in terms of an eigenvalue computation. Having found the underlying variety, we explore the use of Gr\"obner bases and numerical methods to reveal information about its geometry. In particular, we propose a heuristic for numerically detecting points lying near the singular locus of the underlying variety.


title: Infrared line emissions from atoms and atomic ions in NGC 7027: improved wavelength determinations for infrared metal lines and a probable detection of Zn$^{5+}$

abstract: An infrared L- and M-band spectral survey, performed toward the young planetary nebula NGC 7027 with the iSHELL instrument on NASA's Infrared Telescope Facility (IRTF), has revealed more than 20 vibrational lines of the molecules HeH$^+$, H$_2$, and CH$^+$ and more than 50 spectral lines of atoms and atomic ions. The present paper focuses on the atomic line emissions, the molecular lines having been discussed in two previous publications (Neufeld et al. 2020, 2021). The atomic lines detected with high confidence in the 2.951 - 5.24 micron region covered (incompletely) by this survey comprise (1) six collisionally-excited lines of metal ions that had previously been identified in astrophysical nebulae but for which the present observations provide the most accurate wavelength determinations obtained to date; (2) a spectral line at 4.6895 micron, not previously reported, for which the probable identification is the $^4F_{7/2} - $ $^4F_{9/2}$ fine structure transition of [Zn VI]; (3) 39 recombination lines of H and He$^+$, with upper states of principal quantum number up to 38 (H) or 24 (He$^+$); (4) 10 recombination lines of the multielectron species He, C$^{2+}$, and C$^{3+}$.


abstract: A single-field-period quasi-isodynamic stellarator configuration is presented. This configuration, which resembles a twisted strip, is obtained by the method of direct construction, that is, it is found via an expansion in the distance from the magnetic axis. Its discovery, however, relied on an additional step involving numerical optimization, performed within the space of near-axis configurations defined by a set of adjustable magnetic-field parameters. This optimization, completed in 30 seconds on a single cpu core using the SIMSOPT code, yields a solution with excellent confinement, as measured by the conventional figure of merit for neoclassical transport, effective ripple, at a modest aspect ratio of eight. The optimization parameters that led to this configuration are described, its confinement properties are assessed, and a set of magnetic-field coils is found. The resulting transport at low collisionality is much smaller than that of W7-X, and the device needs significantly fewer coils thanks to the reduced number of field periods.


title: Leveraging isotopologues as a general strategy to image neurotransmitters with vibrational microscopy

abstract: Chemical neurotransmission is central to neurotypical brain function but also implicated in a variety of psychiatric and neurodegenerative diseases. The release dynamics of neurotransmitters is correlated with but distinct from electrical signal propagation. It is therefore necessary to track neurotransmitter modulation separately from electrical activity. Here, we present a new approach for imaging deuterated neurotransmitter molecules with vibrational microscopy in the cell-silent window. Using stimulated Raman scattering microscopy, we perform direct imaging of the neurotransmitters dopamine and GABA in PC12 chromafin cells, and primary hippocampal neurons, respectively, based on their C-D vibrational frequencies. We find that isotope labelling does not perturb neurochemical activity. We further show that stimulation of neurotransmitter release results in an overall 20-50% signal reduction, with the ability to observe inter- and intracellular variation in vesicular release potential. Taken together, our data suggest that neurotransmitter isotopologues can serve as a generic, non-perturbative, method to image neurotransmitters.


title: Configurational entropy, transition rates, and optimal interactions for rapid folding in coarse-grained model proteins

abstract: Under certain conditions, the dynamics of coarse-grained models of solvated proteins can be described using a Markov state model, which tracks the evolution of populations of configurations. The transition rates among states that appear in the Markov model can be determined by computing the relative entropy of states and their mean first passage times. In this paper, we present an adaptive method to evaluate the configurational entropy and the mean first passage times for linear chain models with discontinuous potentials. The approach is based on event-driven dynamical sampling in a massively parallel architecture. Using the fact that the transition rate matrix can be calculated for any choice of interaction energies at any temperature, it is demonstrated how each state's energy can be chosen such that the average time to transition between any two states is minimized. The methods are used to analyze the optimization of the folding process of two protein systems: the crambin protein, and a model with frustration and misfolding. It is shown that the folding pathways for both systems are comprised of two regimes: first, the rapid establishment of local bonds, followed by the subsequent formation of more distant contacts. The state energies that lead to the most rapid folding encourage multiple pathways, and either penalize folding pathways through kinetic traps by raising the energies of trapping states, or establish an escape route from the trapping states by lowering free energy barriers to other states that rapidly reach the native state.


title: Stochastic first-order methods for average-reward Markov decision processes

abstract: We study the problem of average-reward Markov decision processes (AMDPs) and develop novel first-order methods with strong theoretical guarantees for both policy evaluation and optimization. Existing on-policy evaluation methods suffer from sub-optimal convergence rates as well as failure in handling insufficiently random policies, e.g., deterministic policies, for lack of exploration. To remedy these issues, we develop a novel variance-reduced temporal difference (VRTD) method with linear function approximation for randomized policies along with sharp convergence guarantees, and an exploratory variance-reduced temporal difference (EVRTD) method for insufficiently random policies with comparable convergence guarantees. We further establish linear convergence rate on the bias of policy evaluation, which is essential for improving the overall sample complexity of policy optimization. On the other hand, compared with intensive research interest in finite sample analysis of policy gradient methods for discounted MDPs, existing studies on policy gradient methods for AMDPs mostly focus on regret bounds under restrictive assumptions on the underlying Markov processes (see, e.g., Abbasi-Yadkori et al., 2019), and they often lack guarantees on the overall sample complexities. Towards this end, we develop an average-reward variant of the stochastic policy mirror descent (SPMD) (Lan, 2022). We establish the first $\widetilde{\mathcal{O}}(\epsilon^{-2})$ sample complexity for solving AMDPs with policy gradient method under both the generative model (with unichain assumption) and Markovian noise model (with ergodic assumption). This bound can be further improved to $\widetilde{\mathcal{O}}(\epsilon^{-1})$ for solving regularized AMDPs. Our theoretical advantages are corroborated by numerical experiments.


title: Study of Self-Interaction Errors in Density Functional Calculations of Magnetic Exchange Coupling Constants Using Three Self-Interaction Correction Methods

abstract: We examine the role of self-interaction errors (SIE) removal on the evaluation of magnetic exchange coupling constants. In particular we analyze the effect of scaling down the self-interaction-correction (SIC) for three {\em non-empirical} density functional approximations (DFAs) namely, the local spin density approximation, the Perdew-Burke-Ernzerhof generalized gradient approximation, and recent SCAN family of meta-GGA functionals. To this end, we employ three one-electron SIC methods: Perdew-Zunger [Perdew, J. P.; Zunger, A. \textit{Phys. Rev. B}, {\bf 1981}, \textit{23}, 5048] SIC, the orbitalwise scaled SIC method [Vydrov, O. A. \textit{et al.}, \textit{J. Chem. Phys.} {\bf 2006,} \textit{124}, 094108], and the recent {local} scaling method [Zope, R. R. \textit{et al.}, \textit{J. Chem. Phys.} {\bf 2019}, \textit{151}, 214108]. We compute the magnetic exchange coupling constants using the spin projection and non projection approaches for sets of molecules composed of dinuclear and polynuclear H--He models, organic radical molecules, and chlorocuprate, and compare these results against accurate theories and experiment. Our results show that for the systems that mainly consist of single electron regions, PZSIC performs well but for more complex organic systems and the chlorcuprates, an overcorrecting tendency of PZSIC combined with the DFAs utilized in this work is more pronounced, and in such cases LSIC with kinetic energy density ratio performs better than PZSIC. Analysis of the results in terms of SIC corrections to the density and to the total energy shows that both density and energy correction are required to obtain an improved prediction of magnetic exchange couplings.


title: Study of self-interaction-errors in barrier heights using locally scaled and Perdew-Zunger self-interaction methods

abstract: We study the effect of self-interaction errors on the barrier heights of chemical reactions. For this purpose we use the well-known Perdew-Zunger [J. P. Perdew and A. Zunger, Phys. Rev. B, {\bf 23}, 5048 (1981)] self-interaction-correction (PZSIC), as well as two variations of the recently developed, locally scaled self-interaction correction (LSIC) [R. R. Zope \textit{et al.}, J. Chem. Phys. {\bf 151}, 214108 (2019)] to study the barrier heights of the BH76 benchmark dataset. Our results show that both PZSIC and especially the LSIC methods improve the barrier heights relative to the local density approximation (LDA). The version of LSIC that uses the iso-orbital indicator $z$ as a scaling factor gives a more consistent improvement than an alternative version that uses an orbital-dependent factor $w$ based on the ratio of orbital densities to the total electron density. We show that LDA energies evaluated using the self-consistent and self-interaction-free PZSIC densities can be used to assess density-driven errors. The LDA reaction barrier errors for the BH76 set are found to contain significant density-driven errors for all types of reactions contained in the set, but the corrections due to adding SIC to the functional are much larger than those stemming from the density for the hydrogen transfer reactions and of roughly equal size for the non-hydrogen transfer reactions.


title: AI and Theoretical Particle Physics

abstract: Theoretical particle physicists continue to push the envelope in both high performance computing and in managing and analyzing large data sets. For example, the goals of sub-percent accuracy in predictions of quantum chromodynamics (QCD) using large scale simulations of lattice QCD and in finding signals of rare events and new physics in exabytes of data produced by experiments at the high luminosity large hadron collider (LHC) require new tools beyond just developments in hardware. Machine learning and artificial intelligence offer the promise of dramatically reducing the computational cost and time. This chapter reviews selected areas where AI/ML tools could have a major impact, provides an overview of the challenges, and discusses how new ideas such as normalizing flows can speed up the generation of gauge configurations needed in lattice QCD calculations; the growth of ML in surrogate models and pattern matching to reduce the cost of event generators and in the analysis of experimental data; and in the search for viable vacua in the landscape of string theories. While such approaches transform aspects of particle theory into computational problems, and thus black boxes, we argue that physics-aware development of these tools combined with algorithms that ensure that the results are bias free will continue to require a deep understanding of the physics. We see this broader transformation as akin to formulating and extracting observables from simulations of lattice QCD, a numerical integration of the path integral formulation of QCD that nevertheless requires a deep understanding of the underlying quantum field theory, the standard model of particle physics and effective field theory methods.


title: Dimension-adaptive machine-learning-based quantum state reconstruction

abstract: We introduce an approach for performing quantum state reconstruction on systems of $n$ qubits using a machine-learning-based reconstruction system trained exclusively on $m$ qubits, where $m\geq n$. This approach removes the necessity of exactly matching the dimensionality of a system under consideration with the dimension of a model used for training. We demonstrate our technique by performing quantum state reconstruction on randomly sampled systems of one, two, and three qubits using machine-learning-based methods trained exclusively on systems containing at least one additional qubit. The reconstruction time required for machine-learning-based methods scales significantly more favorably than the training time; hence this technique can offer an overall savings of resources by leveraging a single neural network for dimension-variable state reconstruction, obviating the need to train dedicated machine-learning systems for each Hilbert space.


title: SubER: A Metric for Automatic Evaluation of Subtitle Quality

abstract: This paper addresses the problem of evaluating the quality of automatically generated subtitles, which includes not only the quality of the machine-transcribed or translated speech, but also the quality of line segmentation and subtitle timing. We propose SubER - a single novel metric based on edit distance with shifts that takes all of these subtitle properties into account. We compare it to existing metrics for evaluating transcription, translation, and subtitle quality. A careful human evaluation in a post-editing scenario shows that the new metric has a high correlation with the post-editing effort and direct human assessment scores, outperforming baseline metrics considering only the subtitle text, such as WER and BLEU, and existing methods to integrate segmentation and timing features.


title: Reduced Plasma Frequency Calculation Based on Particle-In-Cell Simulations

abstract: We propose a scheme to calculate the reduced plasma frequency of a cylindrical-shaped electron beam flowing inside of a cylindrical tunnel, based on results obtained from Particle-in-cell (PIC) simulations. In PIC simulations, we modulate the electron beam using two parallel, non-intercepting, closely-spaced grids which are electrically connected together by a single-tone sinusoidal voltage source. The electron energy and the beam current distributions along the length of the tunnel are monitored after the system is operating at steady-state. We build a system matrix describing the beam's dynamics, estimated by fitting a 2x2 matrix that best agrees with the first order differential equations that govern the physics-based system. Results are compared with the theoretical Branch and Mihran model, which is typically used to compute the plasma frequency reduction factor in such systems. Our method shows excellent agreement with the theoretical model, however, it is also general. Our method can be potentially utilized to determine the reduced plasma frequencies of electron beams propagating in differently-shaped beam tunnels, where no theoretical model yet exists, such as the case of a cylindrical or elliptical electron beam propagating inside of a metallic beam tunnel of cylindrical, square, or elliptical cross-section. It can be applied also to electron beams composed of multiple streams.


title: AppTek's Submission to the IWSLT 2022 Isometric Spoken Language Translation Task

abstract: To participate in the Isometric Spoken Language Translation Task of the IWSLT 2022 evaluation, constrained condition, AppTek developed neural Transformer-based systems for English-to-German with various mechanisms of length control, ranging from source-side and target-side pseudo-tokens to encoding of remaining length in characters that replaces positional encoding. We further increased translation length compliance by sentence-level selection of length-compliant hypotheses from different system variants, as well as rescoring of N-best candidates from a single system. Length-compliant back-translated and forward-translated synthetic data, as well as other parallel data variants derived from the original MuST-C training corpus were important for a good quality/desired length trade-off. Our experimental results show that length compliance levels above 90% can be reached while minimizing losses in MT quality as measured in BERT and BLEU scores.


title: Pauli component erasing quantum channels

abstract: Decoherence of quantum systems is described by quantum channels. However, a complete understanding of such channels, especially in the multi-particle setting, is still an ongoing difficult task. We propose the family of quantum maps that preserve or completely erase the components of a multi-qubit system in the basis of Pauli strings, which we call Pauli component erasing maps. For the corresponding channels, it is shown that the preserved components can be interpreted as a finite vector subspace, from which we derive several properties and complete the characterization. Moreover, we show that the obtained family of channels forms a semigroup and derive its generators. We use this simple structure to determine physical implementations and connect the obtained family of channels with Markovian processes.


title: Topology and Chirality

abstract: Topology, a well-established concept in mathematics, has nowadays become essential to describe condensed matter. At its core are chiral electron states on the bulk, surfaces and edges of the condensed matter systems, in which spin and momentum of the electrons are locked parallel or anti-parallel to each other. Magnetic and non-magnetic Weyl semimetals, for example, exhibit chiral bulk states that have enabled the realization of predictions from high energy and astrophysics involving the chiral quantum number, such as the chiral anomaly, the mixed axial-gravitational anomaly and axions. The potential for connecting chirality as a quantum number to other chiral phenomena across different areas of science, including the asymmetry of matter and antimatter and the homochirality of life, brings topological materials to the fore.


title: Performing Video Frame Prediction of Microbial Growth with a Recurrent Neural Network

abstract: A Recurrent Neural Network (RNN) was used to perform video frame prediction of microbial growth for a population of two mutants of Pseudomonas aeruginosa. The RNN was trained on videos of 20 frames that were acquired using fluorescence microscopy and microfluidics. The network predicted the last 10 frames of each video, and the accuracy's of the predictions was assessed by comparing raw images, population curves, and the number and size of individual colonies. Overall, we found the predictions to be accurate using this approach. The implications this result has on designing autonomous experiments in microbiology, and the steps that can be taken to make the predictions even more accurate, are discussed.


title: Efficient Recovery of Low Rank Tensor via Triple Nonconvex Nonsmooth Rank Minimization

abstract: A tensor nuclear norm (TNN) based method for solving the tensor recovery problem was recently proposed, and it has achieved state-of-the-art performance. However, it may fail to produce a highly accurate solution since it tends to treats each frontal slice and each rank component of each frontal slice equally. In order to get a recovery with high accuracy, we propose a general and flexible rank relaxation function named double weighted nonconvex nonsmooth rank (DWNNR) relaxation function for efficiently solving the third order tensor recovery problem. The DWNNR relaxation function can be derived from the triple nonconvex nonsmooth rank (TNNR) relaxation function by setting the weight vector to be the hypergradient value of some concave function, thereby adaptively selecting the weight vector. To accelerate the proposed model, we develop the general inertial smoothing proximal gradient method. Furthermore, we prove that any limit point of the generated subsequence is a critical point. Combining the Kurdyka-Lojasiewicz (KL) property with some milder assumptions, we further give its global convergence guarantee. Experimental results on a practical tensor completion problem with both synthetic and real data, the results of which demonstrate the efficiency and superior performance of the proposed algorithm.


title: Open Vocabulary Extreme Classification Using Generative Models

abstract: The extreme multi-label classification (XMC) task aims at tagging content with a subset of labels from an extremely large label set. The label vocabulary is typically defined in advance by domain experts and assumed to capture all necessary tags. However in real world scenarios this label set, although large, is often incomplete and experts frequently need to refine it. To develop systems that simplify this process, we introduce the task of open vocabulary XMC (OXMC): given a piece of content, predict a set of labels, some of which may be outside of the known tag set. Hence, in addition to not having training data for some labels - as is the case in zero-shot classification - models need to invent some labels on-the-fly. We propose GROOV, a fine-tuned seq2seq model for OXMC that generates the set of labels as a flat sequence and is trained using a novel loss independent of predicted label order. We show the efficacy of the approach, experimenting with popular XMC datasets for which GROOV is able to predict meaningful labels outside the given vocabulary while performing on par with state-of-the-art solutions for known labels.


title: Consistency study of high- and low-accreting Mg ii quasars: No significant effect of the Fe ii to Mg ii flux ratio on the radius-luminosity relation dispersion

abstract: We use observations of 66 reverberation-measured \Mgii\ quasars (QSOs) in the redshift range $0.36 \leq z \leq 1.686$ -- a subset of the 78 QSOs we previously studied that also have \rfe\ (flux ratio parameter of UV \Feii\ to \Mgii\ that is used as an accretion-rate proxy) measurements -- to simultaneously constrain cosmological model parameters and QSO 2-parameter and 3-parameter radius-luminosity ($R-L$) relation parameters in six different cosmological models. We find that these QSO $R-L$ relation parameters are independent of the assumed cosmological model and so these QSOs are standardizable through the $R-L$ relations. Also: (1) With the 2-parameter $R-L$ relation, we find that the low-\rfe\ and high-\rfe\ data subsets obey the same $R-L$ relation within the error bars. (2) Extending the 2-parameter $R-L$ relation to a 3-parameter one does not result in the hoped-for reduction in the intrinsic dispersion of the $R-L$ relation. (3) Neither of the 3-parameter $R-L$ relations provide a significantly better fit to the measurements than does the 2-parameter $R-L$ relation. These are promising results for the on-going development of \Mgii\ cosmological probes. The first and third of these results differ significantly from those we found elsewhere from analyses of reverberation-measured \hb\ QSOs.


title: On nonuniqueness and nonregularity for gradient flows of polyconvex functionals

abstract: We provide some counterexamples concerning the uniqueness and regularity of weak solutions to the initial-boundary value problem for gradient flows of certain strongly polyconvex functionals by showing that such a problem can possess a trivial classical solution as well as infinitely many weak solutions that are nowhere smooth. Such polyconvex functions have been constructed in the previous work, and the nonuniqueness and nonregularity will be achieved by reformulating the gradient flow as a space-time partial differential relation and then using the convex integration method to construct certain strongly convergent sequences of subsolutions that have a uniform control on the local essential oscillations of their spatial gradients.


title: Coronal and chromospheric emission in A-type stars

abstract: Cool stars on the main sequence generate X-rays from coronal activity, powered by a convective dynamo. With increasing temperature, the convective envelope becomes smaller and X-ray emission fainter. We present Chandra/HRC-I observations of four single stars with early A spectral types. Only the coolest star of this sample, $\tau^3$ Eri ($T_\mathrm{eff}\approx8\,,000$ K), is detected with $\log(L_X/L_\mathrm{bol})=-7.6$ while the three hotter stars ($T_\mathrm{eff}\geq8\,,000$ K), namely $\delta$ Leo, $\beta$ Leo, and $\iota$ Cen, remain undetected with upper limits $\log(L_X/L_\mathrm{bol})<-8.4$. The drop in X-ray emission thus occurs in a narrow range of effective temperatures around $\sim 8100$ K and matches the drop of activity in the C III and O VI transition region lines.


title: Ejecta emplacement as the possible origin of Ryugu's equatorial ridge

abstract: The Japanese spacecraft Hayabusa 2 visited the asteroid (162173) Ryugu and provided many high-resolution images of its surface, revealing that Ryugu has a spinning-top shape with a prominent equatorial ridge, much like the shapes reported for some other asteroids. In this study, through dozens of numerical calculations, we demonstrate that during a period of fast rotation, ejecta from craters formed at lower and mid-latitudes can be deposited on the equatorial ridge. Assuming a rotation period of 3 h, we estimate that an equatorial ridge with a height of 50 m can be generated in 128(+47 / -27) My for a main-belt asteroid, or 3.1(+4.2 / -1.2) Gy for a near-Earth asteroid. Therefore, an equatorial ridge can form within the average mean collisional lifetime of a km-sized asteroid within the main belt, but not for near-Earth asteroids. Furthermore, our model may explain why blue (younger) material occurs on the equatorial ridge.


title: Nanoscale Architecture for Frequency-Resolving Single-Photon Detectors

abstract: Single photon detectors play a key role across several basic science and technology applications. While progress has been made in improving performance, single photon detectors that can maintain high performance while also resolving the photon frequency are still lacking. By means of quantum simulations, we show that nanoscale elements cooperatively interacting with the photon field in a photodetector architecture allow to simultaneously achieve high efficiency, low jitter, and high frequency resolution. We discuss how such cooperative interactions are essential to reach this performance regime, analyzing the factors that impact performance and trade-offs between metrics. We illustrate the potential performance for frequency resolution over a 1 eV bandwidth in the visible range, indicating near perfect detection efficiency, jitter of a few hundred femtoseconds, and frequency resolution of tens of meV. Finally, a potential physical realization of such an architecture is presented based on carbon nanotubes functionalized with quantum dots.


title: The spatial distribution of impact craters on Ryugu

abstract: Asteroid 162173 Ryugu has numerous craters. The initial measurement of impact craters on Ryugu, by Sugita et al. (2019), is based on Hayabusa2 ONC images obtained during the first month after the arrival of Hayabusa2 in June 2018. Utilizing new images taken until February 2019, we constructed a global impact crater catalogue of Ryugu, which includes all craters larger than 20 m in diameter on the surface of Ryugu. As a result, we identified 77 craters on the surface of Ryugu. Ryugu shows variation in crater density which cannot be explained by the randomness of cratering; there are more craters at lower latitudes and fewer at higher latitudes, and fewer craters in the western bulge (160 E - 290 E) than in the region around the meridian (300 E - 30 E). This variation implies a complicated geologic history for Ryugu. It seems that the longitudinal variation in crater density simply indicates variation in the crater ages; the cratered terrain around the meridian seems to be geologically old while the western bulge is relatively young. The latitudinal variation in crater density suggests that the equatorial ridge of Ryugu is a geologically old structure; however, this could be alternatively explained by a collision with many fission fragments during a short rotational period of Ryugu in the past.


title: Non-LTE abundances of zinc in different spectral type stars and the Galactic [Zn/Fe] trend based on quantum-mechanical data on inelastic processes in zinc-hydrogen collisions

abstract: We present a new model atom of Zn I-II based on the most up-to-date photoionisation cross-sections, electron-impact excitation rates, and rate coefficients for the Zn I + H I and Zn II + H- collisions. The latter were calculated using the multi-channel quantum asymptotic treatment based on the Born-Oppenheimer approach. Non-LTE analysis was performed for the first time for lines of Zn I and Zn II in the ultraviolet (UV) spectra of two very metal-poor reference stars, HD 84937 and HD 140283. We found consistent non-LTE abundance from the resonance Zn I 2138 A line, the subordinate lines, and the lines of Zn II. In both stars, non-LTE leads to 0.17 dex higher average abundance from Zn I, while, for Zn II lines, non-LTE corrections are minor and do not exceed 0.06 dex. Using lines of Zn I in the high-resolution spectra, we determined the non-LTE abundances for a sample of 80 stars in the -2.5 < [Fe/H] < 0.2 metallicity range. The [Zn/Fe] versus [Fe/H] diagram reveals a dip, with [Zn/Fe] = 0.3 in the most metal-poor stars, a close-to-solar value for [Fe/H] = -1.2, and increasing [Zn/Fe] up to 0.3 in the thick disk stars. The close-to-solar metallicity stars have subsolar [Zn/H] = -0.1, on average. Non-LTE abundances of zinc were derived for the first time for seven reference F to B-type stars. We provide a grid of the non-LTE abundance corrections.


title: Representation Learning for Context-Dependent Decision-Making

abstract: Humans are capable of adjusting to changing environments flexibly and quickly. Empirical evidence has revealed that representation learning plays a crucial role in endowing humans with such a capability. Inspired by this observation, we study representation learning in the sequential decision-making scenario with contextual changes. We propose an online algorithm that is able to learn and transfer context-dependent representations and show that it significantly outperforms the existing ones that do not learn representations adaptively. As a case study, we apply our algorithm to the Wisconsin Card Sorting Task, a well-established test for the mental flexibility of humans in sequential decision-making. By comparing our algorithm with the standard Q-learning and Deep-Q learning algorithms, we demonstrate the benefits of adaptive representation learning.


title: Exciton-Driven Renormalization of Quasiparticle Band Structure in Monolayer MoS2

abstract: Optical excitation serves as a powerful approach to control the electronic structure of layered Van der Waals materials via many-body screening effects, induced by photoexcited free carriers, or via light-driven coherence, such as optical Stark and Bloch-Siegert effects. Although theoretical work has also pointed to an exotic mechanism of renormalizing band structure via excitonic correlations in bound electron-hole pairs (excitons), experimental observation of such exciton-driven band renormalization and the full extent of their implications is still lacking, largely due to the limitations of optical probes and the impact of screening effects. Here, by using extreme-ultraviolet time-resolved angle-resolved photoemission spectroscopy together with excitonic many-body theoretical calculations, we directly unmask the band renormalization effects driven by excitonic correlations in a monolayer semiconductor. We revealed a surprising bandgap opening, increased by 40 meV, and a simultaneous enhancement of band effective mass. Our findings unmask the novel exciton-driven mechanism towards the band engineering in photoexcited semiconducting materials, opening a new playground to manipulate the transient energy states in layered quantum materials via optical controls of excitonic many-body correlations.


title: On a Tur\'an conjecture and random multiplicative functions

abstract: We show that if $f$ is the random completely multiplicative function, the probability that $\sum_{n\le x}\frac{f(n)}{n}$ is positive for every $x$ is at least $1-10^{-45}$, while also strictly smaller than $1$. For large $x$, we prove an asymptotic upper bound of $O(\exp(-\exp( \frac{\log x}{C\log \log x })))$ on the exceptional probability that a particular truncation is negative, where $C$ is some positive constant.


title: Continuous wavelet transform of multiview images using wavelets based on voxel patterns

abstract: We propose the multiview wavelets based on voxel patterns of autostereoscopic multiview displays. Direct and inverse continuous wavelet transforms of binary and gray-scale images were performed. The input to the inverse wavelet transform was the array of wavelet coefficients of the direct transform. A restored image reproduces the structure of the multiview image correctly. Also, we modified the dimension of the parallax and the depth of 3D images. The restored and modified images were displayed in 3D using lenticular plates. In each case, the visual 3D picture corresponds to the applied modifications. The results can be applied to the autostereoscopic 3D displays.


title: Fermion Mass Hierarchy and Mixing in simplified Grand Gauge-Higgs Unification

abstract: Grand gauge-Higgs unification of five dimensional SU(6) gauge theory on an orbifold $S^1 / Z_2$ with localized gauge kinetic terms is discussed. The Standard model (SM) fermions on the boundaries and some massive bulk fermions coupling to the SM fermions are introduced. The number of the bulk fermions is reduced compared to the previous model, which reproduces the generation mixing of the SM fermions in addition to the SM fermion mass hierarchy by mild tuning the bulk masses and parameters of the localized gauge kinetic terms.


title: Privacy-Preserving Distributed Machine Learning Made Faster

abstract: With the development of machine learning, it is difficult for a single server to process all the data. So machine learning tasks need to be spread across multiple servers, turning the centralized machine learning into a distributed one. However, privacy remains an unsolved problem in distributed machine learning. Multi-key homomorphic encryption is one of the suitable candidates to solve the problem. However, the most recent result of the Multi-key homomorphic encryption scheme (MKTFHE) only supports the NAND gate. Although it is Turing complete, it requires efficient encapsulation of the NAND gate to further support mathematical calculation. This paper designs and implements a series of operations on positive and negative integers accurately. First, we design basic bootstrapped gates with the same efficiency as that of the NAND gate. Second, we construct practical $k$-bit complement mathematical operators based on our basic binary bootstrapped gates. The constructed created can perform addition, subtraction, multiplication, and division on both positive and negative integers. Finally, we demonstrated the generality of the designed operators by achieving a distributed privacy-preserving machine learning algorithm, i.e. linear regression with two different solutions. Experiments show that the operators we designed are practical and efficient.


title: Sparseloop: An Analytical Approach To Sparse Tensor Accelerator Modeling

abstract: In recent years, many accelerators have been proposed to efficiently process sparse tensor algebra applications (e.g., sparse neural networks). However, these proposals are single points in a large and diverse design space. The lack of systematic description and modeling support for these sparse tensor accelerators impedes hardware designers from efficient and effective design space exploration. This paper first presents a unified taxonomy to systematically describe the diverse sparse tensor accelerator design space. Based on the proposed taxonomy, it then introduces Sparseloop, the first fast, accurate, and flexible analytical modeling framework to enable early-stage evaluation and exploration of sparse tensor accelerators. Sparseloop comprehends a large set of architecture specifications, including various dataflows and sparse acceleration features (e.g., elimination of zero-based compute). Using these specifications, Sparseloop evaluates a design's processing speed and energy efficiency while accounting for data movement and compute incurred by the employed dataflow as well as the savings and overhead introduced by the sparse acceleration features using stochastic tensor density models. Across representative accelerators and workloads, Sparseloop achieves over 2000 times faster modeling speed than cycle-level simulations, maintains relative performance trends, and achieves 0.1% to 8% average error. With a case study, we demonstrate Sparseloop's ability to help reveal important insights for designing sparse tensor accelerators (e.g., it is important to co-design orthogonal design aspects).


title: Emotion-Centric Requirements Change Handling in Software Engineering

abstract: Background: Requirements Changes (RCs) -- the additions/modifications/deletions of functional/non-functional requirements in software products -- are challenging for software practitioners to handle. Handling some changes may significantly impact the emotions of the practitioners. Objective: We wanted to know the key challenges that make RC handling difficult, how these impact the emotions of software practitioners, what influences their RC handling, and how RC handling can be made less emotionally challenging. Method: We followed a mixed-methods approach. We conducted two survey studies, with 40 participants and 201 participants respectively. The presentation of key quantitative data was followed by descriptive statistical analysis, and the qualitative data was analysed using Strauss-Corbinian Grounded Theory, and Socio-Technical Grounded Theory analysis techniques. Findings:We found (1) several key factors that make RC handling an emotional challenge, (2) varying emotions that practitioners feel when it is challenging to handle RCs, (3) how stakeholders, including practitioners themselves, peers, managers and customers, influence the RC handling and how practitioners feel due to the stakeholder influence, and (4) practices that can be used to better handle RCs. Conclusion: Some challenges are technical and some are social which also belong to aspects of agile practice, emotional intelligence, and cognitive intelligence. Therefore, to better handle RCs with positive emotions in socio-technical environments, agility, emotional intelligence, and cognitive intelligence need to cooperate with each other.


title: An Efficient Operator-Splitting Method for the Eigenvalue Problem of the Monge-Amp\`{e}re Equation

abstract: We develop an efficient operator-splitting method for the eigenvalue problem of the Monge-Amp\`{e}re operator in the Aleksandrov sense. The backbone of our method relies on a convergent Rayleigh inverse iterative formulation proposed by Abedin and Kitagawa (Inverse iteration for the {M}onge-{A}mp{\`e}re eigenvalue problem, {\it Proceedings of the American Mathematical Society}, 148 (2020), no. 11, 4975-4886). Modifying the theoretical formulation, we develop an efficient algorithm for computing the eigenvalue and eigenfunction of the Monge-Amp\`{e}re operator by solving a constrained Monge-Amp\`{e}re equation during each iteration. Our method consists of four essential steps: (i) Formulate the Monge-Amp\`{e}re eigenvalue problem as an optimization problem with a constraint; (ii) Adopt an indicator function to treat the constraint; (iii) Introduce an auxiliary variable to decouple the original constrained optimization problem into simpler optimization subproblems and associate the resulting new optimization problem with an initial value problem; and (iv) Discretize the resulting initial-value problem by an operator-splitting method in time and a mixed finite element method in space. The performance of our method is demonstrated by several experiments. Compared to existing methods, the new method is more efficient in terms of computational cost and has a comparable rate of convergence in terms of accuracy.


title: Emergence of Quantum Theory and Minkowski Spacetime

abstract: The state-of-the-art physics consists of two irreconcilable branches, i.e., the quantum theory and the general relativity, which work well in their own territories, independently. However, what are quantum and spacetime after all? The key question was never addressed, satisfactorily. In this work, we describe a possibility to reformulate the quantum theory in the Minkowski spacetime from the viewpoint of classic physics in the Euclidean spacetime, i.e., classic mechanics and stochastic process theory. We show that quantum theory and Minkowski spacetime may connect with each other and emerge from a single fundamental entity.


title: MagneticKP: A package for quickly constructing $\boldsymbol{k}\cdot\boldsymbol{p}$ models of magnetic and non-magnetic crystals

abstract: We propose an efficient algorithm to construct $\boldsymbol{k}\cdot \boldsymbol{p}$ effective Hamiltonians, which is much faster than the previously proposed algorithms. This algorithm is implemented in MagneticKP package. The package applies to both single-valued (spinless) and double-valued (spinful) cases, and it works for both magnetic and nonmagnetic systems. By interfacing with SpaceGroupIrep or MSGCorep packages, it can directly output the $\boldsymbol{k}\cdot \boldsymbol{p}$ Hamiltonian around arbitrary momentum and expanded to arbitrary order in $k$.


title: Feature Extractor Stacking for Cross-domain Few-shot Learning

abstract: Cross-domain few-shot learning (CDFSL) addresses learning problems where knowledge needs to be transferred from one or more source domains into an instance-scarce target domain with an explicitly different distribution. Recently published CDFSL methods generally construct a universal model that combines knowledge of multiple source domains into one feature extractor. This enables efficient inference but necessitates re-computation of the extractor whenever a new source domain is added. Some of these methods are also incompatible with heterogeneous source domain extractor architectures. We propose feature extractor stacking (FES), a new CDFSL method for combining information from a collection of extractors, that can utilise heterogeneous pretrained extractors out of the box and does not maintain a universal model that needs to be re-computed when its extractor collection is updated. We present the basic FES algorithm, which is inspired by the classic stacked generalisation approach, and also introduce two variants: convolutional FES (ConFES) and regularised FES (ReFES). Given a target-domain task, these algorithms fine-tune each extractor independently, use cross-validation to extract training data for stacked generalisation from the support set, and learn a simple linear stacking classifier from this data. We evaluate our FES methods on the well-known Meta-Dataset benchmark, targeting image classification with convolutional neural networks, and show that they can achieve state-of-the-art performance.


title: NFLAT: Non-Flat-Lattice Transformer for Chinese Named Entity Recognition

abstract: Recently, Flat-LAttice Transformer (FLAT) has achieved great success in Chinese Named Entity Recognition (NER). FLAT performs lexical enhancement by constructing flat lattices, which mitigates the difficulties posed by blurred word boundaries and the lack of word semantics. In FLAT, the positions of starting and ending characters are used to connect a matching word. However, this method is likely to match more words when dealing with long texts, resulting in long input sequences. Therefore, it significantly increases the memory and computational costs of the self-attention module. To deal with this issue, we advocate a novel lexical enhancement method, InterFormer, that effectively reduces the amount of computational and memory costs by constructing non-flat lattices. Furthermore, with InterFormer as the backbone, we implement NFLAT for Chinese NER. NFLAT decouples lexicon fusion and context feature encoding. Compared with FLAT, it reduces unnecessary attention calculations in "word-character" and "word-word". This reduces the memory usage by about 50% and can use more extensive lexicons or higher batches for network training. The experimental results obtained on several well-known benchmarks demonstrate the superiority of the proposed method over the state-of-the-art hybrid (character-word) models.


title: Fully automated spectroscopic ellipsometry analyses of crystalline-phase semiconductors based on a new algorithm

abstract: One significant drawback of a spectroscopic ellipsometry (SE) technique is its time-consuming and often complicated analysis procedure necessary to assess the optical functions of thin-film and bulk samples. Here, to solve this inherent problem of a traditional SE method, we present a new general way that allows full automation of SE analyses for crystalline-phase semiconductors exhibiting complex absorption features. In particular, we have modified a scheme established in our previous study, which performs a non-linear SE fitting analysis only in a low energy region at the beginning, while the analyzed energy region is gradually expanded toward higher energy by incorporating addition optical transition peaks. In this study, we have further developed a unique analyzing-energy search algorithm, in which a proper analyzing-energy region is determined to incorporate the feature of a new transition peak. In the developed method, a drastic improvement over the previous simple approach has been confirmed for expressing complex dielectric functions consisting of sharp and broad absorption peaks. The proposed method (Delta M method) has been applied successfully to analyze perovskite-based crystalline samples, including hybrid perovskite (CH3NH3PbI3) and chalcogenide perovskites (SrHfS3 and BaZrS3). In the automated analyses of these semiconductors, 7-8 transition peaks are introduced automatically to describe sample dielectric functions, while structural parameters, such as thin-film and roughness thicknesses, are also determined simultaneously. The established method can drastically reduce an analysis time to a level that allows the automatic inspection of daily varying material optical properties and expands the application area of spectroscopic ellipsometry considerably.


title: Surrogate Infeasible Fitness Acquirement FI-2Pop for Procedural Content Generation

abstract: When generating content for video games using procedural content generation (PCG), the goal is to create functional assets of high quality. Prior work has commonly leveraged the feasible-infeasible two-population (FI-2Pop) constrained optimisation algorithm for PCG, sometimes in combination with the multi-dimensional archive of phenotypic-elites (MAP-Elites) algorithm for finding a set of diverse solutions. However, the fitness function for the infeasible population only takes into account the number of constraints violated. In this paper we present a variant of FI-2Pop in which a surrogate model is trained to predict the fitness of feasible children from infeasible parents, weighted by the probability of producing feasible children. This drives selection towards higher-fitness, feasible solutions. We demonstrate our method on the task of generating spaceships for Space Engineers, showing improvements over both standard FI-2Pop, and the more recent multi-emitter constrained MAP-Elites algorithm.


title: Assessment of an energy-based surface tension model for simulation of two-phase flows using second-order phase field methods

abstract: Second-order phase field models have emerged as an attractive option for capturing the advection of interfaces in two-phase flows. Prior to these, state-of-the-art models based on the Cahn-Hilliard equation, which is a fourth-order equation, allowed for the derivation of surface tension models through thermodynamic arguments. In contrast, the second-order phase field models do not follow a known energy law, and deriving a surface tension term for these models using thermodynamic arguments is not straightforward. In this work, we justify that the energy-based surface tension model from the Cahn-Hilliard context can be adopted for second-order phase field models as well and assess its performance. We test the surface tension model on three different second-order phase field equations; the conservative diffuse interface model of Chiu and Lin [1], and two models based on the modified Allen-Cahn equation introduced by Sun and Beckermann [2]. Additionally, we draw the connection between the energy-based model with a localized variation of the continuum surface force (CSF) model. Using canonical tests, we illustrate the lower magnitude of spurious currents, better accuracy, and superior convergence properties of the energy-based surface tension model compared to the CSF model, which is a popular choice used in conjunction with second-order phase field methods, and the localized CSF model. Importantly, in terms of computational expense and parallel efficiency, the energy-based model incurs no penalty compared to the CSF models.

categories: physics.flu-dyn cs.NA math.NA physics.comp-ph


title: Cutting Quantum Circuits to Run on Quantum and Classical Platforms

abstract: Quantum computing (QC) offers a new computing paradigm that has the potential to provide significant speedups over classical computing. Each additional qubit doubles the size of the computational state space available to a quantum algorithm. Such exponentially expanding reach underlies QC's power, but at the same time puts demanding requirements on the quantum processing units (QPU) hardware. On the other hand, purely classical simulations of quantum circuits on either central processing unit (CPU) or graphics processing unit (GPU) scale poorly as they quickly become bottlenecked by runtime and memory. This paper introduces CutQC, a scalable hybrid computing approach that distributes a large quantum circuit onto quantum (QPU) and classical platforms (CPU or GPU) for co-processing. CutQC demonstrates evaluation of quantum circuits that are larger than the limit of QPU or classical simulation, and achieves much higher quantum circuit evaluation fidelity than the large NISQ devices achieve in real-system runs.


title: Group field theory on 2-groups

abstract: Group field theories are quantum field theories built on groups. They can be seen as a tool to generate topological state-sums or quantum gravity models. For four dimensional manifolds, different arguments have pointed towards 2-groups (such as crossed modules) as the relevant symmetry structure to probe four dimensional topological features. Here, we introduce a group field theory built on crossed modules which generate a four dimensional topological model, as we prove that the Feynman diagram amplitudes can be related by Pachner moves. This model is presumably the dual version of the Yetter-Mackaay model.


title: Orthogonal Gromov-Wasserstein Discrepancy with Efficient Lower Bound

abstract: Comparing structured data from possibly different metric-measure spaces is a fundamental task in machine learning, with applications in, e.g., graph classification. The Gromov-Wasserstein (GW) discrepancy formulates a coupling between the structured data based on optimal transportation, tackling the incomparability between different structures by aligning the intra-relational geometries. Although efficient \emph{local} solvers such as conditional gradient and Sinkhorn are available, the inherent non-convexity still prevents a tractable evaluation, and the existing lower bounds are not tight enough for practical use. To address this issue, we take inspiration from the connection with the quadratic assignment problem, and propose the orthogonal Gromov-Wasserstein (OGW) discrepancy as a surrogate of GW. It admits an efficient and \emph{closed-form} lower bound with $\mathcal{O}(n^3)$ complexity, and directly extends to the fused Gromov-Wasserstein (FGW) distance, incorporating node features into the coupling. Extensive experiments on both the synthetic and real-world datasets show the tightness of our lower bounds, and both OGW and its lower bounds efficiently deliver accurate predictions and satisfactory barycenters for graph sets.


title: Quadrupole topological insulators in Ta2M3Te5 (M= Ni, Pd) monolayers

abstract: Higher-order topological insulators have been introduced in the precursory Benalcazar-Bernevig-Hughes quadrupole model, but no electronic compound has been proposed to be a quadrupole topological insulator (QTI) yet. In this work, we predict that Ta$_2M_3$Te$_5$ ($M=$ Pd, Ni) monolayers can be 2D QTIs with second-order topology due to the double-band inversion. A time-reversal-invariant system with two mirror reflections (M$_x$ and M$_y$) can be classified by Stiefel-Whitney numbers ($w_1, w_2$) due to the combined symmetry $TC_{2z}$. Using the Wilson loop method, we compute $w_1=0$ and $w_2=1$ for Ta$_2$Ni$_3$Te$_5$, indicating a QTI with $q^{xy}=e/2$. Thus, gapped edge states and localized corner states are obtained. By analyzing atomic band representations, we demonstrate that its unconventional nature with an essential band representation at an empty site, i.e., $A_g@4e$, is due to the remarkable double-band inversion on Y-$\Gamma$. Then, we construct an eight-band quadrupole model with $M_x$ and $M_y$ successfully for electronic materials. These transition-metal compounds of $A_2M_{1,3}X_5$ ($A$ = Ta, Nb; $M$ = Pd, Ni; $X$ = Se, Te) family provide a good platform for realizing the QTI and exploring the interplay between topology and interactions.


title: Multigrid methods for 3$D$ $H(\mathbf{curl})$ problems with nonoverlapping domain decomposition smoothers

abstract: We propose V--cycle multigrid methods for vector field problems arising from the lowest order hexahedral N\'{e}d\'{e}lec finite element. Since the conventional scalar smoothing techniques do not work well for the problems, a new type of smoothing method is necessary. We introduce new smoothers based on substructuring with nonoverlapping domain decomposition methods. We provide the convergence analysis and numerical experiments that support our theory.


title: Leveraging Uncertainty for Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images

abstract: Trained using only image class label, deep weakly supervised methods allow image classification and ROI segmentation for interpretability. Despite their success on natural images, they face several challenges over histology data where ROI are visually similar to background making models vulnerable to high pixel-wise false positives. These methods lack mechanisms for modeling explicitly non-discriminative regions which raises false-positive rates. We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations and using only image class label. Our method is composed of two networks: a localizer that yields segmentation mask, followed by a classifier. The training loss pushes the localizer to build a segmentation mask that holds most discrimiantive regions while simultaneously modeling background regions. Comprehensive experiments over two histology datasets showed the merits of our method in reducing false positives and accurately segmenting ROI.


title: Supplementary Material: Implementation and Experiments for GAU-based Model

abstract: In February this year Google proposed a new Transformer variant called FLASH, which has a faster speed, lower VRAM footprint and better performance. This is achieved by designing a performant layer named GAU (Gated Attention Unit), which combines the Attention layer and FFN. In this paper, some implementation details are re-analyzed both theoretically and practically. We then propose a novel GAU-based model and pre-train it on a Chinese corpus. Results of the CLUE benchmark show that our model achieves a dev average score of 75.02, 1% higher than RoFormerV1 and being 45% faster, which is also competitive with RoFormerV2.


title: A Survey of Risk-Aware Multi-Armed Bandits

abstract: In several applications such as clinical trials and financial portfolio optimization, the expected value (or the average reward) does not satisfactorily capture the merits of a drug or a portfolio. In such applications, risk plays a crucial role, and a risk-aware performance measure is preferable, so as to capture losses in the case of adverse events. This survey aims to consolidate and summarise the existing research on risk measures, specifically in the context of multi-armed bandits. We review various risk measures of interest, and comment on their properties. Next, we review existing concentration inequalities for various risk measures. Then, we proceed to defining risk-aware bandit problems, We consider algorithms for the regret minimization setting, where the exploration-exploitation trade-off manifests, as well as the best-arm identification setting, which is a pure exploration problem -- both in the context of risk-sensitive measures. We conclude by commenting on persisting challenges and fertile areas for future research.


title: Bi-level Alignment for Cross-Domain Crowd Counting

abstract: Recently, crowd density estimation has received increasing attention. The main challenge for this task is to achieve high-quality manual annotations on a large amount of training data. To avoid reliance on such annotations, previous works apply unsupervised domain adaptation (UDA) techniques by transferring knowledge learned from easily accessible synthetic data to real-world datasets. However, current state-of-the-art methods either rely on external data for training an auxiliary task or apply an expensive coarse-to-fine estimation. In this work, we aim to develop a new adversarial learning based method, which is simple and efficient to apply. To reduce the domain gap between the synthetic and real data, we design a bi-level alignment framework (BLA) consisting of (1) task-driven data alignment and (2) fine-grained feature alignment. In contrast to previous domain augmentation methods, we introduce AutoML to search for an optimal transform on source, which well serves for the downstream task. On the other hand, we do fine-grained alignment for foreground and background separately to alleviate the alignment difficulty. We evaluate our approach on five real-world crowd counting benchmarks, where we outperform existing approaches by a large margin. Also, our approach is simple, easy to implement and efficient to apply. The code is publicly available at https://github.com/Yankeegsj/BLA.


title: Ultra-High-Energy Cosmic Rays: The Intersection of the Cosmic and Energy Frontiers

abstract: The present white paper is submitted as part of the "Snowmass" process to help inform the long-term plans of the United States Department of Energy and the National Science Foundation for high-energy physics. It summarizes the science questions driving the Ultra-High-Energy Cosmic-Ray (UHECR) community and provides recommendations on the strategy to answer them in the next two decades.


title: On the similarity analysis of the growth of microalgae

abstract: Similarity analysis of microalgae growth is crucial for understanding microalgae cultivation, such analysis has not been considered before in previous studies. This letter considers the natural features of the microalgae growth phenomenon that are different from the inanimate process. Accordingly, the similarity of light transfer within microalgae suspensions was comprehensively studied. The characteristic number of microalgae growth and the temporal scaling function were considered to represent the growth relate characteristics. Subsequently, a group of dimensionless numbers were derived to characterize the time-dependent similarity of light within microalgae suspensions. For growth similarity, the newly introduced characteristic number of microalgae growth and the temporal scaling function of extinction, absorption and scattering were considered identical. The similarity relations of the time-dependent optical constants of microalgae were also provided for similar growth. The similarity analysis of the microalgae growth will be useful in designing and guiding experiments on microalgae cultivation.


title: Zero-Knowledge Authentication

abstract: In the thesis we focus on designing an authentication system to authenticate users over a network with a username and a password. The system uses the zero-knowledge proof (ZKP) system as a password verification mechanism. The ZKP protocol used is based on the quadratic residuosity problem. The authentication system is defined as a method in the extensible authentication protocol (EAP). Using a ZKP system yields interesting security properties that make the system favourable to be used over insecure networks.


title: An MMSE Lower Bound via Poincar\'e Inequality

abstract: This paper studies the minimum mean squared error (MMSE) of estimating $\mathbf{X} \in \mathbb{R}^d$ from the noisy observation $\mathbf{Y} \in \mathbb{R}^k$, under the assumption that the noise (i.e., $\mathbf{Y}|\mathbf{X}$) is a member of the exponential family. The paper provides a new lower bound on the MMSE. Towards this end, an alternative representation of the MMSE is first presented, which is argued to be useful in deriving closed-form expressions for the MMSE. This new representation is then used together with the Poincar\'e inequality to provide a new lower bound on the MMSE. Unlike, for example, the Cram\'{e}r-Rao bound, the new bound holds for all possible distributions on the input $\mathbf{X}$. Moreover, the lower bound is shown to be tight in the high-noise regime for the Gaussian noise setting under the assumption that $\mathbf{X}$ is sub-Gaussian. Finally, several numerical examples are shown which demonstrate that the bound performs well in all noise regimes.


title: e-CARE: a New Dataset for Exploring Explainable Causal Reasoning

abstract: Understanding causality has vital importance for various Natural Language Processing (NLP) applications. Beyond the labeled instances, conceptual explanations of the causality can provide deep understanding of the causal facts to facilitate the causal reasoning process. However, such explanation information still remains absent in existing causal reasoning resources. In this paper, we fill this gap by presenting a human-annotated explainable CAusal REasoning dataset (e-CARE), which contains over 21K causal reasoning questions, together with natural language formed explanations of the causal questions. Experimental results show that generating valid explanations for causal facts still remains especially challenging for the state-of-the-art models, and the explanation information can be helpful for promoting the accuracy and stability of causal reasoning models.


title: On the Capacity-Achieving Input of the Gaussian Channel with Polar Quantization

abstract: The polar receiver architecture is a receiver design that captures the envelope and phase information of the signal rather than its in-phase and quadrature components. Several studies have demonstrated the robustness of polar receivers to phase noise and other nonlinearities. Yet, the information-theoretic limits of polar receivers with finite-precision quantizers have not been investigated in the literature. The main contribution of this work is to identify the optimal signaling strategy for the additive white Gaussian noise (AWGN) channel with polar quantization at the output. More precisely, we show that the capacity-achieving modulation scheme has an amplitude phase shift keying (APSK) structure. Using this result, the capacity of the AWGN channel with polar quantization at the output is established by numerically optimizing the probability mass function of the amplitude. The capacity of the polar-quantized AWGN channel with $b_1$-bit phase quantizer and optimized single-bit magnitude quantizer is also presented. Our numerical findings suggest the existence of signal-to-noise ratio (SNR) thresholds, above which the number of amplitude levels of the optimal APSK scheme and their respective probabilities change abruptly. Moreover, the manner in which the capacity-achieving input evolves with increasing SNR depends on the number of phase quantization bits.


title: AFFIRM: Affinity Fusion-based Framework for Iteratively Random Motion correction of multi-slice fetal brain MRI

abstract: Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain volume for clinical diagnosis and quantitative analysis. However, the conventional registration-based correction has a limited capture range and is insufficient for detecting relatively large motions. Here, we present a novel Affinity Fusion-based Framework for Iteratively Random Motion (AFFIRM) correction of the multi-slice fetal brain MRI. It learns the sequential motion from multiple stacks of slices and integrates the features between 2D slices and reconstructed 3D volume using affinity fusion, which resembles the iterations between slice-to-volume registration and volumetric reconstruction in the regular pipeline. The method accurately estimates the motion regardless of brain orientations and outperforms other state-of-the-art learning-based methods on the simulated motion-corrupted data, with a 48.4% reduction of mean absolute error for rotation and 61.3% for displacement. We then incorporated AFFIRM into the multi-resolution slice-to-volume registration and tested it on the real-world fetal MRI scans at different gestation stages. The results indicated that adding AFFIRM to the conventional pipeline improved the success rate of fetal brain super-resolution reconstruction from 77.2% to 91.9%.


title: Dirac nodal lines in the quasi-one-dimensional ternary telluride TaPtTe$_5$

abstract: A Dirac nodal-line phase, as a quantum state of topological materials, usually occur in three-dimensional or at least two-dimensional materials with sufficient symmetry operations that could protect the Dirac band crossings. Here, we report a combined theoretical and experimental study on the electronic structure of the quasi-one-dimensional ternary telluride TaPtTe$_5$, which is corroborated as being in a robust nodal-line phase with fourfold degeneracy. Our angle-resolved photoemission spectroscopy measurements show that two pairs of linearly dispersive Dirac-like bands exist in a very large energy window, which extend from a binding energy of $\sim$ 0.75 eV to across the Fermi level. The crossing points are at the boundary of Brillouin zone and form Dirac-like nodal lines. Using first-principles calculations, we demonstrate the existing of nodal surfaces on the $k_y = \pm \pi$ plane in the absence of spin-orbit coupling (SOC), which are protected by nonsymmorphic symmetry in TaPtTe$_5$. When SOC is included, the nodal surfaces are broken into several nodal lines. By theoretical analysis, we conclude that the nodal lines along $Y$-$T$ and the ones connecting the $R$ points are non-trivial and protected by nonsymmorphic symmetry against SOC.


title: Tutorial: Analog Matrix Computing (AMC) with Crosspoint Resistive Memory Arrays

abstract: Matrix computation is ubiquitous in modern scientific and engineering fields. Due to the high computational complexity in conventional digital computers, matrix computation represents a heavy workload in many data-intensive applications, e.g., machine learning, scientific computing, and wireless communications. For fast, efficient matrix computations, analog computing with resistive memory arrays has been proven to be a promising solution. In this Tutorial, we present analog matrix computing (AMC) circuits based on crosspoint resistive memory arrays. AMC circuits are able to carry out basic matrix computations, including matrix multiplication, matrix inversion, pseudoinverse and eigenvector computation, all with one single operation. We describe the main design principles of the AMC circuits, such as local/global or negative/positive feedback configurations, with/without external inputs. Mapping strategies for matrices containing negative values will be presented. The underlying requirements for circuit stability will be described via the transfer function analysis, which also defines time complexity of the circuits towards steady-state results. Lastly, typical applications, challenges, and future trends of AMC circuits will be discussed.


title: Entity-aware and Motion-aware Transformers for Language-driven Action Localization in Videos

abstract: Language-driven action localization in videos is a challenging task that involves not only visual-linguistic matching but also action boundary prediction. Recent progress has been achieved through aligning language query to video segments, but estimating precise boundaries is still under-explored. In this paper, we propose entity-aware and motion-aware Transformers that progressively localizes actions in videos by first coarsely locating clips with entity queries and then finely predicting exact boundaries in a shrunken temporal region with motion queries. The entity-aware Transformer incorporates the textual entities into visual representation learning via cross-modal and cross-frame attentions to facilitate attending action-related video clips. The motion-aware Transformer captures fine-grained motion changes at multiple temporal scales via integrating long short-term memory into the self-attention module to further improve the precision of action boundary prediction. Extensive experiments on the Charades-STA and TACoS datasets demonstrate that our method achieves better performance than existing methods.


title: Chaotic Shadows of Black Holes: A Short Review

abstract: We give a brief review on the formation and the calculation of black hole shadow. Firstly, we introduce the conception of black hole shadow and the current works on a variety of black hole shadows. Secondly, we present main methods of calculating photon sphere radius and shadow radius, and then explain how the photon sphere affect the boundary of black hole shadow. We review the analytical calculation for black hole shadows which have analytic expressions for shadow boundary due to the integrable photon motion system. And we introduce the fundamental photon orbits which can explain the patterns of black hole shadow shape. Finally, we review the numerical calculation of black hole shadows with the backward ray-tracing method, and introduce some chaotic black hole shadows with self-similar fractal structures. Since the gravitational waves from the merger of binary black holes have been detected, we introduce a couple of shadows of binary black holes, which all have the eyebrowlike shadows around the main shadows with the fractal structures. We discuss the invariant phase space structures of photon motion system in black hole space-time, and explain the formation of black hole shadow is dominated by the invariant manifolds of certain Lyapunov orbits near the fixed points.


title: Water waves generated by moving atmospheric pressure: Theoretical analyses with applications to the 2022 Tonga event

abstract: Both 1DH (dispersive and non-dispersive) and 2DH axisymmetric (approximate, non-dispersive) analytical solutions are derived for water waves generated by moving atmospheric pressures. In 1DH, three wave components can be identified: the locked wave propagating with the speed of the atmospheric pressure, $C_p$, and two free wave components propagating in opposite directions with the respective wave celerity, according to the linear frequency dispersion relationship. Under the supercritical condition ($C_p > C$, which is the fastest celerity of the water wave) the leading water wave is the locked wave and has the same sign (i.e., phase) as the atmospheric pressure, while the trailing free wave has the opposite sign. Under the subcritical condition ($C >C_p$) the fastest moving free wave component leads and its free surface elevation has the same sign as the atmospheric pressure. For a long atmospheric pressure disturbance, the induced free surface profile mimics that of the atmospheric pressure. The 2DH problem involves an axisymmetric atmospheric pressure decaying in the radial direction as $O(r^{-1/2})$. Only two wave components, locked and free, appear due to symmetry. The tsunami DART data captured during Tonga's volcanic eruption event is analyzed. Corrections are necessary to isolate the free surface elevation data. Comparisons between the corrected DART data and the analytical solutions, including the arrival times of the leading locked waves and the trailing free waves, and the amplitude ratios, are in agreement in order-of-magnitude. The differences between them highlight the complexity of problems.


title: Comparing Open Arabic Named Entity Recognition Tools

abstract: The main objective of this paper is to compare and evaluate the performances of three open Arabic NER tools: CAMeL, Hatmi, and Stanza. We collected a corpus consisting of 30 articles written in MSA and manually annotated all the entities of the person, organization, and location types at the article (document) level. Our results suggest a similarity between Stanza and Hatmi with the latter receiving the highest F1 score for the three entity types. However, CAMeL achieved the highest precision values for names of people and organizations. Following this, we implemented a "merge" method that combined the results from the three tools and a "vote" method that tagged named entities only when two of the three identified them as entities. Our results showed that merging achieved the highest overall F1 scores. Moreover, merging had the highest recall values while voting had the highest precision values for the three entity types. This indicates that merging is more suitable when recall is desired, while voting is optimal when precision is required. Finally, we collected a corpus of 21,635 articles related to COVID-19 and applied the merge and vote methods. Our analysis demonstrates the tradeoff between precision and recall for the two methods.


title: Global existence and stability of subsonic time-periodic solution to the damped compressible Euler equations in a bounded domain

abstract: In this paper, we consider the one-dimensional isentropic compressible Euler equations with source term $\beta(t,x)\rho|u|^{\alpha}u$ in a bounded domain, which can be used to describe gas transmission in a nozzle.~The model is imposed a subsonic time-periodic boundary condition.~Our main results reveal that the time-periodic boundary can trigger an unique subsonic time-periodic smooth solution and this unique periodic solution is stable under small perturbations on initial and boundary data.~To get the existence of subsonic time-periodic solution, we use the linear iterative skill and transfer the boundary value problem into two initial value ones by using the hyperbolic property of the system. Then the corresponding linearized system can be decoupled.~The uniqueness is a direct by-product of the stability. There is no small assumptions on the damping coefficient.


title: VLBI observations of VIK J2318-3113, a quasar at z = 6.44

abstract: The nature of jets in active galactic nuclei (AGN) in the early Universe and their feedback to the host galaxy remain a highly topical question. Observations of the radio structure of high-redshift AGNs enabled by very long baseline interferometry (VLBI) provide indispensable input into studies of their properties and role in the galaxies' evolution. Up to now, only five AGNs at redshift $z > 6$ have been studied with the VLBI technique. VIKJ2318-3113 is a recently discovered quasar at z = 6.44 that has not been imaged with VLBI before the current work. Here we present the first VLBI imaging results of this high-redshift quasar, with the aim of corroborating its high-resolution appearance with the physical model of the object. We carried out VLBI phase-referencing observations of VIKJ2318-3113 using the Very Long Baseline Array at two frequencies, 1.6 and 4.7 GHz, and obtained the first view at the radio structure on the milliarcsecond scale. The source was clearly detected at 1.6 GHz. We found that almost all of its radio emission comes from the pc-scale core region. Our dual-frequency observations constrain the spectral index and brightness temperature of the radio core. Its properties are similar to those of other known high-redshift radio-loud AGNs.


title: Rigidity for Lorentzian metrics with the same length of null-geodesics

abstract: We study the Lorentzian metric independent of the time variable in the cylinder $\mathbb{R}\times\Omega$ where $x_0\in\mathbb{R}$ is the time variable and $\Omega$ is a bounded smooth domain in $\mathbb{R}^n$. We consider forward null-geodesics in $\mathbb{R}\times \Omega$ starting on $\mathbb{R}\times\partial\Omega$ at $t=0$ and leaving $\mathbb{R}\times\Omega$ at some later time. We prove the following rigidity result: If two Lorentzian metrics are close enough in some norm and if corresponding null-geodesics have equal lengths then the metrics are equal.


title: S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization

abstract: Camera relocalization is the key component of simultaneous localization and mapping (SLAM) systems. This paper proposes a learning-based approach, named Sparse Spatial Scene Embedding with Graph Neural Networks (S3E-GNN), as an end-to-end framework for efficient and robust camera relocalization. S3E-GNN consists of two modules. In the encoding module, a trained S3E network encodes RGB images into embedding codes to implicitly represent spatial and semantic embedding code. With embedding codes and the associated poses obtained from a SLAM system, each image is represented as a graph node in a pose graph. In the GNN query module, the pose graph is transformed to form a embedding-aggregated reference graph for camera relocalization. We collect various scene datasets in the challenging environments to perform experiments. Our results demonstrate that S3E-GNN method outperforms the traditional Bag-of-words (BoW) for camera relocalization due to learning-based embedding and GNN powered scene matching mechanism.


title: AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling

abstract: Variational Auto-Encoder (VAE) has become the de-facto learning paradigm in achieving representation learning and generation for natural language at the same time. Nevertheless, existing VAE-based language models either employ elementary RNNs, which is not powerful to handle complex works in the multi-task situation, or fine-tunes two pre-trained language models (PLMs) for any downstream task, which is a huge drain on resources. In this paper, we propose the first VAE framework empowered with adaptive GPT-2s (AdaVAE). Different from existing systems, we unify both the encoder\&decoder of the VAE model using GPT-2s with adaptive parameter-efficient components, and further introduce Latent Attention operation to better construct latent space from transformer models. Experiments from multiple dimensions validate that AdaVAE is competent to effectively organize language in three related tasks (language modeling, representation modeling and guided text generation) even with less than $15\%$ activated parameters in training. Our code is available at \url{https://github.com/ImKeTT/AdaVAE}.


title: Quasi-static decomposition and the Gibbs factorial in small thermodynamic system

abstract: For small thermodynamic systems in contact with a heat bath, we determine the free energy by imposing the following two conditions. First, the quasi-static work in any configuration change is equal to the free energy difference. Second, the temperature dependence of the free energy satisfies the Gibbs-Helmholtz relation. We find that these prerequisites uniquely lead to the free energy of a classical system consisting of $N$-interacting identical particles, up to an additive constant proportional to $N$. The free energy thus determined contains the Gibbs factorial $N!$ in addition to the phase space integration of the Gibbs-Boltzmann factor. The key step in the derivation is to construct a quasi-static decomposition of small thermodynamic systems.


title: Optimal convergence rate of the explicit Euler method for convection-diffusion equations II: high dimensional cases

abstract: This is the second part of study on the optimal convergence rate of the explicit Euler discretization in time for the convection-diffusion equations [Appl. Math. Lett. \textbf{131} (2022) 108048] which focuses on high-dimensional linear/nonlinear cases under Dirichlet or Neumann boundary conditions. Several new corrected difference schemes are proposed based on the explicit Euler discretization in temporal derivative and central difference discretization in spatial derivatives. The priori estimate of the corrected scheme with application to constant convection coefficients is provided at length by the maximum principle and the optimal convergence rate four is proved when the step ratios along each direction equal to $1/6$. The corrected difference schemes have essentially improved {\rm \textbf{CFL}} condition and the numerical accuracy comparing with the classical difference schemes. Numerical examples involving two-/three-dimensional linear/nonlinear problems under Dirichlet/Neumann boundary conditions such as the Fisher equation, the Chafee-Infante equation, the Burgers' equation and classification to name a few substantiate the good properties claimed for the corrected difference scheme.