title: Retrieval Augmented Visual Question Answering with Outside Knowledge

abstract: Outside-Knowledge Visual Question Answering (OK-VQA) is a challenging VQA task that requires retrieval of external knowledge to answer questions about images. Recent OK-VQA systems use Dense Passage Retrieval (DPR) to retrieve documents from external knowledge bases, such as Wikipedia, but with DPR trained separately from answer generation, introducing a potential limit on the overall system performance. Instead, we propose a joint training scheme which includes differentiable DPR integrated with answer generation so that the system can be trained in an end-to-end fashion. Our experiments show that our scheme outperforms recent OK-VQA systems with strong DPR for retrieval. We also introduce new diagnostic metrics to analyze how retrieval and generation interact. The strong retrieval ability of our model significantly reduces the number of retrieved documents needed in training, yielding significant benefits in answer quality and computation required for training.


title: Gradient-Type Methods For Decentralized Optimization Problems With Polyak-{\L}ojasiewicz Condition Over Time-Varying Networks

abstract: This paper focuses on the decentralized optimization (minimization and saddle point) problems with objective functions that satisfy Polyak-{\L}ojasiewicz condition (PL-condition). The first part of the paper is devoted to the minimization problem of the sum-type cost functions. In order to solve a such class of problems, we propose a gradient descent type method with a consensus projection procedure and the inexact gradient of the objectives. Next, in the second part, we study the saddle-point problem (SPP) with a structure of the sum, with objectives satisfying the two-sided PL-condition. To solve such SPP, we propose a generalization of the Multi-step Gradient Descent Ascent method with a consensus procedure, and inexact gradients of the objective function with respect to both variables. Finally, we present some of the numerical experiments, to show the efficiency of the proposed algorithm for the robust least squares problem.


title: An Approximation Algorithm for Distance-Constrained Vehicle Routing on Trees

abstract: In the Distance-constrained Vehicle Routing Problem (DVRP), we are given a graph with integer edge weights, a depot, a set of $n$ terminals, and a distance constraint $D$. The goal is to find a minimum number of tours starting and ending at the depot such that those tours together cover all the terminals and the length of each tour is at most $D$. The DVRP on trees is of independent interest, because it is equivalent to the virtual machine packing problem on trees studied by Sindelar et al. [SPAA'11]. We design a simple and natural approximation algorithm for the tree DVRP, parameterized by $\varepsilon >0$. We show that its approximation ratio is $\alpha + \varepsilon$, where $\alpha \approx 1.691$, and in addition, that our analysis is essentially tight. The running time is polynomial in $n$ and $D$. The approximation ratio improves on the ratio of 2 due to Nagarajan and Ravi [Networks'12]. The main novelty of this paper lies in the analysis of the algorithm. It relies on a reduction from the tree DVRP to the bounded space online bin packing problem via a new notion of reduced length.


title: Primordial black holes from stochastic tunnelling

abstract: If the inflaton gets trapped in a local minimum of its potential shortly before the end of inflation, it escapes by building up quantum fluctuations in a process known as stochastic tunnelling. In this work we study cosmological fluctuations produced in such a scenario, and how likely they are to form Primordial Black Holes (PBHs). This is done by using the stochastic-$\delta N$ formalism, which allows us to reconstruct the highly non-Gaussian tails of the distribution function of the number of $e$-folds spent in the false-vacuum state. We explore two different toy models, both analytically and numerically, in order to identify which properties do or do not depend on the details of the false-vacuum profile. We find that when the potential barrier is small enough compared to its width, $\Delta V/V < \Delta\phi^2/M_{\text{Pl}}^2$, the potential can be approximated as being flat between its two local extrema, so results previously obtained in a "flat quantum well'' apply. Otherwise, when $\Delta V/V < V/M_{\text{Pl}}^4$, the PBH abundance depends exponentially on the height of the potential barrier, and when $\Delta V/V > V/M_{\text{Pl}}^4$ it depends super-exponentially ( i.e. as the exponential of an exponential) on the barrier height. In that later case PBHs are massively produced. This allows us to quantify how much flat inflection points need to be fine-tuned. In a deep false vacuum, we also find that slow-roll violations are typically encountered unless the potential is close to linear. This motivates further investigations to generalise our approach to non-slow-roll setups.


title: MOS: A Mathematical Optimization Service

abstract: We introduce MOS, a software application designed to facilitate the deployment, integration, management, and analysis of mathematical optimization models. MOS approaches mathematical optimization at a higher level of abstraction than existing optimization modeling systems, enabling its use with all of them. The sole requirement to harness MOS is a simple annotation of the code specifying the formulation of an optimization model. With this, the model becomes accessible to humans through the automatic generation of a user interface, and to machines through an associated API and client libraries. All this is achieved while avoiding the ad hoc code typically required to obtain such features.


title: Axions in the Early Universe

abstract: The Peccei-Quinn solution to the strong CP problem provides a motivated framework rich in cosmological consequence. Thermal axion production is unavoidable if there is a thermal bath at early times. Scattering and decay processes of bath particles can dump relativistic axions in the primordial plasma, and they can leave observable signatures in cosmological observables probing both the early and the late universe if produced with a significant abundance. We present recent and significant improvements for the calculation of the axion production rate for different scenarios and apply these results to predict the abundance of produced axions. Finally, we provide updated cosmological bounds on the QCD axion mass.


title: Scene-level Tracking and Reconstruction without Object Priors

abstract: We present the first real-time system capable of tracking and reconstructing, individually, every visible object in a given scene, without any form of prior on the rigidness of the objects, texture existence, or object category. In contrast with previous methods such as Co-Fusion and MaskFusion that first segment the scene into individual objects and then process each object independently, the proposed method dynamically segments the non-rigid scene as part of the tracking and reconstruction process. When new measurements indicate topology change, reconstructed models are updated in real-time to reflect that change. Our proposed system can provide the live geometry and deformation of all visible objects in a novel scene in real-time, which makes it possible to be integrated seamlessly into numerous existing robotics applications that rely on object models for grasping and manipulation. The capabilities of the proposed system are demonstrated in challenging scenes that contain multiple rigid and non-rigid objects.


title: Quantum bath suppression in a superconducting circuit by immersion cooling

abstract: Quantum circuits interact with the environment via several temperature-dependent degrees of freedom. Yet, multiple experiments to-date have shown that most properties of superconducting devices appear to plateau out at $T\approx 50$ mK -- far above the refrigerator base temperature. This is for example reflected in the thermal state population of qubits, in excess numbers of quasiparticles, and polarisation of surface spins -- factors contributing to reduced coherence. We demonstrate how to remove this thermal constraint by operating a circuit immersed in liquid $^3$He. This allows to efficiently cool the decohering environment of a superconducting resonator, and we see a continuous change in measured physical quantities down to previously unexplored sub-mK temperatures. The $^3$He acts as a heat sink which increases the energy relaxation rate of the quantum bath coupled to the circuit a thousand times, yet the suppressed bath does not introduce additional circuit losses or noise. Such quantum bath suppression can reduce decoherence in quantum circuits and opens a route for both thermal and coherence management in quantum processors.


title: Enhanced Magnetism in Heterostructures with Transition-Metal Dichalcogenide Monolayers

abstract: Two-dimensional materials and their heterostructures have opened up new possibilities for magnetism at the nanoscale. In this study, we utilize first-principles simulations to investigate the structural, electronic, and magnetic properties of $\textrm{Fe}/\textrm{WSe}_2/\textrm{Pt}$ systems containing pristine, defective, or doped $\textrm{WSe}_2$ monolayers. The proximity effects of the ferromagnetic Fe layer are studied by considering defective and vanadium-doped $\textrm{WSe}_2$ monolayers. All heterostructures are found to be ferromagnetic, and the insertion of the transition-metal dichalcogenide results in a redistribution of spin orientation and an increased density of magnetic atoms due to the magnetized $\textrm{WSe}_2$. There is an increase in the overall total density of states at the Fermi level due to $\textrm{WSe}_2$; however, the transition-metal dichalcogenide may lose its distinct semiconducting properties due to the stronger than van der Waals coupling. Spin-resolved electronic structure properties are linked to larger spin Seebeck coefficients found in heterostructures with $\textrm{WSe}_2$ monolayers.


title: Experimental electronic structure of the electrically switchable antiferromagnet CuMnAs

abstract: Tetragonal CuMnAs is a room temperature antiferromagnet with an electrically reorientable N\'eel vector and a Dirac semimetal candidate. Direct measurements of the electronic structure of single-crystalline thin films of tetragonal CuMnAs using angle-resolved photoemission spectroscopy (ARPES) are reported, including Fermi surfaces (FS) and energy-wavevector dispersions. After correcting for a chemical potential shift of $\approx-390$ meV (hole doping), there is excellent agreement of FS, orbital character of bands, and Fermi velocities between the experiment and density functional theory calculations. Additionally, 2x1 surface reconstructions are found in the low energy electron diffraction (LEED) and ARPES. This work underscores the need to control the chemical potential in tetragonal CuMnAs to enable the exploration and exploitation of the Dirac fermions with tunable masses, which are predicted to be above the chemical potential in the present samples.


title: Schottky Electric Field Induced Circular Photogalvanic Effect in Cd3As2 Nanobelts

abstract: Dirac semimetals are expected to forbid the manifestation of the circular photogalvanic effect (CPGE) because of their crystal inversion symmetry. Here, we report the observation of the CPGE in Cd3As2 nanobelt field effect transistors, when the photoexcitation is focused in the vicinity of the metal contacts up to room temperature. We attribute the CPGE to the Schottky electric field induced symmetry breaking, which results in the photocurrent modulation by circularly polarized photoexcitation via spin-momentum locking. The hypothesis is supported by a suite of experiments including spatially and angularly resolved helicity dependent photocurrent, Kelvin probe force microscopy, and gate voltage dependence. First principles calculations confirmed a topological phase transition upon field induced structural distortion. This work provides key insights on the electrically controlled helicity dependent optoelectronics in Dirac materials.


title: The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks

abstract: In this work, we explore the maximum-margin bias of quasi-homogeneous neural networks trained with gradient flow on an exponential loss and past a point of separability. We introduce the class of quasi-homogeneous models, which is expressive enough to describe nearly all neural networks with homogeneous activations, even those with biases, residual connections, and normalization layers, while structured enough to enable geometric analysis of its gradient dynamics. Using this analysis, we generalize the existing results of maximum-margin bias for homogeneous networks to this richer class of models. We find that gradient flow implicitly favors a subset of the parameters, unlike in the case of a homogeneous model where all parameters are treated equally. We demonstrate through simple examples how this strong favoritism toward minimizing an asymmetric norm can degrade the robustness of quasi-homogeneous models. On the other hand, we conjecture that this norm-minimization discards, when possible, unnecessary higher-order parameters, reducing the model to a sparser parameterization. Lastly, by applying our theorem to sufficiently expressive neural networks with normalization layers, we reveal a universal mechanism behind the empirical phenomenon of Neural Collapse.


title: Large Language Models can Implement Policy Iteration

abstract: This work presents In-Context Policy Iteration, an algorithm for performing Reinforcement Learning (RL), in-context, using foundation models. While the application of foundation models to RL has received considerable attention, most approaches rely on either (1) the curation of expert demonstrations (either through manual design or task-specific pretraining) or (2) adaptation to the task of interest using gradient methods (either fine-tuning or training of adapter layers). Both of these techniques have drawbacks. Collecting demonstrations is labor-intensive, and algorithms that rely on them do not outperform the experts from which the demonstrations were derived. All gradient techniques are inherently slow, sacrificing the "few-shot" quality that made in-context learning attractive to begin with. In this work, we present an algorithm, ICPI, that learns to perform RL tasks without expert demonstrations or gradients. Instead we present a policy-iteration method in which the prompt content is the entire locus of learning. ICPI iteratively updates the contents of the prompt from which it derives its policy through trial-and-error interaction with an RL environment. In order to eliminate the role of in-weights learning (on which approaches like Decision Transformer rely heavily), we demonstrate our algorithm using Codex, a language model with no prior knowledge of the domains on which we evaluate it.


title: Is margin all you need? An extensive empirical study of active learning on tabular data

abstract: Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on deep neural networks trained on 69 real-world tabular classification datasets from the OpenML-CC18 benchmark. We consider different data regimes and the effect of self-supervised model pre-training. Surprisingly, we find that the classical margin sampling technique matches or outperforms all others, including current state-of-art, in a wide range of experimental settings. To researchers, we hope to encourage rigorous benchmarking against margin, and to practitioners facing tabular data labeling constraints that hyper-parameter-free margin may often be all they need.


title: Three-sided pyramid wavefront sensor. II. Preliminary demonstration on the new CACTI testbed

abstract: The next generation of giant ground and space telescopes will have the light-collecting power to detect and characterize potentially habitable terrestrial exoplanets using high-contrast imaging for the first time. This will only be achievable if the performance of Giant Segmented Mirror Telescopes (GSMTs) extreme adaptive optics (ExAO) systems are optimized to their full potential. A key component of an ExAO system is the wavefront sensor (WFS), which measures aberrations from atmospheric turbulence. A common choice in current and next-generation instruments is the pyramid wavefront sensor (PWFS). ExAO systems require high spatial and temporal sampling of wavefronts to optimize performance, and as a result, require large detectors for the WFS. We present a closed-loop testbed demonstration of a three-sided pyramid wavefront sensor (3PWFS) as an alternative to the conventional four-sided pyramid wavefront (4PWFS) sensor for GSMT-ExAO applications on the new Comprehensive Adaptive Optics and Coronagraph Test Instrument (CACTI). The 3PWFS is less sensitive to read noise than the 4PWFS because it uses fewer detector pixels. The 3PWFS has further benefits: a high-quality three-sided pyramid optic is easier to manufacture than a four-sided pyramid. We detail the design of the two components of the CACTI system, the adaptive optics simulator and the PWFS testbed that includes both a 3PWFS and 4PWFS. A preliminary experiment was performed on CACTI to study the performance of the 3PWFS to the 4PWFS in varying strengths of turbulence using both the Raw Intensity and Slopes Map signal processing methods. This experiment was repeated for a modulation radius of 1.6 lambda/D and 3.25 lambda/D. We found that the performance of the two wavefront sensors is comparable if modal loop gains are tuned.


title: Physics Teaching and Educational Interdisciplinarity with A.V. Usova Revisited

abstract: The paper deals with pedagogical heritage of A.V. Usova (1921-2014) that yields insights into problems of interdisciplinary relationship in the school science education system. Her fundamental works were used as teaching guides in the preparation of physics teachers of all pedagogical universities of the Soviet Union and Russia. In this study, professor Usova is not an interdisciplinary researcher; she is a researcher of interdisciplinarity. Here is provided a short and consistent description of her views on teaching physics as a foundation of educational interdisciplinarity. Usova elaborated educational functions, classifications, organizational levels, ways of instantiating, content-related foundations of interdisciplinary relations, recommendations for practical applying interdisciplinary relations. Besides, Usova suggested a unified approach to the study of knowledge and skills through the generalized plans. And we would like not simply clarify, retell or restate the very powerful didactic discoveries of Usova, but consider opportunities of teaching across boundaries for actual educational challenges. The future of the field of didactics, which deals with the study of interdisciplinarity, is very interesting and attractive. This problem will always excite scientists, educators and teachers, and the futurity of science education depends on the ways it is solved.


title: See, Plan, Predict: Language-guided Cognitive Planning with Video Prediction

abstract: Cognitive planning is the structural decomposition of complex tasks into a sequence of future behaviors. In the computational setting, performing cognitive planning entails grounding plans and concepts in one or more modalities in order to leverage them for low level control. Since real-world tasks are often described in natural language, we devise a cognitive planning algorithm via language-guided video prediction. Current video prediction models do not support conditioning on natural language instructions. Therefore, we propose a new video prediction architecture which leverages the power of pre-trained transformers.The network is endowed with the ability to ground concepts based on natural language input with generalization to unseen objects. We demonstrate the effectiveness of this approach on a new simulation dataset, where each task is defined by a high-level action described in natural language. Our experiments compare our method again stone video generation baseline without planning or action grounding and showcase significant improvements. Our ablation studies highlight an improved generalization to unseen objects that natural language embeddings offer to concept grounding ability, as well as the importance of planning towards visual "imagination" of a task.


title: An Analysis of the Effects of Decoding Algorithms on Fairness in Open-Ended Language Generation

abstract: Several prior works have shown that language models (LMs) can generate text containing harmful social biases and stereotypes. While decoding algorithms play a central role in determining properties of LM generated text, their impact on the fairness of the generations has not been studied. We present a systematic analysis of the impact of decoding algorithms on LM fairness, and analyze the trade-off between fairness, diversity and quality. Our experiments with top-$p$, top-$k$ and temperature decoding algorithms, in open-ended language generation, show that fairness across demographic groups changes significantly with change in decoding algorithm's hyper-parameters. Notably, decoding algorithms that output more diverse text also output more texts with negative sentiment and regard. We present several findings and provide recommendations on standardized reporting of decoding details in fairness evaluations and optimization of decoding algorithms for fairness alongside quality and diversity.


title: Formation of c-C6H5CN ice using the SPACE TIGER experimental setup

abstract: Benzonitrile (c-C6H5CN) has been recently detected in cold and dense regions of the interstellar medium (ISM), where it has been used as a signpost of a rich aromatic organic chemistry that might lead to the production of polycyclic aromatic hydrocarbons (PAHs). One possible origin of this benzonitrile is interstellar ice chemistry involving benzene (c-C6H6) and nitrile molecules (organic molecules containing the -CN group). We have addressed the plausibility of this c-C6H5CN formation pathway through laboratory experiments using our new setup SPACE TIGER. The SPACE TIGER experimental setup is designed to explore the physics and chemistry of interstellar ice mantles using laser-based ice processing and product detection methods. We have found that c-C6H5CN is formed upon irradiation of c-C6H6$:CH3CN binary ice mixtures with 2 keV electrons and Lyman-alpha photons at low temperatures (4-10 K). Formation of c-C6H5CN was also observed when c-C6H6 and CH3CN were embedded in a CO ice matrix, but it was efficiently quenched in a H2O ice matrix. The results presented in this work imply that interstellar ice chemistry involving benzene and nitrile molecules could contribute to the formation of the observed benzonitrile only if these species are present on top of the ice mantles or embedded in the CO-rich ice layer, instead of being mixed into the H2O-rich ice layer.


title: Sampling-Based Decomposition Algorithms for Arbitrary Tensor Networks

abstract: We show how to develop sampling-based alternating least squares (ALS) algorithms for decomposition of tensors into any tensor network (TN) format. Provided the TN format satisfies certain mild assumptions, resulting algorithms will have input sublinear per-iteration cost. Unlike most previous works on sampling-based ALS methods for tensor decomposition, the sampling in our framework is done according to the exact leverage score distribution of the design matrices in the ALS subproblems. We implement and test two tensor decomposition algorithms that use our sampling framework in a feature extraction experiment where we compare them against a number of other decomposition algorithms.


title: Early Detection of Bark Beetle Attack Using Remote Sensing and Machine Learning: A Review

abstract: This paper provides a comprehensive review of past and current advances in the early detection of bark beetle-induced tree mortality from three primary perspectives: bark beetle & host interactions, RS, and ML/DL. In contrast to prior efforts, this review encompasses all RS systems and emphasizes ML/DL methods to investigate their strengths and weaknesses. We parse existing literature based on multi- or hyper-spectral analyses and distill their knowledge based on: bark beetle species & attack phases with a primary emphasis on early stages of attacks, host trees, study regions, RS platforms & sensors, spectral/spatial/temporal resolutions, spectral signatures, spectral vegetation indices (SVIs), ML approaches, learning schemes, task categories, models, algorithms, classes/clusters, features, and DL networks & architectures. Although DL-based methods and the random forest (RF) algorithm showed promising results, highlighting their potential to detect subtle changes across visible, thermal, and short-wave infrared (SWIR) spectral regions, they still have limited effectiveness and high uncertainties. To inspire novel solutions to these shortcomings, we delve into the principal challenges & opportunities from different perspectives, enabling a deeper understanding of the current state of research and guiding future research directions.


title: Novel critical phenomena in compressible polar active fluids: Dynamical and Functional Renormalization Group Studies

abstract: Active matter is not only relevant to living matter and diverse nonequilibrium systems, but also constitutes a fertile ground for novel physics. Indeed, dynamic renormalization group (DRG) analyses have uncovered many new universality classes (UCs) in polar active fluids (PAFs) - an archetype of active matter systems. However, due to the inherent technical difficulties in the DRG methodology, almost all previous studies have been restricted to polar active fluids in the incompressible or infinitely compressible (i.e., Malthusian) limits, and, when the $\epsilon$-expansion was used in conjunction, to the one-loop level. Here, we use functional renormalization group (FRG) methods to bypass some of these difficulties and unveil for the first time novel critical behavior in compressible polar active fluids, and calculate the corresponding critical exponents beyond the one-loop level. Specifically, we investigate the multicritical point of compressible PAFs, where the critical order-disorder transition coincides with critical phase separation. We first study the critical phenomenon using a DRG analysis and find that it is insufficient since two-loop effects are important to obtain a nontrivial correction to the scaling exponents. We then remedy this defect by using a FRG analysis. We find three novel universality classes and obtain their critical exponents, which we then use to show that at least two of these universality classes are out of equilibrium because they violate the fluctuation-dissipation relation.


title: How to Make Your Approximation Algorithm Private: A Black-Box Differentially-Private Transformation for Tunable Approximation Algorithms of Functions with Low Sensitivity

abstract: We develop a framework for efficiently transforming certain approximation algorithms into differentially-private variants, in a black-box manner. Specifically, our results focus on algorithms A that output an approximation to a function f of the form $(1-a)f(x)-k \leq A(x) \leq (1+a)f(x)+k$, where $k \in \mathbb{R}_{\geq 0}$ denotes additive error and $a \in [0,1)$ denotes multiplicative error can be``tuned" to small-enough values while incurring only a polynomial blowup in the running time/space. We show that such algorithms can be made DP without sacrificing accuracy, as long as the function f has small global sensitivity. We achieve these results by applying the smooth sensitivity framework developed by Nissim, Raskhodnikova, and Smith (STOC 2007). Our framework naturally applies to transform non-private FPRAS and FPTAS algorithms into $\epsilon$-DP approximation algorithms where the former case requires an additional postprocessing step. We apply our framework in the context of sublinear-time and sublinear-space algorithms, while preserving the nature of the algorithm in meaningful ranges of the parameters. Our results include the first (to the best of our knowledge) $\epsilon$-edge DP sublinear-time algorithm for estimating the number of triangles, the number of connected components, and the weight of a minimum spanning tree of a graph. In the area of streaming algorithms, our results include $\epsilon$-DP algorithms for estimating Lp-norms, distinct elements, and weighted minimum spanning tree for both insertion-only and turnstile streams. Our transformation also provides a private version of the smooth histogram framework, which is commonly used for converting streaming algorithms into sliding window variants, and achieves a multiplicative approximation to many problems, such as estimating Lp-norms, distinct elements, and the length of the longest increasing subsequence.


title: Molecular Gas Reservoirs in Massive Quiescent Galaxies at $\mathrm{z\sim0.7}$ Linked to Late Time Star Formation

abstract: We explore how the presence of detectable molecular gas depends on the inferred star formation histories (SFHs) in 8 massive, quiescent galaxies at $\mathrm{z\sim0.7}$. Half of the sample have clear detections of molecular gas, traced by CO(2-1). We find that the molecular gas content is unrelated to the rate of star formation decline prior to the most recent 1 Gyr, suggesting that the gas reservoirs are not leftover from their primary star formation epoch. However, the recent SFHs of CO-detected galaxies demonstrate evidence for secondary bursts of star formation in their last Gyr. The fraction of stellar mass formed in these secondary bursts ranges from $\mathrm{f_{burst}\approx0.3-6\%}$, and ended between $\mathrm{t_{end\mbox{-}burst}\approx0-330~Myr}$ ago. The CO-detected galaxies form a higher fraction of mass in the last Gyr ($\mathrm{f_{M_{1Gyr}}=2.6\pm1.8\%}$) compared to the CO-undetected galaxies ($\mathrm{f_{M_{1Gyr}}=0.2\pm0.1\%}$). The galaxies with gas reservoirs have enhanced late-time star formation, highlighting this as a contributing factor to the observed heterogeneity in the gas reservoirs in high-redshift quiescent galaxies. We find that the amount of gas and star formation driven by these secondary bursts are inconsistent with that expected from dry minor mergers, and instead are likely driven by recently-accreted gas i.e., gas-rich minor mergers. This conclusion would not have been made based on $\mathrm{SFR_{UV+IR}}$ measurements alone, highlighting the power of detailed SFH modeling in the interpretation of gas reservoirs. Larger samples are needed to understand the frequency of low-level rejuvenation among quiescent galaxies at intermediate redshifts, and to what extent this drives the diversity of molecular gas reservoirs.


title: Rotating proton rich nuclei: the birth of proton bound rotational bands, high-spin giant proton halos and rotation induced extension of nuclear landscape

abstract: It is shown for the first time that rotational bands which are proton unbound at zero or low spins can be transformed into proton bound ones at high spin by collective rotation of nuclear systems. This is due to strong Coriolis interaction which acts on high-$N$ or strongly mixed M orbitals and drives the highest in energy occupied single-particle states of nucleonic configurations into negative energy domain. Proton emission from such proton bound rotational states is suppressed by the disappearance of static pairing correlations at high spins of interest. These physical mechanisms lead to a substantial extension of the nuclear landscape beyond the spin zero proton drip line. In addition, a new phenomenon of the formation of giant proton halos in rotating nuclei emerges: it is triggered by the occupation of strongly mixed M intruder orbitals. Possible experimental fingerprints of the transition from particle bound to particle unbound part of rotational bands are discussed and compared for proton and neutron rich nuclei near and beyond respective drip lines.


title: Improved coarse-graining methods on two dimensional tensor networks including fermions

abstract: We show how to apply renormalization group algorithms incorporating entanglement filtering methods and a loop optimization to a tensor network which includes Grassmann variables which represent fermions in an underlying lattice field theory. As a numerical test a variety of quantities are calculated for two dimensional Wilson--Majorana fermions and for the two flavor Gross--Neveu model. The improved algorithms show much better accuracy for quantities such as the free energy and the determination of Fisher's zeros.


title: Micromotion-Synchronized Pulsed Doppler Cooling of Trapped Ions

abstract: We propose and demonstrate a new method for Doppler cooling trapped-ion crystals where the distribution of micromotion amplitudes may be large and uneven. The technique uses pulses of Doppler cooling light synchronized with the trap RF that selectively target ions when their velocity is near a node, leading to more uniform cooling across a crystal by a single tone of cooling light. We lay out a theoretical framework that describes where this technique is practical, and provide a simple experimental demonstration.


title: Learning the Dynamics of Compliant Tool-Environment Interaction for Visuo-Tactile Contact Servoing

abstract: Many manipulation tasks require the robot to control the contact between a grasped compliant tool and the environment, e.g. scraping a frying pan with a spatula. However, modeling tool-environment interaction is difficult, especially when the tool is compliant, and the robot cannot be expected to have the full geometry and physical properties (e.g., mass, stiffness, and friction) of all the tools it must use. We propose a framework that learns to predict the effects of a robot's actions on the contact between the tool and the environment given visuo-tactile perception. Key to our framework is a novel contact feature representation that consists of a binary contact value, the line of contact, and an end-effector wrench. We propose a method to learn the dynamics of these contact features from real world data that does not require predicting the geometry of the compliant tool. We then propose a controller that uses this dynamics model for visuo-tactile contact servoing and show that it is effective at performing scraping tasks with a spatula, even in scenarios where precise contact needs to be made to avoid obstacles.


title: Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guarantees

abstract: Deep equilibrium models (DEQ) have emerged as a powerful alternative to deep unfolding (DU) for image reconstruction. DEQ models-implicit neural networks with effectively infinite number of layers-were shown to achieve state-of-the-art image reconstruction without the memory complexity associated with DU. While the performance of DEQ has been widely investigated, the existing work has primarily focused on the settings where groundtruth data is available for training. We present self-supervised deep equilibrium model (SelfDEQ) as the first self-supervised reconstruction framework for training model-based implicit networks from undersampled and noisy MRI measurements. Our theoretical results show that SelfDEQ can compensate for unbalanced sampling across multiple acquisitions and match the performance of fully supervised DEQ. Our numerical results on in-vivo MRI data show that SelfDEQ leads to state-of-the-art performance using only undersampled and noisy training data.


title: Learning to embed semantic similarity for joint image-text retrieval

abstract: We present a deep learning approach for learning the joint semantic embeddings of images and captions in a Euclidean space, such that the semantic similarity is approximated by the L2 distances in the embedding space. For that, we introduce a metric learning scheme that utilizes multitask learning to learn the embedding of identical semantic concepts using a center loss. By introducing a differentiable quantization scheme into the end-to-end trainable network, we derive a semantic embedding of semantically similar concepts in Euclidean space. We also propose a novel metric learning formulation using an adaptive margin hinge loss, that is refined during the training phase. The proposed scheme was applied to the MS-COCO, Flicke30K and Flickr8K datasets, and was shown to compare favorably with contemporary state-of-the-art approaches.


title: Edge deletion to tree-like graph classes

abstract: For a fixed property (graph class) ${\Pi}$, given a graph G and an integer k, the ${\Pi}$-deletion problem consists in deciding if we can turn $G$ into a graph with the property ${\Pi}$ by deleting at most $k$ edges. The ${\Pi}$-deletion problem is known to be NP-hard for most of the well-studied graph classes, such as chordal, interval, bipartite, planar, comparability and permutation graphs, among others; even deletion to cacti is known to be NP-hard for general graphs. However, there is a notable exception: the deletion problem to trees is polynomial. Motivated by this fact, we study the deletion problem for some classes similar to trees, addressing in this way a knowledge gap in the literature. We prove that deletion to cacti is hard even when the input is a bipartite graph. On the positive side, we show that the problem becomes tractable when the input is chordal, and for the special case of quasi-threshold graphs we give a simpler and faster algorithm. In addition, we present sufficient structural conditions on the graph class ${\Pi}$ that imply the NP-hardness of the ${\Pi}$-deletion problem, and show that deletion from general graphs to some well-known subclasses of forests is NP-hard.


title: Many-body quantum chaos in stroboscopically-driven cold atoms

abstract: In quantum chaotic systems, the spectral form factor (SFF), defined as the Fourier transform of the two-level spectral correlation function, is known to follow random matrix theory (RMT), namely a 'ramp' followed by a 'plateau' in sufficiently late times. Recently, a generic early-time deviation from the RMT behavior, which we call the 'bump', was shown to exist in random quantum circuits and spin chains as toy models for many-body quantum chaotic systems. Here we demonstrate the existence of the 'bump-ramp-plateau' behavior in the SFF for a number of paradigmatic and stroboscopically-driven 1D cold atom models: (i) Bose-Hubbard model, (ii) spin$-1/2$ Bose-Hubbard model, and (iii) nonintegrable spin-$1$ condensate with contact or dipolar interactions. We find that the scaling of the many-body Thouless time $t_{\textrm{Th}}$ -- the onset of RMT -- , and the bump amplitude are more sensitive to variations in atom number than the lattice size regardless of the hyperfine structure, the symmetry classes, or the choice of driving protocol. Moreover, $t_{\textrm{Th}}$ scaling and the increase of the bump amplitude in atom number are significantly slower in spinor gases than interacting bosons in 1D optical lattices, demonstrating the role of locality. We obtain universal scaling functions of SFF which suggest power-law behavior for the bump regime in quantum chaotic cold-atom systems, and propose an interference measurement protocol.


title: Breaking BERT: Evaluating and Optimizing Sparsified Attention

abstract: Transformers allow attention between all pairs of tokens, but there is reason to believe that most of these connections - and their quadratic time and memory - may not be necessary. But which ones? We evaluate the impact of sparsification patterns with a series of ablation experiments. First, we compare masks based on syntax, lexical similarity, and token position to random connections, and measure which patterns reduce performance the least. We find that on three common finetuning tasks even using attention that is at least 78% sparse can have little effect on performance if applied at later transformer layers, but that applying sparsity throughout the network reduces performance significantly. Second, we vary the degree of sparsity for three patterns supported by previous work, and find that connections to neighbouring tokens are the most significant. Finally, we treat sparsity as an optimizable parameter, and present an algorithm to learn degrees of neighboring connections that gives a fine-grained control over the accuracy-sparsity trade-off while approaching the performance of existing methods.


title: Mutual Theory of Mind for Human-AI Communication

abstract: New developments are enabling AI systems to perceive, recognize, and respond with social cues based on inferences made from humans' explicit or implicit behavioral and verbal cues. These AI systems, equipped with an equivalent of human's Theory of Mind (ToM) capability, are currently serving as matchmakers on dating platforms, assisting student learning as teaching assistants, and enhancing productivity as work partners. They mark a new era in human-AI interaction (HAI) that diverges from traditional human-computer interaction (HCI), where computers are commonly seen as tools instead of social actors. Designing and understanding the human perceptions and experiences in this emerging HAI era becomes an urgent and critical issue for AI systems to fulfill human needs and mitigate risks across social contexts. In this paper, we posit the Mutual Theory of Mind (MToM) framework, inspired by our capability of ToM in human-human communications, to guide this new generation of HAI research by highlighting the iterative and mutual shaping nature of human-AI communication. We discuss the motivation of the MToM framework and its three key components that iteratively shape the human-AI communication in three stages. We then describe two empirical studies inspired by the MToM framework to demonstrate the power of MToM in guiding the design and understanding of human-AI communication. Finally, we discuss future research opportunities in human-AI interaction through the lens of MToM.


title: Differentially Private Deep Learning with ModelMix

abstract: Training large neural networks with meaningful/usable differential privacy security guarantees is a demanding challenge. In this paper, we tackle this problem by revisiting the two key operations in Differentially Private Stochastic Gradient Descent (DP-SGD): 1) iterative perturbation and 2) gradient clipping. We propose a generic optimization framework, called {\em ModelMix}, which performs random aggregation of intermediate model states. It strengthens the composite privacy analysis utilizing the entropy of the training trajectory and improves the $(\epsilon, \delta)$ DP security parameters by an order of magnitude. We provide rigorous analyses for both the utility guarantees and privacy amplification of ModelMix. In particular, we present a formal study on the effect of gradient clipping in DP-SGD, which provides theoretical instruction on how hyper-parameters should be selected. We also introduce a refined gradient clipping method, which can further sharpen the privacy loss in private learning when combined with ModelMix. Thorough experiments with significant privacy/utility improvement are presented to support our theory. We train a Resnet-20 network on CIFAR10 with $70.4\%$ accuracy via ModelMix given $(\epsilon=8, \delta=10^{-5})$ DP-budget, compared to the same performance but with $(\epsilon=145.8,\delta=10^{-5})$ using regular DP-SGD; assisted with additional public low-dimensional gradient embedding, one can further improve the accuracy to $79.1\%$ with $(\epsilon=6.1, \delta=10^{-5})$ DP-budget, compared to the same performance but with $(\epsilon=111.2, \delta=10^{-5})$ without ModelMix.


title: Iterative Methods at Lower Precision

abstract: Since numbers in the computer are represented with a fixed number of bits, loss of accuracy during calculation is unavoidable. At high precision where more bits (e.g. 64) are allocated to each number, round-off errors are typically small. On the other hand, calculating at lower precision, such as half (16 bits), has the advantage of being much faster. This research focuses on experimenting with arithmetic at different precision levels for large-scale inverse problems, which are represented by linear systems with ill-conditioned matrices. We modified the Conjugate Gradient Method for Least Squares (CGLS) and the Chebyshev Semi-Iterative Method (CS) with Tikhonov regularization to do arithmetic at lower precision using the MATLAB chop function, and we ran experiments on applications from image processing and compared their performance at different precision levels. We concluded that CGLS is a more stable algorithm, but overflows easily due to the computation of inner products, while CS is less likely to overflow but it has more erratic convergence behavior. When the noise level is high, CS outperforms CGLS by being able to run more iterations before overflow occurs; when the noise level is close to zero, CS appears to be more susceptible to accumulation of round-off errors.


title: Born this way: thin disc, thick disc, and isotropic spheroid formation in FIRE-2 Milky-Way-mass galaxy simulations

abstract: We investigate the formation of Milky-Way-mass galaxies using FIRE-2 LCDM cosmological zoom-in simulations by studying the orbital evolution of stars formed in the main progenitor of the galaxy, from birth to the present day. We classify in situ stars as isotropic spheroid, thick-disc, and thin-disc according to their orbital circularities and show that these components are assembled in a time-ordered sequence from early to late times, respectively. All simulated galaxies experience an early phase of bursty star formation that transitions to a late-time steady phase. This transition coincides with the time that the inner CGM virializes. During the early bursty phase, galaxies have irregular morphologies and new stars are born on radial orbits; these stars evolve into an isotropic spheroidal population today. The bulk of thick-disc stars form at intermediate times, during a clumpy-disc ``spin-up'' phase, slightly later than the peak of spheroid formation. At late times, once the CGM virializes and star formation ``cools down," stars are born on circular orbits within a narrow plane. Those stars mostly inhabit thin discs today. Broadly speaking, stars with disc-like or spheroid-like orbits today were born that way. Mergers onto discs and secular processes do affect kinematics in our simulations, but play only secondary roles in populating thick-disc and in situ spheroid populations at z=0. The age distributions of spheroid, thick disc, and thin disc populations scale self-similarly with the steady-phase transition time, which suggests that morphological age dating can be linked to the CGM virialization time in galaxies.


title: Breakdown of topological protection due to non-magnetic edge disorder in two-dimensional materials in the Quantum Spin Hall phase

abstract: We study the suppression of the conductance quantization in quantum spin Hall systems by a combined effect of electronic interactions and edge disorder, that is ubiquitous in exfoliated and CVD grown 2D materials. We show that the interplay between the electronic localized states due to edge defects and electron-electron interactions gives rise to local magnetic moments, that break time-reversal symmetry and the topological protection of the edge states in 2D topological systems. Our results suggest that edge disorder leads to small deviations of a perfect quantized conductance in short samples and to a strong conductance suppression in long ones. Our analysis is based on on the Kane-Mele model, an unrestricted Hubbard mean field Hamiltonian and on a self-consistent recursive Green's functions technique to calculate the transport quantities.


title: Graded sum formula for $\tilde{A}_1$-Soergel calculus and the nil-blob algebra

abstract: We study the representation theory of the Soergel calculus algebra $ A_w := \mbox{End}_{{\mathcal D}_{(W,S)}} (\underline{w}) $ over $\mathbb C$ in type $\tilde{A}_1$. We generalize the recent isomorphism between the nil-blob algebra ${\mathbb{NB}}_n$ and $ A_w $ to deal with the two-parameter blob algebra. Under this generalization, the two parameters correspond to the two simple roots for $\tilde{A}_1$. Using this, together with calculations involving the Jones-Wenzl idempotents for the Temperley-Lieb subalgebra of $ \mathbb{NB}_n$, we obtain a concrete diagonalization of the matrix of the bilinear form on the cell module $\Delta_w(v) $ for $ A_w $. The entries of the diagonalized matrices turn out to be products of roots for $\tilde{A}_1$. We use this to study Jantzen type filtrations of $ \Delta_w(v)$ for $A_w $. We show that at enriched Grothendieck group level the corresponding sum formula has terms $ \Delta_w(s_{\alpha }v)[ l(s_{\alpha }v)- l(v)] $, where $[ \cdot ] $ denotes grading shift.


title: An observability result related to active sensing

abstract: For a general class of translationally invariant systems with a specific category of nonlinearity in the output, this paper presents necessary and sufficient conditions for global observability. Critically, this class of systems cannot be stabilized to an isolated equilibrium point by dynamic output feedback. These analyses may help explain the active sensing movements made by animals when they perform certain motor behaviors, despite the fact that these active sensing movements appear to run counter to the primary motor goals. The findings presented here establish that active sensing underlies the maintenance of observability for such biological systems, which are inherently nonlinear due to the presence of the high-pass sensor dynamics.


title: ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering

abstract: With the recent advance in large pre-trained language models, researchers have achieved record performances in NLP tasks that mostly focus on language pattern matching. The community is experiencing the shift of the challenge from how to model language to the imitation of complex reasoning abilities like human beings. In this work, we investigate the application domain of finance that involves real-world, complex numerical reasoning. We propose a new large-scale dataset, ConvFinQA, aiming to study the chain of numerical reasoning in conversational question answering. Our dataset poses great challenge in modeling long-range, complex numerical reasoning paths in real-world conversations. We conduct comprehensive experiments and analyses with both the neural symbolic methods and the prompting-based methods, to provide insights into the reasoning mechanisms of these two divisions. We believe our new dataset should serve as a valuable resource to push forward the exploration of real-world, complex reasoning tasks as the next research focus. Our dataset and code is publicly available at https://github.com/czyssrs/ConvFinQA.


title: Toward an Over-parameterized Direct-Fit Model of Visual Perception

abstract: In this paper, we revisit the problem of computational modeling of simple and complex cells for an over-parameterized and direct-fit model of visual perception. Unlike conventional wisdom, we highlight the difference in parallel and sequential binding mechanisms between simple and complex cells. A new proposal for abstracting them into space partitioning and composition is developed as the foundation of our new hierarchical construction. Our construction can be interpreted as a product topology-based generalization of the existing k-d tree, making it suitable for brute-force direct-fit in a high-dimensional space. The constructed model has been applied to several classical experiments in neuroscience and psychology. We provide an anti-sparse coding interpretation of the constructed vision model and show how it leads to a dynamic programming (DP)-like approximate nearest-neighbor search based on $\ell_{\infty}$-optimization. We also briefly discuss two possible implementations based on asymmetrical (decoder matters more) auto-encoder and spiking neural networks (SNN), respectively.


title: Calibration: A Simple Trick for Wide-table Delta Analytics

abstract: Data analytics over normalized databases typically requires computing and materializing expensive joins (wide-tables). Factorized query execution models execution as message passing between relations in the join graph and pushes aggregations through joins to reduce intermediate result sizes. Although this accelerates query execution, it only optimizes a single wide-table query. In contrast, wide-table analytics is usually interactive and users want to apply delta to the initial query structure. For instance, users want to slice, dice and drill-down dimensions, update part of the tables and join with new tables for enrichment. Such Wide-table Delta Analytics offers novel work-sharing opportunities. This work shows that carefully materializing messages during query execution can accelerate Wide-table Delta Analytics by >10^5x as compared to factorized execution, and only incurs a constant factor overhead. The key challenge is that messages are sensitive to the message passing ordering. To address this challenge, we borrow the concept of calibration in probabilistic graphical models to materialize sufficient messages to support any ordering. We manifest these ideas in the novel Calibrated Junction Hypertree (CJT) data structure, which is fast to build, aggressively re-uses messages to accelerate future queries, and is incrementally maintainable under updates. We further show how CJTs benefit applications such as OLAP, query explanation, streaming data, and data augmentation for ML. Our experiments evaluate three versions of the CJT that run in a single-threaded custom engine, on cloud DBs, and in Pandas, and show 30x - 10^5x improvements over state-of-the-art factorized execution algorithms on the above applications.


title: Stackelberg POMDP: A Reinforcement Learning Approach for Economic Design

abstract: We introduce a reinforcement learning framework for economic design where the interaction between the environment designer and the participants is modeled as a Stackelberg game. In this game, the designer (leader) sets up the rules of the economic system, while the participants (followers) respond strategically. We integrate algorithms for determining followers' response strategies into the leader's learning environment, providing a formulation of the leader's learning problem as a POMDP that we call the Stackelberg POMDP. We prove that the optimal leader's strategy in the Stackelberg game is the optimal policy in our Stackelberg POMDP under a limited set of possible policies, establishing a connection between solving POMDPs and Stackelberg games. We solve our POMDP under a limited set of policy options via the centralized training with decentralized execution framework. For the specific case of followers that are modeled as no-regret learners, we solve an array of increasingly complex settings, including problems of indirect mechanism design where there is turn-taking and limited communication by agents. We demonstrate the effectiveness of our training framework through ablation studies. We also give convergence results for no-regret learners to a Bayesian version of a coarse-correlated equilibrium, extending known results to the case of correlated types.


title: Revisiting Self-Supervised Contrastive Learning for Facial Expression Recognition

abstract: The success of most advanced facial expression recognition works relies heavily on large-scale annotated datasets. However, it poses great challenges in acquiring clean and consistent annotations for facial expression datasets. On the other hand, self-supervised contrastive learning has gained great popularity due to its simple yet effective instance discrimination training strategy, which can potentially circumvent the annotation issue. Nevertheless, there remain inherent disadvantages of instance-level discrimination, which are even more challenging when faced with complicated facial representations. In this paper, we revisit the use of self-supervised contrastive learning and explore three core strategies to enforce expression-specific representations and to minimize the interference from other facial attributes, such as identity and face styling. Experimental results show that our proposed method outperforms the current state-of-the-art self-supervised learning methods, in terms of both categorical and dimensional facial expression recognition tasks.


title: One Analytical Approach of Rashba-Edelstein Magnetoresistance in 2D Materials

abstract: We study analytically the Rashba-Edelstein magnetoresistance (REMR) in a structure made from an insulator ferromagnet, such as yttrium iron garnet (YIG), and a 2D material (2DM) with direct and inverse Rashba-Edelstein effects, such as SLG and MoS$_2$. Our results represent an efficient way of analyzing the Rashba-Edelstein effects.


title: Safety Embedded Stochastic Optimal Control of Networked Multi-Agent Systems via Barrier States

abstract: This paper presents a novel approach for achieving safe stochastic optimal control in networked multi-agent systems (MASs). The proposed method incorporates barrier states (BaSs) into the system dynamics to embed safety constraints. To accomplish this, the networked MAS is factorized into multiple subsystems, and each one is augmented with BaSs for the central agent. The optimal control law is obtained by solving the joint Hamilton-Jacobi-Bellman (HJB) equation on the augmented subsystem, which guarantees safety via the boundedness of the BaSs. The BaS-based optimal control technique yields safe control actions while maintaining optimality. The safe optimal control solution is approximated using path integrals. To validate the effectiveness of the proposed approach, numerical simulations are conducted on a cooperative UAV team in two different scenarios.


title: Disordered vectors in R: introducing the disordR package

abstract: Objects in the {\tt stl map} class of {\tt C++} associate a value to each of a set of keys. Accessing values or keys of such an object is problematic in the R programming language because the value-key pairs are not stored in a well-defined order. This document motivates and discusses the concept of "disordered vector" as implemented by the {\tt disordR} package which facilitates the handling of {\tt map} objects. Values and keys of a map are stored in an implementation-specific way so certain extraction and replacement operations should be forbidden. For example, if values are real, then the "first" value is implementation specific\ldots but the maximum value has a well-defined result. The {\tt disordR} package makes forbidden operations impossible while allowing transparent R idiom for permitted operations. An illustrative R session is given in which the package is used abstractly, without reference to any particular application, and then shows how it can be used to manipulate multivariate polynomials. The {\tt disordR} package is a dependency of {\tt clifford}, {\tt freealg}, {\tt hyper2}, {\tt mvp}, {\tt spray}, {\tt stokes}, and {\tt weyl}. The {\tt disordR} package is available on CRAN at \url{https://CRAN.R-project.org/package=disordR}.


title: Constant-speed interface flow from unbalanced Glauber-Kawasaki dynamics

abstract: We derive the hydrodynamic limit of Glauber-Kawasaki dynamics. The Kawasaki part is simple and describes independent movement of the particles with hard core exclusive interactions. It is speeded up in a diffusive space-time scaling. The Glauber part describes the birth and death of particles. It is set to favor two levels of particle density with a preference for one of the two. It is also speeded up in time, but at a lesser rate than the Kawasaki part. Under this scaling, the limiting particle density instantly takes either of the two favored density values. The interface which separates these two values evolves with constant speed (Huygens' principle). Similar hydrodynamic limits have been derived in four recent papers. The crucial difference with these papers is that we consider Glauber dynamics which has a preferences for one of the two favored density values. As a result, we observe limiting dynamics on a shorter time scale, and the evolution is different from the mean curvature flow obtained in the four previous papers. While several steps in our proof can be adopted from these papers, the proof for the propagation of the interface is new.


title: AlphaTuning: Quantization-Aware Parameter-Efficient Adaptation of Large-Scale Pre-Trained Language Models

abstract: There are growing interests in adapting large-scale language models using parameter-efficient fine-tuning methods. However, accelerating the model itself and achieving better inference efficiency through model compression has not been thoroughly explored yet. Model compression could provide the benefits of reducing memory footprints, enabling low-precision computations, and ultimately achieving cost-effective inference. To combine parameter-efficient adaptation and model compression, we propose AlphaTuning consisting of post-training quantization of the pre-trained language model and fine-tuning only some parts of quantized parameters for a target task. Specifically, AlphaTuning works by employing binary-coding quantization, which factorizes the full-precision parameters into binary parameters and a separate set of scaling factors. During the adaptation phase, the binary values are frozen for all tasks, while the scaling factors are fine-tuned for the downstream task. We demonstrate that AlphaTuning, when applied to GPT-2 and OPT, performs competitively with full fine-tuning on a variety of downstream tasks while achieving >10x compression ratio under 4-bit quantization and >1,000x reduction in the number of trainable parameters.


title: Spectrally-Corrected and Regularized Linear Discriminant Analysis for Spiked Covariance Model

abstract: This paper proposes an improved linear discriminant analysis called spectrally-corrected and regularized LDA (SRLDA). This method integrates the design ideas of the sample spectrally-corrected covariance matrix and the regularized discriminant analysis. With the support of a large-dimensional random matrix analysis framework, it is proved that SRLDA has a linear classification global optimal solution under the spiked model assumption. According to simulation data analysis, the SRLDA classifier performs better than RLDA and ILDA and is closer to the theoretical classifier. Experiments on different data sets show that the SRLDA algorithm performs better in classification and dimensionality reduction than currently used tools.


title: Valence and magnetism in $\rm EuPd_3S_4$ and $\rm (Y,La)_xEu_{1-x}Pd_3S_4$

abstract: $^{151}$Eu M\"ossbauer spectroscopy shows that yttrium substitution in mixed-valent $\rm EuPd_3S_4$ drives the initial 50:50 mix of Eu$^{3+}$ and Eu$^{2+}$ towards pure Eu$^{2+}$, whereas lanthanum substitution has the opposite effect, but only for substitution levels above 50\%. We find that total valence electron count and chemical pressure effects cannot account for the observed behaviour, however conserving the cell volume provides a consistent description of the changes in the Eu$^{2+}$:Eu$^{3+}$ ratio. Remarkably, lanthanum substitution also leads to a clear transition from static mixed-valent behavior at lower temperatures to dynamic mixed valent behavior at higher temperatures, with the onset temperature monotonically increasing with Eu content and extrapolating to a value of $\sim$340~K for the pure $\rm EuPd_3S_4$ compound. Magnetic order persists at least as far as x=0.875 in both series, despite the drastic reduction in the amount of moment-carrying Eu$^{2+}$ ions.


title: Towards Light Weight Object Detection System

abstract: Transformers are a popular choice for classification tasks and as backbones for object detection tasks. However, their high latency brings challenges in their adaptation to lightweight object detection systems. We present an approximation of the self-attention layers used in the transformer architecture. This approximation reduces the latency of the classification system while incurring minimal loss in accuracy. We also present a method that uses a transformer encoder layer for multi-resolution feature fusion. This feature fusion improves the accuracy of the state-of-the-art lightweight object detection system without significantly increasing the number of parameters. Finally, we provide an abstraction for the transformer architecture called Generalized Transformer (gFormer) that can guide the design of novel transformer-like architectures.


title: Model Theory of Operator Systems and C$^*$-Algebras

abstract: We survey the model theory of operator systems and C$^*$-algebras.


title: Comprehensive Demonstration of Spin-Hall Hanle Effects in Epitaxial Pt Thin Films

abstract: We demonstrate a nonlinear Hall effect due to the boundary spin accumulation in Pt films grown on Al2O3 substrates. This Hall effect and the previously demonstrated Hanle magnetoresistance provide a complete picture of the spin-precession control of the spin and charge transport at the boundary of a spin-orbit coupled material, which we refer to as spin-Hall Hanle effects (SHHE). We also show that the SHHE can be employed to measure the spin diffusion length, the spin-Hall angle, and the spin relaxation time of heavy metal without the need of magnetic interface or the input from other measurements. The comprehensive demonstration of SHHE in such a simple system suggests they may be ubiquitous and needs to be considered for unravelling the spin and charge transport in more complex thin film structures of spin-orbit coupled materials.


title: Connectivity of Old and New Models of Friends-and-Strangers Graphs

abstract: In this paper, we investigate the connectivity of friends-and-strangers graphs, which were introduced by Defant and Kravitz in 2020. We begin by considering friends-and-strangers graphs arising from two random graphs and consider the threshold probability at which such graphs attain maximal connectivity. We slightly improve the lower bounds on the threshold probabilities, thus disproving two conjectures of Alon, Defant and Kravitz. We also improve the upper bound on the threshold probability in the case of random bipartite graphs, and obtain a tight bound up to a factor of $n^{o(1)}$. Further, we introduce a generalization of the notion of friends-and-strangers graphs in which vertices of the starting graphs are allowed to have multiplicities and obtain generalizations of previous results of Wilson and of Defant and Kravitz in this new setting.


title: Recover all Coefficients in Second-Order Hyperbolic Equations from Finite Sets of Boundary Measurements

abstract: We consider the inverse hyperbolic problem of recovering all spatial dependent coefficients, which are the wave speed, the damping coefficient, potential coefficient and gradient coefficient, in a second-order hyperbolic equation defined on an open bounded domain with smooth enough boundary. We show that by appropriately selecting finite pairs of initial conditions we can uniquely and Lipschitz stably recover all those coefficients from the corresponding boundary measurements of their solutions. The proofs are based on sharp Carleman estimate, continuous observability inequality and regularity theory for general second-order hyperbolic equations.


title: Symplectic mechanics of relativistic spinning compact bodies I.: Covariant foundations and integrability around black holes

abstract: In general relativity, the motion of an extended body moving in a given spacetime can be described by a particle on a (generally non-geodesic) worldline. In first approximation, this worldline is a geodesic of the underlying spacetime, and the resulting dynamics admit a covariant and 4-dimensional Hamiltonian formulation. In the case of a Kerr background spacetime, the Hamiltonian was shown to be integrable by B.~Carter and the now eponymous constant. At the next level of approximation, the particle possesses proper rotation (hereafter \textit{spin}), which couples the curvature of spacetime and drives the representative worldline away from geodesics. In this article, we lay the theoretical foundations of a series of works aiming at exploiting the Hamiltonian nature of the equations governing the motion of a spinning particle, at linear order in spin. Our formalism is covariant and 10-dimensional. It handles the degeneracies inherent to the local Lorentz invariance of general relativity with tools from Poisson geometry, and accounts for the center-of-mass/spin-supplementary-condition using constrained Hamiltonian system theory. As a first application, we consider the linear-in-spin motion in a Kerr background. We show that the resulting Hamiltonian system admits exactly five functionally independent integrals of motion related to Killing symmetries, thereby proving that the system is integrable. We conclude that linear-in-spin corrections to the geodesic motion do not break integrability, and that the resulting trajectories are not chaotic. We explain how this integrability feature can be used to reduce the computational cost of waveform generation schemes for asymmetric binary systems of compact objects.


title: 2-unitary Operads of GK-dimension 3

abstract: We study and classify the 2-unitary operads of Gelfand-Kirillov dimension three.


title: Remarks on the Grothendieck norm

abstract: The goal of this short note is to point out three observations around the Grothendieck norm and semidefinite programming. The first is that the Grothendieck norm captures the difficulty of relating the off-diagonal entries of a real, symmetric matrix to a probabilistic correlation, the second is that there is an interesting ``Fourier''-type duality between the Schur and Grothendieck norms of a real matrix, and the third and last centers around the difficulty of finding an efficiently computable noncommutative analog to the Grothendieck norm.


title: TAME: Task Agnostic Continual Learning using Multiple Experts

abstract: The goal of lifelong learning is to continuously learn from non-stationary distributions, where the non-stationarity is typically imposed by a sequence of distinct tasks. Prior works have mostly considered idealistic settings, where the identity of tasks is known at least at training. In this paper we focus on a fundamentally harder, so-called task-agnostic setting where the task identities are not known and the learning machine needs to infer them from the observations. Our algorithm, which we call TAME (Task-Agnostic continual learning using Multiple Experts), automatically detects the shift in data distributions and switches between task expert networks in an online manner. At training, the strategy for switching between tasks hinges on an extremely simple observation that for each new coming task there occurs a statistically-significant deviation in the value of the loss function that marks the onset of this new task. At inference, the switching between experts is governed by the selector network that forwards the test sample to its relevant expert network. The selector network is trained on a small subset of data drawn uniformly at random. We control the growth of the task expert networks as well as selector network by employing online pruning. Our experimental results show the efficacy of our approach on benchmark continual learning data sets, outperforming the previous task-agnostic methods and even the techniques that admit task identities at both training and testing, while at the same time using a comparable model size.


title: The closure relations in optical afterglow of Gamma-Ray Bursts

abstract: Gamma-ray bursts (GRBs) are extremely high-energy events that can be observed at very high redshift. In addition to gamma rays, they can emit in X-ray, optical, and sometimes radio wavelengths. Here, following the approach in Srinivasaragavan et al. (2020); Dainotti et al. (2021b,c), and Dainotti et al (2022, submitted), we consider 82 GRBs from Dainotti et al. (2022a) that have been observed in optical wavelengths and fitted with a broken power law (BPL). We consider the relations between the spectral and temporal indices (closure relations; CRs) according to the synchrotron forward-shock model evolving in the constant-density interstellar medium (ISM; k = 0) and the stellar Wind environment (k = 2) in both slow- and fast-cooling regimes, where the density profile is defined as n is proportional to r to the power minus k. We find the nu > max nuc, nu m regime is most favored, where nu c and nu m are the cooling and characteristic frequencies, respectively. Finally, we test the 2D Dainotti correlation between the rest-frame end time of the plateau and the luminosity at that time on GRBs that fulfill the most-favored CRs. When we compare the intrinsic scatter sigma int of those 2D correlations to the scatter presented in Dainotti et al. (2020b, 2022a), we see the scatters of our correlations generally agree with the previous values within 1sigma, both before and after correction for selection bias. This new information has helped us to pinpoint subsamples of GRBs with features that could drive the GRB emission mechanism, and eventually allow for GRBs to be used as standard candles


title: Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models

abstract: Multi-task learning (MTL), instruction tuning, and prompting have recently been shown to improve the generalizability of large language models to new tasks. However, the benefits of such methods are less well-documented in smaller language models, with some studies finding contradictory results. In this work, we explore and isolate the effects of (i) model size, (ii) general purpose MTL, (iii) in-domain MTL, (iv) instruction tuning, and (v) few-shot fine-tuning for models with fewer than 500 million parameters. Our experiments in the zero-shot setting demonstrate that models gain 31% relative improvement, on average, from general purpose MTL, with an additional 37.6% relative gain from in-domain MTL. Contradictory to prior works on large models, we find that instruction tuning provides a modest 2% performance improvement for small models.


title: Ulrich split rings

abstract: A local Cohen--Macaulay ring is called Ulrich-split if any short exact sequence of Ulrich modules split. In this paper we initiate the study of Ulrich split rings. We prove several necessary or sufficient criteria for this property, linking it to syzygies of the residue field and cohomology annihilator. We characterize Ulrich split rings of small dimensions. Over complex numbers, $2$-dimensional Ulrich split rings, which are normal and have minimal multiplicity, are precisely cyclic quotient singularities with at most two indecomposable Ulrich modules up to isomorphism. We give several ways to construct Ulrich split rings, and give a range of applications, from test ideal of the family of maximal Cohen--Macaulay modules, to detecting projective/injective modules via vanishing of $\operatorname{Ext}$.


title: The Solar Neighborhood L: Spectroscopic Discovery of K Dwarfs Younger Than 1 Gyr and New Binaries within 30 pc

abstract: As part of a comprehensive effort to characterize the nearest stars, the CHIRON echelle spectrograph on the CTIO/SMARTS 1.5m telescope is being used to acquire high resolution (R = 80000) spectra of K dwarfs within 50 parsecs. This paper provides spectral details about 35 K dwarfs from five benchmark sets with estimated ages spanning 20 Myr -- 5.7 Gyr. Four spectral age and activity indicators are tested, three of which aligned with the estimated ages of the benchmark groups -- the Na I doublet (5889.95 $\r{A}$ and 5895.92 $\r{A}$), the H$\alpha$ line (6562.8 $\r{A}$), and the Li I resonance line (6707.8 $\r{A}$). The benchmark stars are then used to evaluate seven field K dwarfs exhibiting variable radial velocities for which initial CHIRON data did not show obvious companions. Two of these stars are estimated to be younger than 700 Myr, while one exhibits stellar activity unusual for older K dwarf field stars and is possibly young. The four remaining stars turn out to be spectroscopic binaries, two of which are being reported here for the first time with orbital periods found using CHIRON data. Spectral analysis of the combined sample of 42 benchmark and variable radial velocity stars indicates temperatures ranging from 3900--5300 K and metallicities from $-$0.4 $<$ [Fe/H] $<$ $+$0.2. We also determine $log g$ = 4.5--4.7 for main sequence K dwarfs. Ultimately, this study will target several thousand of the nearest K dwarfs, and provide results that will serve present and future studies of stellar astrophysics and exoplanet habitability.


title: Compact Model of a Topological Transistor

abstract: The precession of a ferromagnet leads to the injection of spin current and heat into an adjacent non-magnetic material. Besides, spin-orbit entanglement causes an additional charge current injection. Such a device has been recently proposed where a quantum-spin hall insulator (QSHI) in proximity to a ferromagnetic insulator (FI) and superconductor (SC) leads to the pumping of charge, spin, and heat. Here we build a circuit-compatible Verilog-A-based compact model for the QSHI-FI-SC device capable of generating two topologically robust modes enabling the device operation. Our model also captures the dependence on the ferromagnetic precision, drain voltage, and temperature with an excellent (> 99%) accuracy.


title: Growth reduction of similarity transformed electronic Hamiltonians in qubit space

abstract: Accurately solving the electronic structure problem through the variational quantum eigensolver (VQE) is hindered by the available quantum resources of current and near-term devices. One approach to relieving the circuit depth requirements for VQE is to "pre-process" the electronic Hamiltonian by a similarity transformation incorporating some degree of electronic correlation, with the remaining correlation left to be addressed by the circuit ansatz. This often comes at the price of a substantial increase in the number of terms to measure in the similarity transformed Hamiltonian. In this work, we propose an efficient approach to sampling elements from the complete Pauli group for $N$ qubits which minimize the onset of new terms in the transformed Hamiltonian, while facilitating substantial energy lowering. We benchmark the growth-mitigating generator selection technique for ground state energy estimations applied to models of the H$_4$, N$_2$ and H$_2$O molecular systems. It is found that utilizing a selection procedure which obtains the growth-minimizing generator from the set of operators with maximal energy gradient is the most competitive approach to reducing the onset of Hamiltonian terms while achieving systematic energy lowering of the reference state.


title: Measurement of proton light yield of water-based liquid scintillator

abstract: The proton light yield of liquid scintillators is an important property in the context of their use in large-scale neutrino experiments, with direct implications for neutrino-proton scattering measurements and the discrimination of fast neutrons from inverse beta-decay coincidence signals. This work presents the first measurement of the proton light yield of a water-based liquid scintillator (WbLS) formulated from 5% linear alkyl benzene (LAB), at energies below 20 MeV, as well as a measurement of the proton light yield of a pure LAB + 2 g/L 2,5-diphenyloxazole (PPO) mixture (LABPPO). The measurements were performed using a double time-of-flight method and a pulsed neutron beam from the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory. The proton light yields were measured relative to that of a 477 keV electron. The relative proton light yield of WbLS was approximately 3.8% lower than that of LABPPO, itself exhibiting a relative proton light yield $15-20\%$ higher than previous measurements of an analogous anoxic sample. The observed quenching is not compatible with the Birks model for either material, but is well described with the addition of Chou's bimolecular quenching term.


title: Using Baryonic Charge Balance Functions to Resolve Questions about the Baryo-Chemistry of the QGP

abstract: Baryon annihilations during the hadronic stage of heavy-ion collisions affects final-state baryon and antibaryon yields and final-state correlations of baryons and antibaryons. Understanding annihilation is important for addressing questions about the chemistry at the beginning of the hadronic stage, and for interpreting charge-balance correlations involving baryons. Here, charge balance functions, using protons and antiprotons binned by relative momentum, rapidity and azimuthal angle, are shown to clarify the amount of annihilation in the hadronic stage. This enables a more accurate extraction of the baryo-chemistry at the beginning of the hadronic stage. Understanding annihilation is also crucial if charge balance correlations are to be used to infer the chemistry of the earliest stages of a heavy-ion collision. Calculations are presented based on microscopic simulations of the hadronic stage coupled to a hydrodynamic description of the earlier stage, along with a detailed modeling of correlations of protons and antiprotons, known as charge-balance functions.


title: An improved restriction estimate in $\mathbb{R}^3$

abstract: We improve the $L^{p}\rightarrow L^p$ restriction estimate in $\mathbb{R}^3$ to the range $p>3+3/14$, based on some Kakeya type incidence estimates and the refined decoupling theorem.


title: Improving Data-Efficient Fossil Segmentation via Model Editing

abstract: Most computer vision research focuses on datasets containing thousands of images of commonplace objects. However, many high-impact datasets, such as those in medicine and the geosciences, contain fine-grain objects that require domain-expert knowledge to recognize and are time-consuming to collect and annotate. As a result, these datasets contain few labeled images, and current machine vision models cannot train intensively on them. Originally introduced to correct large-language models, model-editing techniques in machine learning have been shown to improve model performance using only small amounts of data and additional training. Using a Mask R-CNN to segment ancient reef fossils in rock sample images, we present a two-part paradigm to improve fossil segmentation with few labeled images: we first identify model weaknesses using image perturbations and then mitigate those weaknesses using model editing. Specifically, we apply domain-informed image perturbations to expose the Mask R-CNN's inability to distinguish between different classes of fossils and its inconsistency in segmenting fossils with different textures. To address these shortcomings, we extend an existing model-editing method for correcting systematic mistakes in image classification to image segmentation with no additional labeled data needed and show its effectiveness in decreasing confusion between different kinds of fossils. We also highlight the best settings for model editing in our situation: making a single edit using all relevant pixels in one image (vs. using multiple images, multiple edits, or fewer pixels). Though we focus on fossil segmentation, our approach may be useful in other similar fine-grain segmentation problems where data is limited.


title: Constraining ultralight vector dark matter with the Parkes Pulsar Timing Array second data release

abstract: Composed of ultralight bosons, fuzzy dark matter provides an intriguing solution to challenges that the standard cold dark matter model encounters on sub-galactic scales. The ultralight dark matter with mass $m\sim10^{-23} \rm{eV}$ will induce a periodic oscillation in gravitational potentials with a frequency in the nanohertz band, leading to observable effects in the arrival times of radio pulses from pulsars. Unlike scalar dark matter, pulsar timing signals induced by the vector dark matter are dependent on the oscillation direction of the vector fields. In this work, we search for ultralight vector dark matter in the mass range of $[2\times 10^{-24}, 2\times 10^{-22}]{\rm{eV}}$ through its gravitational effect in the Parkes Pulsar Timing Array (PPTA) second data release. Since no statistically significant detection is made, we place $95\%$ upper limits on the local dark matter density as $\rho_{\rm{\tiny{VF}}} \lesssim 5{\rm{GeV/cm^{3}}}$ for $m\lesssim 10^{-23}{\rm{eV}}$. As no preferred direction is found for the vector dark matter, these constraints are comparable to those given by the scalar dark matter search with an earlier 12-year data set of PPTA.

categories: astro-ph.CO astro-ph.GA astro-ph.HE gr-qc hep-ph


title: Fourier Neural Solver for large sparse linear algebraic systems

abstract: Large sparse linear algebraic systems can be found in a variety of scientific and engineering fields, and many scientists strive to solve them in an efficient and robust manner. In this paper, we propose an interpretable neural solver, the Fourier Neural Solver (FNS), to address them. FNS is based on deep learning and Fast Fourier transform. Because the error between the iterative solution and the ground truth involves a wide range of frequency modes, FNS combines a stationary iterative method and frequency space correction to eliminate different components of the error. Local Fourier analysis reveals that the FNS can pick up on the error components in frequency space that are challenging to eliminate with stationary methods. Numerical experiments on the anisotropy diffusion equation, convection-diffusion equation, and Helmholtz equation show that FNS is more efficient and more robust than the state-of-the-art neural solver.


title: Investigation of Applying Quantum Neural Network of Early-Stage Breast Cancer Detection

abstract: Due to the heavy burden on medical institutes and computer-aided image diagnostics (CAD) have been gaining importance in diagnostic medicine to aid the medical staff to attain better service for the patients. Breast cancer is a fatal disease that can be treated successfully if it is detected early. Quantum neural network (QNN) has been introduced by many researchers around the world and presented recently by research corporations such as Microsoft, Google, and IBM. In this paper, we are trying to answer the question of: whether can the QNN be an effective method for mass-scale early breast cancer detection. This paper is dedicated to drawing a baseline for examining QNN, and the results showed a promising opportunity to use it for mass-scale screening using a fully functional quantum computer.


title: Rethinking the Detection Head Configuration for Traffic Object Detection

abstract: Multi-scale detection plays an important role in object detection models. However, researchers usually feel blank on how to reasonably configure detection heads combining multi-scale features at different input resolutions. We find that there are different matching relationships between the object distribution and the detection head at different input resolutions. Based on the instructive findings, we propose a lightweight traffic object detection network based on matching between detection head and object distribution, termed as MHD-Net. It consists of three main parts. The first is the detection head and object distribution matching strategy, which guides the rational configuration of detection head, so as to leverage multi-scale features to effectively detect objects at vastly different scales. The second is the cross-scale detection head configuration guideline, which instructs to replace multiple detection heads with only two detection heads possessing of rich feature representations to achieve an excellent balance between detection accuracy, model parameters, FLOPs and detection speed. The third is the receptive field enlargement method, which combines the dilated convolution module with shallow features of backbone to further improve the detection accuracy at the cost of increasing model parameters very slightly. The proposed model achieves more competitive performance than other models on BDD100K dataset and our proposed ETFOD-v2 dataset. The code will be available.


title: Don't Lose Yourself! Empathetic Response Generation via Explicit Self-Other Awareness

abstract: As a critical step to achieve human-like chatbots, empathetic response generation has attained increasing interests. Previous attempts are incomplete and not sufficient enough to elicit empathy because they only focus on the initial aspect of empathy to automatically mimic the feelings and thoughts of the user via other-awareness. However, they ignore to maintain and take the own views of the system into account, which is a crucial process to achieve the empathy called self-other awareness. To this end, we propose to generate Empathetic response with explicit Self-Other Awareness (EmpSOA). Specifically, three stages, self-other differentiation, self-other modulation and self-other generation, are devised to clearly maintain, regulate and inject the self-other aware information into the process of empathetic response generation. Both automatic and human evaluations on the benchmark dataset demonstrate the superiority of EmpSOA to generate more empathetic responses.


title: Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

abstract: In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as each target domain exhibits its own specialty, which is not adapted. Furthermore, expecting single-model training to learn extensive knowledge from multiple source domains is counterintuitive. The model is more biased toward learning only domain-invariant features and may result in negative knowledge transfer. In this work, we propose a novel framework for unsupervised test-time adaptation, which is formulated as a knowledge distillation process to address domain shift. Specifically, we incorporate Mixture-of-Experts (MoE) as teachers, where each expert is separately trained on different source domains to maximize their specialty. Given a test-time target domain, a small set of unlabeled data is sampled to query the knowledge from MoE. As the source domains are correlated to the target domains, a transformer-based aggregator then combines the domain knowledge by examining the interconnection among them. The output is treated as a supervision signal to adapt a student prediction network toward the target domain. We further employ meta-learning to enforce the aggregator to distill positive knowledge and the student network to achieve fast adaptation. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art and validates the effectiveness of each proposed component. Our code is available at https://github.com/n3il666/Meta-DMoE.


title: Locality and stability for phase retrieval

abstract: A frame $(x_j)_{j\in J}$ for a Hilbert space $H$ is said to do phase retrieval if for all distinct vectors $x,y\in H$ the magnitude of the frame coefficients $(|\langle x, x_j\rangle|)_{j\in J}$ and $(|\langle y, x_j\rangle|)_{j\in J}$ distinguish $x$ from $y$ (up to a unimodular scalar). We consider the weaker condition where the magnitude of the frame coefficients distinguishes $x$ from every vector $y$ in a small neighborhood of $x$ (up to a unimodular scalar). We prove that some of the important theorems for phase retrieval hold for this local condition, where as some theorems are completely different. We prove as well that when considering stability of phase retrieval, the worst stability inequality is always witnessed at orthogonal vectors. This allows for much simpler calculations when considering optimization problems for phase retrieval.


title: Improving End-to-End Text Image Translation From the Auxiliary Text Translation Task

abstract: End-to-end text image translation (TIT), which aims at translating the source language embedded in images to the target language, has attracted intensive attention in recent research. However, data sparsity limits the performance of end-to-end text image translation. Multi-task learning is a non-trivial way to alleviate this problem via exploring knowledge from complementary related tasks. In this paper, we propose a novel text translation enhanced text image translation, which trains the end-to-end model with text translation as an auxiliary task. By sharing model parameters and multi-task training, our model is able to take full advantage of easily-available large-scale text parallel corpus. Extensive experimental results show our proposed method outperforms existing end-to-end methods, and the joint multi-task learning with both text translation and recognition tasks achieves better results, proving translation and recognition auxiliary tasks are complementary.


title: Accelerated and Deep Expectation Maximization for One-Bit MIMO-OFDM Detection

abstract: In this paper we study the expectation maximization (EM) technique for one-bit MIMO-OFDM detection (OMOD). Arising from the recent interest in massive MIMO with one-bit analog-to-digital converters, OMOD is a massive-scale problem. EM is an iterative method that can exploit the OFDM structure to process the problem in a per-iteration efficient fashion. In this study we analyze the convergence rate of EM for a class of approximate maximum-likelihood OMOD formulations, or, in a broader sense, a class of problems involving regression from quantized data. We show how the SNR and channel conditions can have an impact on the convergence rate. We do so by making a connection between the EM and the proximal gradient methods in the context of OMOD. This connection also gives us insight to build new accelerated and/or inexact EM schemes. The accelerated scheme has faster convergence in theory, and the inexact scheme provides us with the flexibility to implement EM more efficiently, with convergence guarantee. Furthermore we develop a deep EM algorithm, wherein we take the structure of our inexact EM algorithm and apply deep unfolding to train an efficient structured deep net. Simulation results show that our accelerated exact/inexact EM algorithms run much faster than their standard EM counterparts, and that the deep EM algorithm gives promising detection and runtime performances.


title: Renormalization formalism for superconducting phase transition with inner-Cooper-pair dynamics

abstract: As charge carrier of the macroscopic superconductivity, the Cooper pair is a composite particle of two paired electrons, which has both center-of-mass and inner-pair degrees of freedom. In most cases, these two different degrees of freedom can be well described by the macroscopic Ginzburg-Landau theory and the microscopic Bardeen-Cooper-Schrieffer (BCS) theory, respectively. Near the superconducting phase transition where the Cooper pair is fragile and unstable because of the small binding energy, there are non-trivial couplings between these two different degrees of freedom due to such as finite energy and/or momentum transfer. The non-trivial couplings make the original derivation of the Ginzburg-Landau theory from the BCS theory fail in principle as where these two different degrees of freedom should not be decoupled. In this article, we will present a renormalization formalism for an extended Ginzburg-Landau action for the superconducting phase transition where there is finite energy transfer between the center-of-mass and the inner-pair degrees of freedom of Cooper pairs. This renormalization formalism will provide a theoretical tool to study the unusual dynamical effects of the inner-pair time-retarded physics on the superconducting phase transition.


title: Matching Estimators of Causal Effects in Clustered Observational Studies with Application to Quantifying the Impact of Marine Protected Areas on Biodiversity

abstract: Marine conservation preserves fish biodiversity, protects marine and coastal ecosystems, and supports climate resilience and adaptation. Despite the importance of establishing marine protected areas (MPAs), research on the effectiveness of MPAs with different conservation policies is limited due to the lack of quantitative MPA information. In this paper, leveraging a global MPA database, we investigate the causal impact of MPA policies on fish biodiversity. To address challenges posed by this clustered and confounded observational study, we construct a matching estimator of the average treatment effect and a cluster-weighted bootstrap method for variance estimation. We establish the theoretical guarantees of the matching estimator and its variance estimator. Under our proposed matching framework, we recommend matching on both cluster-level and unit-level covariates to achieve efficiency. The simulation results demonstrate that our matching strategy minimizes the bias and achieves the nominal confidence interval coverage. Applying our proposed matching method to compare different MPA policies reveals that the no-take policy is more effective than the multi-use policy in preserving fish biodiversity.


title: Trace ideal and annihilator of Ext and Tor of regular fractional ideals, and some applications

abstract: Given a commutative Noetherian ring $R$ with total ring of fractions $Q(R)$, and a finitely generated $R$-submodule $M$ of $Q(R)$, we prove an equality between trace ideal, and certain annihilator of Ext and Tor of $M$. As a consequence, we answer in one-dimensional local analytically unramified case, a question raised by the present author and R. Takahashi. As another application, we give an alternative proof of a recent result of \"O. Esentepe that for one-dimensional analytically unramified Gorenstein local rings, the cohomology annihilator of Iyengar and Takahashi coincides with the conductor ideal.