title: Optimized Quantum Phase Estimation for Simulating Electronic States in Various Energy Regimes

abstract: While quantum algorithms for simulation exhibit better asymptotic scaling than their classical counterparts, they currently cannot be implemented on real-world devices. Instead, chemists and computer scientists rely on costly classical simulations of these quantum algorithms. In particular, the quantum phase estimation (QPE) algorithm is among several approaches that have attracted much attention in recent years for its genuine quantum character. However, it is memory-intensive to simulate and intractable for moderate system sizes. This paper discusses the performance and applicability of QPESIM, a new simulation of the QPE algorithm designed to take advantage of modest computational resources. In particular, we demonstrate the versatility of QPESIM in simulating various electronic states by examining the ground and core-level states of H$_2$O. For these states, we also discuss the effect of the active-space size on the quality of the calculated energies. For the high-energy core-level states, we demonstrate that new QPE simulations for active spaces defined by 15 active orbitals significantly reduce the errors in core-level excitation energies compared to earlier QPE simulations using smaller active spaces.


title: Robust recovery of low-rank matrices and low-tubal-rank tensors from noisy sketches

abstract: A common approach for compressing large-scale data is through matrix sketching. In this work, we consider the problem of recovering low-rank matrices from two noisy linear sketches using the double sketching scheme discussed in Fazel et al. (2008), which is based on an approach by Woolfe et al. (2008). Using tools from non-asymptotic random matrix theory, we provide the first theoretical guarantees characterizing the error between the output of the double sketch algorithm and the ground truth low-rank matrix. We apply our result to the problems of low-rank matrix approximation and low-tubal-rank tensor recovery.


title: Learning code summarization from a small and local dataset

abstract: Foundation models (e.g., CodeBERT, GraphCodeBERT, CodeT5) work well for many software engineering tasks. These models are pre-trained (using self-supervision) with billions of code tokens, and then fine-tuned with hundreds of thousands of labeled examples, typically drawn from many projects. However, software phenomena can be very project-specific. Vocabulary, and other phenomena vary substantially with each project. Thus, training on project-specific data, and testing on the same project, is a promising idea. This hypothesis has to be evaluated carefully, e.g., in a time-series setting, to prevent training-test leakage. We compare several models and training approaches, including same-project training, cross-project training, training a model especially designed to be sample efficient (and thus prima facie well-suited for learning in a limited-sample same-project setting) and a maximalist hybrid approach, fine-tuning first on many projects in many languages and then training on the same-project. We find that the maximalist hybrid setting provides consistent, substantial gains over the state-of-the-art, on many different projects in both Java and Python.


title: Independent discovery of a nulling pulsar with unusual sub-pulse drifting properties with the Murchison Widefield Array

abstract: We report the independent discovery of PSR J0027-1956 with the Murchison Widefield Array (MWA) in the ongoing Southern-sky MWA Rapid Two-meter (SMART) pulsar survey. J0027-1956 has a period of ~1.306 s, a dispersion measure (DM) of ~20.869 pc cm^-3 , and a nulling fraction of ~77%. This pulsar highlights the advantages of the survey's long dwell times (~80 min), which, when fully searched, will be sensitive to the expected population of similarly bright, intermittent pulsars with long nulls. A single-pulse analysis in the MWA's 140-170 MHz band also reveals a complex sub-pulse drifting behavior, including both rapid changes of the drift rate characteristic of mode switching pulsars, as well as a slow, consistent evolution of the drift rate within modes. In some longer drift sequences, interruptions in the otherwise smooth drift rate evolution occur preferentially at a particular phase, typically lasting a few pulses. These properties make this pulsar an ideal test bed for prevailing models of drifting behavior such as the carousel model.


title: XBound-Former: Toward Cross-scale Boundary Modeling in Transformers

abstract: Skin lesion segmentation from dermoscopy images is of great significance in the quantitative analysis of skin cancers, which is yet challenging even for dermatologists due to the inherent issues, i.e., considerable size, shape and color variation, and ambiguous boundaries. Recent vision transformers have shown promising performance in handling the variation through global context modeling. Still, they have not thoroughly solved the problem of ambiguous boundaries as they ignore the complementary usage of the boundary knowledge and global contexts. In this paper, we propose a novel cross-scale boundary-aware transformer, \textbf{XBound-Former}, to simultaneously address the variation and boundary problems of skin lesion segmentation. XBound-Former is a purely attention-based network and catches boundary knowledge via three specially designed learners. We evaluate the model on two skin lesion datasets, ISIC-2016\&PH$^2$ and ISIC-2018, where our model consistently outperforms other convolution- and transformer-based models, especially on the boundary-wise metrics. We extensively verify the generalization ability of polyp lesion segmentation that has similar characteristics, and our model can also yield significant improvement compared to the latest models.


title: Applied Federated Learning: Architectural Design for Robust and Efficient Learning in Privacy Aware Settings

abstract: The classical machine learning paradigm requires the aggregation of user data in a central location where machine learning practitioners can preprocess data, calculate features, tune models and evaluate performance. The advantage of this approach includes leveraging high performance hardware (such as GPUs) and the ability of machine learning practitioners to do in depth data analysis to improve model performance. However, these advantages may come at a cost to data privacy. User data is collected, aggregated, and stored on centralized servers for model development. Centralization of data poses risks, including a heightened risk of internal and external security incidents as well as accidental data misuse. Federated learning with differential privacy is designed to avoid the server-side centralization pitfall by bringing the ML learning step to users' devices. Learning is done in a federated manner where each mobile device runs a training loop on a local copy of a model. Updates from on-device models are sent to the server via encrypted communication and through differential privacy to improve the global model. In this paradigm, users' personal data remains on their devices. Surprisingly, model training in this manner comes at a fairly minimal degradation in model performance. However, federated learning comes with many other challenges due to its distributed nature, heterogeneous compute environments and lack of data visibility. This paper explores those challenges and outlines an architectural design solution we are exploring and testing to productionize federated learning at Meta scale.


title: Fully relativistic $GW$/Bethe-Salpeter calculations in BerkeleyGW: implementation, symmetries, benchmarking, and performance

abstract: Computing the $GW$ quasiparticle bandstructure and Bethe-Salpeter Equation (BSE) absorption spectra for materials with spin-orbit coupling has commonly been done by treating $GW$ corrections and spin-orbit coupling as separate perturbations to density-functional theory. However, accurate treatment of materials with strong spin-orbit coupling often requires a fully relativistic approach using spinor wavefunctions in the Kohn-Sham equation and $GW$/BSE. Such calculations have only recently become available, in particular for the BSE. We have implemented this approach in the plane-wave pseudopotential $GW$/BSE code BerkeleyGW, which is highly parallelized and widely used in the electronic-structure community. We present reference results for quasiparticle bandstructures and optical absorption spectra of solids with different strengths of spin-orbit coupling, including Si, Ge, GaAs, GaSb, CdSe, Au, and Bi$_2$Se$_3$. The calculated quasiparticle band gaps of these systems are found to agree with experiment to within a few tens of meV. The absorption spectrum of GaSb calculated with the fully-relativistic $GW$-BSE captures the large spin-orbit splitting of peaks in the spectrum. For Bi$_2$Se$_3$, we find a drastic change in the low-energy bandstructure compared to that of DFT, with the fully-relativistic treatment of the $GW$ approximation correctly capturing the parabolic nature of the valence and conduction bands after including off-diagonal self-energy matrix elements. We present the detailed methodology, approach to spatial symmetries for spinors, comparison against other codes, and performance compared to spinless $GW$/BSE calculations and perturbative approaches to SOC. This work aims to spur further development of spinor $GW$/BSE methodology in excited-state research software.


title: Distilling Knowledge from Object Classification to Aesthetics Assessment

abstract: In this work, we point out that the major dilemma of image aesthetics assessment (IAA) comes from the abstract nature of aesthetic labels. That is, a vast variety of distinct contents can correspond to the same aesthetic label. On the one hand, during inference, the IAA model is required to relate various distinct contents to the same aesthetic label. On the other hand, when training, it would be hard for the IAA model to learn to distinguish different contents merely with the supervision from aesthetic labels, since aesthetic labels are not directly related to any specific content. To deal with this dilemma, we propose to distill knowledge on semantic patterns for a vast variety of image contents from multiple pre-trained object classification (POC) models to an IAA model. Expecting the combination of multiple POC models can provide sufficient knowledge on various image contents, the IAA model can easier learn to relate various distinct contents to a limited number of aesthetic labels. By supervising an end-to-end single-backbone IAA model with the distilled knowledge, the performance of the IAA model is significantly improved by 4.8% in SRCC compared to the version trained only with ground-truth aesthetic labels. On specific categories of images, the SRCC improvement brought by the proposed method can achieve up to 7.2%. Peer comparison also shows that our method outperforms 10 previous IAA methods.


title: Offline Reinforcement Learning with Differential Privacy

abstract: The offline reinforcement learning (RL) problem is often motivated by the need to learn data-driven decision policies in financial, legal and healthcare applications. However, the learned policy could retain sensitive information of individuals in the training data (e.g., treatment and outcome of patients), thus susceptible to various privacy risks. We design offline RL algorithms with differential privacy guarantees which provably prevent such risks. These algorithms also enjoy strong instance-dependent learning bounds under both tabular and linear Markov decision process (MDP) settings. Our theory and simulation suggest that the privacy guarantee comes at (almost) no drop in utility comparing to the non-private counterpart for a medium-size dataset.


title: Background-oriented Schlieren technique with vector tomography for measurement of axisymmetric pressure fields of laser-induced underwater shock waves

abstract: This study aims to overcome the problems that existing background-oriented schlieren (BOS) techniques based on computed tomography (CT-BOS) face when measuring pressure fields of laser-induced underwater shock waves. To do this, it proposes a novel BOS technique based on vector tomography (VT-BOS) of an axisymmetric target. The remarkable feature of the proposed technique is the reconstruction of an axisymmetric vector field with nonzero divergence, such as the field of a laser-induced underwater shock wave. This approach is based on an approximate relation between the projection of the axisymmetric vector field and the reconstructed vector field. For comparison, the pressure fields of underwater shock waves are measured with VT-BOS, CT-BOS, and a needle hydrophone. It is found that VT-BOS is significantly better than CT-BOS in terms of better convergence, less dependence on the spatial resolution of the acquired images, and lower computational cost. The proposed technique can be applied not only to fluid dynamical fields, but also to other axisymmetric targets in other areas, such as electromagnetics and thermodynamics.


title: Modeling sRGB Camera Noise with Normalizing Flows

abstract: Noise modeling and reduction are fundamental tasks in low-level computer vision. They are particularly important for smartphone cameras relying on small sensors that exhibit visually noticeable noise. There has recently been renewed interest in using data-driven approaches to improve camera noise models via neural networks. These data-driven approaches target noise present in the raw-sensor image before it has been processed by the camera's image signal processor (ISP). Modeling noise in the RAW-rgb domain is useful for improving and testing the in-camera denoising algorithm; however, there are situations where the camera's ISP does not apply denoising or additional denoising is desired when the RAW-rgb domain image is no longer available. In such cases, the sensor noise propagates through the ISP to the final rendered image encoded in standard RGB (sRGB). The nonlinear steps on the ISP culminate in a significantly more complex noise distribution in the sRGB domain and existing raw-domain noise models are unable to capture the sRGB noise distribution. We propose a new sRGB-domain noise model based on normalizing flows that is capable of learning the complex noise distribution found in sRGB images under various ISO levels. Our normalizing flows-based approach outperforms other models by a large margin in noise modeling and synthesis tasks. We also show that image denoisers trained on noisy images synthesized with our noise model outperforms those trained with noise from baselines models.


title: Two Candidate KH 15D-like Systems from the Zwicky Transient Facility

abstract: KH 15D contains a circumbinary disk that is tilted relative to the orbital plane of the central binary. The precession of the disk and the orbital motion of the binary together produce rich phenomena in the photometric light curve. In this work, we present the discovery and preliminary analysis of two objects that resemble the key features of KH 15D from the Zwicky Transient Facility. These new objects, Bernhard-1 and Bernhard-2, show large-amplitude ($>1.5\,$mag), long-duration (more than tens of days), and periodic dimming events. A one-sided screen model is developed to model the photometric behaviour of these objects, the physical interpretation of which is a tilted, warped circumbinary disk occulting the inner binary. Changes in the object light curves suggest potential precession periods over timescales longer than 10 years. Additional photometric and spectroscopic observations are encouraged to better understand the nature of these interesting systems.


title: Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging

abstract: Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic approximation is a viable alternative in many applications, including gradient-free optimization and reinforcement learning. It was assumed in prior research that the optimal achievable convergence rate is $O(n^{-2})$. It is shown in this paper that through design it is possible to obtain far faster convergence, of order $O(n^{-4+\delta})$, with $\delta>0$ arbitrary. Two techniques are introduced for the first time to achieve this rate of convergence. The theory is also specialized within the context of gradient-free optimization, and tested on standard benchmarks. The main results are based on a combination of novel application of results from number theory and techniques adapted from stochastic approximation theory.


title: Coherent control techniques in three-level quantum sensing

abstract: Quantum coherent control of a quantum system with high-fidelity is rather important in quantum computation and quantum information processing. There are many control techniques to reach these targets, such as resonant excitation, adiabatic passages, shortcuts to adiabaticity, and so on. However, for a single pulse to realize population transfer, the external tiny error has a trivial influence on the final population. The repeated application of the same pulse will greatly amplify the error effect, making it easy to be detected. Here, we propose to measure small control errors in three-level quantum systems by coherent amplification of their effects, using several coherent control techniques. For the two types of Hamiltonian with SU(2) dynamic symmetry, we analyze how the fidelity of population transfer are affected by Rabi frequencies fluctuation and static detuning deviation, based on the pulse sequence with alternating and same phases, respectively. It is found that the sensitivity of detecting these errors can be effectively amplified by the control pulse sequences. Furthermore, we discuss the efficiency of sensing the two errors with these control techniques by comparing the full width at half maximum of the population profiles. The results provide an accurate and reliable way for sensing the weak error in three-level quantum systems by applying repeatedly the coherent control pulse.


title: Quintet formation and exchange fluctuations: The role of stochastic resonance in singlet fission

abstract: Singlet fission describes the spin-conserving production of two triplet excitons from one singlet exciton. The existence of a spin-2 (quintet) triplet-pair state as a product of singlet fission is well established in the literature, and control of quintet formation is an important step towards applying singlet fission in photovoltaics and quantum information. However, a definitive mechanism for quintet formation is yet to be established, which makes it difficult to design materials for optimal quintet formation. Here we outline a mechanism in which inter-triplet exchange coupling fluctuations drive fast and efficient quintet formation. In contrast with conventional wisdom, we show that quintet population can arise despite strong exchange coupling. We evaluate the performance of this quintet formation mechanism in two regimes of conformational freedom, and relate quintet dynamics to material properties of singlet fission molecules.


title: Isothermal and adiabatic elastic constants from virial fluctuations

abstract: We derive expressions for classical isothermal and adiabatic elastic constants for periodic systems with the boundary contributions included explicitly. The potential-dependent part of these expressions is written in terms of potential energies of atomic groups that make up the total potential energy. It is shown that in the thermodynamic limit, the Born term, which depends on the second derivatives of potential energy, can be expressed exactly in terms of equilibrium averages that involve two types of atomic-group virials. As a result, the new form of the Born term involves only first derivatives of either atomic-group or total potential energies. The derived elastic constant expressions involving the two forms of the Born terms are tested and compared using molecular-dynamics simulations of crystalline argon and silicon. For both materials, the elastic constants obtained using the two forms of the Born term are in good agreement. In particular, the new form of the Born term converges to the same value as the original Born term but at a slower rate. The results for silicon also agree well with the results from the previous molecular-dynamics studies.


title: Economic complexity and inequality at the national and regional level

abstract: Recent studies have found evidence of a negative association between economic complexity and inequality at the country level. Moreover, evidence suggests that sophisticated economies tend to outsource products that are less desirable (e.g. in terms of wage and inequality effects), and instead focus on complex products requiring networks of skilled labor and more inclusive institutions. Yet the negative association between economic complexity and inequality on a coarse scale could hide important dynamics at a fine-grained level. Complex economic activities are difficult to develop and tend to concentrate spatially, leading to 'winner-take-most' effects that spur regional inequality in countries. Large, complex cities tend to attract both high- and low-skills activities and workers, and are also associated with higher levels of hierarchies, competition, and skill premiums. As a result, the association between complexity and inequality reverses at regional scales; in other words, more complex regions tend to be more unequal. Ideas from polarization theories, institutional changes, and urban scaling literature can help to understand this paradox, while new methods from economic complexity and relatedness can help identify inclusive growth constraints and opportunities.


title: Conditional estimates for the logarithmic derivative of Dirichlet $L$-functions

abstract: Assuming the Generalized Riemann Hypothesis, we establish explicit bounds in the $q$-aspect for the logarithmic derivative $\left(L'/L\right)\left(\sigma,\chi\right)$ of Dirichlet $L$-functions, where $\chi$ is a primitive character modulo $q\geq 10^{30}$ and $1/2+1/\log{\log{q}}\leq\sigma\leq 1-1/\log\log q$. In addition, for $\sigma=1$ we improve upon the result by Ihara, Murty and Shimura (2009). Similar results for the logarithmic derivative of the Riemann zeta-function are given.


title: NIPQ: Noise proxy-based Integrated Pseudo-Quantization

abstract: Straight-through estimator (STE), which enables the gradient flow over the non-differentiable function via approximation, has been favored in studies related to quantization-aware training (QAT). However, STE incurs unstable convergence during QAT, resulting in notable quality degradation in low precision. Recently, pseudoquantization training has been proposed as an alternative approach to updating the learnable parameters using the pseudo-quantization noise instead of STE. In this study, we propose a novel noise proxy-based integrated pseudoquantization (NIPQ) that enables unified support of pseudoquantization for both activation and weight by integrating the idea of truncation on the pseudo-quantization framework. NIPQ updates all of the quantization parameters (e.g., bit-width and truncation boundary) as well as the network parameters via gradient descent without STE instability. According to our extensive experiments, NIPQ outperforms existing quantization algorithms in various vision and language applications by a large margin.


title: A Confirmation of a Conjecture on the Feldman's Two-armed Bandit Problem

abstract: Myopic strategy is one of the most important strategies when studying bandit problems. In this paper, we consider the two-armed bandit problem proposed by Feldman. With general distributions and utility functions, we obtain a necessary and sufficient condition for the optimality of the myopic strategy. As an application, we could solve Nouiehed and Ross's conjecture for Bernoulli two-armed bandit problems that myopic strategy stochastically maximizes the number of wins.


title: Comparison of theoretical approaches for epidemic processes with waning immunity in complex networks

abstract: The role of waning immunity in basic epidemic models on networks has been undervalued while being noticeable fundamental for real epidemic outbreaks. One central question is which mean-field approach is more accurate in describing the epidemic dynamics. We tackled this problem considering the susceptible-infected-recovered-susceptible (SIRS) epidemic model on networks. Two pairwise mean-field theories, one based on recurrent dynamical message-passing (rDMP) and the other on the pair quenched mean-field theory (PQMF), are compared with extensive stochastic simulations on large networks of different levels of heterogeneity. For waning immunity times longer than or comparable with the recovering time, rDMP outperforms PQMF theory on power-law networks with degree distribution $P(k) \sim k^{-\gamma}$. In particular, for $\gamma > 3$, the epidemic threshold observed in simulations is finite, in qualitative agreement with rDMP, while PQMF leads to an asymptotically null threshold. The critical epidemic prevalence for $\gamma > 3$ is localized in a finite set of vertices in the case of the PQMF theory. In contrast, the localization happens in a subextensive fraction of the network in rDMP theory. Simulations, however, indicate that localization patterns of the actual epidemic lay between the two mean-field theories, and improved theoretical approaches are necessary to understanding the SIRS dynamics.


title: Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules

abstract: To unveil how the brain learns, ongoing work seeks biologically-plausible approximations of gradient descent algorithms for training recurrent neural networks (RNNs). Yet, beyond task accuracy, it is unclear if such learning rules converge to solutions that exhibit different levels of generalization than their nonbiologically-plausible counterparts. Leveraging results from deep learning theory based on loss landscape curvature, we ask: how do biologically-plausible gradient approximations affect generalization? We first demonstrate that state-of-the-art biologically-plausible learning rules for training RNNs exhibit worse and more variable generalization performance compared to their machine learning counterparts that follow the true gradient more closely. Next, we verify that such generalization performance is correlated significantly with loss landscape curvature, and we show that biologically-plausible learning rules tend to approach high-curvature regions in synaptic weight space. Using tools from dynamical systems, we derive theoretical arguments and present a theorem explaining this phenomenon. This predicts our numerical results, and explains why biologically-plausible rules lead to worse and more variable generalization properties. Finally, we suggest potential remedies that could be used by the brain to mitigate this effect. To our knowledge, our analysis is the first to identify the reason for this generalization gap between artificial and biologically-plausible learning rules, which can help guide future investigations into how the brain learns solutions that generalize.


title: Discrete bilinear operators and commutators

abstract: We discuss boundedness properties of certain classes of discrete bilinear operators that are similar to those of the continuous bilinear pseudodifferential operators with symbols in the H\"ormander classes $BS^{\omega}_{1, 0}$. In particular, we investigate their relation to discrete analogues of the bilinear Calder\'on-Zygmund singular integral operators and show compactness of their commutators.


title: Nonconformal Domain Decomposition Method Based on the Hybrid SIE-PDE Formulation for Flexible Transverse Magnetic Analysis

abstract: A nonconformal domain decomposition method based on the hybrid surface integral equation partial differential equation (SIE-PDE) formulation is proposed to solve the transverse magnetic electromagnetic problems. In the hybrid SIE-PDE formulation, an equivalent model with only the electric current density is first constructed, and then is embedded into the inhomogeneous Helmholtz equation as an excitation. A connection matrix, which couples the interfaces of the SIE and PDE domains, is carefully designed to support nonconformal meshes. Since meshes in each domain are independently generated, it is much more efficient and flexible to model multiscale and complex structures compared with the original hybrid SIE-PDE formulation with conformal meshes. The proposed formulation is efficient, flexible and easy to implement. Its accuracy, efficiency and flexibility are validated by three numerical examples.


title: BayesFormer: Transformer with Uncertainty Estimation

abstract: Transformer has become ubiquitous due to its dominant performance in various NLP and image processing tasks. However, it lacks understanding of how to generate mathematically grounded uncertainty estimates for transformer architectures. Models equipped with such uncertainty estimates can typically improve predictive performance, make networks robust, avoid over-fitting and used as acquisition function in active learning. In this paper, we introduce BayesFormer, a Transformer model with dropouts designed by Bayesian theory. We proposed a new theoretical framework to extend the approximate variational inference-based dropout to Transformer-based architectures. Through extensive experiments, we validate the proposed architecture in four paradigms and show improvements across the board: language modeling and classification, long-sequence understanding, machine translation and acquisition function for active learning.


title: Universal Polar Coding for Parallel Gaussian Channels with Non-Binary Inputs and Its Applications to HARQ and MIMO

abstract: In this paper, we first propose an universal polar coding scheme for parallel Gaussian channels with non-binary inputs. It is assumed that the encoder knows only the sum capacity of M parallel channels instead of the capacity of any single channel. By decomposing each parallel channel into T = [log2r] sub channels, we therefore obtain MT binary sub-channels. A super polar coding scheme that across all sub-channels is then proposed. This scheme can achieve the sum capacity when the block length is sufficiently large. We have also discussed the applications of parallel polar coding design for both the HARQ and MIMO systems. It is shown that a capacity-achieving HARQ scheme can be obtained for block fading channel and a capacity-achieving MIMO design that requires only the feedback of the sum rate of all MIMO layers can also be attained.


title: Decentralized temperature and storage volume control in multi-producer district heating

abstract: Modern district heating technologies have a great potential to make the energy sector more flexible and sustainable due to their capabilities to use energy sources of varied nature and to efficiently store energy for subsequent use. Central control tasks within these systems for the efficient and safe distribution of heat refer to the stabilization of overall system temperatures and the regulation of storage units state of charge. These are challenging goals when the networked and nonlinear nature of district heating system models is taken into consideration. In this letter, for district heating systems with multiple, distributed heat producers, we propose a decentralized control scheme to provably meet said tasks stably.


title: Kirillov theory for $C^*(G,\Omega)$

abstract: Let $G$ be a simply connected nilpotent Lie group with Lie algebra $\frak g$; let $\frak g^*$ be the dual of $\frak g$. Let $\Omega$ be a locally compact second countable Hausdorff space with a continuous $G$ action, and let $C^*(G,\Omega)$ be the corresponding transformation group $C^*$ algebra. We construct a continuous surjective map $\phi$ from a quotient space, $\frak g^*\times\Omega/\sim$, which is a homeomorphism from $\frak g^*\times\Omega/\sim$ to Prim$(C^*(G,\Omega))$. We also describe a character theory for $C^*(G,\Omega)$ which generalizes Kirillov character theory for $G$.


title: Progressive Purification for Instance-Dependent Partial Label Learning

abstract: Partial label learning (PLL) aims to train multiclass classifiers from the examples each annotated with a set of candidate labels where a fixed but unknown candidate label is correct. In the last few years, the instance-independent generation process of candidate labels has been extensively studied, on the basis of which many theoretical advances have been made in PLL. Nevertheless, the candidate labels are always instance-dependent in practice and there is no theoretical guarantee that the model trained on the instance-dependent PLL examples can converge to an ideal one. In this paper, a theoretically grounded and practically effective approach named POP, i.e. PrOgressive Purification for instance-dependent partial label learning, is proposed. Specifically, POP updates the learning model and purifies each candidate label set progressively in every epoch. Theoretically, we prove that POP enlarges the region appropriately fast where the model is reliable, and eventually approximates the Bayes optimal classifier with mild assumptions. Technically, POP is flexible with arbitrary PLL losses and could improve the performance of the previous PLL losses in the instance-dependent case. Experiments on the benchmark datasets and the real-world datasets validate the effectiveness of the proposed method.


title: Dynamic Cardiac MRI Reconstruction Using Combined Tensor Nuclear Norm and Casorati Matrix Nuclear Norm Regularizations

abstract: Low-rank tensor models have been applied in accelerating dynamic magnetic resonance imaging (dMRI). Recently, a new tensor nuclear norm based on t-SVD has been proposed and applied to tensor completion. Inspired by the different properties of the tensor nuclear norm (TNN) and the Casorati matrix nuclear norm (MNN), we introduce a combined TNN and Casorati MNN regularizations framework to reconstruct dMRI, which we term as TMNN. The proposed method simultaneously exploits the spatial structure and the temporal correlation of the dynamic MR data. The optimization problem can be efficiently solved by the alternating direction method of multipliers (ADMM). In order to further improve the computational efficiency, we develop a fast algorithm under the Cartesian sampling scenario. Numerical experiments based on cardiac cine MRI and perfusion MRI data demonstrate the performance improvement over the traditional Casorati nuclear norm regularization method.


title: Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates

abstract: Benchmarking the tradeoff between neural network accuracy and training time is computationally expensive. Here we show how a multiplicative cyclic learning rate schedule can be used to construct a tradeoff curve in a single training run. We generate cyclic tradeoff curves for combinations of training methods such as Blurpool, Channels Last, Label Smoothing and MixUp, and highlight how these cyclic tradeoff curves can be used to evaluate the effects of algorithmic choices on network training efficiency.


title: Finite-Time Analysis of Entropy-Regularized Neural Natural Actor-Critic Algorithm

abstract: Natural actor-critic (NAC) and its variants, equipped with the representation power of neural networks, have demonstrated impressive empirical success in solving Markov decision problems with large state spaces. In this paper, we present a finite-time analysis of NAC with neural network approximation, and identify the roles of neural networks, regularization and optimization techniques (e.g., gradient clipping and averaging) to achieve provably good performance in terms of sample complexity, iteration complexity and overparametrization bounds for the actor and the critic. In particular, we prove that (i) entropy regularization and averaging ensure stability by providing sufficient exploration to avoid near-deterministic and strictly suboptimal policies and (ii) regularization leads to sharp sample complexity and network width bounds in the regularized MDPs, yielding a favorable bias-variance tradeoff in policy optimization. In the process, we identify the importance of uniform approximation power of the actor neural network to achieve global optimality in policy optimization due to distributional shift.


title: Second order estimates for convex solutions of degenerate $k$-Hessian equations

abstract: The $C^{1,1}$ estimate of the Dirichlet problem for degenerate $k$-Hessian equations with non-homogenous boundary conditions is an open problem, if the right hand side function $f$ is only assumed to satisfy $f^{1/(k-1)} \in C^{1,1}$. In this paper, we solve this problem for convex solutions defined in the strictly convex bounded domain.


title: Reinforcement learning based parameters adaption method for particle swarm optimization

abstract: Particle swarm optimization (PSO) is a well-known optimization algorithm that shows good performance in solving different optimization problems. However, PSO usually suffers from slow convergence. In this article, a reinforcement learning-based online parameters adaption method(RLAM) is developed to enhance PSO in convergence by designing a network to control the coefficients of PSO. Moreover, based on RLAM, a new RLPSO is designed. In order to investigate the performance of RLAM and RLPSO, experiments on 28 CEC 2013 benchmark functions are carried out when comparing with other online adaption method and PSO variants. The reported computational results show that the proposed RLAM is efficient and effictive and that the the proposed RLPSO is more superior compared with several state-of-the-art PSO variants.


title: Concerning Two Conjectures of Frick and Jafari

abstract: In 2022, Hamid Reza Daneshpajouh provided some counterexamples to the following conjecture of Florian Frick. \bf Conjecture. Let $r \geq 3$. Then, every hypergraph ${\cal G}$ over the ground set $[n]$ satisfies $$ \chi \left({\rm KG}^r ({\cal G}_{r-{\rm stable}})\right) \geq \left\lceil \frac{{\rm cd}^r ({\cal G})}{r-1} \right\rceil . $$ In this paper, we improve Danashpajouh's results. Also, we provide several counterexamples to the following recent conjecture of Amir Jafari. Conjecture. If $s \geq r \geq 2$, then for any hypergraph ${\cal G}$ with vertex set $[n]$ we have $$ \chi \left({\rm KG}^r ({\cal G}_{s-{\rm stable}})\right) \geq \left\lceil \frac{{\rm ecd}^s ({\cal G})}{r-1} \right\rceil .$$


title: Diagonal and off-diagonal thermal conduction with resonant phonon scattering in $Ni_3TeO_6$

abstract: The coupling between phonon and magnon is ubiquitous in magnetic materials and plays a crucial role in many aspects of magnetic properties, most notably in spintronics. Yet, this academically and technologically interesting problem still poses a severe challenge to a general understanding of the issue in certain materials. We report that Ni3TeO6 exhibits clear evidence of significant magnon-phonon coupling in both longitudinal thermal conductivity ($\kappa_{xx}$) and thermal Hall coefficient ($\kappa_{xy}$). The Debye-Callaway model, a phenomenological description for phonon heat conduction, can explain the measured magnetic field dependence of $\kappa_{xx}(H)$: phonon scattering from spin fluctuation in the paramagnetic phase and additional scattering due to magnon-phonon coupling in the collinear antiferromagnetic phase. We further suggest that a similar approach could be applied to understand the finite $\kappa_{xy}$ values in $Ni_3TeO_6$.


title: Bi-convolution matrix factorization algorithm based on improved ConvMF

abstract: With the rapid development of information technology, "information overload" has become the main theme that plagues people's online life. As an effective tool to help users quickly search for useful information, a personalized recommendation is more and more popular among people. In order to solve the sparsity problem of the traditional matrix factorization algorithm and the problem of low utilization of review document information, this paper proposes a Bicon-vMF algorithm based on improved ConvMF. This algorithm uses two parallel convolutional neural networks to extract deep features from the user review set and item review set respectively and fuses these features into the decomposition of the rating matrix, so as to construct the user latent model and the item latent model more accurately. The experimental results show that compared with traditional recommendation algorithms like PMF, ConvMF, and DeepCoNN, the method proposed in this paper has lower prediction error and can achieve a better recommendation effect. Specifically, compared with the previous three algorithms, the prediction errors of the algorithm proposed in this paper are reduced by 45.8%, 16.6%, and 34.9%, respectively.


title: Ultra-broadband surface-normal coherent optical receiver with nanometallic polarizers

abstract: A coherent receiver that can demodulate high-speed in-phase and quadrature signals of light is an essential component for optical communication, interconnects, imaging, and computing. Conventional waveguide-based coherent receivers, however, exhibit large footprints, difficulty in coupling a large number of spatial channels efficiently, and limited operating bandwidth imposed by the waveguide-based optical hybrid. Here, we present a surface-normal coherent receiver with nanometallic-grating-based polarizers integrated directly on top of photodetectors without the need for an optical hybrid circuit. Using a fabricated device with the active section occupying a 70-{\mu}m-square footprint, we demonstrate demodulation of high-speed (up to 64 Gbaud) coherent signals in various formats. Moreover, ultra-broadband operation from 1260 nm to 1630 nm is demonstrated, thanks to the wavelength-insensitive nanometallic polarizers. To our knowledge, this is the first demonstration of a surface-normal homodyne optical receiver, which can easily be scaled to a compact two-dimensional arrayed device to receive highly parallelized coherent signals.


title: Fano foliations with small algebraic ranks

abstract: In this paper we study the algebraic ranks of foliations on $\mathbb{Q}$-factorial normal projective varieties. We start by establishing a Kobayashi-Ochiai's theorem for Fano foliations in terms of algebraic rank. We then investigate the local positivity of the anti-canonical divisors of foliations, obtaining a lower bound for the algebraic rank of a foliation in terms of Seshadri constant. We describe those foliations whose algebraic rank slightly exceeds this bound and classify Fano foliations on smooth projective varieties attaining this bound. Finally we construct several examples to illustrate the general situation, which in particular allow us to answer a question asked by Araujo and Druel on the generalised indices of foliations.


title: Topology-insensitive axion mass in magnetic topological insulators

abstract: We study the axion in three-dimensional topological insulators with magnetic impurities under finite temperature. We find a stable antiferromagnetic ground state and ferromagnetic metastable state. In both magnetic states, the mass of the axion is found to be up to eV scale and it approaches zero near the phase boundary of the magnetic state. This result applies to both normal and topological insulator phases, i.e., the axion mass is insensitive to the topological states, and it will have a direct impact on the targeted mass range of particle axion dark matter in future experiments.


title: Seven years of coordinated Chandra-NuSTAR observations of SN2014C unfold the extreme mass-loss history of its stellar progenitor

abstract: We present the results from our seven-year long broad-band X-ray observing campaign of SN\,2014C with \emph{Chandra} and \emph{NuSTAR}. These coordinated observations represent the first look at the evolution of a young extragalactic SN in the 0.3-80 keV energy range in the years after core collapse. We find that the spectroscopic metamorphosis of SN\,2014C from an ordinary type Ib SN into an interacting SN with copious hydrogen emission is accompanied by luminous X-rays reaching $L_x\approx 5.6\times10^{40}\, \rm{erg\,s^{-1}}$ (0.3--100 keV) at $\sim 1000$ days post explosion and declining as $L_x\propto t^{-1}$ afterwards. The broad-band X-ray spectrum is of thermal origin and shows clear evidence for cooling after peak, with $T(t)\approx 20 \,{\rm keV}(t/t_{\rm pk})^{-0.5}$. Soft X-rays of sub-keV energy suffer from large photoelectric absorption originating from the local SN environment with $NH_{\rm int}(t)\approx3\times 10^{22}(t/400 \,\rm{days})^{-1.4}\,\rm{cm^{-2}}$. We interpret these findings as the result of the interaction of the SN shock with a dense ($n\approx 10^{5}-10^{6}\,\rm{cm^{-3}}$), H-rich disk-like circumstellar medium (CSM) with inner radius $\sim2\times 10^{16}$ cm and extending to $\sim 10^{17}$ cm. Based on the declining $NH_{\rm int}(t)$ and X-ray luminosity evolution, we infer a CSM mass of $\sim(1.2\,f$--2.0$\sqrt{f}) \rm{M_{\odot}}$, where $f$ is the volume filling factor. Finally, we place SN\,2014C in the context of 119 core-collapse SNe with evidence for strong shock interaction with a thick circumstellar medium and we highlight the challenges that the current mass-loss theories (including wave-driven mass loss, binary interaction and line-driven winds) face when interpreting the wide dynamic ranges of CSM parameters inferred from observations.


title: DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks

abstract: Efficient deep neural network (DNN) models equipped with compact operators (e.g., depthwise convolutions) have shown great potential in reducing DNNs' theoretical complexity (e.g., the total number of weights/operations) while maintaining a decent model accuracy. However, existing efficient DNNs are still limited in fulfilling their promise in boosting real-hardware efficiency, due to their commonly adopted compact operators' low hardware utilization. In this work, we open up a new compression paradigm for developing real-hardware efficient DNNs, leading to boosted hardware efficiency while maintaining model accuracy. Interestingly, we observe that while some DNN layers' activation functions help DNNs' training optimization and achievable accuracy, they can be properly removed after training without compromising the model accuracy. Inspired by this observation, we propose a framework dubbed DepthShrinker, which develops hardware-friendly compact networks via shrinking the basic building blocks of existing efficient DNNs that feature irregular computation patterns into dense ones with much improved hardware utilization and thus real-hardware efficiency. Excitingly, our DepthShrinker framework delivers hardware-friendly compact networks that outperform both state-of-the-art efficient DNNs and compression techniques, e.g., a 3.06% higher accuracy and 1.53$\times$ throughput on Tesla V100 over SOTA channel-wise pruning method MetaPruning. Our codes are available at: https://github.com/facebookresearch/DepthShrinker.


title: Static quark potential from centre vortices in the presence of dynamical fermions

abstract: For the first time, centre vortices are identified on SU(3) lattice ensembles that include dynamical fermions. Using a variational method, the static quark potential is calculated on untouched, vortex-removed, and vortex-only fields. Two dynamical ensembles and one pure gauge ensemble are studied, allowing for an exploration of the impact of dynamical fermions on the centre-vortex vacuum. Novel modifications to the standard Coulomb term are introduced to describe the long range behaviour of the vortex-removed potential. These modifications remove a source of systematic error in the fitted string tension on the original ensembles. Our pure Yang-Mills result is consistent with previous studies, where projected centre-vortex fields only reproduce approximately two thirds of the string tension. Remarkably, we find that the vortex-only fields on both dynamical lattices are able to fully reproduce the respective untouched string tensions.


title: Hyperspherical Consistency Regularization

abstract: Recent advances in contrastive learning have enlightened diverse applications across various semi-supervised fields. Jointly training supervised learning and unsupervised learning with a shared feature encoder becomes a common scheme. Though it benefits from taking advantage of both feature-dependent information from self-supervised learning and label-dependent information from supervised learning, this scheme remains suffering from bias of the classifier. In this work, we systematically explore the relationship between self-supervised learning and supervised learning, and study how self-supervised learning helps robust data-efficient deep learning. We propose hyperspherical consistency regularization (HCR), a simple yet effective plug-and-play method, to regularize the classifier using feature-dependent information and thus avoid bias from labels. Specifically, HCR first projects logits from the classifier and feature projections from the projection head on the respective hypersphere, then it enforces data points on hyperspheres to have similar structures by minimizing binary cross entropy of pairwise distances' similarity metrics. Extensive experiments on semi-supervised and weakly-supervised learning demonstrate the effectiveness of our method, by showing superior performance with HCR.


title: Faster Rates of Convergence to Stationary Points in Differentially Private Optimization

abstract: We study the problem of approximating stationary points of Lipschitz and smooth functions under $(\varepsilon,\delta)$-differential privacy (DP) in both the finite-sum and stochastic settings. A point $\widehat{w}$ is called an $\alpha$-stationary point of a function $F:\mathbb{R}^d\rightarrow\mathbb{R}$ if $\|\nabla F(\widehat{w})\|\leq \alpha$. We provide a new efficient algorithm that finds an $\tilde{O}\big(\big[\frac{\sqrt{d}}{n\varepsilon}\big]^{2/3}\big)$-stationary point in the finite-sum setting, where $n$ is the number of samples. This improves on the previous best rate of $\tilde{O}\big(\big[\frac{\sqrt{d}}{n\varepsilon}\big]^{1/2}\big)$. We also give a new construction that improves over the existing rates in the stochastic optimization setting, where the goal is to find approximate stationary points of the population risk. Our construction finds a $\tilde{O}\big(\frac{1}{n^{1/3}} + \big[\frac{\sqrt{d}}{n\varepsilon}\big]^{1/2}\big)$-stationary point of the population risk in time linear in $n$. Furthermore, under the additional assumption of convexity, we completely characterize the sample complexity of finding stationary points of the population risk (up to polylog factors) and show that the optimal rate on population stationarity is $\tilde \Theta\big(\frac{1}{\sqrt{n}}+\frac{\sqrt{d}}{n\varepsilon}\big)$. Finally, we show that our methods can be used to provide dimension-independent rates of $O\big(\frac{1}{\sqrt{n}}+\min\big(\big[\frac{\sqrt{rank}}{n\varepsilon}\big]^{2/3},\frac{1}{(n\varepsilon)^{2/5}}\big)\big)$ on population stationarity for Generalized Linear Models (GLM), where $rank$ is the rank of the design matrix, which improves upon the previous best known rate.


title: TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generation

abstract: Many scientific papers such as those in arXiv and PubMed data collections have abstracts with varying lengths of 50-1000 words and average length of approximately 200 words, where longer abstracts typically convey more information about the source paper. Up to recently, scientific summarization research has typically focused on generating short, abstract-like summaries following the existing datasets used for scientific summarization. In domains where the source text is relatively long-form, such as in scientific documents, such summary is not able to go beyond the general and coarse overview and provide salient information from the source document. The recent interest to tackle this problem motivated curation of scientific datasets, arXiv-Long and PubMed-Long, containing human-written summaries of 400-600 words, hence, providing a venue for research in generating long/extended summaries. Extended summaries facilitate a faster read while providing details beyond coarse information. In this paper, we propose TSTR, an extractive summarizer that utilizes the introductory information of documents as pointers to their salient information. The evaluations on two existing large-scale extended summarization datasets indicate statistically significant improvement in terms of Rouge and average Rouge (F1) scores (except in one case) as compared to strong baselines and state-of-the-art. Comprehensive human evaluations favor our generated extended summaries in terms of cohesion and completeness.


title: Order-detection of slopes on the boundaries of knot manifolds

abstract: Motivated by the L-space conjecture, we investigate various notions of order-detection of slopes on knot manifolds. These notions are designed to characterise when rational homology 3-spheres obtained by gluing compact manifolds along torus boundary components have left-orderable fundamental groups and when a Dehn filling of a knot manifold has a left-orderable fundamental group. Our developments parallel existing results in the case of Heegaard-Floer slope detection and foliation slope detection, leading to several conjectured structure theorems that connect relative Heegaard-Floer homology and the boundary behaviour of co-oriented taut foliations with the set of left-orders supported by the fundamental group of a 3-manifold. The dynamics of the actions of 3-manifold groups on the real line plays a key role in our constructions and proofs. Our analysis leads to conjectured dynamical constraints on such actions in the case where the underlying manifold is Floer simple.


title: $\mathbf{Z}$-Categories I

abstract: This paper is the first in a series of two papers, $\mathbf{Z}$-Categories I and $\mathbf{Z}$-Categories II, which develop the notion of $\mathbf{Z}$-category, the natural bi-infinite analog to strict $\omega$-categories, and show that the $\left(\infty,1\right)$-category of spectra relates to the $\left(\infty,1\right)$-category of homotopy coherent $\mathbf{Z}$-categories as the pointed groupoids. In this work we provide a $2$-categorical treatment of the combinatorial spectra of \cite{Kan} and argue that this description is a simplicial avatar of the abiding notion of homotopy coherent $\mathbf{Z}$-category. We then develop the theory of limits in the $2$-category of categories with arities of Berger, Mellies, and Weber to provide a cellular category which is to $\mathbf{Z}$-categories as $\triangle$ is to $1$-categories or $\Theta_{n}$ is to $n$-categories. In an appendix we provide a generalization of the spectrification functors of 20$^{\mathrm{th}}$ century stable homotopy theory in the language of category-weighted limits.


title: Dynamic MRI using Learned Transform-based Tensor Low-Rank Network (LT$^2$LR-Net)

abstract: While low-rank matrix prior has been exploited in dynamic MR image reconstruction and has obtained satisfying performance, tensor low-rank models have recently emerged as powerful alternative representations for three-dimensional dynamic MR datasets. In this paper, we introduce a novel deep unrolling network for dynamic MRI, namely the learned transform-based tensor low-rank network (LT$^2$LR-Net). First, we generalize the tensor singular value decomposition (t-SVD) into an arbitrary unitary transform-based version and subsequently propose the novel transformed tensor nuclear norm (TTNN). Then, we design a novel TTNN-based iterative optimization algorithm based on the alternating direction method of multipliers (ADMM) to exploit the tensor low-rank prior in the transformed domain. The corresponding iterative steps are unrolled into the proposed LT$^2$LR-Net, where the convolutional neural network (CNN) is incorporated to adaptively learn the transformation from the dynamic MR dataset for more robust and accurate tensor low-rank representations. Experimental results on the cardiac cine MR dataset demonstrate that the proposed framework can provide improved recovery results compared with the state-of-the-art methods.


title: Finite Element Complexes in Two Dimensions

abstract: In this study, two-dimensional finite element complexes with various levels of smoothness, including the de Rham complex, the curldiv complex, the elasticity complex, and the divdiv complex, are systematically constructed. Smooth scalar finite elements in two dimensions are developed based on a non-overlapping decomposition of the simplicial lattice and the Bernstein basis of the polynomial space, with the order of differentiability at vertices being greater than twice that at edges. Finite element de Rham complexes with different levels of smoothness are devised using smooth finite elements with smoothness parameters that satisfy certain relations. Finally, finite element elasticity complexes and finite element divdiv complexes are derived from finite element de Rham complexes by using the Bernstein-Gelfand-Gelfand (BGG) framework. This study is the first work to construct finite element complexes in a systematic way. Moreover, the novel tools developed in this work, such as the non-overlapping decomposition of the simplicial lattice and the discrete BGG construction, can be useful for further research in this field.


title: Chemical reactions in imperfect cavities: enhancement, suppression, and resonance

abstract: The use of optical cavities to control chemical reactions has been of great interest recently, following demonstrations of enhancement, suppression, and negligible effects on chemical reaction rates depending on the specific reaction and cavity frequency. In this work, we study the reaction rate inside imperfect cavities, where we introduce a broadening parameter in the spectral density to mimic Fabry-P\'erot cavities. We investigate cavity modifications to reaction rates using non-Markovian Langevin dynamics with frictional and random forces to account for the presence of imperfect optical cavities. We demonstrate that in the regime of weak solvent and cavity friction, the cavity can enhance chemical reaction rates. On the other hand, in the high friction regime, cavities can suppress chemical reactions. Furthermore, we find that the broadening of the cavity spectral density gives rise to blue shifts of the resonance conditions and, surprisingly, increases the sharpness of the resonance effect.


title: Masked Bayesian Neural Networks : Computation and Optimality

abstract: As data size and computing power increase, the architectures of deep neural networks (DNNs) have been getting more complex and huge, and thus there is a growing need to simplify such complex and huge DNNs. In this paper, we propose a novel sparse Bayesian neural network (BNN) which searches a good DNN with an appropriate complexity. We employ the masking variables at each node which can turn off some nodes according to the posterior distribution to yield a nodewise sparse DNN. We devise a prior distribution such that the posterior distribution has theoretical optimalities (i.e. minimax optimality and adaptiveness), and develop an efficient MCMC algorithm. By analyzing several benchmark datasets, we illustrate that the proposed BNN performs well compared to other existing methods in the sense that it discovers well condensed DNN architectures with similar prediction accuracy and uncertainty quantification compared to large DNNs.


title: A class of graded conformal algebras which is induced by Heisenberg-Virasoro conformal algebra

abstract: In this paper, we obtain a class of $\mathbb{Z}$-graded conformal algebras which is induced by Heisenberg-Virasoro conformal algebra. More precisely, we classify $\mathbb{Z}$-graded conformal algebras $\mathcal{A} = \oplus^\infty_{i=-1}\mathcal{A}_i$ satisfying the following conditions, (C1) $\mathcal{A}_0$ is the Heisenberg-Virasoro conformal algebra; C2) Each $\mathcal{A}_i$ for $i\in\mathbb{Z}_{\ge-1}^*$ is an $\mathcal{A}_0$-module of rank one; (C3) $[{X_{-1}}_\lambda X_i]\neq 0$ for $i\ge 0$, where $X_i$ is any one of $\mathbb{C}[\partial]$-generators of $\mathcal{A}_i$ for $i\in \mathbb{Z}_{\ge -1}$. Further, we prove that all finite nontrivial irreducible modules of these algebras under some special conditions are free of rank one as a $\mathbb{C}[\partial]$-module. The conformal derivations of this class of graded Lie conformal algebras are also determined.


title: The growth of operator entropy in operator growth

abstract: We study upper bounds on the growth of operator entropy $S_K$ in operator growth. Using uncertainty relation, we first prove a dispersion bound on the growth rate $|\partial_t S_K|\leq 2b_1 \Delta S_K$, where $b_1$ is the first Lanczos coefficient and $\Delta S_K$ is the variance of $S_K$. However, for irreversible process, this bound generally turns out to be too loose at long times. We further find a tighter bound in the long time limit using a universal logarithmic relation between Krylov complexity and operator entropy. The new bound describes the long time behavior of operator entropy very well for physically interesting cases, such as chaotic systems and integrable models.


title: MentSum: A Resource for Exploring Summarization of Mental Health Online Posts

abstract: Mental health remains a significant challenge of public health worldwide. With increasing popularity of online platforms, many use the platforms to share their mental health conditions, express their feelings, and seek help from the community and counselors. Some of these platforms, such as Reachout, are dedicated forums where the users register to seek help. Others such as Reddit provide subreddits where the users publicly but anonymously post their mental health distress. Although posts are of varying length, it is beneficial to provide a short, but informative summary for fast processing by the counselors. To facilitate research in summarization of mental health online posts, we introduce Mental Health Summarization dataset, MentSum, containing over 24k carefully selected user posts from Reddit, along with their short user-written summary (called TLDR) in English from 43 mental health subreddits. This domain-specific dataset could be of interest not only for generating short summaries on Reddit, but also for generating summaries of posts on the dedicated mental health forums such as Reachout. We further evaluate both extractive and abstractive state-of-the-art summarization baselines in terms of Rouge scores, and finally conduct an in-depth human evaluation study of both user-written and system-generated summaries, highlighting challenges in this research.


title: Transparent reporting of research-related greenhouse gas emissions through the scientific CO$_2$nduct initiative

abstract: Estimating the greenhouse gas emissions of research-related activities is a critical first step towards the design of mitigation policies and actions. Here we propose and motivate a transparent framework for reporting research-related greenhouse gas emissions, through the inclusion of standardised reporting tables in scientific publications.


title: Bayesian Inference of Stochastic Dynamical Networks

abstract: Network inference has been extensively studied in several fields, such as systems biology and social sciences. Learning network topology and internal dynamics is essential to understand mechanisms of complex systems. In particular, sparse topologies and stable dynamics are fundamental features of many real-world continuous-time (CT) networks. Given that usually only a partial set of nodes are able to observe, in this paper, we consider linear CT systems to depict networks since they can model unmeasured nodes via transfer functions. Additionally, measurements tend to be noisy and with low and varying sampling frequencies. For this reason, we consider CT models since discrete-time approximations often require fine-grained measurements and uniform sampling steps. The developed method applies dynamical structure functions (DSFs) derived from linear stochastic differential equations (SDEs) to describe networks of measured nodes. A numerical sampling method, preconditioned Crank-Nicolson (pCN), is used to refine coarse-grained trajectories to improve inference accuracy. The convergence property of the developed method is robust to the dimension of data sources. Monte Carlo simulations indicate that the developed method outperforms state-of-the-art methods including group sparse Bayesian learning (GSBL), BINGO, kernel-based methods, dynGENIE3, GENIE3, and ARNI. The simulations include random and ring networks, and a synthetic biological network. These are challenging networks, suggesting that the developed method can be applied under a wide range of contexts, such as gene regulatory networks, social networks, and communication systems.


title: Disentangled Generation Network for Enlarged License Plate Recognition and A Unified Dataset

abstract: License plate recognition plays a critical role in many practical applications, but license plates of large vehicles are difficult to be recognized due to the factors of low resolution, contamination, low illumination, and occlusion, to name a few. To overcome the above factors, the transportation management department generally introduces the enlarged license plate behind the rear of a vehicle. However, enlarged license plates have high diversity as they are non-standard in position, size, and style. Furthermore, the background regions contain a variety of noisy information which greatly disturbs the recognition of license plate characters. Existing works have not studied this challenging problem. In this work, we first address the enlarged license plate recognition problem and contribute a dataset containing 9342 images, which cover most of the challenges of real scenes. However, the created data are still insufficient to train deep methods of enlarged license plate recognition, and building large-scale training data is very time-consuming and high labor cost. To handle this problem, we propose a novel task-level disentanglement generation framework based on the Disentangled Generation Network (DGNet), which disentangles the generation into the text generation and background generation in an end-to-end manner to effectively ensure diversity and integrity, for robust enlarged license plate recognition. Extensive experiments on the created dataset are conducted, and we demonstrate the effectiveness of the proposed approach in three representative text recognition frameworks.


title: Self-Consistency of the Fokker-Planck Equation

abstract: The Fokker-Planck equation (FPE) is the partial differential equation that governs the density evolution of the It\^o process and is of great importance to the literature of statistical physics and machine learning. The FPE can be regarded as a continuity equation where the change of the density is completely determined by a time varying velocity field. Importantly, this velocity field also depends on the current density function. As a result, the ground-truth velocity field can be shown to be the solution of a fixed-point equation, a property that we call self-consistency. In this paper, we exploit this concept to design a potential function of the hypothesis velocity fields, and prove that, if such a function diminishes to zero during the training procedure, the trajectory of the densities generated by the hypothesis velocity fields converges to the solution of the FPE in the Wasserstein-2 sense. The proposed potential function is amenable to neural-network based parameterization as the stochastic gradient with respect to the parameter can be efficiently computed. Once a parameterized model, such as Neural Ordinary Differential Equation is trained, we can generate the entire trajectory to the FPE.


title: Dynamic Structure Estimation from Bandit Feedback

abstract: This work present novel method for structure estimation of an underlying dynamical system. We tackle problems of estimating dynamic structure from bandit feedback contaminated by sub-Gaussian noise. In particular, we focus on periodically behaved discrete dynamical system in the Euclidean space, and carefully identify certain obtainable subset of full information of the periodic structure. We then derive a sample complexity bound for periodic structure estimation. Technically, asymptotic results for exponential sums are adopted to effectively average out the noise effects while preventing the information to be estimated from vanishing. For linear systems, the use of the Weyl sum further allows us to extract eigenstructures. Our theoretical claims are experimentally validated on simulations of toy examples, including Cellular Automata.


title: A general criterion for the P\'{o}lya-Carlson dichotomy and application

abstract: We prove a general criterion for an irrational power series $f(z)=\displaystyle\sum_{n=0}^{\infty}a_nz^n$ with coefficients in a number field $K$ to admit the unit circle as a natural boundary. As an application, let $F$ be a finite field, let $d$ be a positive integer, let $A\in M_d(F[t])$ be a $d\times d$-matrix with entries in $F[t]$, and let $\zeta_A(z)$ be the Artin-Mazur zeta function associated to the multiplication-by-$A$ map on the compact abelian group $F((1/t))^d/F[t]^d$. We provide a complete characterization of when $\zeta_A(z)$ is algebraic and prove that it admits the circle of convergence as a natural boundary in the transcendence case. This is in stark contrast to the case of linear endomorphisms on $\mathbb{R}^d/\mathbb{Z}^d$ in which Baake, Lau, and Paskunas prove that the zeta function is always rational. Some connections to earlier work of Bell, Byszewski, Cornelissen, Miles, Royals, and Ward are discussed. Our method uses a similar technique in recent work of Bell, Nguyen, and Zannier together with certain patching arguments involving linear recurrence sequences.


title: Geometry of Nonequilibrium Chemical Reaction Networks and Generalized Entropy Production Decompositions

abstract: We derive the Hessian geometric structure of nonequilibrium chemical reaction networks (CRN) on the flux and force spaces induced by the Legendre duality of convex dissipation functions and characterize their dynamics as a generalized flow. With this structure, we can extend theories of nonequilibrium systems with quadratic dissipation functions to more general ones with nonquadratic ones, which are pivotal for studying chemical reaction networks. By applying generalized notions of orthogonality in Hessian geometry to chemical reaction networks, we obtain two generalized decompositions of the entropy production rate, each of which captures gradient-flow and minimum-dissipation aspects in nonequilibrium dynamics.


title: Quantum phase measurement for two-qubit states in an open waveguide

abstract: We present a new method for quantum state tomography within a single-excitation subspace of two-qubit states in an open waveguide. The system under investigation consists of three qubits in an open waveguide, separated by a distance comparable to the wavelength of the electromagnetic field. We show that the modulation of the frequency of the central ancillary qubit allows us to obtain unambiguous information about the initial phase difference $\varphi_1-\varphi_3$ of the edge qubits via the measurement of the evolution of their probability amplitudes.


title: Comment on the subtlety of defining real-time path integral in lattice gauge theories

abstract: Recently, Hoshina, Fujii, and Kikukawa pointed out that the naive lattice gauge theory action in Minkowski signature does not result in a unitary theory in the continuum limit, and Kanwar and Wagman proposed alternative lattice actions to the Wilson action without divergences. We here show that the subtlety can be understood from the asymptotic expansion of the modified Bessel function, which has been discussed for path integral of compact variables in nonrelativistic quantum mechanics. The essential ingredient for defining the appropriate continuum theory is the $i\varepsilon$ prescription, and with the proper implementation of the $i\varepsilon$ we show that the Wilson action can be used for the real-time path integrals. It is here important that the $i\varepsilon$ should be implemented for both timelike and spacelike plaquettes. We also argue the reason why the $i\varepsilon$ becomes required for the Wilson action from the Hamiltonian formalism. The $i\varepsilon$ is needed to manifestly suppress the contributions from singular paths, for which the Wilson action can give different values from those of the actual continuum action.


title: Analytical SNR Prediction in Long-Haul Optical Transmission using General Dual-Polarization 4D Formats

abstract: Nonlinear interference models for dual-polarization 4D (DP-4D) modulation have only been used so far to predict signal-signal nonlinear interference. We show that including the signal-noise term in the prediction of the effective signal-to-noise ratio in long distance DP-4D transmission improves the accuracy by up to 0.2 dB.


title: Stochastic Deep-Ritz for Parametric Uncertainty Quantification

abstract: Scientific machine learning has become an increasingly important tool in materials science and engineering. It is particularly well suited to tackle material problems involving many variables or to allow rapid construction of surrogates of material models, to name just a few. Mathematically, many problems in materials science and engineering can be cast as variational problems. However, handling of uncertainty, ever present in materials, in the context of variational formulations remains challenging for scientific machine learning. In this article, we propose a deep-learning-based numerical method for solving variational problems under uncertainty. Our approach seamlessly combines deep-learning approximation with Monte-Carlo sampling. The resulting numerical method is powerful yet remarkably simple. We assess its performance and accuracy on a number of variational problems.


title: 6G Survey on Challenges, Requirements, Applications, Key Enabling Technologies, Use Cases, AI integration issues and Security aspects

abstract: The fifth-generation (5G) network is likely to bring in high data rates, more reliability, and low delays for mobile, personal and local area networks. Alongside the rapid growth of smart wireless sensing and communication technologies, data traffic has significantly risen, and existing 5G networks are not fully capable of supporting future massive data traffic in terms of services, storage, and processing. To meet the forthcoming challenges, the research community is investigating the Terahertz-based sixth-generation (6G) wireless network which is supposed to be offered for industrial usage in around 10 years. This is the right time to explore and learn about various 6G aspects that will play a key role in the successful execution and implementation of 6G networks in the future. This survey provides a review of specifications, requirements, applications, enabling technologies including disruptive and innovative, integration of 6G with advanced architectures and networks like software-defined networks (SDN), network functions virtualization (NFV), cloud/fog computing, etc, artificial intelligence (AI) oriented technologies, privacy and security issues and solutions, and potential futuristic use cases: virtual reality, smart healthcare and Industry 5.0. Furthermore, based on the conducted review, challenges and future research directions are highlighted to aid the deployment of 6G networks.


title: Spatiotemporal models for Poisson areal data with an application to the AIDS epidemic in Rio de Janeiro

abstract: We present a class of spatiotemporal models for Poisson areal data suitable for the analysis of emerging infectious diseases. These models assume Poisson observations related through a link equation to a latent random field process. This latent random field process evolves through time with proper Gaussian Markov random field convolutions. Our approach naturally accommodates flexible structures such as distinct but interacting temporal trends for each region and across-time contamination among neighboring regions. We develop a Bayesian analysis approach with a simulation-based procedure: specifically, we construct a Markov chain Monte Carlo algorithm based on the generalized extended Kalman filter to obtain samples from an approximate posterior distribution. Finally, for the comparison of Poisson spatiotemporal models, we develop a simulation-based conditional Bayes factor. We illustrate the utility and flexibility of our Poisson spatiotemporal framework with an application to the number of acquired immunodeficiency syndrome (AIDS) cases during the period 1982-2007 in Rio de Janeiro.


title: Revisiting Barrow's Graduated Inflationary Universe: A Warm perspective

abstract: It is presumed that thermal fluctuations present during inflationary epoch can make inflaton scalar field to interact with other fields resulting in the existence of a thermal component during the inflationary period. The presence of this thermal component assists structure formation and reduces reheating dependence as in the contemporary inflationary paradigm. This is known as warm inflation. In 1990 J . D. Barrow \cite{25} considered a scenario of inflation with matter field having a phenomenological equation of state of the type $p+\rho=\gamma\rho^{\lambda},~\gamma\neq 0$ and $\lambda$ constant. He called such inflationary scenarios as "graduated inflation". In this work we reconsider the above equation of state in a scenario of warm inflation. Our aim would be to investigate and understand whether such matter can also act as a viable candidate for warm inflation.


title: Magnetic field intermittency in the solar wind: PSP and SolO observations ranging from the Alfven region out to 1 AU

abstract: $PSP$ and $SolO$ data are utilized to investigate magnetic field intermittency in the solar wind (SW). Small-scale intermittency $(20-100d_{i})$ is observed to radially strengthen when methods relying on higher-order moments are considered ($SF_q$, $SDK$), but no clear trend is observed at larger scales. However, lower-order moment-based methods (e.g., PVI) are deemed more appropriate for examining the evolution of the bulk of Coherent Structures (CSs), $PVI \ge 3$. Using PVI, we observe a scale-dependent evolution in the fraction of the dataset occupied by CSs, $f_{PVI \ge 3}$. Specifically, regardless of the SW speed, a subtle increase is found in $f_{PVI\ge3}$ for $\ell =20 d_i$, in contrast to a more pronounced radial increase in CSs observed at larger scales. Intermittency is investigated in relation to plasma parameters. Though, slower SW speed intervals exhibit higher $f_{PVI \geq 6}$ and higher kurtosis maxima, no statistical differences are observed for $f_{PVI \geq 3}$. Highly Alfv\'enic intervals, display lower levels of intermittency. The anisotropy with respect to the angle between the magnetic field and SW flow, $\Theta_{VB}$ is investigated. Intermittency is weaker at $\Theta_{VB} \approx 0^{\circ}$ and is strengthened at larger angles. Considering the evolution at a constant alignment angle, a weakening of intermittency is observed with increasing advection time of the SW. Our results indicate that the strengthening of intermittency in the inner heliosphere is driven by the increase in comparatively highly intermittent perpendicular intervals sampled by the probes with increasing distance, an effect related directly to the evolution of the Parker spiral.


title: On the acyclicity of reductions of elliptic curves modulo primes in arithmetic progressions

abstract: Let $E$ be an elliptic curve defined over $\mathbb{Q}$ and, for a prime $p$ of good reduction for $E$ let $\tilde{E}_p$ denote the reduction of $E$ modulo $p$. Inspired by an elliptic curve analogue of Artin's primitive root conjecture posed by S. Lang and H. Trotter in 1977, J-P. Serre adapted methods of C. Hooley to prove a GRH-conditional asymptotic formula for the number of primes $p \leq x$ for which the group $\tilde{E}_p(\mathbb{F}_p)$ is cyclic. More recently, Akbal and G\"{u}lo$\breve{\text{g}}$lu considered the question of cyclicity of $\tilde{E}_p(\mathbb{F}_p)$ under the additional restriction that $p$ lie in an arithmetic progression. In this note, we study the issue of which arithmetic progressions $a \bmod n$ have the property that, for all but finitely many primes $p \equiv a \bmod n$, the group $\tilde{E}_p(\mathbb{F}_p)$ is not cyclic, answering a question of Akbal and G\"{u}lo$\breve{\text{g}}$lu on this issue.


title: Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphs

abstract: This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret bounds for stochastic environments. As Alon et al. [2015] have shown, tight regret bounds depend on the structure of the feedback graph: strongly observable graphs yield minimax regret of $\tilde{\Theta}( \alpha^{1/2} T^{1/2} )$, while weakly observable graphs induce minimax regret of $\tilde{\Theta}( \delta^{1/3} T^{2/3} )$, where $\alpha$ and $\delta$, respectively, represent the independence number of the graph and the domination number of a certain portion of the graph. Our proposed algorithm for strongly observable graphs has a regret bound of $\tilde{O}( \alpha^{1/2} T^{1/2} ) $ for adversarial environments, as well as of $ {O} ( \frac{\alpha (\ln T)^3 }{\Delta_{\min}} ) $ for stochastic environments, where $\Delta_{\min}$ expresses the minimum suboptimality gap. This result resolves an open question raised by Erez and Koren [2021]. We also provide an algorithm for weakly observable graphs that achieves a regret bound of $\tilde{O}( \delta^{1/3}T^{2/3} )$ for adversarial environments and poly-logarithmic regret for stochastic environments. The proposed algorithms are based on the follow-the-regularized-leader approach combined with newly designed update rules for learning rates.


title: Age of Information in Reservation Multi-Access Networks with Stochastic Arrivals

abstract: This paper investigates the Age of Information (AoI) performance of Frame Slotted ALOHA with Reservation and Data slots (FSA-RD). We consider a symmetric multi-access network where each user transmits its randomly generated status updates to an access point in a framed manner. Each frame consists of one reservation slot and several data slots. The reservation slot is made up of some mini-slots. In each reservation slot, users, with a status update packet to transmit, randomly send short reservation packets in one of the mini-slots to contend for data slots of the frame. The data slots are assigned to those users that succeed in reservation slot. To provide insights in optimizing the information freshness of FSA-RD, we manage to derive a closed-form expression of the average AoI under FSA-RD by applying a recursive method. Numerical results validate the analytical expression and demonstrate the influence of the frame size and reservation probability on the average AoI. We finally perform a comparison between the AoI performance of FSA-RD with optimized frame size and reservation probability, and that of slotted ALOHA with optimized transmission probability. The comparison results show that FSA-RD can effectively reduce the AoI performance of multi-access networks, especially when the status arrival rate of the network becomes large.


title: Ring isomorphisms of type II$_\infty$ locally measurable operator algebras

abstract: We show that every ring isomorphism between the algebras of locally measurable operators for type II$_\infty$ von Neumann algebras is similar to a real $^*$-isomorphism. This together with previous results by the author and Ayupov--Kudaybergenov completely describes ring isomorphisms between the algebras of locally measurable operators as well as lattice isomorphisms between the projection lattices for a general pair of von Neumann algebras without finite type I direct summands.


title: Imaging of CsI(Tl) crystal event and double-slit Young's interference by a single photon sensitive camera

abstract: We will discuss an imaging measurement with a single photon sensitive and low noise camera aiming to a new paradigm in the optical readout of scintillation detectors. The features of the single photon sensitive camera will be characterized and demonstrated with a measurement on double-slit Young's interference in single photon mode. An imaging test on CsI(Tl) crystal and alpha source will be performed further for preliminary measurements on the noise level and sensitivity of the system with a 1/2", f/1.4 lens, which reaches an sensitivity on light intensity around 1/10 of the 3-inch PMT and shows a potential to realize an imaging of single alpha event. An application proposal to scintillation detectors will be further discussed, where it is usually assumed that the imaging is not possible in such a photon-starved and large-emittance regime.


title: EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm & Accelerator Co-Design

abstract: Eye tracking has become an essential human-machine interaction modality for providing immersive experience in numerous virtual and augmented reality (VR/AR) applications desiring high throughput (e.g., 240 FPS), small-form, and enhanced visual privacy. However, existing eye tracking systems are still limited by their: (1) large form-factor largely due to the adopted bulky lens-based cameras; and (2) high communication cost required between the camera and backend processor, thus prohibiting their more extensive applications. To this end, we propose a lensless FlatCam-based eye tracking algorithm and accelerator co-design framework dubbed EyeCoD to enable eye tracking systems with a much reduced form-factor and boosted system efficiency without sacrificing the tracking accuracy, paving the way for next-generation eye tracking solutions. On the system level, we advocate the use of lensless FlatCams to facilitate the small form-factor need in mobile eye tracking systems. On the algorithm level, EyeCoD integrates a predict-then-focus pipeline that first predicts the region-of-interest (ROI) via segmentation and then only focuses on the ROI parts to estimate gaze directions, greatly reducing redundant computations and data movements. On the hardware level, we further develop a dedicated accelerator that (1) integrates a novel workload orchestration between the aforementioned segmentation and gaze estimation models, (2) leverages intra-channel reuse opportunities for depth-wise layers, and (3) utilizes input feature-wise partition to save activation memory size. On-silicon measurement validates that our EyeCoD consistently reduces both the communication and computation costs, leading to an overall system speedup of 10.95x, 3.21x, and 12.85x over CPUs, GPUs, and a prior-art eye tracking processor called CIS-GEP, respectively, while maintaining the tracking accuracy.


title: EfficientNeRF: Efficient Neural Radiance Fields

abstract: Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an efficient NeRF-based method to represent 3D scene and synthesize novel-view images. Although several ways exist to accelerate the training or testing process, it is still difficult to much reduce time for both phases simultaneously. We analyze the density and weight distribution of the sampled points then propose valid and pivotal sampling at the coarse and fine stage, respectively, to significantly improve sampling efficiency. In addition, we design a novel data structure to cache the whole scene during testing to accelerate the rendering speed. Overall, our method can reduce over 88\% of training time, reach rendering speed of over 200 FPS, while still achieving competitive accuracy. Experiments prove that our method promotes the practicality of NeRF in the real world and enables many applications.


title: Lattice QCD calculation of light sterile neutrino contribution in $0\nu2\beta$ decay

abstract: We present a lattice QCD study of the neutrinoless double beta decay involving light sterile neutrinos. The calculation is performed at physical pion mass using five gauge ensembles generated with the $2+1$-flavor domain wall fermions. We obtain the low-energy constants $g_{\text{LR}}^{\pi\pi}(m_\nu)$ with the neutrino mass $m_\nu$ from $0$ GeV to $3$ GeV. The lattice results are reasonably consistent with the previous interpolation method with a $\sim20\%$ deviation at small $m_\nu$. We provide an explanation on the discrepancy at vanishing neutrino mass. At large $m_\nu$, a good consistence between our results and the previous lattice determination of $g_{4}^{\pi\pi}(\mu)$ is found at $\mu=m_\nu=3$ GeV.


title: Subconvexity of twisted Shintani zeta functions

abstract: Previously the authors proved subconvexity of Shintani's zeta function enumerating class numbers of binary cubic forms. Here we return to prove subconvexity of the Maass form twisted version.


title: Singularities of pluri-fundamental divisors on Gorenstein Fano varieties of coindex $4$

abstract: Let $X$ be a Gorenstein canonical Fano variety of coindex $4$ and dimension $n$ with $H$ fundamental divisor. Assume $h^0(X, H) \geq n -2$. We prove that a general element of the linear system $|mH|$ has at worst canonical singularities for any integer $m \geq 1$. When $X$ has terminal singularities and $n \geq 5$, we show that a general element of $|mH|$ has at worst terminal singularities for any integer $m \geq 1$. When $n=4$, we give an example of Gorenstein terminal Fano fourfold $X$ such that a general element of $|H|$ does not have terminal singularities.


title: Assessing the impact of non-Gaussian noise on convolutional neural networks that search for continuous gravitational waves

abstract: We present a convolutional neural network that is capable of searching for continuous gravitational waves, quasi-monochromatic, persistent signals arising from asymmetrically rotating neutron stars, in $\sim 1$ year of simulated data that is plagued by non-stationary, narrow-band disturbances, i.e., lines. Our network has learned to classify the input strain data into four categories: (1) only Gaussian noise, (2) an astrophysical signal injected into Gaussian noise, (3) a line embedded in Gaussian noise, and (4) an astrophysical signal contaminated by both Gaussian noise and line noise. In our algorithm, different frequencies are treated independently; therefore, our network is robust against sets of evenly-spaced lines, i.e., combs, and we only need to consider perfectly sinusoidal line in this work. We find that our neural network can distinguish between astrophysical signals and lines with high accuracy. In a frequency band without line noise, the sensitivity depth of our network is about $\mathcal{D}^{95\%} \simeq 43.9$ with a false alarm probability of $\sim 0.5\%$, while in the presence of line noise, we can maintain a false alarm probability of $\sim 10\%$ and achieve $\mathcal{D}^\mathrm{95\%} \simeq 3.62$ when the line noise amplitude is $h_0^\mathrm{line}/\sqrt{S_\mathrm{n}(f_k)} = 1.0$. We evaluate the computational cost of our method to be $O(10^{19})$ floating point operations, and compare it to those from standard all-sky searches, putting aside differences between covered parameter spaces. Our results show that our method is more efficient by one or two orders of magnitude than standard searches. Although our neural network takes about $O(10^8)$ sec to employ using our current facilities (a single GPU of GTX1080Ti), we expect that it can be reduced to an acceptable level by utilizing a larger number of improved GPUs.


title: A scalar valued Fourier transform for the Heisenberg group

abstract: We define a scalar valued Fourier transform for functions on the Heisenberg group and establish some of its basic properties like inversion formula, Plancherel theorem and Riemann-Lebesgue lemma. We also restate certain well known theorems for the group Fourier transform in terms of the new transform which we would like to call Strichartz Fourier transform.


title: Measure equivalence rigidity among the Higman groups

abstract: We prove that all (generalized) Higman groups on at least $5$ generators are superrigid for measure equivalence. More precisely, let $k\ge 5$, and let $H$ be a group with generators $a_1,\dots,a_k$, and Baumslag-Solitar relations given by $a_ia_{i+1}^{m_i}a_i^{-1}=a_i^{n_i}$, with $i$ varying in $\mathbb{Z}/k\mathbb{Z}$ and nonzero integers $|m_i|\neq |n_i|$ for each $i$. We prove that every countable group which is measure equivalent to $H$, is in fact virtually isomorphic to $H$. A key ingredient in the proof is a general statement providing measured group theoretic invariants for groups acting acylindrically on $\mathrm{CAT}(-1)$ polyhedral complexes with control on vertex and edge stabilizers. Among consequences of our work, we obtain rigidity theorems for generalized Higman groups with respect to lattice embeddings and automorphisms of their Cayley graphs. We also derive an orbit equivalence and $W^*$-superrigidity theorem for all free, ergodic, probability measure-preserving actions of generalized Higman groups.


title: Coordinated Double Machine Learning

abstract: Double machine learning is a statistical method for leveraging complex black-box models to construct approximately unbiased treatment effect estimates given observational data with high-dimensional covariates, under the assumption of a partially linear model. The idea is to first fit on a subset of the samples two non-linear predictive models, one for the continuous outcome of interest and one for the observed treatment, and then to estimate a linear coefficient for the treatment using the remaining samples through a simple orthogonalized regression. While this methodology is flexible and can accommodate arbitrary predictive models, typically trained independently of one another, this paper argues that a carefully coordinated learning algorithm for deep neural networks may reduce the estimation bias. The improved empirical performance of the proposed method is demonstrated through numerical experiments on both simulated and real data.


title: Watch Out for the Safety-Threatening Actors: Proactively Mitigating Safety Hazards

abstract: Despite the successful demonstration of autonomous vehicles (AVs), such as self-driving cars, ensuring AV safety remains a challenging task. Although some actors influence an AV's driving decisions more than others, current approaches pay equal attention to each actor on the road. An actor's influence on the AV's decision can be characterized in terms of its ability to decrease the number of safe navigational choices for the AV. In this work, we propose a safety threat indicator (STI) using counterfactual reasoning to estimate the importance of each actor on the road with respect to its influence on the AV's safety. We use this indicator to (i) characterize the existing real-world datasets to identify rare hazardous scenarios as well as the poor performance of existing controllers in such scenarios; and (ii) design an RL based safety mitigation controller to proactively mitigate the safety hazards those actors pose to the AV. Our approach reduces the accident rate for the state-of-the-art AV agent(s) in rare hazardous scenarios by more than 70%.


title: A note on the Lumer--Phillips theorem for bi-continuous semigroups

abstract: Given a Banach space $X$ and an additional coarser Hausdorff locally convex topology $\tau$ on $X$ we characterise the generators of $\tau$-bi-continuous semigroups in the spirit of the Lumer--Phillips theorem, i.e. by means of dissipativity w.r.t.~a directed system of seminorms and a range condition.


title: Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

abstract: The recently proposed Conformer model has become the de facto backbone model for various downstream speech tasks based on its hybrid attention-convolution architecture that captures both local and global features. However, through a series of systematic studies, we find that the Conformer architecture's design choices are not optimal. After re-examining the design choices for both the macro and micro-architecture of Conformer, we propose Squeezeformer which consistently outperforms the state-of-the-art ASR models under the same training schemes. In particular, for the macro-architecture, Squeezeformer incorporates (i) the Temporal U-Net structure which reduces the cost of the multi-head attention modules on long sequences, and (ii) a simpler block structure of multi-head attention or convolution modules followed up by feed-forward module instead of the Macaron structure proposed in Conformer. Furthermore, for the micro-architecture, Squeezeformer (i) simplifies the activations in the convolutional block, (ii) removes redundant Layer Normalization operations, and (iii) incorporates an efficient depthwise down-sampling layer to efficiently sub-sample the input signal. Squeezeformer achieves state-of-the-art results of 7.5%, 6.5%, and 6.0% word-error-rate (WER) on LibriSpeech test-other without external language models, which are 3.1%, 1.4%, and 0.6% better than Conformer-CTC with the same number of FLOPs. Our code is open-sourced and available online.


title: On the structure of pointsets with many collinear triples

abstract: It is conjectured that if a finite set of points in the plane contains many collinear triples then there is some structure in the set. We are going to show that under some combinatorial conditions such pointsets contain special configurations of triples, proving a case of Elekes' conjecture. Using the techniques applied in the proof we show a density version of Jamison's theorem. If the number of distinct directions between many pairs of points of a pointset in convex position is small, then many points are on a conic.