title: An efficient neural-network and finite-difference hybrid method for elliptic interface problems with applications

abstract: A new and efficient neural-network and finite-difference hybrid method is developed for solving Poisson equation in a regular domain with jump discontinuities on embedded irregular interfaces. Since the solution has low regularity across the interface, when applying finite difference discretization to this problem, an additional treatment accounting for the jump discontinuities must be employed. Here, we aim to elevate such an extra effort to ease our implementation by machine learning methodology. The key idea is to decompose the solution into singular and regular parts. The neural network learning machinery incorporating the given jump conditions finds the singular solution, while the standard five-point Laplacian discretization is used to obtain the regular solution with associated boundary conditions. Regardless of the interface geometry, these two tasks only require supervised learning for function approximation and a fast direct solver for Poisson equation, making the hybrid method easy to implement and efficient. The two- and three-dimensional numerical results show that the present hybrid method preserves second-order accuracy for the solution and its derivatives, and it is comparable with the traditional immersed interface method in the literature. As an application, we solve the Stokes equations with singular forces to demonstrate the robustness of the present method.


title: A Learning-Based Estimation and Control Framework for Contact-Intensive Tight-Tolerance Tasks

abstract: We present a two-stage framework that integrates a learning-based estimator and a controller, designed to address contact-intensive tasks. The estimator leverages a Bayesian particle filter with a mixture density network (MDN) structure, effectively handling multi-modal issues arising from contact information. The controller combines a self-supervised and reinforcement learning (RL) approach, strategically dividing the low-level admittance controller's parameters into labelable and non-labelable categories, which are then trained accordingly. To further enhance accuracy and generalization performance, a transformer model is incorporated into the self-supervised learning component. The proposed framework is evaluated on the bolting task using an accurate real-time simulator and successfully transferred to an experimental environment. More visualization results are available on our project website: https://sites.google.com/view/2stagecitt


title: Quantum Hall Bogoliubov Interferometer

abstract: A quantum Hall interferometer containing a grounded superconducting terminal is proposed. This geometry allows to control the Andreev and normal scattering amplitudes of sub-gap Bogoliubov quasiparticles with the Aharonov-Bohm phase, as well as with the constrictions defining the interferometer loop. The conductance matrix of such a three-terminal NSN interference device exhibits a much richer behavior as compared to its two-terminal Fabry-P\'erot counterpart, which is illustrated by non-trivial behavior of non-local charge and heat responses. A single edge version of the interferometer enables full on-demand control of the electron-hole superposition, including resonant enhancement of arbitrary small Andreev reflection probability up to 1, and can be used as a building block in future more complex interference setups.


title: Exploring the neighborhood of 1-layer QAOA with Instantaneous Quantum Polynomial circuits

abstract: We embed 1-layer QAOA circuits into the larger class of parameterized Instantaneous Quantum Polynomial circuits to produce an improved variational quantum algorithm for solving combinatorial optimization problems. The use of analytic expressions to find optimal parameters classically makes our protocol robust against barren plateaus and hardware noise. The average overlap with the ground state scales as $\mathcal{O}(2^{-0.31 N})$ with the number of qubits $N$ for random Sherrington-Kirkpatrick (SK) Hamiltonians of up to 29 qubits, a polynomial improvement over 1-layer QAOA. Additionally, we observe that performing variational imaginary time evolution on the manifold approximates low-temperature pseudo-Boltzmann states. Our protocol outperforms 1-layer QAOA on the recently released Quantinuum H2 trapped-ion quantum hardware and emulator, where we obtain an average approximation ratio of $0.985$ across 312 random SK instances of 7 to 32 qubits, from which almost $44\%$ are solved optimally using 4 to 1208 shots per instance.


title: Rational circle-equivariant elliptic cohomology of CP(V)

abstract: We compute rational $T$-equivariant elliptic cohomology of CP(V), where $T$ is the circle group, and CP(V) is the $T$-space of complex lines for a finite dimensional complex $T$-representation V. Starting from an elliptic curve C over the complex numbers and a coordinate data around the identity, we achieve this computation by proving that the $T$-equivariant elliptic cohomology theory $EC_T$ built in [Gre05], and the $T^2$-equivariant elliptic cohomology theory $EC_{T^2}$ built in [Bar22] are 1x$T$-split. This result allows us to reduce the computation of $EC_T(CP(V))$ to the computation of $T^2$-elliptic cohomology of spheres of complex representations, already performed in [Bar22].


title: Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systems

abstract: Do all instances need inference through the big models for a correct prediction? Perhaps not; some instances are easy and can be answered correctly by even small capacity models. This provides opportunities for improving the computational efficiency of systems. In this work, we present an explorative study on 'model cascading', a simple technique that utilizes a collection of models of varying capacities to accurately yet efficiently output predictions. Through comprehensive experiments in multiple task settings that differ in the number of models available for cascading (K value), we show that cascading improves both the computational efficiency and the prediction accuracy. For instance, in K=3 setting, cascading saves up to 88.93% computation cost and consistently achieves superior prediction accuracy with an improvement of up to 2.18%. We also study the impact of introducing additional models in the cascade and show that it further increases the efficiency improvements. Finally, we hope that our work will facilitate development of efficient NLP systems making their widespread adoption in real-world applications possible.


title: An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification

abstract: Non-hierarchical sparse attention Transformer-based models, such as Longformer and Big Bird, are popular approaches to working with long documents. There are clear benefits to these approaches compared to the original Transformer in terms of efficiency, but Hierarchical Attention Transformer (HAT) models are a vastly understudied alternative. We develop and release fully pre-trained HAT models that use segment-wise followed by cross-segment encoders and compare them with Longformer models and partially pre-trained HATs. In several long document downstream classification tasks, our best HAT model outperforms equally-sized Longformer models while using 10-20% less GPU memory and processing documents 40-45% faster. In a series of ablation studies, we find that HATs perform best with cross-segment contextualization throughout the model than alternative configurations that implement either early or late cross-segment contextualization. Our code is on GitHub: https://github.com/coastalcph/hierarchical-transformers.


title: Variance-Based Sensitivity Analysis of $\Lambda$-type Quantum Memory

abstract: The storage and retrieval of photonic quantum states, quantum memory, is a key resource for a wide range of quantum applications. Here we investigate the sensitivity of $\Lambda$-type quantum memory to experimental fluctuations and drift. We use a variance-based approach, focusing on the effects of fluctuations and drift on memory efficiency. We consider shot-to-shot fluctuations of the memory parameters, and separately we consider longer timescale drift of the control field parameters. We find the parameters that a quantum memory is most sensitive to depend on the quantum memory protocol being employed, where the observed sensitivity agrees with physical interpretation of the protocols. We also present a general framework that is applicable to other figures of merit beyond memory efficiency. These results have practical ramifications for quantum memory experiments.


title: Specialization at an expanding front

abstract: As a population grows, spreading to new environments may favor specialization. In this paper, we introduce and explore a model for specialization at the front of a colony expanding synchronously into new territory. We show through numerical simulations that, by gaining fitness through accumulating mutations, progeny of the initial seed population can differentiate into distinct specialists. With competition and selection limited to the growth front, the emerging specialists first segregate into sectors, which then expand to dominate the entire population. We quantify the scaling of the fixation time with the size of the population and observe different behaviors corresponding to distinct universality classes: unbounded and bounded gains in fitness lead to superdiffusive ($z=3/2$) and diffusive ($z=2$) stochastic wanderings of the sector boundaries, respectively.


title: Flow-oriented perturbation theory

abstract: We introduce a new diagrammatic approach to perturbative quantum field theory, which we call flow-oriented perturbation theory (FOPT). Within it, Feynman graphs are replaced by strongly connected directed graphs (digraphs). FOPT is a coordinate space analogue of time-ordered perturbation theory and loop-tree duality, but it has the advantage of having combinatorial and canonical Feynman rules, combined with a simplified $i\varepsilon$ dependence of the resulting integrals. Moreover, we introduce a novel digraph-based representation for the S-matrix. The associated integrals involve the Fourier transform of the flow polytope. Due to this polytope's properties, our S-matrix representation exhibits manifest infrared singularity factorization on a per-diagram level. Our findings reveal an interesting interplay between spurious singularities and Fourier transforms of polytopes.


title: Style-Guided Inference of Transformer for High-resolution Image Synthesis

abstract: Transformer is eminently suitable for auto-regressive image synthesis which predicts discrete value from the past values recursively to make up full image. Especially, combined with vector quantised latent representation, the state-of-the-art auto-regressive transformer displays realistic high-resolution images. However, sampling the latent code from discrete probability distribution makes the output unpredictable. Therefore, it requires to generate lots of diverse samples to acquire desired outputs. To alleviate the process of generating lots of samples repetitively, in this article, we propose to take a desired output, a style image, as an additional condition without re-training the transformer. To this end, our method transfers the style to a probability constraint to re-balance the prior, thereby specifying the target distribution instead of the original prior. Thus, generated samples from the re-balanced prior have similar styles to reference style. In practice, we can choose either an image or a category of images as an additional condition. In our qualitative assessment, we show that styles of majority of outputs are similar to the input style.


title: Learning Inter-Superpoint Affinity for Weakly Supervised 3D Instance Segmentation

abstract: Due to the few annotated labels of 3D point clouds, how to learn discriminative features of point clouds to segment object instances is a challenging problem. In this paper, we propose a simple yet effective 3D instance segmentation framework that can achieve good performance by annotating only one point for each instance. Specifically, to tackle extremely few labels for instance segmentation, we first oversegment the point cloud into superpoints in an unsupervised manner and extend the point-level annotations to the superpoint level. Then, based on the superpoint graph, we propose an inter-superpoint affinity mining module that considers the semantic and spatial relations to adaptively learn inter-superpoint affinity to generate high-quality pseudo labels via semantic-aware random walk. Finally, we propose a volume-aware instance refinement module to segment high-quality instances by applying volume constraints of objects in clustering on the superpoint graph. Extensive experiments on the ScanNet-v2 and S3DIS datasets demonstrate that our method achieves state-of-the-art performance in the weakly supervised point cloud instance segmentation task, and even outperforms some fully supervised methods.


title: S-spectrum and numerical range of a quaternionic operator

abstract: We study the numerical range of bounded linear operators on quaternionic Hilbert spaces and its relation with the S-spectrum. The class of complex operators on quaternionic Hilbert spaces is introduced and the upper bild of normal complex operators is completely characterized in this setting.


title: Novel Closed-form Point Estimators for the Beta Distribution

abstract: In this paper, novel closed-form point estimators of the beta distribution are proposed and investigated. The first estimators are a modified version of Pearson's method of moments. The underlying idea is to involve the sufficient statistics, i.e., log-moments in the moment estimation equations and solve the mixed type of moment equations simultaneously. The second estimators are based on an approximation to Fisher's likelihood principle. The idea is to solve two score equations derived from the log-likelihood function of generalized beta distributions. Both two resulted estimators are in closed forms, strongly consistent and asymptotically normal. In addition, through extensive simulations, the proposed estimators are shown to perform very close to the ML estimators in both small and large samples, and they significantly outperform the moment estimators.


title: A logical limit law for $231$-avoiding permutations

abstract: We prove that the class of 231-avoiding permutations satisfies a logical limit law, i.e. that for any first-order sentence $\Psi$, in the language of two total orders, the probability $p_{n,\Psi}$ that a uniform random 231-avoiding permutation of size $n$ satisfies $\Psi$ admits a limit as $n$ is large. Moreover, we establish two further results about the behavior and value of $p_{n,\Psi}$: (i) it is either bounded away from $0$, or decays exponentially fast; (ii) the set of possible limits is dense in $[0,1]$. Our tools come mainly from analytic combinatorics and singularity analysis.


title: Estimating optimal treatment regimes in survival contexts using an instrumental variable

abstract: In survival contexts, substantial literature exists on estimating optimal treatment regimes, where treatments are assigned based on personal characteristics for the purpose of maximizing the survival probability. These methods assume that a set of covariates is sufficient to deconfound the treatment-outcome relationship. Nevertheless, the assumption can be limited in observational studies or randomized trials in which non-adherence occurs. Thus, we propose a novel approach for estimating the optimal treatment regime when certain confounders are not observable and a binary instrumental variable is available. Specifically, via a binary instrumental variable, we propose two semiparametric estimators for the optimal treatment regime by maximizing Kaplan-Meier-like estimators within a pre-defined class of regimes, one of which possesses the desirable property of double robustness. Because the Kaplan-Meier-like estimators are jagged, we incorporate kernel smoothing methods to enhance their performance. Under appropriate regularity conditions, the asymptotic properties are rigorously established. Furthermore, the finite sample performance is assessed through simulation studies. Finally, we exemplify our method using data from the National Cancer Institute's (NCI) prostate, lung, colorectal, and ovarian cancer screening trial.


title: Transition disks: the observational revolution from SEDs to imaging

abstract: Protoplanetary disks surrounding young stars are the birth place of planets. Of particular interest are the transition disks with large inner dust cavities of tens of au, hinting at the presence of massive companions. These cavities were first recognized by a deficit in their Spectral Energy Distribution (SED), later confirmed by millimeter interferometry observations. The Atacama Large Millimeter/submillimeter Array (ALMA) has truly revolutionized the field of spatially resolved imaging of protoplanetary disks in both dust and gas, providing important hints for the origin of gaps and cavities. At the same time, new types of substructures have been revealed. Also infrared observations show a large range of substructures both in resolved imaging, interferometry and spectroscopy. Since the last review paper of transition disks (Protostars and Planets VI), a huge amount of data has been taken, which led to numerous new insights in the origin of transition disks. In this review I will summarize the observational efforts from the past decade, compare their insights with the predictions from SED modeling, analyze the properties of the transition disk population and discuss their role in general disk evolution.


title: Multi-channel fluctuating field approach to competing instabilities in interacting electronic systems

abstract: Systems with strong electronic Coulomb correlations often display rich phase diagrams exhibiting different ordered phases involving spin, charge, or orbital degrees of freedom. The theoretical description of the interplay of the corresponding collective fluctuations giving rise to this phenomenology remains however a tremendous challenge. Here, we introduce a multi-channel extension of the recently developed fluctuating field approach to competing collective fluctuations in correlated electron systems. The method is based on a variational optimization of a trial action that explicitly contains the order parameters of the leading fluctuation channels. It gives direct access to the free energy of the system, facilitating the distinction between stable and meta-stable phases of the system. We apply our approach to the extended Hubbard model in the weak to intermediate coupling regime where we find it to capture the interplay of competing charge density wave and antiferromagnetic fluctuations with qualitative agreement with more computationally expensive methods. The multi-channel fluctuation field approach thus offers a promising new route for a numerically cheap treatment of the interplay between collective fluctuations in large systems.


title: Radiation Reaction and Gravitational Waves at Fourth Post-Minkowskian Order

abstract: We obtain the total impulse in the scattering of non-spinning binaries in general relativity at fourth Post-Minkowskian order, i.e. ${\cal O}(G^4)$, including linear, nonlinear, and hereditary radiation-reaction effects. We derive the total radiated spacetime momentum as well as the associated energy flux. The latter can be used to compute gravitational-wave observables for generic (un)bound orbits. We employ the ("in-in") Schwinger-Keldysh worldline effective field theory framework in combination with modern "multi-loop" integration techniques from collider physics. The complete results are in agreement with various partial calculations in the Post-Newtonian/Minkowskian expansion.


title: Real-time frequency estimation of a qubit without single-shot-readout

abstract: Quantum sensors can potentially achieve the Heisenberg limit of sensitivity over a large dynamic range using quantum algorithms. The adaptive phase estimation algorithm (PEA) is one example that was proven to achieve such high sensitivities with single-shot readout (SSR) sensors. However, using the adaptive PEA on a non-SSR sensor is not trivial due to the low contrast nature of the measurement. The standard approach to account for the averaged nature of the measurement in this PEA algorithm is to use a method based on `majority voting'. Although it is easy to implement, this method is more prone to mistakes due to noise in the measurement. To reduce these mistakes, a binomial distribution technique from a batch selection was recently shown theoretically to be superior, as all ranges of outcomes from an averaged measurement are considered. Here we apply, for the first time, real-time non-adaptive PEA on a non-SSR sensor with the binomial distribution approach. We compare the mean square error of the binomial distribution method to the majority-voting approach using the nitrogen-vacancy center in diamond at ambient conditions as a non-SSR sensor. Our results suggest that the binomial distribution approach achieves better accuracy with the same sensing times. To further shorten the sensing time, we propose an adaptive algorithm that controls the readout phase and, therefore, the measurement basis set. We show by numerical simulation that adding the adaptive protocol can further improve the accuracy in a future real-time experiment.


title: Parallel solutions for preemptive makespan scheduling on two identical machines

abstract: We consider online preemptive scheduling of jobs arriving one by one, to be assigned to two identical machines, with the goal of makespan minimization. We study the effect of selecting the best solution out of two independent solutions constructed in parallel in an online fashion. Two cases are analyzed, where one case is purely online, and in the other one jobs are presented sorted by non-increasing sizes. We show that using two solutions rather than one improves the performance significantly, but that an optimal solution cannot be obtained for any constant number of solutions constructed in parallel. Our algorithms have the best possible competitive ratios out of algorithms for each one of the classes.


title: The regularity with respect to domains of the additive eigenvalues of superquadratic Hamilton--Jacobi equation

abstract: We study the additive eigenvalues on changing domains, along with the associated vanishing discount problems. We consider the convergence of the vanishing discount problem on changing domains for a general scaling type $\Omega_\lambda = (1+r(\lambda))\Omega$ with a continuous function $r$ and a positive constant $\lambda$. We characterize all solutions to the ergodic problem on $\Omega$ in terms of $r$. In addition, we demonstrate that the additive eigenvalue $\lambda\mapsto c_{\Omega_\lambda}$ on a rescaled domain $\Omega_\lambda = (1+\lambda)\Omega$ possesses one-sided derivatives everywhere. Additionally, the limiting solution can be parameterized by a real function, and we establish a connection between the regularity of this real function and the regularity of $\lambda \mapsto c_{\Omega_\lambda}$. We provide examples where higher regularity is achieved.


title: Reliability and Reproducibility of the Cryogenic Sapphire Oscillator Technology

abstract: The cryogenic sapphire oscillator (CSO) is a highly specialized machine, which delivers a reference signal exhibiting the lowest frequency fluctuations. For the best units, the Allan deviation (ADEV) is <1e-15 for integration time between 1 and 10,000 s, with a drift <1e-14 in one day.The oscillator is based on a sapphire monocrystal resonating at 10 GHz in a whispering-gallery mode, cooled at 6 K for highest Q-factor and zero thermal coefficient. We report on the progress accomplished implementing eleven CSOs in about 10 years since the first sample delivered to the ESA station in Argentina. Short-term stability is improved by a factor of 3-10, depending on the integration time, and the refrigerator's electric power is reduced to 3 kW. Frequency stability and overall performances are reproducible, with unattended operation between scheduled maintenance every two years. The CSO is suitable to scientific applications requiring extreme frequency stability with reliable long-term operation. For example, the flywheel for primary frequency standards, the ground segment of GNSS, astrometry, VLBI, and radio astronomy stations.


title: What does a deep neural network confidently perceive? The effective dimension of high certainty class manifolds and their low confidence boundaries

abstract: Deep neural network classifiers partition input space into high confidence regions for each class. The geometry of these class manifolds (CMs) is widely studied and intimately related to model performance; for example, the margin depends on CM boundaries. We exploit the notions of Gaussian width and Gordon's escape theorem to tractably estimate the effective dimension of CMs and their boundaries through tomographic intersections with random affine subspaces of varying dimension. We show several connections between the dimension of CMs, generalization, and robustness. In particular we investigate how CM dimension depends on 1) the dataset, 2) architecture (including ResNet, WideResNet \& Vision Transformer), 3) initialization, 4) stage of training, 5) class, 6) network width, 7) ensemble size, 8) label randomization, 9) training set size, and 10) robustness to data corruption. Together a picture emerges that higher performing and more robust models have higher dimensional CMs. Moreover, we offer a new perspective on ensembling via intersections of CMs. Our code is at https://github.com/stanislavfort/slice-dice-optimize/


title: Development of a high-fidelity computational tool for chemically reacting hypersonic flow simulations

abstract: In this paper, we present a methodology to achieve high-fidelity simulations of chemically reacting hypersonic flows and demonstrate our numerical solver's capabilities on a selection of configurations. The numerical tools are developed based on previous in-house codes for high-speed simulations with improvements in both numerical and physical modeling. Additionally, a modular, open-source library is coupled with the flow solver for modeling real-gas effects in variable atmospheric mixtures. Verification against literature is done for canonical flat-plate boundary layers with various choices for gas modeling, with excellent agreement observed in all cases. The implementation of an artificial-diffusivity shock-capturing numerical scheme is then verified for supersonic shockwave--boundary-layer interaction (SBLI) cases and the improved code's capabilities are demonstrated for the cases of hypersonic SBLI and a sonic jet injection in a hypersonic crossflow, at higher enthalpy levels than those previously investigated. The results show excellent agreement with previous observations in the literature. The work presented in this paper demonstrates the range of applications that can be investigated with this tool, highlights the need for accurate physicochemical modeling, and paves the way for addressing increasingly more complex configurations and flows.


title: On the chemical potential of many-body perturbation theory in extended systems

abstract: Many methods for computing electronic correlation effects at finite temperature are related to many-body perturbation theory in the grand-canonical ensemble. In most applications, however, the average number of electrons is known rather than the chemical potential, requiring that expensive correlation calculations must be repeated iteratively in search for the chemical potential that yields the desired average number of electrons. In extended systems with mobile charges, however, the long-ranged electrostatic interaction should guarantee that the average ratio of negative and positive charges is one for any finite chemical potential. All properties per electron are virtually independent of the chemical potential, as for instance in an electric wire at different voltage potentials. This work shows that the infinite-size limit of the exchange-correlation free energy agrees with the infinite-size limit of the exchange-correlation grand potential at a non-interacting chemical potential. The latter requires only one expensive correlation calculation for each system size. Analogous to classical simulations of long-range-interacting particles, this work uses a regularization of the Coulomb interaction such that each electron on average interacts only with as many electrons as there are electrons in the simulation, avoiding interactions with periodic images. Numerical calculations of the warm uniform electron gas have been conducted with the Spencer--Alavi regularization employing the finite-temperature Hartree approximation for the self-consistent field and linearized finite-temperature direct-ring coupled cluster doubles for treating correlation.


title: Continual Training of Language Models for Few-Shot Learning

abstract: Recent work on applying large language models (LMs) achieves impressive performance in many NLP applications. Adapting or posttraining an LM using an unlabeled domain corpus can produce even better performance for end-tasks in the domain. This paper proposes the problem of continually extending an LM by incrementally post-train the LM with a sequence of unlabeled domain corpora to expand its knowledge without forgetting its previous skills. The goal is to improve the few-shot end-task learning in these domains. The resulting system is called CPT (Continual PostTraining), which to our knowledge, is the first continual post-training system. Experimental results verify its effectiveness.


title: Quantum Dynamics of Vibrational Polariton Chemistry

abstract: We employ an exact quantum mechanical simulation technique to investigate a model of cavity-modified chemical reactions in the condensed phase. The model contains the coupling of the reaction coordinate to a generic solvent, cavity coupling to either the reaction coordinate or a non-reactive mode, and the coupling of the cavity to lossy modes. Thus, many of the most important features needed for realistic modeling of the cavity modification of chemical reactions are included. We find that when a molecule is coupled to an optical cavity it is essential to treat the problem quantum mechanically in order to obtain a quantitative account of alterations to reactivity. We find sizable and sharp changes in the rate constant that are associated with quantum mechanical state splittings and resonances. The features that emerge from our simulations are closer to those observed in experiments than are previous calculations, even for realistically small values of coupling and cavity loss. This work highlights the importance of a fully quantum treatment of vibrational polariton chemistry.


title: Intersections of linear codes and related MDS codes with new Galois hulls

abstract: Let $\mathrm{SLAut}(\mathbb{F}_{q}^{n})$ denote the group of all semilinear isometries on $\mathbb{F}_{q}^{n}$, where $q=p^{e}$ is a prime power. In this paper, we investigate general properties of linear codes associated with $\sigma$ duals for $\sigma\in\mathrm{SLAut}(\mathbb{F}_{q}^{n})$. We show that the dimension of the intersection of two linear codes can be determined by generator matrices of such codes and their $\sigma$ duals. We also show that the dimension of $\sigma$ hull of a linear code can be determined by a generator matrix of it or its $\sigma$ dual. We give a characterization on $\sigma$ dual and $\sigma$ hull of a matrix-product code. We also investigate the intersection of a pair of matrix-product codes. We provide a necessary and sufficient condition under which any codeword of a generalized Reed-Solomon (GRS) code or an extended GRS code is contained in its $\sigma$ dual. As an application, we construct eleven families of $q$-ary MDS codes with new $\ell$-Galois hulls satisfying $2(e-\ell)\mid e$, which are not covered by the latest papers by Cao (IEEE Trans. Inf. Theory 67(12), 7964-7984, 2021) and by Fang et al. (Cryptogr. Commun. 14(1), 145-159, 2022) when $\ell\neq \frac{e}{2}$.


title: Multi-Agent Distributed and Decentralized Geometric Task Allocation

abstract: We consider the general problem of geometric task allocation, wherein a large, decentralised swarm of simple mobile agents must detect the locations of tasks in the plane and position themselves nearby. The tasks are represented by an a priori unknown demand profile $\Phi(x,y)$ that determines how many agents are needed in each location. The agents are autonomous, oblivious and indistinguishable, and have finite sensing range. They must configure themselves according to $\Phi$ using only local information about $\Phi$ and about the positions of nearby agents. All agents act according to the same local sensing-based rule of motion, and cannot explicitly communicate nor share information. We propose an optimization-based approach to the problem which results in attraction-repulsion dynamics. Repulsion encourages agents to spread out and explore the region so as to find the tasks, and attraction causes them to accumulate at task locations. We derive this approach via gradient descent over an appropriate ``error'' functional, and test it extensively through numerical simulations. The figures in this work are snapshots of simulations that can be viewed online at https://youtu.be/kyUiGYSaaoQ.


title: Evaluating Unsupervised Denoising Requires Unsupervised Metrics

abstract: Unsupervised denoising is a crucial challenge in real-world imaging applications. Unsupervised deep-learning methods have demonstrated impressive performance on benchmarks based on synthetic noise. However, no metrics are available to evaluate these methods in an unsupervised fashion. This is highly problematic for the many practical applications where ground-truth clean images are not available. In this work, we propose two novel metrics: the unsupervised mean squared error (MSE) and the unsupervised peak signal-to-noise ratio (PSNR), which are computed using only noisy data. We provide a theoretical analysis of these metrics, showing that they are asymptotically consistent estimators of the supervised MSE and PSNR. Controlled numerical experiments with synthetic noise confirm that they provide accurate approximations in practice. We validate our approach on real-world data from two imaging modalities: videos in raw format and transmission electron microscopy. Our results demonstrate that the proposed metrics enable unsupervised evaluation of denoising methods based exclusively on noisy data.


title: Unimodular rows over affine algebras over algebraic closure of a finite field

abstract: In this article, we prove that if $R$ is an affine algebra of dimension $d\geq 4$ over $\overline{\mathbb{F}}_{p}$ and $1/(d-1)! \in R,$ then any unimodular row over $R$ of length $d$ can be mapped to a factorial row by elementary transformations.


title: Dark SU(2) Stueckelberg portal

abstract: We study the non-abelian $SU(2)_D$ extension of the $U(1)_D$ Stueckelberg portal, which plays a role of the mediator between the Standard Model (SM) and Dark Sector (DS). This portal is specified by the Stueckelberg mechanism for generation of dark gauge boson masses. Proposed $U(1)_D\times SU(2)_D$ Stueckelberg portal has a connection with SM matter fields in analogy with Familon Model. We derive bounds on the couplings of dark portal bosons and SM particles, which govern diagonal and non-diagonal flavor transitions of quarks and leptons.


title: ViLPAct: A Benchmark for Compositional Generalization on Multimodal Human Activities

abstract: We introduce ViLPAct, a novel vision-language benchmark for human activity planning. It is designed for a task where embodied AI agents can reason and forecast future actions of humans based on video clips about their initial activities and intents in text. The dataset consists of 2.9k videos from \charades extended with intents via crowdsourcing, a multi-choice question test set, and four strong baselines. One of the baselines implements a neurosymbolic approach based on a multi-modal knowledge base (MKB), while the other ones are deep generative models adapted from recent state-of-the-art (SOTA) methods. According to our extensive experiments, the key challenges are compositional generalization and effective use of information from both modalities.


title: OPERA: Omni-Supervised Representation Learning with Hierarchical Supervisions

abstract: The pretrain-finetune paradigm in modern computer vision facilitates the success of self-supervised learning, which tends to achieve better transferability than supervised learning. However, with the availability of massive labeled data, a natural question emerges: how to train a better model with both self and full supervision signals? In this paper, we propose Omni-suPErvised Representation leArning with hierarchical supervisions (OPERA) as a solution. We provide a unified perspective of supervisions from labeled and unlabeled data and propose a unified framework of fully supervised and self-supervised learning. We extract a set of hierarchical proxy representations for each image and impose self and full supervisions on the corresponding proxy representations. Extensive experiments on both convolutional neural networks and vision transformers demonstrate the superiority of OPERA in image classification, segmentation, and object detection. Code is available at: https://github.com/wangck20/OPERA.


title: Causal and counterfactual views of missing data models

abstract: It is often said that the fundamental problem of causal inference is a missing data problem -- the comparison of responses to two hypothetical treatment assignments is made difficult because for every experimental unit only one potential response is observed. In this paper, we consider the implications of the converse view: that missing data problems are a form of causal inference. We make explicit how the missing data problem of recovering the complete data law from the observed law can be viewed as identification of a joint distribution over counterfactual variables corresponding to values had we (possibly contrary to fact) been able to observe them. Drawing analogies with causal inference, we show how identification assumptions in missing data can be encoded in terms of graphical models defined over counterfactual and observed variables. We review recent results in missing data identification from this viewpoint. In doing so, we note interesting similarities and differences between missing data and causal identification theories.


title: Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidance

abstract: Diffusion models have achieved unprecedented performance in generative modeling. The commonly-adopted formulation of the latent code of diffusion models is a sequence of gradually denoised samples, as opposed to the simpler (e.g., Gaussian) latent space of GANs, VAEs, and normalizing flows. This paper provides an alternative, Gaussian formulation of the latent space of various diffusion models, as well as an invertible DPM-Encoder that maps images into the latent space. While our formulation is purely based on the definition of diffusion models, we demonstrate several intriguing consequences. (1) Empirically, we observe that a common latent space emerges from two diffusion models trained independently on related domains. In light of this finding, we propose CycleDiffusion, which uses DPM-Encoder for unpaired image-to-image translation. Furthermore, applying CycleDiffusion to text-to-image diffusion models, we show that large-scale text-to-image diffusion models can be used as zero-shot image-to-image editors. (2) One can guide pre-trained diffusion models and GANs by controlling the latent codes in a unified, plug-and-play formulation based on energy-based models. Using the CLIP model and a face recognition model as guidance, we demonstrate that diffusion models have better coverage of low-density sub-populations and individuals than GANs. The code is publicly available at https://github.com/ChenWu98/cycle-diffusion.


title: Comparison of encrypted control approaches and tutorial on dynamic systems using LWE-based homomorphic encryption

abstract: Encrypted control has been introduced to protect controller data by encryption at the stage of computation and communication, by performing the computation directly on encrypted data. In this article, we first review and categorize recent relevant studies on encrypted control. Approaches based on homomorphic encryption, multi-party computation, and secret sharing are introduced, compared, and then discussed with respect to computational complexity, communication load, enabled operations, security, and research directions. We proceed to discuss a current challenge in the application of homomorphic encryption to dynamic systems, where arithmetic operations other than integer addition and multiplication are limited. We also introduce a homomorphic cryptosystem called ``GSW-LWE'' and discuss its benefits that allow for recursive multiplication of encrypted dynamic systems, without use of computationally expensive bootstrapping techniques.


title: Schedule-Robust Online Continual Learning

abstract: A continual learning (CL) algorithm learns from a non-stationary data stream. The non-stationarity is modeled by some schedule that determines how data is presented over time. Most current methods make strong assumptions on the schedule and have unpredictable performance when such requirements are not met. A key challenge in CL is thus to design methods robust against arbitrary schedules over the same underlying data, since in real-world scenarios schedules are often unknown and dynamic. In this work, we introduce the notion of schedule-robustness for CL and a novel approach satisfying this desirable property in the challenging online class-incremental setting. We also present a new perspective on CL, as the process of learning a schedule-robust predictor, followed by adapting the predictor using only replay data. Empirically, we demonstrate that our approach outperforms existing methods on CL benchmarks for image classification by a large margin.


title: An improved decomposition-based heuristic for truck platooning

abstract: Truck platooning is a promising transportation mode in which several trucks drive together and thus save fuel consumption by suffering less air resistance. In this paper, we consider a truck platooning system for which we jointly optimize the truck routes and schedules from the perspective of a central platform. We improve an existing decomposition-based heuristic by Luo and Larson (2022), which iteratively solves a routing and scheduling problem, with a cost modification step after each scheduling run. We propose different formulations for the routing and the scheduling problem and embed these into Luo and Larson's framework, and we examine ways to improve their iterative process. In addition, we propose another scheduling heuristic to deal with large instances. The computational results show that our procedure achieves better performance than the existing one under certain realistic settings.


title: Searching Lorentz invariance violation from cosmic photon attenuation

abstract: Lorentz invariance violation~(LIV) can change the threshold behavior predicted by special relativity and cause threshold anomalies which affect the propagation of cosmic photons. In this work, we focus on the threshold anomaly effect on cosmic photon attenuations by extragalactic background light~(EBL) and discuss how to identify LIV from observations of very high energy~(VHE) photons propagated from long distance in the universe. We point out that the Large High Altitude Air Shower Observatory~(LHAASO), one of the most sensitive gamma-ray detector arrays currently operating at TeV and PeV energies, is an ideal facility for performing such LIV searching. We apply the proposed strategy to discuss the newly observed gamma-ray burst GRB 221009A to demonstrate the predictive ability of our suggestions.


title: Hypergraph Convolutional Networks for Weakly-Supervised Semantic Segmentation

abstract: Semantic segmentation is a fundamental topic in computer vision. Several deep learning methods have been proposed for semantic segmentation with outstanding results. However, these models require a lot of densely annotated images. To address this problem, we propose a new algorithm that uses HyperGraph Convolutional Networks for Weakly-supervised Semantic Segmentation (HyperGCN-WSS). Our algorithm constructs spatial and k-Nearest Neighbor (k-NN) graphs from the images in the dataset to generate the hypergraphs. Then, we train a specialized HyperGraph Convolutional Network (HyperGCN) architecture using some weak signals. The outputs of the HyperGCN are denominated pseudo-labels, which are later used to train a DeepLab model for semantic segmentation. HyperGCN-WSS is evaluated on the PASCAL VOC 2012 dataset for semantic segmentation, using scribbles or clicks as weak signals. Our algorithm shows competitive performance against previous methods.


title: Incandescent temporal metamaterials

abstract: Regarded as a promising alternative to spatially shaping matter, time-varying media can be seized to control and manipulate wave phenomena, including thermal radiation. Here, based upon the framework of macroscopic quantum electrodynamics, we elaborate a comprehensive quantum theoretical formulation that lies the basis for investigating thermal emission effects in time-modulated media. Our theory unveils new physics brought about by time-varying media: nontrivial correlations between thermal fluctuating currents at different frequencies and positions, thermal radiation overcoming the black-body spectrum, and quantum vacuum amplification effects at finite temperature. We illustrate how these features lead to striking phenomena and novel thermal emitters, specifically, showing that the time-modulation releases strong field fluctuations confined within epsilon-near-zero (ENZ) bodies, and that, in turn, it enables a narrowband (partially coherent) emission spanning the whole range of wavevectors, from near to far-field regimes.


title: The Equalization Losses: Gradient-Driven Training for Long-tailed Object Recognition

abstract: Long-tail distribution is widely spread in real-world applications. Due to the extremely small ratio of instances, tail categories often show inferior accuracy. In this paper, we find such performance bottleneck is mainly caused by the imbalanced gradients, which can be categorized into two parts: (1) positive part, deriving from the samples of the same category, and (2) negative part, contributed by other categories. Based on comprehensive experiments, it is also observed that the gradient ratio of accumulated positives to negatives is a good indicator to measure how balanced a category is trained. Inspired by this, we come up with a gradient-driven training mechanism to tackle the long-tail problem: re-balancing the positive/negative gradients dynamically according to current accumulative gradients, with a unified goal of achieving balance gradient ratios. Taking advantage of the simple and flexible gradient mechanism, we introduce a new family of gradient-driven loss functions, namely equalization losses. We conduct extensive experiments on a wide spectrum of visual tasks, including two-stage/single-stage long-tailed object detection (LVIS), long-tailed image classification (ImageNet-LT, Places-LT, iNaturalist), and long-tailed semantic segmentation (ADE20K). Our method consistently outperforms the baseline models, demonstrating the effectiveness and generalization ability of the proposed equalization losses. Codes will be released at https://github.com/ModelTC/United-Perception.


title: Global Spectral Filter Memory Network for Video Object Segmentation

abstract: This paper studies semi-supervised video object segmentation through boosting intra-frame interaction. Recent memory network-based methods focus on exploiting inter-frame temporal reference while paying little attention to intra-frame spatial dependency. Specifically, these segmentation model tends to be susceptible to interference from unrelated nontarget objects in a certain frame. To this end, we propose Global Spectral Filter Memory network (GSFM), which improves intra-frame interaction through learning long-term spatial dependencies in the spectral domain. The key components of GSFM is 2D (inverse) discrete Fourier transform for spatial information mixing. Besides, we empirically find low frequency feature should be enhanced in encoder (backbone) while high frequency for decoder (segmentation head). We attribute this to semantic information extracting role for encoder and fine-grained details highlighting role for decoder. Thus, Low (High) Frequency Module is proposed to fit this circumstance. Extensive experiments on the popular DAVIS and YouTube-VOS benchmarks demonstrate that GSFM noticeably outperforms the baseline method and achieves state-of-the-art performance. Besides, extensive analysis shows that the proposed modules are reasonable and of great generalization ability. Our source code is available at https://github.com/workforai/GSFM.


title: Improving Long-tailed Object Detection with Image-Level Supervision by Multi-Task Collaborative Learning

abstract: Data in real-world object detection often exhibits the long-tailed distribution. Existing solutions tackle this problem by mitigating the competition between the head and tail categories. However, due to the scarcity of training samples, tail categories are still unable to learn discriminative representations. Bringing more data into the training may alleviate the problem, but collecting instance-level annotations is an excruciating task. In contrast, image-level annotations are easily accessible but not fully exploited. In this paper, we propose a novel framework CLIS (multi-task Collaborative Learning with Image-level Supervision), which leverage image-level supervision to enhance the detection ability in a multi-task collaborative way. Specifically, there are an object detection task (consisting of an instance-classification task and a localization task) and an image-classification task in our framework, responsible for utilizing the two types of supervision. Different tasks are trained collaboratively by three key designs: (1) task-specialized sub-networks that learn specific representations of different tasks without feature entanglement. (2) a siamese sub-network for the image-classification task that shares its knowledge with the instance-classification task, resulting in feature enrichment of detectors. (3) a contrastive learning regularization that maintains representation consistency, bridging feature gaps of different supervision. Extensive experiments are conducted on the challenging LVIS dataset. Without sophisticated loss engineering, CLIS achieves an overall AP of 31.1 with 10.1 point improvement on tail categories, establishing a new state-of-the-art. Code will be at https://github.com/waveboo/CLIS.


title: QED on the lattice and numerical perturbative computation of $g-2$

abstract: We compute the electron $g$ factor to the $\mathcal{O}(\alpha^5)$ order on the lattice in quenched QED. We first study finite volume corrections in various IR regularization methods to discuss which regularization is optimal for our purpose. We find that in QED$_L$ the finite volume correction to the effective mass can have different parametric dependences depending on the size of Euclidean time $t$ and match the `naive on-shell result' only at very large $t$ region, $t \gg L$. We adopt finite photon mass regularization to suppress finite volume effects exponentially and also discuss our strategy for selecting simulation parameters and the order of extrapolations to efficiently obtain the $g$ factor. We perform lattice simulation using small lattices to test feasibility of our calculation strategy. This study can be regarded as an intermediate step toward giving the five-loop coefficient independently of the preceding studies.


title: 12CO (3-2) High-Resolution Survey (COHRS) of the Galactic Plane: Complete Data Release

abstract: We present the full data release of 12CO (3-2) High-Resolution Survey (COHRS), which has mapped the inner Galactic plane over the range of 9.5$^{\circ}$ $\le$ l $\le$ 62.3$^{\circ}$ and $|b| \le 0.5^{\circ}$. The COHRS has been carried out using the Heterodyne Array Receiver Program (HARP) on the 15 m James Clerk Maxwell Telescope (JCMT) in Hawaii. The released data are smoothed to have a spatial resolution of 16.6 arcsec and a velocity resolution of 0.635 km/s, achieving a mean root-mean-square of $\sim 0.6$ K on $T_\mathrm{A}^*$. The COHRS data are useful for investigating detailed three-dimensional structures of individual molecular clouds and large-scale structures such as spiral arms in the Galactic plane. Furthermore, data from other available public surveys of different CO isotopologues and transitions with similar angular resolutions to this survey, such as FUGIN, SEDIGISM, and CHIMPS/CHIMPS2, allow studying the physical properties of molecular clouds and comparing their states with each other. In this paper, we report further observations on R2 and improved data reduction since the original COHRS release. We discuss the characteristics of the COHRS data and present integrated-emission images and a position-velocity (PV) map of the region covered. The PV map shows a good match with the spiral-arm traces from the existing CO and HI surveys. We also obtain and compare integrated one-dimensional distributions of 12CO (1-0) and (3-2) and those of star-forming populations to each other.


title: Misspecified Phase Retrieval with Generative Priors

abstract: In this paper, we study phase retrieval under model misspecification and generative priors. In particular, we aim to estimate an $n$-dimensional signal $\mathbf{x}$ from $m$ i.i.d.~realizations of the single index model $y = f(\mathbf{a}^T\mathbf{x})$, where $f$ is an unknown and possibly random nonlinear link function and $\mathbf{a} \in \mathbb{R}^n$ is a standard Gaussian vector. We make the assumption $\mathrm{Cov}[y,(\mathbf{a}^T\mathbf{x})^2] \ne 0$, which corresponds to the misspecified phase retrieval problem. In addition, the underlying signal $\mathbf{x}$ is assumed to lie in the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We propose a two-step approach, for which the first step plays the role of spectral initialization and the second step refines the estimated vector produced by the first step iteratively. We show that both steps enjoy a statistical rate of order $\sqrt{(k\log L)\cdot (\log m)/m}$ under suitable conditions. Experiments on image datasets are performed to demonstrate that our approach performs on par with or even significantly outperforms several competing methods.


title: Knowledge-Driven New Drug Recommendation

abstract: Drug recommendation assists doctors in prescribing personalized medications to patients based on their health conditions. Existing drug recommendation solutions adopt the supervised multi-label classification setup and only work with existing drugs with sufficient prescription data from many patients. However, newly approved drugs do not have much historical prescription data and cannot leverage existing drug recommendation methods. To address this, we formulate the new drug recommendation as a few-shot learning problem. Yet, directly applying existing few-shot learning algorithms faces two challenges: (1) complex relations among diseases and drugs and (2) numerous false-negative patients who were eligible but did not yet use the new drugs. To tackle these challenges, we propose EDGE, which can quickly adapt to the recommendation for a new drug with limited prescription data from a few support patients. EDGE maintains a drug-dependent multi-phenotype few-shot learner to bridge the gap between existing and new drugs. Specifically, EDGE leverages the drug ontology to link new drugs to existing drugs with similar treatment effects and learns ontology-based drug representations. Such drug representations are used to customize the metric space of the phenotype-driven patient representations, which are composed of a set of phenotypes capturing complex patient health status. Lastly, EDGE eliminates the false-negative supervision signal using an external drug-disease knowledge base. We evaluate EDGE on two real-world datasets: the public EHR data (MIMIC-IV) and private industrial claims data. Results show that EDGE achieves 7.3% improvement on the ROC-AUC score over the best baseline.


title: Higher-order Far-field Boundary Conditions for Crystalline Defects

abstract: Crystalline materials exhibit long-range elastic fields due to the presence of defects, leading to significant domain size effects in atomistic simulations. A rigorous far-field expansion of these long-range fields identifies low-rank structure in the form of a sum of discrete multipole terms and continuum correctors. We propose a novel numerical scheme that exploits this low-rank structure to accelerate material defect simulations by minimizing the domain size effects. Our approach iteratively improves the boundary condition, systematically following the asymptotic expansion of the far field. We provide both rigorous error estimates for the method and a range of empirical numerical tests, to assess it's convergence and robustness.


title: Motion Aware Self-Supervision for Generic Event Boundary Detection

abstract: The task of Generic Event Boundary Detection (GEBD) aims to detect moments in videos that are naturally perceived by humans as generic and taxonomy-free event boundaries. Modeling the dynamically evolving temporal and spatial changes in a video makes GEBD a difficult problem to solve. Existing approaches involve very complex and sophisticated pipelines in terms of architectural design choices, hence creating a need for more straightforward and simplified approaches. In this work, we address this issue by revisiting a simple and effective self-supervised method and augment it with a differentiable motion feature learning module to tackle the spatial and temporal diversities in the GEBD task. We perform extensive experiments on the challenging Kinetics-GEBD and TAPOS datasets to demonstrate the efficacy of the proposed approach compared to the other self-supervised state-of-the-art methods. We also show that this simple self-supervised approach learns motion features without any explicit motion-specific pretext task.


title: A numerical investigation of the mechanics of intracranial aneurysms walls: Assessing the influence of tissue hyperelastic laws and heterogeneous properties on the stress and stretch fields

abstract: Numerical simulations have been extensively used in the past two decades for the study of intracranial aneurysms (IAs), a dangerous disease that occurs in the arteries that reach the brain. They may affect up to 10 % of the world's population, with up to 50 % mortality rate, in case of rupture. Physically, the blood flow inside IAs should be modeled as a fluid-solid interaction problem. However, the large majority of those works have focused on the hemodynamics of the intra-aneurysmal flow, while ignoring the wall tissue's mechanical response entirely, through rigid-wall modeling, or using limited modeling assumptions for the tissue mechanics. One of the explanations is the scarce data on the properties of IAs walls, thus limiting the use of better modeling options. Unfortunately, this situation is still the case, thus our present study investigates the effect of different modeling approaches to simulate the motion of an IA. We used three hyperelastic laws and two different ways of modeling the wall thickness and tissue mechanical properties -- one assumed that both were uniform while the other accounted for the heterogeneity of the wall by using a "hemodynamics-driven" approach in which both thickness and material constants varied spatially with the cardiac-cycle-averaged hemodynamics. Pulsatile numerical simulations, with patient-specific vascular geometries harboring IAs, were carried out using the one-way fluid-solid interaction solution strategy, in which the blood flow is solved and applied as the driving force of the wall motion. We found that different wall morphology models yield smaller absolute differences in the mechanical response than different hyperelastic laws. Furthermore, the stretch levels of IAs walls were more sensitive to the hyperelastic and material constants than the stress. These findings could be used to guide modeling decisions on IA simulations.


title: Quantum metrology of low frequency electromagnetic modes with frequency upconverters

abstract: We describe the RF Quantum Upconverter (RQU) and describe its application to quantum metrology of electromagnetic modes between dc and the Very High Frequency band (VHF) ($\lesssim$300MHz). The RQU uses a Josephson interferometer made up of superconducting loops and Josephson junctions to implement a parametric interaction between a low-frequency electromagnetic mode (between dc and VHF) and a mode in the microwave C Band ($\sim$ 5GHz), analogous to the radiation pressure interaction between electromagnetic and mechanical modes in cavity optomechanics. The RQU can operate as a quantum-limited op-amp, or use protocols from optomechanics to implement non-classical measurement protocols equivalent to those used in cavity optomechanics, including back-action evading (BAE) measurements, sideband cooling, and two-mode squeezing. These protocols enable experiments using dc-VHF electromagnetic modes as quantum sensors.


title: What Can the Neural Tangent Kernel Tell Us About Adversarial Robustness?

abstract: The adversarial vulnerability of neural nets, and subsequent techniques to create robust models have attracted significant attention; yet we still lack a full understanding of this phenomenon. Here, we study adversarial examples of trained neural networks through analytical tools afforded by recent theory advances connecting neural networks and kernel methods, namely the Neural Tangent Kernel (NTK), following a growing body of work that leverages the NTK approximation to successfully analyze important deep learning phenomena and design algorithms for new applications. We show how NTKs allow to generate adversarial examples in a ``training-free'' fashion, and demonstrate that they transfer to fool their finite-width neural net counterparts in the ``lazy'' regime. We leverage this connection to provide an alternative view on robust and non-robust features, which have been suggested to underlie the adversarial brittleness of neural nets. Specifically, we define and study features induced by the eigendecomposition of the kernel to better understand the role of robust and non-robust features, the reliance on both for standard classification and the robustness-accuracy trade-off. We find that such features are surprisingly consistent across architectures, and that robust features tend to correspond to the largest eigenvalues of the model, and thus are learned early during training. Our framework allows us to identify and visualize non-robust yet useful features. Finally, we shed light on the robustness mechanism underlying adversarial training of neural nets used in practice: quantifying the evolution of the associated empirical NTK, we demonstrate that its dynamics falls much earlier into the ``lazy'' regime and manifests a much stronger form of the well known bias to prioritize learning features within the top eigenspaces of the kernel, compared to standard training.


title: Hybrid toric varieties and the non-archimedean SYZ fibration on Calabi-Yau hypersurfaces

abstract: Using a construction by Yamamoto of tropical contractions, we construct a non-archimedean SYZ fibration on the Berkovich analytification of a class of maximally degenerate hypersurfaces in projective space. We furthermore prove that under a discrete symmetry assumption, the potential for the non-archimedean Calabi-Yau metric is constant along the fibers of the retraction. The proof uses the work of Li on the Fermat degeneration of hypersurfaces, and an explicit description of toric plurisubharmonic metrics on the hybrid space associated to a complex toric variety.


title: Benefits of Permutation-Equivariance in Auction Mechanisms

abstract: Designing an incentive-compatible auction mechanism that maximizes the auctioneer's revenue while minimizes the bidders' ex-post regret is an important yet intricate problem in economics. Remarkable progress has been achieved through learning the optimal auction mechanism by neural networks. In this paper, we consider the popular additive valuation and symmetric valuation setting; i.e., the valuation for a set of items is defined as the sum of all items' valuations in the set, and the valuation distribution is invariant when the bidders and/or the items are permutated. We prove that permutation-equivariant neural networks have significant advantages: the permutation-equivariance decreases the expected ex-post regret, improves the model generalizability, while maintains the expected revenue invariant. This implies that the permutation-equivariance helps approach the theoretically optimal dominant strategy incentive compatible condition, and reduces the required sample complexity for desired generalization. Extensive experiments fully support our theory. To our best knowledge, this is the first work towards understanding the benefits of permutation-equivariance in auction mechanisms.


title: The non-autonomous Navier-Stokes-Brinkman-Forchheimer equation with Dirichlet boundary conditions: dissipativity, regularity, and attractors

abstract: We give a comprehensive study of the 3D Navier-Stokes-Brinkman-Forchheimer equations in a bounded domain endowed with the Dirichlet boundary conditions and non-autonomous external forces. This study includes the questions related with the regularity of weak solutions, their dissipativity in higher energy spaces and the existence of the corresponding uniform attractors


title: Aggregating Crowdsourced and Automatic Judgments to Scale Up a Corpus of Anaphoric Reference for Fiction and Wikipedia Texts

abstract: Although several datasets annotated for anaphoric reference/coreference exist, even the largest such datasets have limitations in terms of size, range of domains, coverage of anaphoric phenomena, and size of documents included. Yet, the approaches proposed to scale up anaphoric annotation haven't so far resulted in datasets overcoming these limitations. In this paper, we introduce a new release of a corpus for anaphoric reference labelled via a game-with-a-purpose. This new release is comparable in size to the largest existing corpora for anaphoric reference due in part to substantial activity by the players, in part thanks to the use of a new resolve-and-aggregate paradigm to 'complete' markable annotations through the combination of an anaphoric resolver and an aggregation method for anaphoric reference. The proposed method could be adopted to greatly speed up annotation time in other projects involving games-with-a-purpose. In addition, the corpus covers genres for which no comparable size datasets exist (Fiction and Wikipedia); it covers singletons and non-referring expressions; and it includes a substantial number of long documents (> 2K in length).


title: Digital Twin-Based Multiple Access Optimization and Monitoring via Model-Driven Bayesian Learning

abstract: Commonly adopted in the manufacturing and aerospace sectors, digital twin (DT) platforms are increasingly seen as a promising paradigm to control and monitor software-based, "open", communication systems, which play the role of the physical twin (PT). In the general framework presented in this work, the DT builds a Bayesian model of the communication system, which is leveraged to enable core DT functionalities such as control via multi-agent reinforcement learning (MARL) and monitoring of the PT for anomaly detection. We specifically investigate the application of the proposed framework to a simple case-study system encompassing multiple sensing devices that report to a common receiver. The Bayesian model trained at the DT has the key advantage of capturing epistemic uncertainty regarding the communication system, e.g., regarding current traffic conditions, which arise from limited PT-to-DT data transfer. Experimental results validate the effectiveness of the proposed Bayesian framework as compared to standard frequentist model-based solutions.


title: Minisuperspace Quantum Cosmology from the Einstein-Cartan Path Integral

abstract: We derive the fixed-$\Lambda$ and unimodular propagators using the path integral formalism as applied to the Einstein-Cartan action. The simplicity of the action (which is linear in the lapse function) allows for an exact integration starting from the lapse function and the enforcement of the Hamiltonian constraint, leading to a product of Chern-Simons states if the connection is fixed at the endpoints. No saddle point approximation is needed. Should the metric be fixed at the endpoints, then, depending on the contour chosen for the connection, Hartle-Hawking or Vilenkin propagators are obtained. Thus, in this approach one trades a choice of contour in the lapse function for one in the connection, where appropriate. The unimodular propagators are also trivial to obtain via the path integral, and the previously derived expressions are recovered.


title: On Adaptivity in Non-stationary Stochastic Optimization With Bandit Feedback

abstract: In this paper we study the non-stationary stochastic optimization question with bandit feedback and dynamic regret measures. The seminal work of Besbes et al. (2015) shows that, when aggregated function changes is known a priori, a simple re-starting algorithm attains the optimal dynamic regret. In this work, we designed a stochastic optimization algorithm with fixed step sizes, which combined together with the multi-scale sampling framework of Wei and Luo (2021) achieves the optimal dynamic regret in non-stationary stochastic optimization without requiring prior knowledge of function change budget, thereby closes a question that has been open for a while. We also establish an additional result showing that any algorithm achieving good regret against stationary benchmarks with high probability could be automatically converted to an algorithm that achieves good regret against dynamic benchmarks, which is applicable to a wide class of bandit convex optimization algorithms.


title: Intrinsic localized modes in a two-dimensional checkerboard ferromagnetic lattice

abstract: An analytical work on intrinsic localized modes in a two-dimensional Heisenberg ferromagnet on the checkerboard lattice is presented. Taking advantage of an asymptotic method, the governing lattice dynamical equations are reduced to one (2+1) -dimensional nonlinear Schr\"odinger. In our work, we obtain two types of nonlinear localized mode solutions, namely, Brillouin zone center modes and Brillouin zone corner modes. The occurrence conditions for these intrinsic localized modes are given in detail. Especially, we find that the competition between the Dzialozinskii-Moriy interaction and the next-nearest neighbor interaction of the checkerboard ferromagnet has an effect on the local structure of the Brillouin zone corner acoustic mode.


title: Passive Bias-Free Nonreciprocal Metasurfaces Based on Nonlinear Quasi-Bound States in the Continuum

abstract: Nonreciprocal devices - in which light is transmitted with different efficiencies along opposite directions - are key technologies for modern photonic applications, yet their compact and miniaturized implementation remains an open challenge. Among different avenues, nonlinearity-induced nonreciprocity has attracted significant attention due to the absence of external bias and integrability within conventional material platforms. So far, nonlinearity-induced nonreciprocity has been demonstrated only in guided platforms using high-Q resonators. Here, we demonstrate ultrathin optical metasurfaces with large nonreciprocal response for free-space radiation based on silicon third-order nonlinearities. Our metasurfaces combine an out-of-plane asymmetry - necessary to obtain nonreciprocity - with in-plane broken symmetry, which finely tunes the radiative linewidth of quasi-bound states in the continuum (q-BICs). Third-order nonlinearities naturally occurring in silicon, engaged by q-BICs, are shown to enable over 10 dB of nonreciprocal transmission while maintaining less than 3 dB in insertion loss. The demonstrated devices merge the field of nonreciprocity with ultrathin metasurface technologies, offering an exciting functionality for signal processing and routing, communications, and protection of high-power laser cavities.


title: Multi-faceted plasmonic nanocavities

abstract: Plasmonic nanocavities form very robust sub-nanometer gaps between nanometallic structures and confine light in deep subwavelength volumes to enable unprecedented control on light-matter interactions. However, spherical nanoparticles acquire various polyhedral shapes during their synthesis, which has defining impact on controlling many light-matter interactions, such as photocatalytic reactions. Here, we focus on nanocavities made of three polyhedral nanoparticles (cuboctahedron, rhombicuboctahedron, decahedron) that commonly occur during the synthesis of spherical nanoparticles. Their photonic modes have a very intricate and rich optical behaviour, both in the near- and far-field. Through a recombination technique, we obtain the total far-field produced by a molecule placed within these nanocavities, to reveal how energy couples in and out of the system. This work paves the way towards understanding and controlling light-matter interactions, such as photocatalytic reactions and non-linear vibrational pumping, in such extreme environments.


title: Rigidity of nonpositively curved manifolds with convex boundary

abstract: We show that a compact Riemannian $3$-manifold $M$ with strictly convex simply connected boundary and sectional curvature $K\leq a\leq 0$ is isometric to a convex domain in a complete simply connected space of constant curvature $a$, provided that $K\equiv a$ on planes tangent to the boundary of $M$. This yields a characterization of strictly convex surfaces with minimal total curvature in Cartan-Hadamard $3$-manifolds, and extends some rigidity results of Greene-Wu, Gromov, and Schroeder-Strake. Our proof is based on a recent comparison formula for total curvature of Riemannian hypersurfaces, which also yields some dual results for $K\geq a\geq 0$.


title: Combining Relaying and Reflective Surfaces: Power Consumption and Energy Efficiency Analysis

abstract: Hybrid relaying networks (HRNs) combining both a relay and an intelligent reflective surface (IRS) can lead to enhanced rate performance compared to non-hybrid relaying schemes, where only either an IRS or a relay is utilized. However, utilizing both the relay and the IRS simultaneously results in higher power consumption for the HRNs compared to their counterpart. In this work, we study the required transmit power levels and the energy efficiency (EE) of HRNs utilizing both a half-duplex decode-and-forward (HD-DF) relay and an IRS, and compare their performance with non-hybrid relaying schemes. The impact of the required channel estimation overheads is considered when the reflective beamforming design (RBD) at the IRS is carried out under both instantaneous and statistical channel state information models. Also, the investigation is performed for both slow- and fast-changing environments. In terms of the transmit power requirements, our results show that HRNs can lead to higher power savings if the number of reflective elements at the IRS is not very large. However, non-hybrid relaying schemes are shown to be more energy-efficient, unless the targeted rate is high and the IRS is distant from both transmitter and receiver but within a close proximity to the relay.


title: Two-photon interference from a quantum emitter in hexagonal boron nitride

abstract: Recently discovered quantum emitters in two-dimensional (2D) materials have opened new perspectives of integrated photonic devices for quantum information. Most of these applications require the emitted photons to be indistinguishable, which has remained elusive in 2D materials. Here, we investigate two-photon interference of a quantum emitter generated in hexagonal boron nitride (hBN) using an electron beam. We measure the correlations of zero-phonon-line photons in a Hong-Ou-Mandel (HOM) interferometer under non-resonant excitation. We find that the emitted photons exhibit a partial indistinguishability of $0.44 \pm 0.11$ in a 3 ns time window, which corresponds to a corrected value of $0.56 \pm 0.11$ after accounting for imperfect emitter purity. The dependence of the HOM visibility on the width of the post-selection time window allows us to estimate the dephasing time of the emitter to be $\sim 1.5$ ns, about half the limit set by spontaneous emission. A visibility above 90 % is under reach using Purcell effect with up-to-date 2D material photonics.


title: Relativistic time-of-arrival measurements: predictions, post-selection and causality problem

abstract: We analyze time-of-arrival probability distributions for relativistic particles in the context of quantum field theory (QFT). We show that QFT leads to a unique prediction, modulo post-selection that incorporates properties of the apparatus into the initial state. We also show that an experimental distinction of different probability assigments is possible especially in near-field measurements. We also analyze causality in relativistic measurements. We consider a quantum state obtained by a spacetime-localized operation on the vacuum, and we show that detection probabilities are typically characterized by small transient non-causal terms. We explain that these terms originate from Feynman-propagation of the initial operation, because the Feynman propagator does not vanish outside the light-cone. We discuss possible ways to restore causality, and we argue that this may not be possible in measurement models that involve switching the field-apparatus coupling on and off.


title: Logic-Based Benders for intermodal operations with delay penalties

abstract: Intermodal logistics typically include the successive stages of intermodal shipment and last-mile delivery. We investigate this problem under a novel Logic-Based Benders Decomposition, which exploits the staged nature of the problem to minimise the sum of transport costs and delivery penalties. We establish the validity of our decomposition and apply effective optimality cuts. Apart from models and formal proofs, we provide extensive experimentation on random instances of considerable scale that shows the improvement achieved in terms of small gaps and shorter time compared to a monolithic MILP approach. Last, we propose a major extension of our generic method for a real logistics case. The implementation of the extension on real instances show the versatility of our method in terms of supporting different planning approaches thus leading to actual cost improvements.


title: Prototypical VoteNet for Few-Shot 3D Point Cloud Object Detection

abstract: Most existing 3D point cloud object detection approaches heavily rely on large amounts of labeled training data. However, the labeling process is costly and time-consuming. This paper considers few-shot 3D point cloud object detection, where only a few annotated samples of novel classes are needed with abundant samples of base classes. To this end, we propose Prototypical VoteNet to recognize and localize novel instances, which incorporates two new modules: Prototypical Vote Module (PVM) and Prototypical Head Module (PHM). Specifically, as the 3D basic geometric structures can be shared among categories, PVM is designed to leverage class-agnostic geometric prototypes, which are learned from base classes, to refine local features of novel categories.Then PHM is proposed to utilize class prototypes to enhance the global feature of each object, facilitating subsequent object localization and classification, which is trained by the episodic training strategy. To evaluate the model in this new setting, we contribute two new benchmark datasets, FS-ScanNet and FS-SUNRGBD. We conduct extensive experiments to demonstrate the effectiveness of Prototypical VoteNet, and our proposed method shows significant and consistent improvements compared to baselines on two benchmark datasets.


title: Navigating Ensemble Configurations for Algorithmic Fairness

abstract: Bias mitigators can improve algorithmic fairness in machine learning models, but their effect on fairness is often not stable across data splits. A popular approach to train more stable models is ensemble learning, but unfortunately, it is unclear how to combine ensembles with mitigators to best navigate trade-offs between fairness and predictive performance. To that end, we built an open-source library enabling the modular composition of 8 mitigators, 4 ensembles, and their corresponding hyperparameters, and we empirically explored the space of configurations on 13 datasets. We distilled our insights from this exploration in the form of a guidance diagram for practitioners that we demonstrate is robust and reproducible.


title: The Exoplanet Radius Valley from Gas-driven Planet Migration and Breaking of Resonant Chains

abstract: The size frequency distribution of exoplanet radii between 1 and 4$R_{\oplus}$ is bimodal with peaks at $\sim$1.4 $R_{\oplus}$ and $\sim$2.4 $R_{\oplus}$, and a valley at $\sim$1.8$R_{\oplus}$. This radius valley separates two classes of planets -- usually referred to as "super-Earths" and "mini-Neptunes" -- and its origin remains debated. One model proposes that super-Earths are the outcome of photo-evaporation or core-powered mass-loss stripping the primordial atmospheres of the mini-Neptunes. A contrasting model interprets the radius valley as a dichotomy in the bulk compositions, where super-Earths are rocky planets and mini-Neptunes are water-ice rich worlds. In this work, we test whether the migration model is consistent with the radius valley and how it distinguishes these views. In the migration model, planets migrate towards the disk inner edge forming a chain of planets locked in resonant configurations. After the gas disk dispersal, orbital instabilities "break the chains" and promote late collisions. This model broadly matches the period-ratio and planet-multiplicity distributions of Kepler planets, and accounts for resonant chains such as TRAPPIST-1, Kepler-223, and TOI-178. Here, by combining the outcome of planet formation simulations with compositional mass-radius relationships, and assuming complete loss of primordial H-rich atmospheres in late giant-impacts, we show that the migration model accounts for the exoplanet radius valley and the intra-system uniformity ("peas-in-a-pod") of Kepler planets. Our results suggest that planets with sizes of $\sim$1.4 $R_{\oplus}$ are mostly rocky, whereas those with sizes of $\sim$2.4 $R_{\oplus}$ are mostly water-ice rich worlds. Our results do not support an exclusively rocky composition for the cores of mini-Neptunes.


title: Geometry of Radial Basis Neural Networks for Safety Biased Approximation of Unsafe Regions

abstract: Barrier function-based inequality constraints are a means to enforce safety specifications for control systems. When used in conjunction with a convex optimization program, they provide a computationally efficient method to enforce safety for the general class of control-affine systems. One of the main assumptions when taking this approach is the a priori knowledge of the barrier function itself, i.e., knowledge of the safe set. In the context of navigation through unknown environments where the locally safe set evolves with time, such knowledge does not exist. This manuscript focuses on the synthesis of a zeroing barrier function characterizing the safe set based on safe and unsafe sample measurements, e.g., from perception data in navigation applications. Prior work formulated a supervised machine learning algorithm whose solution guaranteed the construction of a zeroing barrier function with specific level-set properties. However, it did not explore the geometry of the neural network design used for the synthesis process. This manuscript describes the specific geometry of the neural network used for zeroing barrier function synthesis, and shows how the network provides the necessary representation for splitting the state space into safe and unsafe regions.


title: Digitization of Raster Logs: A Deep Learning Approach

abstract: Raster well-log images are digital representations of well-logs data generated over the years. Raster digital well logs represent bitmaps of the log image in a rectangular array of black (zeros) and white dots (ones) called pixels. Experts study the raster logs manually or with software applications that still require a tremendous amount of manual input. Besides the loss of thousands of person-hours, this process is erroneous and tedious. To digitize these raster logs, one must buy a costly digitizer that is not only manual and time-consuming but also a hidden technical debt since enterprises stand to lose more money in additional servicing and consulting charges. We propose a deep neural network architecture called VeerNet to semantically segment the raster images from the background grid and classify and digitize the well-log curves. Raster logs have a substantially greater resolution than images traditionally consumed by image segmentation pipelines. Since the input has a low signal-to-resolution ratio, we require rapid downsampling to alleviate unnecessary computation. We thus employ a modified UNet-inspired architecture that balances retaining key signals and reducing result dimensionality. We use attention augmented read-process-write architecture. This architecture efficiently classifies and digitizes the curves with an overall F1 score of 35% and IoU of 30%. When compared to the actual las values for Gamma-ray and derived value of Gamma-ray from VeerNet, a high Pearson coefficient score of 0.62 was achieved.


title: Enriching Biomedical Knowledge for Low-resource Language Through Large-Scale Translation

abstract: Biomedical data and benchmarks are highly valuable yet very limited in low-resource languages other than English such as Vietnamese. In this paper, we make use of a state-of-the-art translation model in English-Vietnamese to translate and produce both pretrained as well as supervised data in the biomedical domains. Thanks to such large-scale translation, we introduce ViPubmedT5, a pretrained Encoder-Decoder Transformer model trained on 20 million translated abstracts from the high-quality public PubMed corpus. ViPubMedT5 demonstrates state-of-the-art results on two different biomedical benchmarks in summarization and acronym disambiguation. Further, we release ViMedNLI - a new NLP task in Vietnamese translated from MedNLI using the recently public En-vi translation model and carefully refined by human experts, with evaluations of existing methods against ViPubmedT5.


title: Improving Sample Efficiency of Deep Learning Models in Electricity Market

abstract: The superior performance of deep learning relies heavily on a large collection of sample data, but the data insufficiency problem turns out to be relatively common in global electricity markets. How to prevent overfitting in this case becomes a fundamental challenge when training deep learning models in different market applications. With this in mind, we propose a general framework, namely Knowledge-Augmented Training (KAT), to improve the sample efficiency, and the main idea is to incorporate domain knowledge into the training procedures of deep learning models. Specifically, we propose a novel data augmentation technique to generate some synthetic data, which are later processed by an improved training strategy. This KAT methodology follows and realizes the idea of combining analytical and deep learning models together. Modern learning theories demonstrate the effectiveness of our method in terms of effective prediction error feedbacks, a reliable loss function, and rich gradient noises. At last, we study two popular applications in detail: user modeling and probabilistic price forecasting. The proposed method outperforms other competitors in all numerical tests, and the underlying reasons are explained by further statistical and visualization results.


title: Observability Analysis of Graph SLAM-Based Joint Calibration of Multiple Microphone Arrays and Sound Source Localization

abstract: Multiple microphone arrays have many applications in robot audition, including sound source localization, audio scene perception and analysis, etc. However, accurate calibration of multiple microphone arrays remains a challenge because there are many unknown parameters to be identified, including the Euler angles, geometry, asynchronous factors between the microphone arrays. This paper is concerned with joint calibration of multiple microphone arrays and sound source localization using graph simultaneous localization and mapping (SLAM). By using a Fisher information matrix (FIM) approach, we focus on the observability analysis of the graph SLAM framework for the above-mentioned calibration problem. We thoroughly investigate the identifiability of the unknown parameters, including the Euler angles, geometry, asynchronous effects between the microphone arrays, and the sound source locations. We establish necessary/sufficient conditions under which the FIM and the Jacobian matrix have full column rank, which implies the identifiability of the unknown parameters. These conditions are closely related to the variation in the motion of the sound source and the configuration of microphone arrays, and have intuitive and physical interpretations. We also discover several scenarios where the unknown parameters are not uniquely identifiable. All theoretical findings are demonstrated using simulation data.


title: Electrodynamics in geometric algebra

abstract: We consider the electrodynamics of electric charges and currents in vacuum and then generalise our results to the description of a dielectric and magnetic material medium : first in spatial algebra (SA) and then in space-time algebra (STA). Introducing a polarisation multivector $\tilde{P} = \boldsymbol{\tilde{p}} -\,\frac{1}{c}\,\boldsymbol{\tilde{M}}$ and an auxiliary electromagnetic field multivector $G = \varepsilon_0\,F + \tilde{P}$, we express the Maxwell equation in the material medium in SA. Introducing a bound current vector $\tilde{J} = J -\,c\,\nabla\cdot\tilde{P}$ in space-time, the Maxwell equation is then expressed in STA. The wave equation in the material medium is obtained by taking the gradient of the Maxwell equation. For a uniform electromagnetic medium consisting of induced electric and magnetic dipoles, the stress-energy momentum vector is written as $\dot{T}\left(\dot{\nabla}\right) = \frac{1}{c}\,J \cdot F = f$ where $f$ is the electromagnetic force density vector in space-time. Finally, the Maxwell equation in the material medium can be written in STA as a wave equation for the potential vector $A$.


title: On Monotonicities of Interval Valued Functions

abstract: In this paper, we develop the notions of weak/directional monotonicity (developed by Sesma-Sara et al. in terms of the \emph{Kulisch-Miranker order}) and the notion of $ G $-monotonicity (introduced by Santiago et al. for $ [0,\!1]$) for intervals endowed with admissible orders.


title: A new physical mechanism for the onset of atomic ionization in an optical field with jolts of phase

abstract: A theoretical model that describes a new mechanism of atomic and molecular ionization in a low intensity electro-magnetic wave (light or laser beam) with the energy of quanta that is lower than required for a single photon ionization is presented. The essence of the proposed physical mechanism is the step-like gain of energy of a bound electron that occurs every time the phase of the electro-magnetic field jolts. Providing there is sufficiently large number of the phase jolts, the summation of the step increases of the electron oscillation energy can render the total energy of the bound electron such that it exceeds the ionization potential.


title: Rydberg blockade based parity quantum optimization

abstract: We present a scalable architecture for solving higher-order constrained binary optimization problems on current neutral-atom hardware operating in the Rydberg blockade regime. In particular, we formulate the recently developed parity encoding of arbitrary connected higher-order optimization problems as a maximum-weight independent set (\textsf{MWIS}) problem on disk graphs, that are directly encodable on such devices. Our architecture builds from small \textsf{MWIS} modules in a problem-independent way, crucial for practical scalability.


title: Weyl asymptotics for fractional-order Dirichlet realizations in nonsmooth cases

abstract: Let $P$ be a symmetric $2a$-order classical strongly elliptic pseudodifferential operator with even symbol $p(x,\xi )$ on $R^n$ ($0<a<1$), for example a perturbation of $(-\Delta )^a$. Let $\Omega \subset R^n$ be bounded, and let $P_D$ be the Dirichlet realization in $L_2(\Omega )$ defined under the exterior condition $u=0$ in $R^n\setminus\Omega $. When $p(x,\xi )$ and $\Omega $ are $C^\infty $, it is known that the eigenvalues $\lambda _j$ (ordered in a nondecreasing sequence for $j\to\infty $) satisfy a Weyl asymptotic formula $$ \lambda _j(P_{D})=C(P,\Omega )j^{2a/n}+o(j^{2a/n})\text{ for }j\to \infty, $$ with $C(P,\Omega )$ determined from the principal symbol of $P$. We now show that this result is valid for more general operators with a possibly nonsmooth $x$-dependence, over Lipschitz domains, and that it extends to $\tilde P=P+P'+P''$, where $P'$ is an operator of order $<\min\{2a, a+\frac12\}$ with certain mapping properties, and $P''$ is bounded in $L_2(\Omega )$ (e.g. $P''=V(x)\in L_\infty (\Omega )$). Also the regularity of eigenfunctions of $P_D$ is discussed.


title: Spectral characteristics of the black hole binary 4U 1957+115: A multi-mission perspective

abstract: We report spectral analysis of the persistent black hole X-ray binary, 4U 1957+115, using AstroSat, Swift and NuSTAR observations carried out between 2016-2019. Modelling with a disk emission, thermal comptonization and blurred reflection components revealed that the source was in the high soft state with the disk flux $\sim 87$ % of the total and high energy photon index $\sim2.6$. There is an evidence that either the inner disk radius varied by $\sim25$ % or the colour hardening factor changed by $\sim12$ %. The values of the inner disk radius imply that for a non-spinning black hole, the black hole mass is $<7$ M$_\odot$ and the source is located $>30 $ kpc away. On the other hand, a rapidly spinning black hole would be consistent with the more plausible black hole mass of $< 10$ M$_\odot$ and a source distance of $\sim10$ kpc. Fixing the distance to $10$ kpc and using a relativistic accretion disk model, constrained the black hole mass to 6 M$_\odot$ and inclination angle to 72$^{\circ}$. A positive correlation is detected between the accretion rate and inner radii or equivalently between the accretion rate and colour factor.


title: Divergence Results and Convergence of a Variance Reduced Version of ADAM

abstract: Stochastic optimization algorithms using exponential moving averages of the past gradients, such as ADAM, RMSProp and AdaGrad, have been having great successes in many applications, especially in training deep neural networks. ADAM in particular stands out as efficient and robust. Despite of its outstanding performance, ADAM has been proved to be divergent for some specific problems. We revisit the divergent question and provide divergent examples under stronger conditions such as in expectation or high probability. Under a variance reduction assumption, we show that an ADAM-type algorithm converges, which means that it is the variance of gradients that causes the divergence of original ADAM. To this end, we propose a variance reduced version of ADAM and provide a convergent analysis of the algorithm. Numerical experiments show that the proposed algorithm has as good performance as ADAM. Our work suggests a new direction for fixing the convergence issues.


title: Heat and wave type equations with non-local operators, I. Compact Lie groups

abstract: We prove existence, uniqueness and give the analytical solution of heat and wave type equations on a compact Lie group $G$ by using a non-local (in time) differential operator and a positive left invariant operator (maybe unbounded) acting on the group. For heat type equations, solutions are given in $L^q(G)$ for data in $L^p(G)$ with $1<p\leqslant 2\leqslant q<+\infty$. We also provide some asymptotic estimates (large-time behavior) for the solutions. Some examples are given. Also, for wave type equations, we give the solution on some suitable Sobolev spaces over $L^2(G)$. We complement our results, by studying a multi-term heat type equation as well.


title: On the automorphism of Barns Wall Lattice $\Lambda_{BW_{16}}$ and rank 4 tensor of quaternions

abstract: In a previous paper, I found that the Weyl group $W(F_4)$ and Barns-Wall Lattice $BW_{16}$ can be constructed using the rank $2$ tensor of the quaternion. In the present paper, I describe how I were able to construct an algebra, which is the subalgebra of the direct product of Hurwitz Quaternionic integers $\mathscr{H}^4$, isomorphic to the automorphism $\text{Aut}(BW_{16})$ order $2^{21} \cdot 3^5 \cdot 5^2 \cdot 7$ of Barns Wall Lattice $BW_{16}$ by functionally extending the rank of the tensor product of quaternions to $4$.


title: MTet: Multi-domain Translation for English and Vietnamese

abstract: We introduce MTet, the largest publicly available parallel corpus for English-Vietnamese translation. MTet consists of 4.2M high-quality training sentence pairs and a multi-domain test set refined by the Vietnamese research community. Combining with previous works on English-Vietnamese translation, we grow the existing parallel dataset to 6.2M sentence pairs. We also release the first pretrained model EnViT5 for English and Vietnamese languages. Combining both resources, our model significantly outperforms previous state-of-the-art results by up to 2 points in translation BLEU score, while being 1.6 times smaller.