title: Cosmological Boundary Flux Parameter

abstract: The {\it{Cosmological Boundary Flux Parameter}} is a novel proposal that attempts to explain the origin of the cosmological parameter $\Lambda$ purely by geometric nature. Then we implement this new approach to a flat FLRW universe along with a barotropic fluid. We present an ansatz in which $\Lambda$ is straightforwardly coupled to the matter sector; therefore, only one additional parameter was introduced: $\lambda$. Also, through a statistical analysis, using late-time data of observational Hubble and type Ia Supernovae, we computed the joint best-fit value of the free parameters by means of the affine-invariant MCMC. We want to emphasise that the joint analysis produces a smaller $H_{0}^{\rm CBFP}=69.80\rm\,\, Km \,s^{-1}\,Mpc^{-1}$ in contrast to the flat $\Lambda$CDM result $H_{0}^{\Lambda\rm CDM}=70.53\rm\,\, Km \,s^{-1}\,Mpc^{-1}$. The work presented here seeks to contribute to the discussion of the possible explanation for the cosmos' acceleration, together with tackling other important questions in modern cosmology.


title: Towards Scalable Hyperbolic Neural Networks using Taylor Series Approximations

abstract: Hyperbolic networks have shown prominent improvements over their Euclidean counterparts in several areas involving hierarchical datasets in various domains such as computer vision, graph analysis, and natural language processing. However, their adoption in practice remains restricted due to (i) non-scalability on accelerated deep learning hardware, (ii) vanishing gradients due to the closure of hyperbolic space, and (iii) information loss due to frequent mapping between local tangent space and fully hyperbolic space. To tackle these issues, we propose the approximation of hyperbolic operators using Taylor series expansions, which allows us to reformulate the computationally expensive tangent and cosine hyperbolic functions into their polynomial equivariants which are more efficient. This allows us to retain the benefits of preserving the hierarchical anatomy of the hyperbolic space, while maintaining the scalability over current accelerated deep learning infrastructure. The polynomial formulation also enables us to utilize the advancements in Euclidean networks such as gradient clipping and ReLU activation to avoid vanishing gradients and remove errors due to frequent switching between tangent space and hyperbolic space. Our empirical evaluation on standard benchmarks in the domain of graph analysis and computer vision shows that our polynomial formulation is as scalable as Euclidean architectures, both in terms of memory and time complexity, while providing results as effective as hyperbolic models. Moreover, our formulation also shows a considerable improvement over its baselines due to our solution to vanishing gradients and information loss.


title: FedPop: A Bayesian Approach for Personalised Federated Learning

abstract: Personalised federated learning (FL) aims at collaboratively learning a machine learning model taylored for each client. Albeit promising advances have been made in this direction, most of existing approaches works do not allow for uncertainty quantification which is crucial in many applications. In addition, personalisation in the cross-device setting still involves important issues, especially for new clients or those having small number of observations. This paper aims at filling these gaps. To this end, we propose a novel methodology coined FedPop by recasting personalised FL into the population modeling paradigm where clients' models involve fixed common population parameters and random effects, aiming at explaining data heterogeneity. To derive convergence guarantees for our scheme, we introduce a new class of federated stochastic optimisation algorithms which relies on Markov chain Monte Carlo methods. Compared to existing personalised FL methods, the proposed methodology has important benefits: it is robust to client drift, practical for inference on new clients, and above all, enables uncertainty quantification under mild computational and memory overheads. We provide non-asymptotic convergence guarantees for the proposed algorithms and illustrate their performances on various personalised federated learning tasks.


title: Predictive Modeling of Charge Levels for Battery Electric Vehicles using CNN EfficientNet and IGTD Algorithm

abstract: Convolutional Neural Networks (CNN) have been a good solution for understanding a vast image dataset. As the increased number of battery-equipped electric vehicles is flourishing globally, there has been much research on understanding which charge levels electric vehicle drivers would choose to charge their vehicles to get to their destination without any prevention. We implemented deep learning approaches to analyze the tabular datasets to understand their state of charge and which charge levels they would choose. In addition, we implemented the Image Generator for Tabular Dataset algorithm to utilize tabular datasets as image datasets to train convolutional neural networks. Also, we integrated other CNN architecture such as EfficientNet to prove that CNN is a great learner for reading information from images that were converted from the tabular dataset, and able to predict charge levels for battery-equipped electric vehicles. We also evaluated several optimization methods to enhance the learning rate of the models and examined further analysis on improving the model architecture.


title: Two reasons for the appearance of pushed wavefronts in the Belousov-Zhabotinsky system with spatiotemporal interaction

abstract: We prove the existence of the minimal speed of propagation $c_*(r,b,K) \in [2\sqrt{1-r},2]$ for wavefronts in the Belousov-Zhabotinsky system with a spatiotemporal interaction defined by the convolution with (possibly, "fat-tailed") kernel $K$. The model is assumed to be monostable non-degenerate, i.e. $r\in (0,1)$. The slowest wavefront is termed pushed or non-linearly determined if its velocity $c_*(r,b,K) > 2\sqrt{1-r}$. We show that $c_*(r,b,K)$ is close to 2 if i) positive system's parameter $b$ is sufficiently large or ii) if $K$ is spatially asymmetric to one side (e.g. to the left: in such a case, the influence of the right side concentration of the bromide ion on the dynamics is more significant than the influence of the left side). Consequently, this reveals two reasons for the appearance of pushed wavefronts in the Belousov-Zhabotinsky reaction.


title: The Giant Magellan Telescope high contrast adaptive optics phasing testbed (p-HCAT): lab tests of segment/petal phasing with a pyramid wavefront sensor and a holographic dispersed fringe sensor (HDFS) in turbulence

abstract: The Giant Magellan Telescope (GMT) design consists of seven circular 8.4-m diameter mirror segments that are separated by large > 30 cm gaps, creating the possibility of fluctuations in optical path differences due to flexure, segment vibrations, wind buffeting, temperature effects, and atmospheric seeing. In order to utilize the full diffraction-limited aperture of the GMT for natural guide star adaptive optics (NGSAO) science, the seven mirror segments must be co-phased to well within a fraction of a wavelength. The current design of the GMT involves seven adaptive secondary mirrors, an off-axis dispersed fringe sensor (part of the AGWS), and a pyramid wavefront sensor (PyWFS; part of the NGWS) to measure and correct the total path length between segment pairs, but these methods have yet to be tested "end-to-end" in a lab environment. We present the design and working prototype of a "GMT High-Contrast Adaptive Optics phasing Testbed" (p-HCAT) which leverages the existing MagAO-X AO instrument to demonstrate segment phase sensing and simultaneous AO-control for GMT NGSAO science. We present the first test results of closed-loop piston control with one GMT segment using MagAO-X's PyWFS and a novel Holographic Dispersed Fringe Sensor (HDFS) with and without simulated atmospheric turbulence. We show that the PyWFS alone was unsuccessful at controlling segment piston with generated ~ 0.6 arcsec and ~ 1.2 arcsec seeing turbulence due to non-linear modal cross-talk and poor pixel sampling of the segment gaps on the PyWFS detector. We report the success of an alternate solution to control piston using the novel HDFS while controlling all other modes with the PyWFS purely as a slope sensor (piston mode removed). This "second channel" WFS method worked well to control piston to within 50 nm RMS and $\pm$ 10 $\mu$m dynamic range under simulated 0.6 arcsec atmospheric seeing conditions.


title: The Holographic Dispersed Fringe Sensors (HDFS): phasing the Giant Magellan Telescope

abstract: The next generation of Giant Segmented Mirror Telescopes (GSMT) will have large gaps between the segments either caused by the shadow of the mechanical structure of the secondary mirror (E-ELT and TMT) or intrinsically by design (GMT). These gaps are large enough to fragment the aperture into independent segments that are separated by more than the typical Fried parameter. This creates piston and petals modes that are not well sensed by conventional wavefront sensors such as the Shack-Hartmann wavefront sensor or the pyramid wavefront sensor. We propose to use a new optical device, the Holographic Dispersed Fringe Sensor (HDFS), to sense and control these petal/piston modes. The HDFS uses a single pupil-plane hologram to interfere the segments onto different spatial locations in the focal plane. Numerical simulations show that the HDFS is very efficient and that it reaches a differential piston rms smaller than 10 nm for GMT/E-ELT/TMT for guide stars up to 13th J+H band magnitude. The HDFS has also been validated in the lab with MagAO-X and HCAT, the GMT phasing testbed. The lab experiments reached 5 nm rms piston error on the Magellan telescope aperture. The HDFS also reached 50 nm rms of piston error on a segmented GMT-like aperture while the pyramid wavefront sensor was compensating simulated atmosphere under median seeing conditions. The simulations and lab results demonstrate the HDFS as an excellent piston sensor for the GMT. We find that the combination of a pyramid slope sensor with a HDFS piston sensor is a powerful architecture for the GMT.


title: A directed walk in probability space that locates mean field solutions to spin models

abstract: Despite their formal simplicity, most lattice spin models cannot be easily solved, even under the simplifying assumptions of mean field theory. In this manuscript, we present a method for generating mean field solutions to classical continuous spins. We focus our attention on systems with non-local interactions and non-periodic boundaries, which require careful handling with existing approaches, such as Monte Carlo sampling. Our approach utilizes functional optimization to derive a closed-form optimality condition and arrive at self-consistent mean field equations. We show that this approach significantly outperforms conventional Monte Carlo sampling in convergence speed and accuracy. To convey the general concept behind the approach, we first demonstrate its application to a simple system - a finite one-dimensional dipolar chain in an external electric field. We then describe how the approach naturally extends to more complicated spin systems and to continuum field theories. Furthermore, we numerically illustrate the efficacy of our approach by highlighting its utility on nonperiodic spin models of various dimensionality.


title: Subject Granular Differential Privacy in Federated Learning

abstract: This paper considers subject level privacy in the FL setting, where a subject is an individual whose private information is embodied by several data items either confined within a single federation user or distributed across multiple federation users. We propose two new algorithms that enforce subject level DP at each federation user locally. Our first algorithm, called LocalGroupDP, is a straightforward application of group differential privacy in the popular DP-SGD algorithm. Our second algorithm is based on a novel idea of hierarchical gradient averaging (HiGradAvgDP) for subjects participating in a training mini-batch. We also show that user level Local Differential Privacy (LDP) naturally guarantees subject level DP. We observe the problem of horizontal composition of subject level privacy loss in FL - subject level privacy loss incurred at individual users composes across the federation. We formally prove the subject level DP guarantee for our algorithms, and also show their effect on model utility loss. Our empirical evaluation on FEMNIST and Shakespeare datasets shows that LocalGroupDP delivers the best performance among our algorithms. However, its model utility lags behind that of models trained using a DP-SGD based algorithm that provides a weaker item level privacy guarantee. Privacy loss amplification due to subject sampling fractions and horizontal composition remain key challenges for model utility.


title: GRMHD simulations of neutron-star mergers with weak interactions: r-process nucleosynthesis and electromagnetic signatures of dynamical ejecta

abstract: Fast material ejected dynamically over $<10$ ms during the merger of a binary neutron-star (BNS) system can give rise to distinctive electromagnetic counterparts to the system's gravitational-wave emission that can serve as a "smoking gun" to distinguish between a BNS and a NS-black-hole merger. We present novel ab-initio modeling of the associated kilonova precursor and kilonova afterglow based on three-dimensional general-relativistic magneto-hydrodynamic simulations of BNS mergers with tabulated, composition-dependent, finite-temperature equations of state (EOSs), weak interactions, and approximate neutrino transport. We analyze dynamical mass ejection from 1.35-1.35Msun binaries, typical of Galactic double-NS systems and consistent with properties of the first observed BNS merger GW170817, using three nuclear EOSs that span the range of allowed compactness. Nuclear reaction network calculations yield a robust 2nd-to-3rd-peak r-process. We find few 1e-6Msun of fast ($v>0.6$c) ejecta that give rise to broad-band synchrotron emission on ~yr timescales, consistent with recent tentative evidence for excess X-ray/radio emission following GW170817. We find 2e-5Msun of free neutrons that power a kilonova precursor on <h timescale. A boost in early UV/optical brightness by a factor of a few due to previously neglected relativistic effects, with appreciable enhancements up to 10h post-merger, provides promising prospects for future detection with UV/optical telescopes such as Swift or ULTRASAT out to 250Mpc. We find that a recently predicted opacity boost due to highly ionized lanthanides at ~70000K is unlikely to affect the early kilonova lightcurve based on the obtained ejecta structures. Azimuthal inhomogeneities in dynamical ejecta composition for soft EOSs found here ("lanthanide/actinide pockets") may have observable consequences for both early kilonova and late-time nebular emission.


title: Bayesian additive regression trees for probabilistic programming

abstract: Bayesian additive regression trees (BART) is a non-parametric method to approximate functions. It is a black-box method based on the sum of many trees where priors are used to regularize inference, mainly by restricting trees' learning capacity so that no individual tree is able to explain the data, but rather the sum of trees. We discuss BART in the context of probabilistic programming languages (PPL), i.e., we present BART as a primitive that can be used as a component of a probabilistic model rather than as a standalone model. Specifically, we introduce the Python library PyMC-BART, which works by extending PyMC, a library for probabilistic programming. We showcase a few examples of models that can be built using PyMC-BART, discuss recommendations for the selection of hyperparameters, and finally, we close with limitations of our implementation and future directions for improvement.


title: Special cubulation of strict hyperbolization

abstract: We prove that the Gromov hyperbolic groups obtained by the strict hyperbolization procedure of Charney and Davis are virtually compact special, hence linear and residually finite. Our strategy consists in constructing an action of a hyperbolized group on a certain dual CAT(0) cubical complex. As a result, all the common applications of strict hyperbolization are shown to provide manifolds with virtually compact special fundamental group. In particular, we obtain examples of closed negatively curved Riemannian manifolds whose fundamental groups are linear and virtually algebraically fiber.


title: Homogeneous coordinate rings as direct summands of regular rings

abstract: We study the question of when a ring can be realized as a direct summand of a regular ring by examining the case of homogeneous coordinate rings. We present very strong obstacles to expressing a graded ring with isolated singularity as a finite graded direct summand. For several classes of examples (del Pezzo surfaces, hypersurfaces), we give a complete classification of which coordinate rings can be expressed as direct summands (not necessarily finite), and in doing so answer a question of Hara about the FFRT property of the quintic del Pezzo. We also examine what happens in the case where the ring does not have isolated singularities, through topological arguments: as an example, we give a classification of which coordinate rings of singular cubic surfaces can be written as finite direct summands of regular rings.


title: Topological Data Analysis Ball Mapper for Finance

abstract: Finance is heavily influenced by data-driven decision-making. Meanwhile, our ability to comprehend the full informational content of data sets remains impeded by the tools we apply in analysis, especially where the data is high-dimensional. Presenting the Topological Data Analysis Ball Mapper algorithm this paper illuminates a new means of seeing the detail in data from data shape. With comparisons to existing approaches and illustrative examples, the value of the new tool is shown. Directions for employing Ball Mapper in practice are given and the benefits are reviewed.


title: Dap-FL: Federated Learning flourishes by adaptive tuning and secure aggregation

abstract: Federated learning (FL), an attractive and promising distributed machine learning paradigm, has sparked extensive interest in exploiting tremendous data stored on ubiquitous mobile devices. However, conventional FL suffers severely from resource heterogeneity, as clients with weak computational and communication capability may be unable to complete local training using the same local training hyper-parameters. In this paper, we propose Dap-FL, a deep deterministic policy gradient (DDPG)-assisted adaptive FL system, in which local learning rates and local training epochs are adaptively adjusted by all resource-heterogeneous clients through locally deployed DDPG-assisted adaptive hyper-parameter selection schemes. Particularly, the rationality of the proposed hyper-parameter selection scheme is confirmed through rigorous mathematical proof. Besides, due to the thoughtlessness of security consideration of adaptive FL systems in previous studies, we introduce the Paillier cryptosystem to aggregate local models in a secure and privacy-preserving manner. Rigorous analyses show that the proposed Dap-FL system could guarantee the security of clients' private local models against chosen-plaintext attacks and chosen-message attacks in a widely used honest-but-curious participants and active adversaries security model. In addition, through ingenious and extensive experiments, the proposed Dap-FL achieves higher global model prediction accuracy and faster convergence rates than conventional FL, and the comprehensiveness of the adjusted local training hyper-parameters is validated. More importantly, experimental results also show that the proposed Dap-FL achieves higher model prediction accuracy than two state-of-the-art RL-assisted FL methods, i.e., 6.03% higher than DDPG-based FL and 7.85% higher than DQN-based FL.


title: DISH: A Distributed Hybrid Primal-Dual Optimization Framework to Utilize System Heterogeneity

abstract: We consider solving distributed consensus optimization problems over multi-agent networks. Current distributed methods fail to capture the heterogeneity among agents' local computation capacities. We propose DISH as a distributed hybrid primal-dual algorithmic framework to handle and utilize system heterogeneity. Specifically, DISH allows those agents with higher computational capabilities or cheaper computational costs to implement Newton-type updates locally, while other agents can adopt the much simpler gradient-type updates. We show that DISH is a general framework and includes EXTRA, DIGing, and ESOM-0 as special cases. Moreover, when all agents take both primal and dual Newton-type updates, DISH approximates Newton's method by estimating both primal and dual Hessians. Theoretically, we show that DISH achieves a linear (Q-linear) convergence rate to the exact optimal solution for strongly convex functions, regardless of agents' choices of gradient-type and Newton-type updates. Finally, we perform numerical studies to demonstrate the efficacy of DISH in practice. To the best of our knowledge, DISH is the first hybrid method allowing heterogeneous local updates for distributed consensus optimization under general network topology with provable convergence and rate guarantees.


title: Measurement of Parity-Odd Modes in the Large-Scale 4-Point Correlation Function of SDSS BOSS DR12 CMASS and LOWZ Galaxies

abstract: A tetrahedron is the simplest shape that cannot be rotated into its mirror image in 3D. The 4-Point Correlation Function (4PCF), which quantifies excess clustering of quartets of galaxies over random, is the lowest-order statistic sensitive to parity violation. Each galaxy defines one vertex of the tetrahedron. Parity-odd modes of the 4PCF probe an imbalance between tetrahedra and their mirror images. We measure these modes from the largest currently available spectroscopic samples, the 280,067 Luminous Red Galaxies (LRGs) of the Baryon Oscillation Spectroscopic Survey (BOSS) DR12 LOWZ ($\bar{z} = 0.32$) and the 803,112 LRGS of BOSS DR12 CMASS ($\bar{z} = 0.57$). In LOWZ we find $3.1\sigma$ evidence for a non-zero parity-odd 4PCF, and in CMASS we detect a parity-odd 4PCF at $7.1\sigma$. Gravitational evolution alone does not produce this effect; parity-breaking in LSS, if cosmological in origin, must stem from the epoch of inflation. We have explored many sources of systematic error and found none that can produce a spurious parity-odd \textit{signal} sufficient to explain our result. Underestimation of the \textit{noise} could also lead to a spurious detection. Our reported significances presume that the mock catalogs used to calculate the covariance sufficiently capture the covariance of the true data. We have performed numerous tests to explore this issue. The odd-parity 4PCF opens a new avenue for probing new forces during the epoch of inflation with 3D LSS; such exploration is timely given large upcoming spectroscopic samples such as DESI and Euclid.

categories: astro-ph.CO gr-qc hep-th physics.data-an


title: Space-time unfitted finite element methods for time-dependent problems on moving domains

abstract: We propose a space-time scheme that combines an unfitted finite element method in space with a discontinuous Galerkin time discretisation for the accurate numerical approximation of parabolic problems with moving domains or interfaces. We make use of an aggregated finite element space to attain robustness with respect to the cut locations. The aggregation is performed slab-wise to have a tensor product structure of the space-time discrete space, which is required in the numerical analysis. We analyse the proposed algorithm, providing stability, condition number bounds and anisotropic \emph{a priori} error estimates. A set of numerical experiments confirm the theoretical results for a parabolic problem on a moving domain. The method is applied for a mass transfer problem with changing topology.


title: Universal Properties of Dense Clumps in Magnetized Molecular Clouds Formed through Shock Compression of Two-phase Atomic Gases

abstract: We investigate the formation of molecular clouds from atomic gas by using three-dimensional magnetohydrodynamical simulations,including non-equilibrium chemical reactions, heating/cooling processes, and self-gravity by changing the collision speed $V_0$ and the angle $\theta$ between the magnetic field and colliding flow. We found that the efficiency of the dense gas formation depends on $\theta$. For small $\theta$, anisotropic super-Alfv\'enic turbulence delays the formation of gravitationally unstable clumps. An increase in $\theta$ develops shock-amplified magnetic fields along which the gas is accumulated, making prominent filamentary structures. We further investigate the statistical properties of dense clumps identified with different density thresholds. The statistical properties of the dense clumps with lower densities depend on $V_0$ and $\theta$ because their properties are inherited from the global turbulence structure of the molecular clouds. By contrast, denser clumps appear to have asymptotic universal statistical properties, which do not depend on the properties of the colliding flow significantly. The internal velocity dispersions approach subsonic and plasma $\beta$ becomes order of unity. We develop an analytic formula of the virial parameter which reproduces the simulation results reasonably well. This property may be one of the reasons for the universality of the initial mass function of stars.


title: SmI3: 4f5 honeycomb magnet with spin-orbital entangled {\Gamma}7 Kramers doublet

abstract: We report magnetic properties of a 4f-honeycomb iodide SmI3 made up of edge-shared network of SmI6 octahedra. High temperature magnetic susceptibility indicates {\Gamma}7 Kramers doublet ground state of Sm3+ (4f5) ions stabilized by the spin-orbit coupling and octahedral crystal electric field, which interact with Sm-I-Sm bond angle nearly 90 degree. Magnetization measurements down to 0.1 K detected antiferromagnetic correlations and an anomaly in the magnetization curve before saturation without a sign of long-range order. Relevance between SmI3 and the antiferromagnetic Kitaev material proposed in the 4f-electron system is discussed.


title: Malcev Yang-Baxter equation, weighted $\mathcal{O}$-operators on Malcev algebras and post-Malcev algebras

abstract: The purpose of this paper is to study the $\mathcal{O}$-operators on Malcev algebras and discuss the solutions of Malcev Yang-Baxter equation by $\mathcal{O}$-operators. Furthermore we introduce the notion of weighted $\mathcal{O}$-operators on Malcev algebras, which can be characterized by graphs of the semi-direct product Malcev algebra. Then we introduce a new algebraic structure called post-Malcev algebras. Therefore, post-Malcev algebras can be viewed as the underlying algebraic structures of weighted $\mathcal{O}$-operators on Malcev algebras. A post-Malcev algebra also gives rise to a new Malcev algebra. Post-Malcev algebras are analogues for Malcev algebras of post-Lie algebras and fit into a bigger framework with a close relationship with post-alternative algebras.


title: Technical Report (v1.0)--Pseudo-random Cartesian Sampling for Dynamic MRI

abstract: For an effective application of compressed sensing (CS), which exploits the underlying compressibility of an image, one of the requirements is that the undersampling artifact be incoherent (noise-like) in the sparsifying transform domain. For cardiovascular MRI (CMR), several pseudo-random sampling methods have been proposed that yield a high level of incoherence. In this technical report, we present a collection of five pseudo-random Cartesian sampling methods that can be applied to 2D cine and flow, 3D volumetric cine, and 4D flow imaging. Four out of the five presented methods yield fast computation for on-the-fly generation of the sampling mask, without the need to create and store pre-computed look-up tables. In addition, the sampling distribution is parameterized, providing control over the sampling density. For each sampling method in the report, (i) we briefly describe the methodology, (ii) list default values of the pertinent parameters, and (iii) provide a publicly available MATLAB implementation.


title: Time-delay systems with delayed impulses: A unified criterion on asymptotic stability

abstract: The paper deals with the global asymptotic stability of general nonlinear time-delay systems with delay-dependent impulses through the Lyapunov-Krasovskii method. We derive a unified stability criterion which can be applied to a variety of impulsive systems. The cases when each of the continuous dynamics and the impulsive component is either stabilizing or destabilizing are investigated. Both theoretically and numerically, we demonstrate that the obtained result is more general than those existing in the literature.


title: Estimating accurate reddening values of LAMOST M dwarfs

abstract: M dwarfs are the dominating type of stars in the solar neighbourhood. They serve as excellent tracers for the study of the distribution and properties of the nearby interstellar dust. In this work, we aim to obtain high accuracy reddening values of M dwarf stars from the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) Data Release 8 (DR8). Combining the LAMOST spectra with the high-quality optical photometry from the Gaia Early Data Release 3 (Gaia EDR3), we have estimated the reddening values $E(G_{\rm BP}-G_{\rm RP})$ of 641,426 M dwarfs with the machine-learning algorithm Random Forest regression. The typical reddening uncertainty is only 0.03 mag in $E(G_{\rm BP}-G_{\rm RP})$. We have obtained the reddening coefficient $R_{(G_{\rm BP}-G_{\rm RP})}$, which is a function of the stellar intrinsic colour $(G_{\rm BP}-G_{\rm RP})_0$ and reddening value $E(B-V)$. The values of $E(B-V)$ are also provided for the individual stars in our catalogue. Our resultant high accuracy reddening values of M dwarfs, combined with the Gaia parallaxes, will be very powerful to map the fine structures of the dust in the solar neighbourhood.


title: Ensembles for Uncertainty Estimation: Benefits of Prior Functions and Bootstrapping

abstract: In machine learning, an agent needs to estimate uncertainty to efficiently explore and adapt and to make effective decisions. A common approach to uncertainty estimation maintains an ensemble of models. In recent years, several approaches have been proposed for training ensembles, and conflicting views prevail with regards to the importance of various ingredients of these approaches. In this paper, we aim to address the benefits of two ingredients -- prior functions and bootstrapping -- which have come into question. We show that prior functions can significantly improve an ensemble agent's joint predictions across inputs and that bootstrapping affords additional benefits if the signal-to-noise ratio varies across inputs. Our claims are justified by both theoretical and experimental results.


title: Intrinsic Characterization of $3$-dimensional Riemannian submanifolds of $\mathbb{R}^4$

abstract: It is well known that an $m$-dimensional Riemannian manifold can be locally isometrically embedded into the $m+1$-dimensional Euclidean space if and only if there exists a symmetric 2-tensor field satisfying the Gauss and Codazzi equations. In this paper, we prove that two known intrinsic conditions, which were obtained previously by Weiss, Thomas and Rivertz, are sufficient to ensure the existence of such symmetric 2-tensor field under certain generic condition when $m=3$. Note that, in the case $m=3$, a symmetric 2-tensor field satisfying the Gauss equation does not satisfy the Codazzi equation automatically, which is different from the cases $m \geq 4$. In our proof, the symbolic method, which is a famous tool known in classical invariant theory, plays an important role. As applications of our result, we consider $3$-dimensional warped product Riemannian manifolds whether they can be locally isometrically embedded into $\mathbb{R}^4$. In some case, the Monge-Amp\`{e}re equation naturally appears.


title: Network Report: A Structured Description for Network Datasets

abstract: The rapid development of network science and technologies depends on shareable datasets. Currently, there is no standard practice for reporting and sharing network datasets. Some network dataset providers only share links, while others provide some contexts or basic statistics. As a result, critical information may be unintentionally dropped, and network dataset consumers may misunderstand or overlook critical aspects. Inappropriately using a network dataset can lead to severe consequences (e.g., discrimination) especially when machine learning models on networks are deployed in high-stake domains. Challenges arise as networks are often used across different domains (e.g., network science, physics, etc) and have complex structures. To facilitate the communication between network dataset providers and consumers, we propose network report. A network report is a structured description that summarizes and contextualizes a network dataset. Network report extends the idea of dataset reports (e.g., Datasheets for Datasets) from prior work with network-specific descriptions of the non-i.i.d. nature, demographic information, network characteristics, etc. We hope network reports encourage transparency and accountability in network research and development across different fields.


title: Magnetic Uncertainties for Compact Kibble Balances: An Investigation

abstract: The Kibble balance has become one of the major instruments for realizing the mass unit, the kilogram, in the revised international system of units (SI). Researchers at about a dozen national metrology institutes are actively working with Kibble balances that are capable of weighing masses with nominal values from 10g to 1kg. In the future, the design of smaller Kibble balances will play a more significant role. Smaller Kibble balances require smaller magnet systems, and here we investigate the scaling of systematic uncertainties with the size of the magnet system. We describe the size dependence of three magnetic effects: the coil-inductance effect, the yoke nonlinear effect, and the thermal effect. The analysis shows that the relative systematic effects become increasingly larger with smaller sizes. For small magnets the thermal effects become dominant and, hence, a good thermal design is imperative.


title: Exploring accurate potential energy surfaces via integrating variational quantum eigensovler with machine learning

abstract: The potential energy surface (PES) is crucial for interpreting a variety of chemical reaction processes. However, predicting accurate PESs with high-level electronic structure methods is a challenging task due to the high computational cost. As an appealing application of quantum computing, we show in this work that variational quantum algorithms can be integrated with machine learning (ML) techniques as a promising scheme for exploring accurate PESs. Different from using a ML model to represent the potential energy, we encode the molecular geometry information into a deep neural network (DNN) for representing parameters of the variational quantum eigensolver (VQE), leaving the PES to the wave function ansatz. Once the DNN model is trained, the variational optimization procedure that hinders the application of the VQE to complex systems is avoided and thus the evaluation of PESs is significantly accelerated. Numerical results demonstrate that a simple DNN model is able to reproduce accurate PESs for small molecules.


title: Alternately Optimized Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have greatly advanced the semi-supervised node classification task on graphs. The majority of existing GNNs are trained in an end-to-end manner that can be viewed as tackling a bi-level optimization problem. This process is often inefficient in computation and memory usage. In this work, we propose a new optimization framework for semi-supervised learning on graphs. The proposed framework can be conveniently solved by the alternating optimization algorithms, resulting in significantly improved efficiency. Extensive experiments demonstrate that the proposed method can achieve comparable or better performance with state-of-the-art baselines while it has significantly better computation and memory efficiency.


title: METAL: The Metal Evolution, Transport, and Abundance in the Large Magellanic Cloud Hubble program. IV. Calibration of Dust Depletions vs Abundance Ratios in the Milky Way and Magellanic Clouds and Application to Damped Lyman-alpha Systems

abstract: The evolution of the metal content of the universe can be tracked through rest-frame UV spectroscopy of damped Ly-$\alpha$ systems (DLAs). Gas-phase abundances in DLAs must be corrected for dust depletion effects, which can be accomplished by calibrating the relation between abundance ratios such as [Zn/Fe] and depletions (the fraction of metals in gas, as opposed to dust). Using samples of gas-phase abundances and depletions in the Milky Way (MW), LMC, and SMC, we demonstrate that the relation between [Zn/Fe] and other abundance ratios does not change significantly between these local galaxies and DLAs, indicating that [Zn/Fe] should trace depletions of heavy elements in those systems. The availability of photospheric abundances in young massive stars, a proxy for the total (gas+dust) metallicity of neutral gas, in the MW LMC, and SMC allows us to calibrate the relation between [Zn/Fe] and depletions in these nearby galaxies. We apply the local calibrations of depletions to DLA systems. We find that the fraction of metals in dust, the dust-to-gas-ratio, and total abundances are 2-5 times lower than inferred from previous depletion calibrations based on MW measurements and a different formalism. However, the trend of dust abundance vs. metallicity remains only slightly sub-linear for all existing depletion calibrations, contrary to what is inferred from FIR, 21 cm, and CO emission in nearby galaxies and predicted by chemical evolution models. Observational constraints on the FIR dust opacity and depletions at metallicities lower than 20\% solar will be needed to resolve this tension.


title: Event-Triggered Control for Nonlinear Time-Delay Systems

abstract: This article studies the event-triggered control problem of general nonlinear systems with time delay. A novel event-triggering scheme is presented with two tunable design parameters, based on a Lyapunov functional result for the input-to-state stability of time-delay systems. The proposed event-triggered control algorithm guarantees the resulting closed-loop systems to be globally asymptotically stable, uniformly bounded, and/or globally attractive for different choices of these parameters. Sufficient conditions on the parameters are derived to exclude Zeno behavior. Two illustrative examples are studied to demonstrate our theoretical results.


title: Global strong solutions of 3D Compressible Navier-Stokes equations with short pulse type initial data

abstract: Short pulse initial datum is referred to the one supported in the ball of radius $\delta$ and with amplitude $\delta^{\frac12}$ which looks like a pulse. It was first introduced by Christodoulou to prove the formation of black holes for Einstein equations and also to catch the shock formation for compressible Euler equations. The aim of this article is to consider the same type initial data, which allow the density of the fluid to have large amplitude $\delta^{-\frac{\alpha}{\gamma}}$ with $\delta\in(0,1],$ for the compressible Navier-Stokes equations. We prove the global well-posedness and show that the initial bump region of the density with large amplitude will disappear within a very short time. As a consequence, we obtain the global dynamic behavior of the solutions and the boundedness of $\|\nabla u\|_{L^1([0,\infty);L^\infty)}$. The key ingredients of the proof lie in the new observations for the effective viscous flux and new decay estimates for the density via the Lagrangian coordinate.


title: Implementing quantum walks with a single qubit

abstract: Quantum walks have wide applications in quantum information, such as universal quantum computation, so it is important to explore properties of quantum walks thoroughly. We propose a novel method to implement discrete-time quantum walks (DTQWs) using only a single qubit, in which both coin and walker are encoded in the two-dimensional state space of a single qubit, operations are realized using single-qubit gates only, and high-dimensional final states of DTQWs can be obtained naturally. With this "one-qubit" approach, DTQW experiments can be realized much more easily, compared with previous methods, in most quantum systems and all properties based on quantum states of DTQWs (such as quantum correlation and coherence) can be investigated. By this approach, we experimentally implement one-particle and two-particle DTQWs with seven steps using single photons. Furthermore, we systematically investigate quantum correlations and coherence (based on the full state of the coin and walker) of the DTQW systems with different initial states of the coin, which have not been obtained and studied in DTQW experiments. As an application, we also study the assisted distillation of quantum coherence using the full state of the two-particle DTQW from the experiment. The maximal increase in distillable coherence for high-dimensional mixed states is investigated for the first time by obtaining its upper and lower bounds. Our work opens a new door to implement DTQW experiments and to better explore properties of quantum walks.


title: Event-Triggered Impulsive Control for Nonlinear Systems with Actuation Delays

abstract: This paper studies impulsive stabilization of nonlinear systems. We propose two types of event-triggering algorithms to update the impulsive control signals with actuation delays. The first algorithm is based on continuous event detection, while the second type makes decision about updating the impulsive control inputs according to periodic event detection. Sufficient conditions are derived to ensure asymptotic stability of the impulsive control systems with the designed event-triggering algorithms. Lower bounds of the time period between two consecutive events are also obtained, so that the closed-loop impulsive systems are free of Zeno behavior. That is to say that the pulse phenomena are excluded from the event-triggered impulsive control systems, in the community of impulsive differential equations. An illustrative example demonstrates effectiveness of the proposed algorithms and our theoretical results.


title: Neural Bandit with Arm Group Graph

abstract: Contextual bandits aim to identify among a set of arms the optimal one with the highest reward based on their contextual information. Motivated by the fact that the arms usually exhibit group behaviors and the mutual impacts exist among groups, we introduce a new model, Arm Group Graph (AGG), where the nodes represent the groups of arms and the weighted edges formulate the correlations among groups. To leverage the rich information in AGG, we propose a bandit algorithm, AGG-UCB, where the neural networks are designed to estimate rewards, and we propose to utilize graph neural networks (GNN) to learn the representations of arm groups with correlations. To solve the exploitation-exploration dilemma in bandits, we derive a new upper confidence bound (UCB) built on neural networks (exploitation) for exploration. Furthermore, we prove that AGG-UCB can achieve a near-optimal regret bound with over-parameterized neural networks, and provide the convergence analysis of GNN with fully-connected layers which may be of independent interest. In the end, we conduct extensive experiments against state-of-the-art baselines on multiple public data sets, showing the effectiveness of the proposed algorithm.


title: Input-to-State Stability of Time-Delay Systems With Delay-Dependent Impulses

abstract: This paper studies input-to-state stability (ISS) of general nonlinear time-delay systems subject to delay-dependent impulse effects. Sufficient conditions for ISS are constructed by using the method of Lyapunov functionals. It is shown that, when the continuous dynamics are ISS but the discrete dynamics governing the delay-dependent impulses are not, the impulsive system as a whole is ISS provided the destabilizing impulses do not occur too frequently. On the contrary, when the discrete dynamics are ISS but the continuous dynamics are not, the delayed impulses must occur frequently enough to overcome the destabilizing effects of the continuous dynamics so that the ISS can be achieved for the impulsive system. Particularly, when the discrete dynamics are ISS and the continuous dynamics are also ISS or just stable for the zero input, the impulsive system is ISS for arbitrary impulse time sequences. Compared with the existing results on impulsive time-delay systems, the obtained ISS criteria are more general in the sense that these results are applicable to systems with delay dependent impulses while the existing ones are not. Moreover, when consider time-delay systems with delay-free impulses, our result for systems with unstable continuous dynamics and stabilizing impulses is less conservative than the existing ones, as a weaker condition on the upper bound of impulsive intervals is obtained. To demonstrate the theoretical results, we provide two examples with numerical simulations, in which distributed delays and discrete delays in the impulses are considered, respectively.


title: Mechanisms of soot restructuring and compaction

abstract: Soot aggregates form as open, fractal-like structures, but aged atmospheric particles are often observed to be restructured into more compact shapes. This compaction has a major effect on the radiative properties of the aggregates, and may also influence their aerosol-cloud interactions and toxicity. Recent laboratory studies have presented conflicting arguments on whether this compaction occurs during condensation or during evaporation. In this three-part study, we combine theory and experiments to explain these conflicting results. First, we review the surface-science literature and identify explicit mechanisms for condensation compaction as well as evaporation compaction. We also identify a mechanism for avoiding compacting during condensation, which is predicted from heterogeneous nucleation theory and the kinetic barriers to capillary formation. Second, we review the soot-restructuring literature and find evidence for all of these compaction mechanisms, the most common being condensation-compaction. Some atmospheric studies have reported non-compacted soot in internal mixtures, which we attribute to coagulation, and which is less common. Third, we present new experimental results from a study in our laboratory where the surface tension of anthracene coatings was "switched on" or "switched off" by using solid or liquid phases during addition and removal. Consequently, we demonstrated condensation compaction, evaporation compaction, and no compaction, for the same soot source. Overall, our study indicates that it is most reasonable to assume that soot will undergo compaction upon coating condensation in the atmosphere, in combustion systems, and in human lungs.


title: Deterministic generation of entangled photonic cluster states from quantum dot molecules

abstract: Successful generation of photonic cluster states is the key step in the realization of measurement-based quantum computation and quantum network protocols. Several proposals for the generation of such entangled states from different solid-state emitters have been put forward. Each of these protocols come with their own challenges in terms of both conception and implementation. In this work we propose deterministic generation of these photonic cluster states from a spin-photon interface based on a hole spin qubit hosted in a quantum dot molecule. Our protocol resolves many of the difficulties of existing proposals and paves the way for an experimentally feasible realization of highly entangled multi-qubit photonic states with a high production rate.


title: Thermal ion kinetic effects and Landau damping in fishbone modes

abstract: The kinetic-MHD hybrid simulation approach for macroscopic instabilities in plasmas can be extended to include the kinetic effects of both thermal ions and energetic ions. The new coupling scheme includes synchronization of density and parallel velocity between thermal ions and MHD, in addition to pressure coupling, to ensure the quasineutrality condition and avoid numerical errors. The new approach has been implemented in the kinetic-MHD code M3D-C1-K, and was used to study the thermal ion kinetic effects and Landau damping in fishbone modes in both DIII-D and NSTX. It is found that the thermal ion kinetic effects can cause an increase of the frequencies of the non-resonant $n=1$ fishbone modes driven by energetic particles for $q_\mathrm{min}>1$, and Landau damping can provide additional stabilization effects. A nonlinear simulation for $n=1$ fishbone mode in NSTX is also performed, and the perturbation on magnetic flux surfaces and the transport of energetic particles are calculated.


title: On the Linear Convergence Rate of Generalized ADMM for Convex Composite Programming

abstract: Over the fast few years, the numerical success of the generalized alternating direction method of multipliers (GADMM) proposed by Eckstein \& Bertsekas [Math. Prog., 1992] has inspired intensive attention in analyzing its theoretical convergence properties. In this paper, we devote to establishing the linear convergence rate of the semi-proximal GADMM (sPGADMM) for solving linearly constrained convex composite optimization problems. The semi-proximal terms contained in each subproblem possess the abilities of handling with multi-block problems efficiently. We initially present some important inequalities for the sequence generated by the sPGADMM, and then establish the local linear convergence rate under the assumption of calmness. As a by-product, the global convergence property is also discussed.


title: Threshold-independent method for single-shot readout of spin qubits in semiconductor quantum dots

abstract: The single-shot readout data process is essential for the realization of high-fidelity qubits and fault-tolerant quantum algorithms in semiconductor quantum dots. However, the fidelity and visibility of the readout process is sensitive to the choice of the thresholds and limited by the experimental hardware. By demonstrating the linear dependence between the measured spin state probabilities and readout visibilities along with dark counts, we describe an alternative threshold-independent method for the single-shot readout of spin qubits in semiconductor quantum dots. We can obtain the extrapolated spin state probabilities of the prepared probabilities of the excited spin state through the threshold-independent method. Then, we analyze the corresponding errors of the method, finding that errors of the extrapolated probabilities cannot be neglected with no constraints on the readout time and threshold voltage. Therefore, by limiting the readout time and threshold voltage we ensure the accuracy of the extrapolated probability. Then, we prove that the efficiency and robustness of this method is 60 times larger than that of the most commonly used method. Moreover, we discuss the influence of the electron temperature on the effective area with a fixed external magnetic field and provide a preliminary demonstration for a single-shot readout up to 0.7 K/1.5T in the future.


title: Optimization of Robot Trajectory Planning with Nature-Inspired and Hybrid Quantum Algorithms

abstract: We solve robot trajectory planning problems at industry-relevant scales. Our end-to-end solution integrates highly versatile random-key algorithms with model stacking and ensemble techniques, as well as path relinking for solution refinement. The core optimization module consists of a biased random-key genetic algorithm. Through a distinct separation of problem-independent and problem-dependent modules, we achieve an efficient problem representation, with a native encoding of constraints. We show that generalizations to alternative algorithmic paradigms such as simulated annealing are straightforward. We provide numerical benchmark results for industry-scale data sets. Our approach is found to consistently outperform greedy baseline results. To assess the capabilities of today's quantum hardware, we complement the classical approach with results obtained on quantum annealing hardware, using qbsolv on Amazon Braket. Finally, we show how the latter can be integrated into our larger pipeline, providing a quantum-ready hybrid solution to the problem.

categories: quant-ph cond-mat.dis-nn cs.NE cs.RO math.OC


title: Formation of protein-mediated tubes is governed by a snapthrough transition

abstract: Plasma membrane tubes are ubiquitous in cellular membranes and in the membranes of intracellular organelles. They play crucial roles in trafficking, ion transport, and cellular motility. The formation of plasma membrane tubes can be due to localized forces acting on the membrane or by curvature-induced by membrane-bound proteins. Here, we present a mathematical framework to model cylindrical tubular protrusions formed by proteins that induce anisotropic spontaneous curvature. Our analysis revealed that the tube radius depends on an effective tension that includes contributions from the bare membrane tension and the protein-induced curvature. We also found that the length of the tube undergoes an abrupt transition from a short, dome-shaped membrane to a long cylinder and this transition is characteristic of a snapthrough instability. Finally, we show that the snapthrough instability depends on the different parameters including coat area, bending modulus, and extent of protein-induced curvature. Our findings have implications for tube formation due to BAR-domain proteins in processes such as endocytosis, t-tubule formation in myocytes, and cristae formation in mitochondria.


title: Gate-Tunable Spin-Orbit Coupling in a Germanium Hole Double Quantum Dot

abstract: Hole spins confined in semiconductor quantum dot systems have gained considerable interest for their strong spin-orbit interactions (SOIs) and relatively weak hyperfine interactions. Here we experimentally demonstrate a tunable SOI in a double quantum dot in a Germanium (Ge) hut wire (HW), which could help enable fast all-electric spin manipulations while suppressing unwanted decoherence. Specifically, we measure the transport spectra in the Pauli spin blockade regime in the double quantum dot device.By adjusting the interdot tunnel coupling, we obtain an electric field tuned spin-orbit length lso = 2.0 - 48.9 nm. This tunability of the SOI could pave the way toward the realization of high-fidelity qubits in Ge HW systems.


title: Solving the Spike Feature Information Vanishing Problem in Spiking Deep Q Network with Potential Based Normalization

abstract: Brain inspired spiking neural networks (SNNs) have been successfully applied to many pattern recognition domains. The SNNs based deep structure have achieved considerable results in perceptual tasks, such as image classification, target detection. However, the application of deep SNNs in reinforcement learning (RL) tasks is still a problem to be explored. Although there have been previous studies on the combination of SNNs and RL, most of them focus on robotic control problems with shallow networks or using ANN-SNN conversion method to implement spiking deep Q Network (SDQN). In this work, we mathematically analyzed the problem of the disappearance of spiking signal features in SDQN and proposed a potential based layer normalization(pbLN) method to directly train spiking deep Q networks. Experiment shows that compared with state-of-art ANN-SNN conversion method and other SDQN works, the proposed pbLN spiking deep Q networks (PL-SDQN) achieved better performance on Atari game tasks.


title: pFL-Bench: A Comprehensive Benchmark for Personalized Federated Learning

abstract: Personalized Federated Learning (pFL), which utilizes and deploys distinct local models, has gained increasing attention in recent years due to its success in handling the statistical heterogeneity of FL clients. However, standardized evaluation and systematical analysis of diverse pFL methods remain a challenge. Firstly, the highly varied datasets, FL simulation settings and pFL implementations prevent easy and fair comparisons of pFL methods. Secondly, the current pFL literature diverges in the adopted evaluation and ablation protocols. Finally, the effectiveness and robustness of pFL methods are under-explored in various practical scenarios, such as the generalization to new clients and the participation of resource-limited clients. To tackle these challenges, we propose the first comprehensive pFL benchmark, pFL-Bench, for facilitating rapid, reproducible, standardized and thorough pFL evaluation. The proposed benchmark contains more than 10 dataset variants in various application domains with a unified data partition and realistic heterogeneous settings; a modularized and easy-to-extend pFL codebase with more than 20 competitive pFL method implementations; and systematic evaluations under containerized environments in terms of generalization, fairness, system overhead, and convergence. We highlight the benefits and potential of state-of-the-art pFL methods and hope the pFL-Bench enables further pFL research and broad applications that would otherwise be difficult owing to the absence of a dedicated benchmark. The code is released at https://github.com/alibaba/FederatedScope/tree/master/benchmark/pFL-Bench.


title: Fair Classification via Domain Adaptation: A Dual Adversarial Learning Approach

abstract: Modern machine learning (ML) models are becoming increasingly popular and are widely used in decision-making systems. However, studies have shown critical issues of ML discrimination and unfairness, which hinder their adoption on high-stake applications. Recent research on fair classifiers has drawn significant attention to developing effective algorithms to achieve fairness and good classification performance. Despite the great success of these fairness-aware machine learning models, most of the existing models require sensitive attributes to pre-process the data, regularize the model learning or post-process the prediction to have fair predictions. However, sensitive attributes are often incomplete or even unavailable due to privacy, legal or regulation restrictions. Though we lack the sensitive attribute for training a fair model in the target domain, there might exist a similar domain that has sensitive attributes. Thus, it is important to exploit auxiliary information from a similar domain to help improve fair classification in the target domain. Therefore, in this paper, we study a novel problem of exploring domain adaptation for fair classification. We propose a new framework that can learn to adapt the sensitive attributes from a source domain for fair classification in the target domain. Extensive experiments on real-world datasets illustrate the effectiveness of the proposed model for fair classification, even when no sensitive attributes are available in the target domain.


title: Delving into the Pre-training Paradigm of Monocular 3D Object Detection

abstract: The labels of monocular 3D object detection (M3OD) are expensive to obtain. Meanwhile, there usually exists numerous unlabeled data in practical applications, and pre-training is an efficient way of exploiting the knowledge in unlabeled data. However, the pre-training paradigm for M3OD is hardly studied. We aim to bridge this gap in this work. To this end, we first draw two observations: (1) The guideline of devising pre-training tasks is imitating the representation of the target task. (2) Combining depth estimation and 2D object detection is a promising M3OD pre-training baseline. Afterwards, following the guideline, we propose several strategies to further improve this baseline, which mainly include target guided semi-dense depth estimation, keypoint-aware 2D object detection, and class-level loss adjustment. Combining all the developed techniques, the obtained pre-training framework produces pre-trained backbones that improve M3OD performance significantly on both the KITTI-3D and nuScenes benchmarks. For example, by applying a DLA34 backbone to a naive center-based M3OD detector, the moderate ${\rm AP}_{3D}70$ score of Car on the KITTI-3D testing set is boosted by 18.71\% and the NDS score on the nuScenes validation set is improved by 40.41\% relatively.


title: Reviving the Vortex Particle Method: A Stable Formulation for Meshless Large Eddy Simulation

abstract: The vortex particle method (VPM) is a mesh-free approach to computational fluid dynamics (CFD) solving the Navier-Stokes equations in their velocity-vorticity form. The VPM uses a Lagrangian scheme, which not only avoids the hurdles of mesh generation, but it also conserves vortical structures over long distances with minimal numerical dissipation while being orders of magnitude faster than conventional mesh-based CFD. However, VPM is known to be numerically unstable when vortical structures break down close to the turbulent regime. In this study, we reformulate the VPM as a large eddy simulation (LES) in a scheme that is numerically stable, without increasing its computational cost. A new set of VPM governing equations are derived from the LES-filtered Navier-Stokes equations. The new equations reinforce conservation of mass and angular momentum by reshaping the vortex elements subject to vortex stretching. In addition to the VPM reformulation, a new anisotropic dynamic model of subfilter-scale (SFS) vortex stretching is developed. This SFS model is well suited for turbulent flows with coherent vortical structures where the predominant cascade mechanism is vortex stretching. Advection, viscous diffusion, and vortex stretching are validated through simulation of isolated and leapfrogging vortex rings. Mean and fluctuating components of turbulent flow are validated through simulation of a turbulent round jet, where Reynolds stresses are resolved directly and compared to experimental measurements. Finally, the computational efficiency of the scheme is showcased in the simulation of an aircraft rotor in hover, showing our meshless LES to be 100x faster than a mesh-based LES with similar fidelity, while being 10x faster than a low-fidelity unsteady Reynolds-average Navier-Stokes simulation and 1000x faster than a high-fidelity detached-eddy simulation.


title: Scalable Online Disease Diagnosis via Multi-Model-Fused Actor-Critic Reinforcement Learning

abstract: For those seeking healthcare advice online, AI based dialogue agents capable of interacting with patients to perform automatic disease diagnosis are a viable option. This application necessitates efficient inquiry of relevant disease symptoms in order to make accurate diagnosis recommendations. This can be formulated as a problem of sequential feature (symptom) selection and classification for which reinforcement learning (RL) approaches have been proposed as a natural solution. They perform well when the feature space is small, that is, the number of symptoms and diagnosable disease categories is limited, but they frequently fail in assignments with a large number of features. To address this challenge, we propose a Multi-Model-Fused Actor-Critic (MMF-AC) RL framework that consists of a generative actor network and a diagnostic critic network. The actor incorporates a Variational AutoEncoder (VAE) to model the uncertainty induced by partial observations of features, thereby facilitating in making appropriate inquiries. In the critic network, a supervised diagnosis model for disease predictions is involved to precisely estimate the state-value function. Furthermore, inspired by the medical concept of differential diagnosis, we combine the generative and diagnosis models to create a novel reward shaping mechanism to address the sparse reward problem in large search spaces. We conduct extensive experiments on both synthetic and real-world datasets for empirical evaluations. The results demonstrate that our approach outperforms state-of-the-art methods in terms of diagnostic accuracy and interaction efficiency while also being more effectively scalable to large search spaces. Besides, our method is adaptable to both categorical and continuous features, making it ideal for online applications.


title: Provably-secure quantum randomness expansion with uncharacterised homodyne detection

abstract: Quantum random number generators (QRNGs) are able to generate numbers that are certifiably random, even to an agent who holds some side-information. Such systems typically require that the elements being used are precisely calibrated and validly certified for a credible security analysis. However, this can be experimentally challenging and result in potential side-channels which could compromise the security of the QRNG. In this work, we propose, design and experimentally demonstrate a QRNG protocol that completely removes the calibration requirement for the measurement device. Moreover, our protocol is secure against quantum side-information. We also take into account the finite-size effects and remove the independent and identically distributed requirement for the measurement side. More importantly, our QRNG scheme features a simple implementation which uses only standard optical components and are readily implementable on integrated-photonic platforms. To validate the feasibility and practicability of the protocol, we set up a fibre-optical experimental system with a home-made homodyne detector with an effective efficiency of 91.7% at 1550nm. The system works at a rate of 2.5MHz, and obtains a net randomness expansion rate of 4.98kbits/s at 1E10 rounds. Our results pave the way for an integrated QRNG with self-testing feature and provable security.


title: One Hyper-Initializer for All Network Architectures in Medical Image Analysis

abstract: Pre-training is essential to deep learning model performance, especially in medical image analysis tasks where limited training data are available. However, existing pre-training methods are inflexible as the pre-trained weights of one model cannot be reused by other network architectures. In this paper, we propose an architecture-irrelevant hyper-initializer, which can initialize any given network architecture well after being pre-trained for only once. The proposed initializer is a hypernetwork which takes a downstream architecture as input graphs and outputs the initialization parameters of the respective architecture. We show the effectiveness and efficiency of the hyper-initializer through extensive experimental results on multiple medical imaging modalities, especially in data-limited fields. Moreover, we prove that the proposed algorithm can be reused as a favorable plug-and-play initializer for any downstream architecture and task (both classification and segmentation) of the same modality.


title: Robust self-tuning semiparametric PCA for contaminated elliptical distribution

abstract: Principal component analysis (PCA) is one of the most popular dimension reduction methods. The usual PCA is known to be sensitive to the presence of outliers, and thus many robust PCA methods have been developed. Among them, the Tyler's M-estimator is shown to be the most robust scatter estimator under the elliptical distribution. However, when the underlying distribution is contaminated and deviates from ellipticity, Tyler's M-estimator might not work well. In this article, we apply the semiparametric theory to propose a robust semiparametric PCA. The merits of our proposal are twofold. First, it is robust to heavy-tailed elliptical distributions as well as robust to non-elliptical outliers. Second, it pairs well with a data-driven tuning procedure, which is based on active ratio and can adapt to different degrees of data outlyingness. Theoretical properties are derived, including the influence functions for various statistical functionals and asymptotic normality. Simulation studies and a data analysis demonstrate the superiority of our method.


title: Existence and Concentration Results for the General Kirchhoff Type Equations

abstract: We consider the following singularly perturbed Kirchhoff type equations $$-\varepsilon^2 M\left(\varepsilon^{2-N}\int_{\R^N}|\nabla u|^2 dx\right)\Delta u +V(x)u=|u|^{p-2}u~\hbox{in}~\R^N, u\in H^1(\R^N),N\geq 1,$$ where $M\in C([0,\infty))$ and $V\in C(\R^N)$ are given functions. Under very mild assumptions on $M$, we prove the existence of single-peak or multi-peak solution $u_\varepsilon$ for above problem, concentrating around topologically stable critical points of $V$, by a direct corresponding argument. This gives an affirmative answer to an open problem raised by Figueiredo et al. in 2014 [ARMA,213].


title: Web3 Meets Behavioral Economics: An Example of Profitable Crypto Lottery Mechanism Design

abstract: We are often faced with the non-trivial task of designing incentive mechanisms in the era of Web3. As history has shown, many Web3 services failed mostly due to the lack of a rigorous incentive mechanism design based on token economics. However, traditional mechanism design, where there is an assumption that the users of services strategically make decisions so that their expected profits are maximized, often does not capture their real behavior well as it ignores humans' psychological bias in making decisions under uncertainty. In this paper, we propose an incentive mechanism design for crypto-enabled services using behavioral economics. Specifically, we take an example of a crypto lottery game in this work and incorporate a seminal work of cumulative prospect theory into its lottery game mechanism (or rule) design. We designed four mechanisms and compared them in terms of utility, a metric of how appealing a mechanism is to participants, and a game operator's expected profit. Our approach is generic and will be applicable to a wide range of crypto-based services where a decision has to be made under uncertainty.


title: Lower Bounds and Nearly Optimal Algorithms in Distributed Learning with Communication Compression

abstract: Recent advances in distributed optimization and learning have shown that communication compression is one of the most effective means of reducing communication. While there have been many results on convergence rates under communication compression, a theoretical lower bound is still missing. Analyses of algorithms with communication compression have attributed convergence to two abstract properties: the unbiased property or the contractive property. They can be applied with either unidirectional compression (only messages from workers to server are compressed) or bidirectional compression. In this paper, we consider distributed stochastic algorithms for minimizing smooth and non-convex objective functions under communication compression. We establish a convergence lower bound for algorithms whether using unbiased or contractive compressors in unidirection or bidirection. To close the gap between the lower bound and the existing upper bounds, we further propose an algorithm, NEOLITHIC, which almost reaches our lower bound (up to logarithm factors) under mild conditions. Our results also show that using contractive bidirectional compression can yield iterative methods that converge as fast as those using unbiased unidirectional compression. The experimental results validate our findings.


title: Depth Estimation Matters Most: Improving Per-Object Depth Estimation for Monocular 3D Detection and Tracking

abstract: Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior performance when compared to LiDAR-based techniques. Through systematic analysis, we identified that per-object depth estimation accuracy is a major factor bounding the performance. Motivated by this observation, we propose a multi-level fusion method that combines different representations (RGB and pseudo-LiDAR) and temporal information across multiple frames for objects (tracklets) to enhance per-object depth estimation. Our proposed fusion method achieves the state-of-the-art performance of per-object depth estimation on the Waymo Open Dataset, the KITTI detection dataset, and the KITTI MOT dataset. We further demonstrate that by simply replacing estimated depth with fusion-enhanced depth, we can achieve significant improvements in monocular 3D perception tasks, including detection and tracking.


title: Graviton non-gaussianity in $\alpha$-vacuum

abstract: We compute the leading order non-Gaussianity, i.e., the bispectrum, of the tensor perturbation in the general $\alpha$-vacuum on de Sitter space in general relativity. In addition to the well-known Bunch-Davies (BD) vacuum, there exits an infinite number of de Sitter invariant vacua represented by a real parameter $\alpha$ and a phase $\phi$, with $\alpha=0$ being the BD vacuum. They are called $\alpha$-vacua. In the standard slow-roll inflation, as de Sitter invariance no longer applies, the $\alpha$-vacua lose its relevance in the rigorous sense. Nevertheless, if we assume that the parameter $\alpha$ is only weakly dependent on the wavenumber with an appropriate UV cutoff, we may consider pseudo-$\alpha$-vacua. In the case of false vacuum inflation where the background spacetime is pure de Sitter, a non-trivial (non-BD) $\alpha$-vacuum could indeed be realized. We find an intriguing result that the bispectrum may be exponentially enhanced to be detectable by observation even if the spectrum is too small to be detected.


title: Dielectric properties and impedance spectroscopy of NASICON type Na$_3$Zr$_2$Si$_2$PO$_{12}$

abstract: We report the temperature dependent dielectric properties and impedance spectroscopy investigation of Na$_3$Zr$_2$Si$_2$PO$_{12}$ in the frequency range of 20 Hz--2 MHz. The Rietveld refinement of x-ray diffraction pattern confirms the monoclinic phase with C2/c space group. The {\it d.c.} resistivity behavior shows its strong insulating nature at low temperatures, and follows Arrhenius law of thermal conduction with an activation energy of 0.68 eV. The decrease in electric permittivity ($\epsilon_r$) with frequency is explained based on the space polarization mechanism and its increment with temperature by thermal activation of charge carriers. The dielectric loss (D=tan$\delta$) peak follows the Arrhenius law of thermal activation with an energy of 0.25 eV. We observe an enhancement in {\it a.c.} conductivity with frequency and temperature due to the decrease in the activation energy, which results in enhancing the conduction between defect states. Further, we observe an abrupt increase in the {\it a.c.} conductivity at high frequencies, which is explained using the universal Jonschers power law. The analysis of {\it a.c.} conductivity shows two types of conduction mechanisms namely correlated barrier hopping and non-overlapping small polaron tunnelling in the measured temperature range. The imaginary part of the electric modulus confirms the non-Debye type relaxation in the sample. The shifting of the relaxation peak towards higher frequency side with an increase in temperature ensures its thermally activated nature. The scaling behavior of the electric modulus shows similar type of relaxation over the measured temperature range. The combined analysis of electric modulus and impedance with frequency shows the short-range mobility of charge carriers.


title: Toward Certified Robustness Against Real-World Distribution Shifts

abstract: We consider the problem of certifying the robustness of deep neural networks against real-world distribution shifts. To do so, we bridge the gap between hand-crafted specifications and realistic deployment settings by proposing a novel neural-symbolic verification framework, in which we train a generative model to learn perturbations from data and define specifications with respect to the output of the learned model. A unique challenge arising from this setting is that existing verifiers cannot tightly approximate sigmoid activations, which are fundamental to many state-of-the-art generative models. To address this challenge, we propose a general meta-algorithm for handling sigmoid activations which leverages classical notions of counter-example-guided abstraction refinement. The key idea is to "lazily" refine the abstraction of sigmoid functions to exclude spurious counter-examples found in the previous abstraction, thus guaranteeing progress in the verification process while keeping the state-space small. Experiments on the MNIST and CIFAR-10 datasets show that our framework significantly outperforms existing methods on a range of challenging distribution shifts.


title: Zero-Added-Loss Entangled Photon Multiplexing for Ground- and Space-Based Quantum Networks

abstract: We propose a scheme for optical entanglement distribution in quantum networks based on a quasi-deterministic entangled photon pair source. By combining heralded photonic Bell pair generation with spectral mode conversion to interface with quantum memories, the scheme eliminates switching losses due to multiplexing. We analyze this `zero-added-loss multiplexing' (ZALM) Bell pair source for the particularly challenging problem of long-baseline entanglement distribution via satellites and ground-based memories, where it unlocks additional advantages: (i) the substantially higher channel efficiency $\eta$ of \textit{downlinks} vs.\ \textit{uplinks} with realistic adaptive optics, and (ii) photon loss occurring \textit{before} interaction with the quantum memory -- i.e., Alice and Bob receiving rather than transmitting -- improve entanglement generation rate scaling by $\mathcal{O}(\sqrt{\eta})$. Based on numerical analyses, we estimate our protocol to achieve $>$10$~$ebits/s at memory multiplexing of $10^2$ spin qubits for ground distance $>$10$^2~$km, with the spin-spin Bell state fidelity exceeding 99$\%$. Our architecture presents a blueprint for realizing global-scale quantum networks in the near-term.


title: COVIDx CXR-3: A Large-Scale, Open-Source Benchmark Dataset of Chest X-ray Images for Computer-Aided COVID-19 Diagnostics

abstract: After more than two years since the beginning of the COVID-19 pandemic, the pressure of this crisis continues to devastate globally. The use of chest X-ray (CXR) imaging as a complementary screening strategy to RT-PCR testing is not only prevailing but has greatly increased due to its routine clinical use for respiratory complaints. Thus far, many visual perception models have been proposed for COVID-19 screening based on CXR imaging. Nevertheless, the accuracy and the generalization capacity of these models are very much dependent on the diversity and the size of the dataset they were trained on. Motivated by this, we introduce COVIDx CXR-3, a large-scale benchmark dataset of CXR images for supporting COVID-19 computer vision research. COVIDx CXR-3 is composed of 30,386 CXR images from a multinational cohort of 17,026 patients from at least 51 countries, making it, to the best of our knowledge, the most extensive, most diverse COVID-19 CXR dataset in open access form. Here, we provide comprehensive details on the various aspects of the proposed dataset including patient demographics, imaging views, and infection types. The hope is that COVIDx CXR-3 can assist scientists in advancing machine learning research against both the COVID-19 pandemic and related diseases.


title: Two-scale cut-and-projection convergence for quasiperiodic monotone operators

abstract: Averaging certain class of quasiperiodic monotone operators can be simplified to the periodic homogenization setting by mapping the original quasiperiodic structure onto a periodic structure in a higher dimensional space using cut-and projection method. We characterize cut-and-projection convergence limit of the nonlinear monotone partial differential operator $-\mathrm{div} \; \sigma\left({\bf x},\frac{{\bf R}{\bf x}}{\eta}, \nabla u_\eta\right)$ for a bounded sequence $u_\eta$ in $W^{1,p}_0(\Omega)$, where $1<p < \infty$, $\Omega$ is a bounded open subset in $R^n$ with Lipschitz boundary. We identify the homogenized problem with a local equation defined on the hyperplane in the higher-dimensional space. A new corrector result is established.

categories: math.AP cond-mat.mtrl-sci math-ph math.MP


title: Unsupervised Learning of 3D Scene Flow from Monocular Camera

abstract: Scene flow represents the motion of points in the 3D space, which is the counterpart of the optical flow that represents the motion of pixels in the 2D image. However, it is difficult to obtain the ground truth of scene flow in the real scenes, and recent studies are based on synthetic data for training. Therefore, how to train a scene flow network with unsupervised methods based on real-world data shows crucial significance. A novel unsupervised learning method for scene flow is proposed in this paper, which utilizes the images of two consecutive frames taken by monocular camera without the ground truth of scene flow for training. Our method realizes the goal that training scene flow network with real-world data, which bridges the gap between training data and test data and broadens the scope of available data for training. Unsupervised learning of scene flow in this paper mainly consists of two parts: (i) depth estimation and camera pose estimation, and (ii) scene flow estimation based on four different loss functions. Depth estimation and camera pose estimation obtain the depth maps and camera pose between two consecutive frames, which provide further information for the next scene flow estimation. After that, we used depth consistency loss, dynamic-static consistency loss, Chamfer loss, and Laplacian regularization loss to carry out unsupervised training of the scene flow network. To our knowledge, this is the first paper that realizes the unsupervised learning of 3D scene flow from monocular camera. The experiment results on KITTI show that our method for unsupervised learning of scene flow meets great performance compared to traditional methods Iterative Closest Point (ICP) and Fast Global Registration (FGR). The source code is available at: https://github.com/IRMVLab/3DUnMonoFlow.


title: Integrating Symmetry into Differentiable Planning with Steerable Convolutions

abstract: We study how group symmetry helps improve data efficiency and generalization for end-to-end differentiable planning algorithms when symmetry appears in decision-making tasks. Motivated by equivariant convolution networks, we treat the path planning problem as \textit{signals} over grids. We show that value iteration in this case is a linear equivariant operator, which is a (steerable) convolution. This extends Value Iteration Networks (VINs) on using convolutional networks for path planning with additional rotation and reflection symmetry. Our implementation is based on VINs and uses steerable convolution networks to incorporate symmetry. The experiments are performed on four tasks: 2D navigation, visual navigation, and 2 degrees of freedom (2DOFs) configuration space and workspace manipulation. Our symmetric planning algorithms improve training efficiency and generalization by large margins compared to non-equivariant counterparts, VIN and GPPN.


title: Biomimetic random lasers with tunable spatial and temporal coherence

abstract: Biologically inspired photonic structures are the key for technological advances and for miniaturized lasers. Here random lasers in dye-doped titania with the disordered structure of paper are proposed. Sharp electromagnetic resonances with unexpected broad spatial extension are reported. The modes interact and compete on wide length scales, enabling to control precisely the device performance by acting on the pumping


title: Minimal Joint Entropy and Order-Preserving Couplings

abstract: This paper focuses on the extreme-value problem for Shannon entropy of the joint distribution with given marginals. It is proved that the minimum-entropy coupling must be of order-preserving, while the maximum-entropy coupling coincides with the independent one. Note that in this sense, we interpret entropy as a measure of system disorder.


title: Unary interpretability logics for sublogics of the interpretability logic $\mathbf{IL}$

abstract: De Rijke introduced a unary interpretability logic $\mathbf{il}$, and proved that $\mathbf{il}$ is the unary counterpart of the binary interpretability logic $\mathbf{IL}$. In this paper, we find the unary counterparts of the sublogics of $\mathbf{IL}$.


title: UHD Image Deblurring via Multi-scale Cubic-Mixer

abstract: Currently, transformer-based algorithms are making a splash in the domain of image deblurring. Their achievement depends on the self-attention mechanism with CNN stem to model long range dependencies between tokens. Unfortunately, this ear-pleasing pipeline introduces high computational complexity and makes it difficult to run an ultra-high-definition image on a single GPU in real time. To trade-off accuracy and efficiency, the input degraded image is computed cyclically over three dimensional ($C$, $W$, and $H$) signals without a self-attention mechanism. We term this deep network as Multi-scale Cubic-Mixer, which is acted on both the real and imaginary components after fast Fourier transform to estimate the Fourier coefficients and thus obtain a deblurred image. Furthermore, we combine the multi-scale cubic-mixer with a slicing strategy to generate high-quality results at a much lower computational cost. Experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art deblurring approaches on the several benchmarks and a new ultra-high-definition dataset in terms of accuracy and speed.


title: Residual Supersingular Iwasawa Theory over quadratic imaginary fields

abstract: Let p be an odd prime and let E be an elliptic curve defined over a quadratic imaginary field where p splits completely. Suppose E has supersingular reduction at primes above p. We define and study the fine double-signed residual Selmer groups in these settings for Z_p^2-extensions. We prove that for two residually isomorphic elliptic curves, the vanishing of the signed {\mu}-invariants of one elliptic curve implies the vanishing of the signed {\mu}-invariants of the other. Finally, we show that the Pontryagin dual of the Selmer group and the double-signed Selmer groups have no non-trivial pseudo-null submodules for these extensions.


title: Improving Evaluation of Debiasing in Image Classification

abstract: Image classifiers often rely overly on peripheral attributes that have a strong correlation with the target class (i.e., dataset bias) when making predictions. Due to the dataset bias, the model correctly classifies data samples including bias attributes (i.e., bias-aligned samples) while failing to correctly predict those without bias attributes (i.e., bias-conflicting samples). Recently, a myriad of studies focus on mitigating such dataset bias, the task of which is referred to as debiasing. However, our comprehensive study indicates several issues need to be improved when conducting evaluation of debiasing in image classification. First, most of the previous studies do not specify how they select their hyper-parameters and model checkpoints (i.e., tuning criterion). Second, the debiasing studies until now evaluated their proposed methods on datasets with excessively high bias-severities, showing degraded performance on datasets with low bias severity. Third, the debiasing studies do not share consistent experimental settings (e.g., datasets and neural networks) which need to be standardized for fair comparisons. Based on such issues, this paper 1) proposes an evaluation metric `Align-Conflict (AC) score' for the tuning criterion, 2) includes experimental settings with low bias severity and shows that they are yet to be explored, and 3) unifies the standardized experimental settings to promote fair comparisons between debiasing methods. We believe that our findings and lessons inspire future researchers in debiasing to further push state-of-the-art performances with fair comparisons.


title: Machine learning assisted droplet trajectories extraction in dense emulsions and their analysis

abstract: This work analyzes trajectories obtained by YOLO and DeepSORT algorithms of dense emulsion systems simulated by Lattice Boltzmann methods. The results indicate that the individual droplet's moving direction is influenced more by the droplets immediately behind it than the droplets in front of it. The analysis also provides hints on constraints on writing down a dynamical model of droplets for the dense emulsion in narrow channels.


title: Aspects of the screw function corresponding to the Riemann zeta function

abstract: We introduce a screw function corresponding to the Riemann zeta-function and study its properties from various aspects. Typical results are several equivalent conditions for the Riemann hypothesis in terms of the screw function. One of them can be considered an analog of so-called Weil's positivity or Li's criterion. In addition, we prove a few partial but unconditional results for such equivalents.


title: The BV action of 3D twisted R-Poisson sigma models

abstract: We determine the solution to the classical master equation for a 3D topological field theory with Wess-Zumino term and an underlying geometrical structure of a twisted R-Poisson manifold on its target space. The graded geometry of the target space departs from the usual QP structure encountered in the AKSZ construction of topological sigma models, the obstruction being attributed to the presence of the Wess-Zumino 4-form. Due to the inapplicability of the AKSZ construction in this case, we set up the traditional BV/BRST formalism for twisted R-Poisson sigma models in any dimension, which feature an open gauge algebra and constitute multiple stages reducible constrained Hamiltonian systems. An unusual feature of the theories is that it exhibits non-linear openness of the gauge algebra, in other words products of the equations of motion appear in it. Nevertheless, we find the BV action in presence of the 4-form twist in 3D, namely for a specific 4-form twisted (pre-)Courant sigma model. Moreover, we provide a complete set of explicit formulas for the off-shell nilpotent BV operator for untwisted R-Poisson sigma models in any dimension.


title: Progress Report: A Deep Learning Guided Exploration of Affine Unimodular Loop Transformations

abstract: In this paper, we present a work in progress about a deep learning based approach for automatic code optimization in polyhedral compilers. The proposed technique explores combinations of affine and non-affine loop transformations to find the sequence of transformations that minimizes the execution time of a given program. This exploration is guided by a deep learning based cost model that evaluates the speedup that each sequence of transformations would yield. Preliminary results show that the proposed techniques achieve a 2.35x geometric mean speedup over state of the art polyhedral compilers (Pluto).


title: On pointwise error estimates for Vorono\"i-based finite volume methods for the Poisson equation on the sphere

abstract: In this paper, we give pointwise estimates of a Vorono\"i-based finite volume approximation of the Laplace-Beltrami operator on Vorono\"i-Delaunay decompositions of the sphere. These estimates are the basis for a local error analysis, in the maximum norm, of the approximate solution of the Poisson equation and its gradient. Here, we consider the Vorono\"i-based finite volume method as a perturbation of the finite element method. Finally, using regularized Green's functions, we derive quasi-optimal convergence order in the maximum-norm with minimal regularity requirements. Numerical examples show that the convergence is at least as good as predicted.


title: Semi-supervised MIMO Detection Using Cycle-consistent Generative Adversarial Network

abstract: In this paper, a new semi-supervised deep multiple-input multiple-output (MIMO) detection approach using a cycle-consistent generative adversarial network (CycleGAN) is proposed for communication systems without any prior knowledge of underlying channel distributions. Specifically, we propose the CycleGAN detector by constructing a bidirectional loop of two modified least squares generative adversarial networks (LS-GAN). The forward LS-GAN learns to model the transmission process, while the backward LS-GAN learns to detect the received signals. By optimizing the cycle-consistency of the transmitted and received signals through this loop, the proposed method is trained online and semi-supervisedly using both the pilots and the received payload data. As such, the demand on labelled training dataset is considerably controlled, and thus the overhead is effectively reduced. Numerical results show that the proposed CycleGAN detector achieves better performance in terms of both bit error-rate (BER) and achievable rate than existing semi-blind deep learning (DL) detection methods as well as conventional linear detectors, especially when considering signal distortion due to the nonlinearity of power amplifiers (PA) at the transmitter.


title: A Unified Model for Multi-class Anomaly Detection

abstract: Despite the rapid advance of unsupervised anomaly detection, existing methods require to train separate models for different objects. In this work, we present UniAD that accomplishes anomaly detection for multiple classes with a unified framework. Under such a challenging setting, popular reconstruction networks may fall into an "identical shortcut", where both normal and anomalous samples can be well recovered, and hence fail to spot outliers. To tackle this obstacle, we make three improvements. First, we revisit the formulations of fully-connected layer, convolutional layer, as well as attention layer, and confirm the important role of query embedding (i.e., within attention layer) in preventing the network from learning the shortcut. We therefore come up with a layer-wise query decoder to help model the multi-class distribution. Second, we employ a neighbor masked attention module to further avoid the information leak from the input feature to the reconstructed output feature. Third, we propose a feature jittering strategy that urges the model to recover the correct message even with noisy inputs. We evaluate our algorithm on MVTec-AD and CIFAR-10 datasets, where we surpass the state-of-the-art alternatives by a sufficiently large margin. For example, when learning a unified model for 15 categories in MVTec-AD, we surpass the second competitor on the tasks of both anomaly detection (from 88.1% to 96.5%) and anomaly localization (from 89.5% to 96.8%). Code is available at https://github.com/zhiyuanyou/UniAD.


title: Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials

abstract: A recent goal in the theory of deep learning is to identify how neural networks can escape the "lazy training," or Neural Tangent Kernel (NTK) regime, where the network is coupled with its first order Taylor expansion at initialization. While the NTK is minimax optimal for learning dense polynomials (Ghorbani et al, 2021), it cannot learn features, and hence has poor sample complexity for learning many classes of functions including sparse polynomials. Recent works have thus aimed to identify settings where gradient based algorithms provably generalize better than the NTK. One such example is the "QuadNTK" approach of Bai and Lee (2020), which analyzes the second-order term in the Taylor expansion. Bai and Lee (2020) show that the second-order term can learn sparse polynomials efficiently; however, it sacrifices the ability to learn general dense polynomials. In this paper, we analyze how gradient descent on a two-layer neural network can escape the NTK regime by utilizing a spectral characterization of the NTK (Montanari and Zhong, 2020) and building on the QuadNTK approach. We first expand upon the spectral analysis to identify "good" directions in parameter space in which we can move without harming generalization. Next, we show that a wide two-layer neural network can jointly use the NTK and QuadNTK to fit target functions consisting of a dense low-degree term and a sparse high-degree term -- something neither the NTK nor the QuadNTK can do on their own. Finally, we construct a regularizer which encourages our parameter vector to move in the "good" directions, and show that gradient descent on the regularized loss will converge to a global minimizer, which also has low test error. This yields an end to end convergence and generalization guarantee with provable sample complexity improvement over both the NTK and QuadNTK on their own.


title: Emerging Two-Dimensional Magnetism in Nonmagnetic Electrides Hf2X (X = S, Se, Te)

abstract: Recent experimental discoveries of two-dimensional (2D) magnets have triggered intense research activities to search for atomically thin magnetic systems. Using first-principles calculations, we predict the emergence of 2D magnetism in the monolayers (MLs), few layers, and surfaces of nonmagnetic layered electrides Hf2X (X = S, Se, Te) consisting of three-atom-thick Hf-X-Hf stacks. It is revealed that each bulk Hf2X hosts a novel quantum state of Dirac nodal lines with a high density of states arising from Hf-5d cationic and interlayer anionic electrons around -0.9 eV below the Fermi level EF. However, for the MLs, few layers, and surfaces of Hf2X, such hybridized states are shifted toward EF to generate van Hove singularities, leading to a Stoner instability. The resulting surface ferromagnetism gives rise to strongly spin-polarized topological surface states at Hf2X(001), demonstrating that anionic electrons, 2D magnetism, and band topology are entangled with each other. Our findings will open new perspectives for the discovery of 2D magnets via exploiting surface effects in nonmagnetic layered electrides.