title: DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting

abstract: End-to-end text spotting aims to integrate scene text detection and recognition into a unified framework. Dealing with the relationship between the two sub-tasks plays a pivotal role in designing effective spotters. Although Transformer-based methods eliminate the heuristic post-processing, they still suffer from the synergy issue between the sub-tasks and low training efficiency. In this paper, we present DeepSolo, a simple DETR-like baseline that lets a single Decoder with Explicit Points Solo for text detection and recognition simultaneously. Technically, for each text instance, we represent the character sequence as ordered points and model them with learnable explicit point queries. After passing a single decoder, the point queries have encoded requisite text semantics and locations, thus can be further decoded to the center line, boundary, script, and confidence of text via very simple prediction heads in parallel. Besides, we also introduce a text-matching criterion to deliver more accurate supervisory signals, thus enabling more efficient training. Quantitative experiments on public benchmarks demonstrate that DeepSolo outperforms previous state-of-the-art methods and achieves better training efficiency. In addition, DeepSolo is also compatible with line annotations, which require much less annotation cost than polygons. The code is available at https://github.com/ViTAE-Transformer/DeepSolo.


title: A Two-Stage Active Learning Algorithm for $k$-Nearest Neighbors

abstract: $k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design active learning strategies for the training of local voting-based classifiers that naturally retain these desirable properties, and hence active learning strategies for $k$-nearest neighbor classification have been conspicuously missing from the literature. In this work, we introduce a simple and intuitive active learning algorithm for the training of $k$-nearest neighbor classifiers, the first in the literature which retains the concept of the $k$-nearest neighbor vote at prediction time. We provide consistency guarantees for a modified $k$-nearest neighbors classifier trained on samples acquired via our scheme, and show that when the conditional probability function $\mathbb{P}(Y=y|X=x)$ is sufficiently smooth and the Tsybakov noise condition holds, our actively trained classifiers converge to the Bayes optimal classifier at a faster asymptotic rate than passively trained $k$-nearest neighbor classifiers.


title: Emulating Fast Processes in Climate Models

abstract: Cloud microphysical parameterizations in atmospheric models describe the formation and evolution of clouds and precipitation, a central weather and climate process. Cloud-associated latent heating is a primary driver of large and small-scale circulations throughout the global atmosphere, and clouds have important interactions with atmospheric radiation. Clouds are ubiquitous, diverse, and can change rapidly. In this work, we build the first emulator of an entire cloud microphysical parameterization, including fast phase changes. The emulator performs well in offline and online (i.e. when coupled to the rest of the atmospheric model) tests, but shows some developing biases in Antarctica. Sensitivity tests demonstrate that these successes require careful modeling of the mixed discrete-continuous output as well as the input-output structure of the underlying code and physical process.


title: The Hurwitz-Hopf Map and Harmonic Wave Functions for Integer and Half-Integer Angular Momentum

abstract: Harmonic wave functions for integer and half-integer angular momentum are given in terms of the Euler angles $(\theta,\phi,\psi)$ that define a rotation in $SO(3)$, and the Euclidean norm in ${\mathbb R}^3$. Following a classical work by Schwinger, $2$-dimensional harmonic oscillators are used to produce raising and lowering operators that change the total angular momentum eigenvalue of the wave functions in half units. The nature of the representation space $\mathcal H$ is approached from the double covering group homomorphism $SU(2)\to SO(3)$ and the topology involved is taken care of by using the Hurwitz-Hopf map $H:{\mathbb R}^4\to{\mathbb R}^3$. It is shown how to reconsider $H$ as a 2-to-1 group map, $G_0={\mathbb R}^+\times SU(2)\to {\mathbb R}^+\times SO(3)$, translating it into an assignment $(z_1,z_2)\mapsto (r,\theta,\phi,\psi)$ whose domain consists of pairs $(z_1,z_2)$ of complex variables. It is shown how the Lie algebra of $G_0$ is coupled with two Heisenberg Lie algebras of $2$-dimensional (Schwinger's) harmonic oscillators generated by the operators $\{z_1,z_2,\bar{z}_1,\bar{z}_2\}$ and their adjoints. The whole set of operators gets algebraically closed either into a $13$-dimensional Lie algebra or into a $(4|8)$-dimensional Lie superalgebra. The wave functions in $\mathcal H$ can be written in terms of polynomials in the complex coordinates $(z_1,z_2)$ and their complex conjugates, and the representations are explicitly constructed via the various highest weight (or lowest weight) vector representations of $G_0$. A new non-relativistic quantum (Schr\"odinger-like) equation for the hydrogen atom that takes into account the electron spin is introduced and expressed in terms of $(r,\theta,\phi,\psi)$ and the time $t$. The equation may be solved exactly in terms of the harmonic wave functions hereby introduced.


title: Bayesian Modal Regression based on Mixture Distributions

abstract: Compared to mean regression and quantile regression, the literature on modal regression is very sparse. We propose a unified framework for Bayesian modal regression based on a family of unimodal distributions indexed by the mode along with other parameters that allow for flexible shapes and tail behaviors. Following prior elicitation, we carry out regression analysis of simulated data and datasets from several real-life applications. Besides drawing inference for covariate effects that are easy to interpret, we consider prediction and model selection under the proposed Bayesian modal regression framework. Evidence from these analyses suggest that the proposed inference procedures are very robust to outliers, enabling one to discover interesting covariate effects missed by mean or median regression, and to construct much tighter prediction intervals than those from mean or median regression. Computer programs for implementing the proposed Bayesian modal regression are available at https://github.com/rh8liuqy/Bayesian_modal_regression.


title: Non-Coherent Over-the-Air Decentralized Gradient Descent

abstract: Decentralized Gradient Descent (DGD) is a popular algorithm used to solve decentralized optimization problems in diverse domains such as remote sensing, distributed inference, multi-agent coordination, and federated learning. Yet, executing DGD over wireless systems affected by noise, fading and limited bandwidth presents challenges, requiring scheduling of transmissions to mitigate interference and the acquisition of topology and channel state information -- complex tasks in wireless decentralized systems. This paper proposes a DGD algorithm tailored to wireless systems. Unlike existing approaches, it operates without inter-agent coordination, topology information, or channel state information. Its core is a Non-Coherent Over-The-Air (NCOTA) consensus scheme, exploiting a noisy energy superposition property of wireless channels. With a randomized transmission strategy to accommodate half-duplex operation, transmitters map local optimization signals to energy levels across subcarriers in an OFDM frame, and transmit concurrently without coordination. It is shown that received energies form a noisy consensus signal, whose fluctuations are mitigated via a consensus stepsize. NCOTA-DGD leverages the channel pathloss for consensus formation, without explicit knowledge of the mixing weights. It is shown that, for the class of strongly-convex problems, the expected squared distance between the local and globally optimum models vanishes with rate $\mathcal O(1/\sqrt{k})$ after $k$ iterations, with a proper design of decreasing stepsizes. Extensions address a broad class of fading models and frequency-selective channels. Numerical results on an image classification task depict faster convergence vis-\`a-vis running time than state-of-the-art schemes, especially in densely deployed networks.


title: Possibility of stable thin-shell around wormholes within the string cloud and quintessential field via the van der Waals and polytropic EOS in General relativity

abstract: In this work, we present the Einstein field equations (EFE) in the framework of a modified matter source and thus find out the solutions for the Wormhole. To obtain characteristic solutions set, we employ two kinds of equations of states (EOS), i.e., the van der Waals and polytropic EOS to the EFE. We adopt embedding class as a general technique for the system and discuss several physical attributes of the stellar system under embedded wormhole solutions. Detailed discussion about the matter contents of the thin-shell developed around the obtained wormhole solutions in the background of Schwarzschild BH surrounded by cloud and quintessence-type fluid distribution by using a well-known cut and paste approach. We have also performed stability analysis using the linearized radial perturbation method for the van der Waals EOS and polytropic EOS. Several interesting points have evolved from the entire investigation along with the features of the thin shell around the wormhole.


title: Seebeck and Nernst coefficients of a magnetized hot QCD medium with number conserving kernel

abstract: We have studied the thermoelectric response of a hot and magnetized QCD medium created in the noncentral events at heavy-ion collider experiments. The collisional aspects of the medium have been embedded in the relativistic Boltzmann transport equation (RBTE) using Bhatnagar-Gross-Krook (BGK) collision integral, which insures the particle number conservation, unlike the commonly used relaxation time approximation (RTA). We have incorporated the thermal medium effects in the guise of a quasiparticle model, where the interaction among the partons is embodied in the medium dependent mass of the quark, which has been evaluated using the framework of the perturbative thermal QCD with a magnetic field in the background. In the absence of $B$, the Seebeck coefficient for individual quark flavors gets slightly reduced in the BGK term in comparison to naive RTA, while it gets enhanced for the composite partonic medium. In the presence of strong magnetic field ($B$), the BGK term enhances the Seebeck coefficient for the individual flavors as well as that for medium. The medium Seebeck coefficient rises with the strength of quark chemical potential ($\mu$) in the absence as well as that in the strong $B$. We observe chirality dependence in the Seebeck and Nernst coefficients in the weak magnetic field as the degeneracy in the masses of left- and right-handed chiral modes gets lifted in the weak $B$. Seebeck coefficient is larger for left-handed modes contrary to the Nernst coefficient which is higher for the right-handed modes. Seebeck coefficient is almost similar in the weak field for both the collision term, while Nernst coefficient gets reduced (enhanced) for $L$ ($R$) modes considerably in the BGK collision term.


title: ArtELingo: A Million Emotion Annotations of WikiArt with Emphasis on Diversity over Language and Culture

abstract: This paper introduces ArtELingo, a new benchmark and dataset, designed to encourage work on diversity across languages and cultures. Following ArtEmis, a collection of 80k artworks from WikiArt with 0.45M emotion labels and English-only captions, ArtELingo adds another 0.79M annotations in Arabic and Chinese, plus 4.8K in Spanish to evaluate "cultural-transfer" performance. More than 51K artworks have 5 annotations or more in 3 languages. This diversity makes it possible to study similarities and differences across languages and cultures. Further, we investigate captioning tasks, and find diversity improves the performance of baseline models. ArtELingo is publicly available at https://www.artelingo.org/ with standard splits and baseline models. We hope our work will help ease future research on multilinguality and culturally-aware AI.


title: Automorphisms and derivations of affine commutative and PI-algebras

abstract: We prove analogs of A.~Selberg's result for finitely generated subgroups of $\text{Aut}(A)$ and of Engel's theorem for subalgebras of $\text{Der}(A)$ for a finitely generated associative commutative algebra $A$ over an associative commutative ring. We prove also an analog of the theorem of W.~Burnside and I.~Schur about locally finiteness of torsion subgroups of $\text{Aut}(A)$.


title: Let Graph be the Go Board: Gradient-free Node Injection Attack for Graph Neural Networks via Reinforcement Learning

abstract: Graph Neural Networks (GNNs) have drawn significant attentions over the years and been broadly applied to essential applications requiring solid robustness or vigorous security standards, such as product recommendation and user behavior modeling. Under these scenarios, exploiting GNN's vulnerabilities and further downgrading its performance become extremely incentive for adversaries. Previous attackers mainly focus on structural perturbations or node injections to the existing graphs, guided by gradients from the surrogate models. Although they deliver promising results, several limitations still exist. For the structural perturbation attack, to launch a proposed attack, adversaries need to manipulate the existing graph topology, which is impractical in most circumstances. Whereas for the node injection attack, though being more practical, current approaches require training surrogate models to simulate a white-box setting, which results in significant performance downgrade when the surrogate architecture diverges from the actual victim model. To bridge these gaps, in this paper, we study the problem of black-box node injection attack, without training a potentially misleading surrogate model. Specifically, we model the node injection attack as a Markov decision process and propose Gradient-free Graph Advantage Actor Critic, namely G2A2C, a reinforcement learning framework in the fashion of advantage actor critic. By directly querying the victim model, G2A2C learns to inject highly malicious nodes with extremely limited attacking budgets, while maintaining a similar node feature distribution. Through our comprehensive experiments over eight acknowledged benchmark datasets with different characteristics, we demonstrate the superior performance of our proposed G2A2C over the existing state-of-the-art attackers. Source code is publicly available at: https://github.com/jumxglhf/G2A2C}.


title: Gradient-Free Federated Learning Methods with $l_1$ and $l_2$-Randomization for Non-Smooth Convex Stochastic Optimization Problems

abstract: This paper studies non-smooth problems of convex stochastic optimization. Using the smoothing technique based on the replacement of the function value at the considered point by the averaged function value over a ball (in $l_1$-norm or $l_2$-norm) of small radius with the center in this point, the original problem is reduced to a smooth problem (whose Lipschitz constant of the gradient is inversely proportional to the radius of the ball). An important property of the smoothing used is the possibility to calculate an unbiased estimation of the gradient of a smoothed function based only on realizations of the original function. The obtained smooth stochastic optimization problem is proposed to be solved in a distributed federated learning architecture (the problem is solved in parallel: nodes make local steps, e.g. stochastic gradient descent, then they communicate - all with all, then all this is repeated). The goal of this paper is to build on the current advances in gradient-free non-smooth optimization and in feild of federated learning, gradient-free methods for solving non-smooth stochastic optimization problems in federated learning architecture.


title: Model-based tools for assessing space and time change in daily maximum temperature: an application to the Ebro basin in Spain

abstract: There is continuing interest in the investigation of change in temperature over space and time. We offer a set of tools to illuminate such change temporally, at desired temporal resolution, and spatially, according to region of interest, using data generated from suitable space-time models. These tools include predictive spatial probability surfaces and spatial extents for an event. Working with exceedance events around the center of the temperature distribution, the probability surfaces capture the spatial variation in the risk of an exceedance event, while the spatial extents capture the expected proportion of incidence of a given exceedance event for a region of interest. Importantly, the proposed tools can be used with the output from any suitable model fitted to any set of spatially referenced time series data. As an illustration, we employ a dataset from 1956 to 2015 collected at 18 stations over Arag\'{o}n in Spain, and a collection of daily maximum temperature series obtained from posterior predictive simulation of a Bayesian hierarchical daily temperature model. The results for the summer period show that although there is an increasing risk in all the events used to quantify the effects of climate change, it is not spatially homogeneous, with the largest increase arising in the center of Ebro valley and Eastern Pyrenees area. The risk of an increase of the average temperature between 1966-1975 and 2006-2015 higher than $1^\circ$C is higher than 0.5 all over the region, and close to 1 in the previous areas. The extent of daily temperature higher than the reference mean has increased 3.5% per decade. The mean of the extent indicates that 95% of the area under study has suffered a positive increment of the average temperature, and almost 70% higher than $1^{\circ}$C.


title: A bias-free cosmological analysis with quasars alleviating $H_0$ tension

abstract: Cosmological models and their parameters are widely debated because of theoretical and observational mismatches of the standard cosmological model, especially the current discrepancy between the value of the Hubble constant, $H_{0}$, obtained by Type Ia supernovae (SNe Ia), and the Cosmic Microwave Background Radiation (CMB). Thus, considering high-redshift probes like quasars (QSOs), having intermediate redshifts between SNe Ia and CMB, is a necessary step. In this work, we use SNe Ia and the most updated QSO sample, reaching redshifts up to $z\sim7.5$, applying the Risaliti-Lusso QSO relation based on a non-linear relation between ultraviolet and X-ray luminosities. We consider this relation both in its original form and corrected for selection biases and evolution in redshift through a reliable statistical method also accounting for the circularity problem. We also explore two approaches: with and without calibration on SNe Ia. We then investigate flat and non-flat standard cosmological models and a flat $w$CDM model, with a constant dark energy equation of state parameter $w$. Remarkably, when correcting for the evolution as a function of cosmology, we obtain closed constraints on $\Omega_M$ using only non-calibrated QSOs. We find that considering non-calibrated QSOs combined with SNe Ia and accounting for the same correction, our results are compatible with a flat $\Lambda$CDM model with $\Omega_M = 0.3$ and $H_0 = 70 \, \mathrm{km\,s^{-1}\,Mpc^{-1}}$. Intriguingly, the $H_0$ values obtained place halfway between the one from SNe Ia and CMB, paving the way for new insights into the $H_0$ tension.


title: Infuence of pressure on magnetic phase transitions in the ferromagnetic superconductor UGe$_2$ -- phenomenological approach

abstract: We propose a thermodynamic model of free energy expansion up to eighth order of magnetisation to describe the complex magnetic phase transitions in ferromagnetic superconductor UGe$_2$. The model successfully describes transitions between ordered phases which take place without changing of magnetic structure but only of magnetisation which is the case of UGe$_2$ where two magnetic phases with same structure but with different magnitude occur with decreasing of temperature. We consider the infuence of pressure on magnetic transitions in the simplest form of including it only in pressure dependence of Curie temperature for the transition between the paramagnetic and themagnetic phase with the lower magnetic moment FM1. Our results show that for pressures lower than some limiting pressure the transition betweenlow-and high-magnetisation phase remains of crossover type. Above this limiting pressure this transition changes to real thermodynamic transition of first order.


title: A new semiconducting perovskite alloy system made possible by gas-source molecular beam epitaxy

abstract: Optoelectronic technologies are based on families of semiconductor alloys. It is rare that a new semiconductor alloy family is developed to the point where epitaxial growth is possible; since the 1950s, this has happened approximately once per decade. Here we demonstrate epitaxial thin film growth of semiconducting chalcogenide perovskite alloys in the Ba-Zr-S-Se system by gas-source molecular beam epitaxy (MBE). We stabilize the full range y = 0 ... 3 of compositions BaZrS$_{(3-y)}$Se$_y$ in the perovskite structure, up to and including BaZrSe$_3$, by growing on BaZrS$_3$ epitaxial templates. The resulting films are environmentally stable and the direct band gap ($E_g$) varies strongly with Se content, as predicted by theory, covering the range $E_g$ = 1.9 ... 1.4 eV for $y$ = 0 ... 3. This creates possibilities for visible and near-infrared (VIS-NIR) optoelectronics, solid state lighting, and solar cells using chalcogenide perovskites.


title: Primes and composites in the determinant Hosoya triangle

abstract: In this paper, we look at numbers of the form $H_{r,k}:=F_{k-1}F_{r-k+2}+F_{k}F_{r-k}$. These numbers are the entries of a triangular array called the \emph{determinant Hosoya triangle} which we denote by ${\mathcal H}$. We discuss the divisibility properties of the above numbers and their primality. We give a small sieve of primes to illustrate the density of prime numbers in ${\mathcal H}$. Since the Fibonacci and Lucas numbers appear as entries in ${\mathcal H}$, our research is an extension of the classical questions concerning whether there are infinitely many Fibonacci or Lucas primes. We prove that ${\mathcal H}$ has arbitrarily large neighbourhoods of composite entries. Finally we present an abundance of data indicating a very high density of primes in ${\mathcal H}$.


title: Deep Learning-Aided Perturbation Model-Based Fiber Nonlinearity Compensation

abstract: Fiber nonlinearity effects cap achievable rates and ranges in long-haul optical fiber communication links. Conventional nonlinearity compensation methods, such as perturbation theory-based nonlinearity compensation (PB-NLC), attempt to compensate for the nonlinearity by approximating analytical solutions to the signal propagation over optical fibers. However, their practical usability is limited by model mismatch and the immense computational complexity associated with the analytical computation of perturbation triplets and the nonlinearity distortion field. Recently, machine learning techniques have been used to optimise parameters of PB-based approaches, which traditionally have been determined analytically from physical models. It has been claimed in the literature that the learned PB-NLC approaches have improved performance and/or reduced computational complexity over their non-learned counterparts. In this paper, we first revisit the acclaimed benefits of the learned PB-NLC approaches by carefully carrying out a comprehensive performance-complexity analysis utilizing state-of-the-art complexity reduction methods. Interestingly, our results show that least squares-based PB-NLC with clustering quantization has the best performance-complexity trade-off among the learned PB-NLC approaches. Second, we advance the state-of-the-art of learned PB-NLC by proposing and designing a fully learned structure. We apply a bi-directional recurrent neural network for learning perturbation triplets that are alike those obtained from the analytical computation and are used as input features for the neural network to estimate the nonlinearity distortion field. Finally, we demonstrate through numerical simulations that our proposed fully learned approach achieves an improved performance-complexity trade-off compared to the existing learned and non-learned PB-NLC techniques.


title: Simple and Effective Augmentation Methods for CSI Based Indoor Localization

abstract: Indoor localization is a challenging task. Compared to outdoor environments where GPS is dominant, there is no robust and almost-universal approach. Recently, machine learning (ML) has emerged as the most promising approach for achieving accurate indoor localization. Nevertheless, its main challenge is requiring large datasets to train the neural networks. The data collection procedure is costly and laborious, requiring extensive measurements and labeling processes for different indoor environments. The situation can be improved by Data Augmentation (DA), a general framework to enlarge the datasets for ML, making ML systems more robust and increasing their generalization capabilities. This paper proposes two simple yet surprisingly effective DA algorithms for channel state information (CSI) based indoor localization motivated by physical considerations. We show that the number of measurements for a given accuracy requirement may be decreased by an order of magnitude. Specifically, we demonstrate the algorithm's effectiveness by experiments conducted with a measured indoor WiFi measurement dataset. As little as 10% of the original dataset size is enough to get the same performance as the original dataset. We also showed that if we further augment the dataset with the proposed techniques, test accuracy is improved more than three-fold.


title: AdaFNIO: Adaptive Fourier Neural Interpolation Operator for video frame interpolation

abstract: We present, AdaFNIO - Adaptive Fourier Neural Interpolation Operator, a neural operator-based architecture to perform video frame interpolation. Current deep learning based methods rely on local convolutions for feature learning and suffer from not being scale-invariant, thus requiring training data to be augmented through random flipping and re-scaling. On the other hand, AdaFNIO, learns the features in the frames, independent of input resolution, through token mixing and global convolution in the Fourier space or the spectral domain by using Fast Fourier Transform (FFT). We show that AdaFNIO can produce visually smooth and accurate results. To evaluate the visual quality of our interpolated frames, we calculate the structural similarity index (SSIM) and Peak Signal to Noise Ratio (PSNR) between the generated frame and the ground truth frame. We provide the quantitative performance of our model on Vimeo-90K dataset, DAVIS, UCF101 and DISFA+ dataset.


title: Spacetime metric for pedestrian movement

abstract: This paper will present a model for pedestrian motion by defining a spacetime metric. This model considers the factors that are effective in the movement of pedestrians (such as obstacles, walls and other pedestrians) by defining a proper metric. In fact, the surrounding environment that affects the motion of pedestrians changes the flat(Euclidean) spacetime metric and, therefore, the shortest possible path to their destination. This change is such that pedestrians have a different feeling of time at any point and moment in the environment. Based on this feeling, they adjust their route to the destination so that they travel the shortest possible route in curved spacetime, which follows a geodesic. The contributions are :1. Defining spacetime metric for pedestrian movement.2. Visualizing the spacetime geometry for several timesteps.3. Introducing a parameter called the time factor and its physical meaning in terms of the pedestrian feeling of time. According to this paper formulation, pedestrians feel time differently at each position and moment, and the time factor measures this feeling of time. 4. Proposing a simple model with differential equations suitable for data assimilation methods while preserving the essential feature of collision avoidance behaviour.


title: BENK: The Beran Estimator with Neural Kernels for Estimating the Heterogeneous Treatment Effect

abstract: A method for estimating the conditional average treatment effect under condition of censored time-to-event data called BENK (the Beran Estimator with Neural Kernels) is proposed. The main idea behind the method is to apply the Beran estimator for estimating the survival functions of controls and treatments. Instead of typical kernel functions in the Beran estimator, it is proposed to implement kernels in the form of neural networks of a specific form called the neural kernels. The conditional average treatment effect is estimated by using the survival functions as outcomes of the control and treatment neural networks which consists of a set of neural kernels with shared parameters. The neural kernels are more flexible and can accurately model a complex location structure of feature vectors. Various numerical simulation experiments illustrate BENK and compare it with the well-known T-learner, S-learner and X-learner for several types of the control and treatment outcome functions based on the Cox models, the random survival forest and the Nadaraya-Watson regression with Gaussian kernels. The code of proposed algorithms implementing BENK is available in https://github.com/Stasychbr/BENK.


title: NVDiff: Graph Generation through the Diffusion of Node Vectors

abstract: Learning to generate graphs is challenging as a graph is a set of pairwise connected, unordered nodes encoding complex combinatorial structures. Recently, several works have proposed graph generative models based on normalizing flows or score-based diffusion models. However, these models need to generate nodes and edges in parallel from the same process, whose dimensionality is unnecessarily high. We propose NVDiff, which takes the VGAE structure and uses a score-based generative model (SGM) as a flexible prior to sample node vectors. By modeling only node vectors in the latent space, NVDiff significantly reduces the dimension of the diffusion process and thus improves sampling speed. Built on the NVDiff framework, we introduce an attention-based score network capable of capturing both local and global contexts of graphs. Experiments indicate that NVDiff significantly reduces computations and can model much larger graphs than competing methods. At the same time, it achieves superior or competitive performances over various datasets compared to previous methods.


title: A Large-Area RPC Detector for Muography

abstract: A muon telescope equipped with four Resistive Plate Chambers of 2 m$^{2}$ per plane was tested with the muon scattering tomography technique. The telescope was operated during several hours with high atomic number materials located at its center with two detector planes on each side. With an intrinsic efficiency above 98%, spatial resolution around 1 cm and detector planes spaced by 45 cm, it was possible to identify the presence of a 5 cm thick tungsten block in 10 minutes of acquisition. The results obtained after five hours of acquisition are also presented in this communication.


title: Quantifying Human Bias and Knowledge to guide ML models during Training

abstract: This paper discusses a crowdsourcing based method that we designed to quantify the importance of different attributes of a dataset in determining the outcome of a classification problem. This heuristic, provided by humans acts as the initial weight seed for machine learning models and guides the model towards a better optimal during the gradient descent process. Often times when dealing with data, it is not uncommon to deal with skewed datasets, that over represent items of certain classes, while underrepresenting the rest. Skewed datasets may lead to unforeseen issues with models such as learning a biased function or overfitting. Traditional data augmentation techniques in supervised learning include oversampling and training with synthetic data. We introduce an experimental approach to dealing with such unbalanced datasets by including humans in the training process. We ask humans to rank the importance of features of the dataset, and through rank aggregation, determine the initial weight bias for the model. We show that collective human bias can allow ML models to learn insights about the true population instead of the biased sample. In this paper, we use two rank aggregator methods Kemeny Young and the Markov Chain aggregator to quantify human opinion on importance of features. This work mainly tests the effectiveness of human knowledge on binary classification (Popular vs Not-popular) problems on two ML models: Deep Neural Networks and Support Vector Machines. This approach considers humans as weak learners and relies on aggregation to offset individual biases and domain unfamiliarity.


title: An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation

abstract: In the study, we empirically compare the two recently proposed decoding methods, i.e. Contrastive Search (CS) and Contrastive Decoding (CD), for open-ended text generation. The automatic evaluation results suggest that, while CS performs worse than CD on the MAUVE metric, it substantially surpasses CD on the diversity and coherence metrics. More notably, extensive human evaluations across three different domains demonstrate that human annotators are universally more in favor of CS over CD with substantial margins. The contradicted results between MAUVE and human evaluations reveal that MAUVE does not accurately reflect human preferences. Therefore, we call upon the research community to develop better evaluation metrics for open-ended text generation. To ensure the reproducibility of our work, we have open-sourced all our code, evaluation results, as well as human annotations at https://github.com/yxuansu/Contrastive_Search_versus_Contrastive_Decoding.


title: Input-to-State Stability of a Bilevel Proximal Gradient Descent Algorithm

abstract: This paper studies convergence properties of inexact iterative solution schemes for bilevel optimization problems. Bilevel optimization problems emerge in control-aware design optimization, where the system design parameters are optimized in the outer loop and a discrete-time control trajectory is optimized in the inner loop, but also arise in other domains including machine learning. In the paper an interconnection of proximal gradient algorithms is proposed to solve the inner loop and outer loop optimization problems in the setting of control-aware design optimization and robustness is analyzed from a control-theoretic perspective. By employing input-to-state stability arguments, conditions are derived that ensure convergence of the interconnected scheme to the optimal solution for a class of the bilevel optimization problem.


title: Light guided in tailored environments: from basic aspects to applications (Ph.D. thesis)

abstract: This dissertation is dedicated to investigating quantum optical effects involving single photons in tailored structures. It consists of six chapters and an appendix. The central part of the thesis starts with a chapter titled "Theoretical background" where the author introduces key quantum optical concepts needed for understanding the subsequent chapters. The next chapter is devoted to a discussion of the estimation of the Sellmeier coefficient in nonlinear crystals with the SPDC process. The accuracy and feasibility of the method are analysed in the context of the experimental results. The subsequent chapter is focused on the numerical modelling of the photon pair wavefunction generated in the SPDC process. In this chapter, the author presented a comparison between numerically predicted outcomes with the experimental results obtained in two different laboratory setups. The fifth chapter is devoted to modelling the modes of the bent waveguide, combining analytical considerations and numerical modelling. The correctness of the results is verified with numerical simulations obtained in COMSOL. In this chapter author emphasized the context of basic research: It is shown that the bent waveguide is described by equations analogous to the equations of the dynamics of a quantum particle in a space with axial symmetry. The appendix is devoted to the form of the differential operator in cylindrical coordinates, the analysis of the influence of photon propagation in the optical fibre on the photon wave function and the Schr\"odinger equation for a particle in two-dimensional space with axial symmetry.


title: Contraction theorem for generalized pairs

abstract: We use Koll\'ar's gluing theory to prove the contraction theorem for generalized pairs. In particular, we show that we can run the MMP for any generalized log canonical pairs.


title: Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training

abstract: Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually start from the pre-trained dense models and only focus on efficient inference, while time-consuming training is still unavoidable. In contrast, this paper points out that the million-scale training data is redundant, which is the fundamental reason for the tedious training. To address the issue, this paper aims to introduce sparsity into data and proposes an end-to-end efficient training framework from three sparse perspectives, dubbed Tri-Level E-ViT. Specifically, we leverage a hierarchical data redundancy reduction scheme, by exploring the sparsity under three levels: number of training examples in the dataset, number of patches (tokens) in each example, and number of connections between tokens that lie in attention weights. With extensive experiments, we demonstrate that our proposed technique can noticeably accelerate training for various ViT architectures while maintaining accuracy. Remarkably, under certain ratios, we are able to improve the ViT accuracy rather than compromising it. For example, we can achieve 15.2% speedup with 72.6% (+0.4) Top-1 accuracy on Deit-T, and 15.7% speedup with 79.9% (+0.1) Top-1 accuracy on Deit-S. This proves the existence of data redundancy in ViT.


title: An adaptive route choice model for integrated fixed and flexible transit systems

abstract: Over the past decade, there has been a surge of interest in the transport community in the application of agent-based simulation models to evaluate flexible transit solutions characterized by different degrees of short-term flexibility in routing and scheduling. A central modeling decision in the development of an agent-based simulation model for the evaluation of flexible transit is how one chooses to represent the mode- and route-choices of travelers. The real-time adaptive behavior of travelers is intuitively important to model in the presence of a flexible transit service, where the routing and scheduling of vehicles is highly dependent on supply-demand dynamics at a closer to real-time temporal resolution. We propose a utility-based transit route-choice model with representation of within-day adaptive travel behavior and between-day learning where station-based fixed-transit, flexible-transit, and active-mode alternatives may be dynamically combined in a single path. To enable experimentation, this route-choice model is implemented within an agent-based dynamic public transit simulation framework. Model properties are first explored in a choice between fixed- and flexible-transit modes for a toy network. The framework is then applied to illustrate level-of-service trade-offs and analyze traveler mode choices within a mixed fixed- and flexible transit system in a case study based on a real-life branched transit service in Stockholm, Sweden.


title: X-ray and optical spectroscopic study of a gamma Cassiopeiae analog source pi Aquarii

abstract: Gamma Cas analog sources are a subset of Be stars that emit intense and hard X-ray emission. Two competing ideas for their X-ray production mechanism are (a) the magnetic activities of the Be star and its disk and (b) the accretion from the Be star to an unidentified compact object. Among such sources, Pi Aqr plays a pivotal role as it is one of the only two spectroscopic binaries observed for many orbital cycles and one of the three sources with X-ray brightness sufficient for detailed X-ray spectroscopy. Bjorkman et al. (2002) estimated the secondary mass > 2.0 Mo with optical spectroscopy, which would argue against the compact object being a white dwarf (WD). However, their dynamical mass solution is inconsistent with an evolutionary solution and their radial velocity measurement is inconsistent with later work by Naze et al. (2019). We revisit this issue by adding a new data set with the NuSTAR X-ray observatory and the HIDES echelle spectrograph. We found that the radial velocity amplitude is consistent with Naze et al. (2019), which is only a half of that claimed by Bjorkman et al. (2002). Fixing the radial velocity amplitude of the primary, the secondary mass is estimated as < 1.4 Mo over an assumed range of the primary mass and the inclination angle. We further constrained the inclination angle and the secondary mass independently by fitting the X-ray spectra with a non-magnetic or magnetic accreting WD model under the assumption that the secondary is indeed a WD. The two results match well. We thus argue that the possibility of the secondary being a WD should not be excluded for pi Aqr.


title: Immersion graded index optics: theory, design, and prototypes

abstract: Immersion optics enable creation of systems with improved optical concentration and coupling by taking advantage of the fact that the luminance of light is proportional to the square of the refractive index in a lossless optical system. Immersion graded index optical concentrators, that do not need to track the source, are described in terms of theory, simulations, and experiments. We introduce a generalized design guide equation which follows the Pareto function and can be used to create various immersion graded index optics depending on the application requirements of concentration, refractive index, height, and efficiency. We present glass and polymer fabrication techniques for creating broadband transparent graded index materials with large refractive index ranges, (refractive index ratio)^2 of ~2, going many fold beyond what is seen in nature or the optics industry. The prototypes demonstrate 3x optical concentration with over 90% efficiency. We report via functional prototypes that graded-index-lens concentrators perform close to the theoretical maximum limit and we introduce simple, inexpensive, design-flexible, and scalable fabrication techniques for their implementation.


title: On the Pointwise Behavior of Recursive Partitioning and Its Implications for Heterogeneous Causal Effect Estimation

abstract: Decision tree learning is increasingly being used for pointwise inference. Important applications include causal heterogenous treatment effects and dynamic policy decisions, as well as conditional quantile regression and design of experiments, where tree estimation and inference is conducted at specific values of the covariates. In this paper, we call into question the use of decision trees (trained by adaptive recursive partitioning) for such purposes by demonstrating that they can fail to achieve polynomial rates of convergence in uniform norm with non-vanishing probability, even with pruning. Instead, the convergence may be arbitrarily slow or, in some important special cases, such as honest regression trees, fail completely. We show that random forests can remedy the situation, turning poor performing trees into nearly optimal procedures, at the cost of losing interpretability and introducing two additional tuning parameters. The two hallmarks of random forests, subsampling and the random feature selection mechanism, are seen to each distinctively contribute to achieving nearly optimal performance for the model class considered.


title: AiCEF: An AI-assisted Cyber Exercise Content Generation Framework Using Named Entity Recognition

abstract: Content generation that is both relevant and up to date with the current threats of the target audience is a critical element in the success of any Cyber Security Exercise (CSE). Through this work, we explore the results of applying machine learning techniques to unstructured information sources to generate structured CSE content. The corpus of our work is a large dataset of publicly available cyber security articles that have been used to predict future threats and to form the skeleton for new exercise scenarios. Machine learning techniques, like named entity recognition (NER) and topic extraction, have been utilised to structure the information based on a novel ontology we developed, named Cyber Exercise Scenario Ontology (CESO). Moreover, we used clustering with outliers to classify the generated extracted data into objects of our ontology. Graph comparison methodologies were used to match generated scenario fragments to known threat actors' tactics and help enrich the proposed scenario accordingly with the help of synthetic text generators. CESO has also been chosen as the prominent way to express both fragments and the final proposed scenario content by our AI-assisted Cyber Exercise Framework (AiCEF). Our methodology was put to test by providing a set of generated scenarios for evaluation to a group of experts to be used as part of a real-world awareness tabletop exercise.


title: Concept-based Explanations using Non-negative Concept Activation Vectors and Decision Tree for CNN Models

abstract: This paper evaluates whether training a decision tree based on concepts extracted from a concept-based explainer can increase interpretability for Convolutional Neural Networks (CNNs) models and boost the fidelity and performance of the used explainer. CNNs for computer vision have shown exceptional performance in critical industries. However, it is a significant barrier when deploying CNNs due to their complexity and lack of interpretability. Recent studies to explain computer vision models have shifted from extracting low-level features (pixel-based explanations) to mid-or high-level features (concept-based explanations). The current research direction tends to use extracted features in developing approximation algorithms such as linear or decision tree models to interpret an original model. In this work, we modify one of the state-of-the-art concept-based explanations and propose an alternative framework named TreeICE. We design a systematic evaluation based on the requirements of fidelity (approximate models to original model's labels), performance (approximate models to ground-truth labels), and interpretability (meaningful of approximate models to humans). We conduct computational evaluation (for fidelity and performance) and human subject experiments (for interpretability) We find that Tree-ICE outperforms the baseline in interpretability and generates more human readable explanations in the form of a semantic tree structure. This work features how important to have more understandable explanations when interpretability is crucial.


title: Combining State-of-the-Art Models with Maximal Marginal Relevance for Few-Shot and Zero-Shot Multi-Document Summarization

abstract: In Natural Language Processing, multi-document summarization (MDS) poses many challenges to researchers above those posed by single-document summarization (SDS). These challenges include the increased search space and greater potential for the inclusion of redundant information. While advancements in deep learning approaches have led to the development of several advanced language models capable of summarization, the variety of training data specific to the problem of MDS remains relatively limited. Therefore, MDS approaches which require little to no pretraining, known as few-shot or zero-shot applications, respectively, could be beneficial additions to the current set of tools available in summarization. To explore one possible approach, we devise a strategy for combining state-of-the-art models' outputs using maximal marginal relevance (MMR) with a focus on query relevance rather than document diversity. Our MMR-based approach shows improvement over some aspects of the current state-of-the-art results in both few-shot and zero-shot MDS applications while maintaining a state-of-the-art standard of output by all available metrics.


title: Heuristic Algorithm for Univariate Stratification Problem

abstract: In sampling theory, stratification corresponds to a technique used in surveys, which allows segmenting a population into homogeneous subpopulations (strata) to produce statistics with a higher level of precision. In particular, this article proposes a heuristic to solve the univariate stratification problem - widely studied in the literature. One of its versions sets the number of strata and the precision level and seeks to determine the limits that define such strata to minimize the sample size allocated to the strata. A heuristic-based on a stochastic optimization method and an exact optimization method was developed to achieve this goal. The performance of this heuristic was evaluated through computational experiments, considering its application in various populations used in other works in the literature, based on 20 scenarios that combine different numbers of strata and levels of precision. From the analysis of the obtained results, it is possible to verify that the heuristic had a performance superior to four algorithms in the literature in more than 94% of the cases, particularly concerning the known algorithms of Kozak and Lavallee-Hidiroglou.


title: The Viscosity of Polyelectrolyte Solutions and its Dependence on their Persistence Length, Concentration and Solvent Quality

abstract: In this work, a comprehensive study about the influence on shear viscosity of polyelectrolyte concentration, persistence length, salt concentration and solvent quality is reported, using numerical simulations of confined solutions under stationary Poiseuille flow. Various scaling regimes for the viscosity are reproduced, both under good solvent and theta solvent conditions. The key role played by the electrostatic interactions in the viscosity is borne out when the ionic strength is varied. It is argued that these results are helpful for the understanding of viscosity scaling in entangled polyelectrolyte solutions for both rigid and flexible polyelectrolytes in different solvents, which is needed to perform intelligent design of new polyelectrolytes capable of fine tuning the viscosity in complex fluids.


title: Nonlinear evolution of magnetorotational instability in a magnetized Taylor-Couette flow: scaling properties and relation to upcoming DRESDYN-MRI experiment

abstract: Magnetorotational instability (MRI) is the most likely mechanism driving angular momentum transport in astrophysical disks. However, despite many efforts, a conclusive experimental evidence of MRI is still missing. Recently, performing 1D linear analysis of the standard MRI (SMRI) in a cylindrical Taylor-Couette (TC) flow with an axial magnetic field, we showed that SMRI can be detected in the upcoming DRESDYN-MRI experiment based on a magnetized TC flow of liquid sodium. In this study, also related to DRESDYN-MRI experiments, we focused on the nonlinear evolution and saturation properties of SMRI and analyzed its scaling behavior with respect to the main parameters of the TC flow. We did a detailed analysis over the extensive ranges of magnetic Reynolds number $Rm\in [8.5, 37.1]$, Lundquist number $Lu\in[1.5, 15.5]$ and Reynolds number, $Re\in[10^3, 10^5]$. We considered small magnetic Prandtl numbers, $Pm \ll 1$, down to $Pm\sim 10^{-4}$, aiming at values typical of liquid sodium in the experiments. In the saturated state, the magnetic energy of SMRI and torque due to perturbations on the cylinders, which characterizes angular momentum transport, both increase with $Rm$ for fixed $(Lu, Re)$, while for fixed $(Lu, Rm)$, the magnetic energy decreases and torque increases with increasing $Re$. We studied the scaling of the magnetic energy and torque in the saturated state as a function of $Re$ and find a power law dependence $Re^{-0.6...-0.5}$ for the magnetic energy and $Re^{0.4...0.5}$ for the torque at all $(Lu, Rm)$ and high $Re\geq 4000$. We also explored the dependence on Lundquist number and angular velocity of the cylinders. These scaling laws will be instrumental in the subsequent analysis of more realistic finite-length TC flows and comparison of numerical results with those obtained from the DRESDYN-MRI experiments to unambiguously identify SMRI in laboratory.

categories: physics.flu-dyn astro-ph.EP astro-ph.HE astro-ph.SR physics.plasm-ph


title: Face Swapping as A Simple Arithmetic Operation

abstract: We propose a novel high-fidelity face swapping method called "Arithmetic Face Swapping" (AFS) that explicitly disentangles the intermediate latent space W+ of a pretrained StyleGAN into the "identity" and "style" subspaces so that a latent code in W+ is the sum of an "identity" code and a "style" code in the corresponding subspaces. Via our disentanglement, face swapping (FS) can be regarded as a simple arithmetic operation in W+, i.e., the summation of a source "identity" code and a target "style" code. This makes AFS more intuitive and elegant than other FS methods. In addition, our method can generalize over the standard face swapping to support other interesting operations, e.g., combining the identity of one source with styles of multiple targets and vice versa. We implement our identity-style disentanglement by learning a neural network that maps a latent code to a "style" code. We provide a condition for this network which theoretically guarantees identity preservation of the source face even after a sequence of face swapping operations. Extensive experiments demonstrate the advantage of our method over state-of-the-art FS methods in producing high-quality swapped faces. Our source code was made public at https://github.com/truongvu2000nd/AFS


title: The Effective Interfacial Tensions between Pure Liquids and Rough Solids: A Coarse-Grained Simulation Study

abstract: The effective solid liquid interfacial tension (SL IFT) between pure liquids and rough solid surfaces is studied through coarse grained simulations. Using the dissipative particle dynamics method, we design solid liquid interfaces, confining a pure liquid between two explicit solid surfaces with different roughness degrees. The roughness of the solid phase was characterized by Wenzel roughness factor and the effective SL IFT ({\gamma}_sl^') is reported as a function of it also. Two solid liquid systems differentiated from each other by their solid liquid repulsion strength are studied to measure the effects caused by the surface roughness on the calculation of {\gamma}_sl^'. We found that the roughness produces changes in the structure of the liquid, which is observed in the first layer of liquid near the solid. These changes are responsible for the effective SL IFT increase as surface roughness increases. Although there is a predominance of surface roughness in the calculation of {\gamma}_sl^', it is found that the effective SL IFT is directly proportional to the magnitude of the solid liquid repulsion strength. The insights provided by these simulations suggest that the increase of Wenzel roughness factor is a direct consequence of the increase in surface area due to the vertical deviations measured in the topography. This, in turn, produces an increase in the number of effective solid liquid interactions between particles, eventually yielding significant changes in the local values of the normal and tangential components of the pressure tensor.


title: Design and test of optical payload for polarization encoded QKD for Nanosatellites

abstract: Satellite based Quantum Key Distribution (QKD) in Low Earth Orbit (LEO) is currently the only viable technology to span thousands of kilometres. Since the typical overhead pass of a satellite lasts for a few minutes, it is crucial to increase the the signal rate to maximise the secret key length. For the QUARC CubeSat mission due to be launched within two years, we are designing a dual wavelength, weak-coherent-pulse decoy-state Bennett-Brassard '84 (WCP DS BB84) QKD source. The optical payload is designed in a $12{\times}9{\times}5 cm^3$ bespoke aluminium casing. The Discrete Variable QKD Source consists of two symmetric sources operating at 785 nm and 808 nm. The laser diodes are fixed to produce Horizontal,Vertical, Diagonal, and Anti-diagonal (H,V,D,A) polarisation respectively, which are combined and attenuated to a mean photon number of 0.3 and 0.5 photons/pulse. We ensure that the source is secure against most side channel attacks by spatially mode filtering the output beam and characterising their spectral and temporal characterstics. The extinction ratio of the source contributes to the intrinsic Qubit Error Rate(QBER) with $0.817 \pm 0.001\%$. This source operates at 200MHz, which is enough to provide secure key rates of a few kilo bits per second despite 40 dB of estimated loss in the free space channel


title: Non-stationary Risk-sensitive Reinforcement Learning: Near-optimal Dynamic Regret, Adaptive Detection, and Separation Design

abstract: We study risk-sensitive reinforcement learning (RL) based on an entropic risk measure in episodic non-stationary Markov decision processes (MDPs). Both the reward functions and the state transition kernels are unknown and allowed to vary arbitrarily over time with a budget on their cumulative variations. When this variation budget is known a prior, we propose two restart-based algorithms, namely Restart-RSMB and Restart-RSQ, and establish their dynamic regrets. Based on these results, we further present a meta-algorithm that does not require any prior knowledge of the variation budget and can adaptively detect the non-stationarity on the exponential value functions. A dynamic regret lower bound is then established for non-stationary risk-sensitive RL to certify the near-optimality of the proposed algorithms. Our results also show that the risk control and the handling of the non-stationarity can be separately designed in the algorithm if the variation budget is known a prior, while the non-stationary detection mechanism in the adaptive algorithm depends on the risk parameter. This work offers the first non-asymptotic theoretical analyses for the non-stationary risk-sensitive RL in the literature.


title: Regularity to Timoshenko's System with Thermoelasticity of Type III with Fractional Damping

abstract: The article, presents the study of the regularity of two thermoelastic beam systems defined by the Timoshenko beam model coupled with the heat conduction of Green-Naghdiy theory of type III, both mathematical models are differentiated by their coupling terms that arise as a consequence of the constitutive laws initially considered. The systems presented in this work have 3 fractional dampings: $\mu_1(-\Delta)^\tau \phi_t$, $\mu_2(-\Delta)^\sigma \psi_t$ and $K(-\Delta)^\xi \theta_t$, where $\phi,\psi$ and $\theta$ are transverse displacement, rotation angle and empirical temperature of the bean respectively and the parameters $(\tau,\sigma,\xi)\in [0,1]^3$. It is noted that for values 0 and 1 of the parameter $\tau$, the so-called frictional or viscous damping will be faced, respectively. The main contribution of this article is to show that the corresponding semigroup $S_i(t)=e^{\mathcal{B}_it}$, with $i=1,2$, is of Gevrey class $s>\frac{r+1}{2r}$ for $r=\min \{\tau,\sigma,\xi\}$ for all $(\tau,\sigma,\xi )\in R_{CG}:= (0, 1)^3$. It is also showed that $S_1(t)=e^{\mathcal{B}_1t}$ is analytic in the region $R_{A_1}:=\{(\tau,\sigma, \xi )\in [\frac{1}{2},1]^3\}$ and $S_2(t)=e^{\mathcal{B}_2t}$ is analytic in the region $R_{A_2}:=\{(\tau,\sigma, \xi )\in [\frac{1}{2},1]^3/ \tau=\xi\}$.


title: On estimation and prediction in a spatial semi-functional linear regression model

abstract: We tackle estimation and prediction at non-visted sites in a spatial semi-functional linear regression model with derivatives that combines a functional linear model with a nonparametric regression one. The parametric part is estimated by a method of moments and the other one by a local linear estimator. We establish the convergence rate of the resulting estimators and predictor. A simulation study and an application to ozone pollution prediction at non-visted sites are proposed to illustrate our results.


title: An Electromagnetic Calculation of Ionospheric Conductance that seems to Override the Field Line Integrated Conductivity

abstract: We derive a steady-state, electromagnetic solution for collisional plasma and apply it to computing the total conductance for a vertically stratified ionosphere interrogated by a 3D signal with finite transverse wavelength, which we compare to the field-line-integrated conductivity, finding significant differences on all scales investigated. The approximate solution is derived from an exact linearization of the electromagnetic 5-moment fluid equations, and writing down the integral form of the driven steady-state solution, which is expressed as a sum over modal contributions associated with the eigenvectors/eigenvalues of the set of equations. We find the eigenvectors/eigenvalues numerically and use them to argue that only two of the modes are capable of transmitting energy through the ionosphere. Approximating their integrands with analytic functions yields a solution valid for homogeneous plasma, expressed in terms of the eigenvectors/eigenvalues for the two modes. The solution may be understood using wavepacket concepts. Transmission line theory is then used to extend the homogeneous-plasma solution to a solution for the vertically-stratified ionosphere. We review how transmission line theory contains electrostatic theory as a special case, and show that our solution reproduces electrostatic theory exactly when the eigenvectors/eigenvalues have the right properties, which requires that they be artificially modified. Otherwise we find short-wavelength, mode-mixing, and wave-admittance effects with broad relevance to ionospheric science, and to global modeling of the Sun-Earth system. Since resonant systems can be very sensitive, quantitative accuracy may require tuning, but the physical conclusions seem unavoidable and to affect all transverse scales.


title: Block size estimation for data partitioning in HPC applications using machine learning techniques

abstract: The extensive use of HPC infrastructures and frameworks for running dataintensive applications has led to a growing interest in data partitioning techniques and strategies. In fact, application performance can be heavily affected by how data are partitioned, which in turn depends on the selected size for data blocks, i.e. the block size. Therefore, finding an effective partitioning, i.e. a suitable block size, is a key strategy to speed-up parallel data-intensive applications and increase scalability. This paper describes a methodology, namely BLEST-ML (BLock size ESTimation through Machine Learning), for block size estimation that relies on supervised machine learning techniques. The proposed methodology was evaluated by designing an implementation tailored to dislib, a distributed computing library highly focused on machine learning algorithms built on top of the PyCOMPSs framework. We assessed the effectiveness of the provided implementation through an extensive experimental evaluation considering different algorithms from dislib, datasets, and infrastructures, including the MareNostrum 4 supercomputer. The results we obtained show the ability of BLEST-ML to efficiently determine a suitable way to split a given dataset, thus providing a proof of its applicability to enable the efficient execution of data-parallel applications in high performance environments.


title: Black holes and the nature of the event horizon

abstract: The problem of the event horizon in relativistic gravity is discussed. Singular solutions in general relativity are well known. The Schwarschild metric of a spherical mass is singular at zero ($r = 0$) and at the event horizon ($r = r_g$). Both features reflect the existence of the phenomenon of collapse in general relativity for compact masses exceeding $3M_{\odot }$. A material particle crossing the event horizon falls into a central singularity according to the classical theory of general relativity. In the quantum theory of gravity, there may be no central singularity. The physics of the event horizon is currently being refined. A promising technique is the study of gravitational waves (GW) accompanying the merger of binary black holes at the ringdown stage. GW observations of quasi-normal modes of the newly formed super dense remnant will help clarify the physics of the event horizon.


title: DeepGAR: Deep Graph Learning for Analogical Reasoning

abstract: Analogical reasoning is the process of discovering and mapping correspondences from a target subject to a base subject. As the most well-known computational method of analogical reasoning, Structure-Mapping Theory (SMT) abstracts both target and base subjects into relational graphs and forms the cognitive process of analogical reasoning by finding a corresponding subgraph (i.e., correspondence) in the target graph that is aligned with the base graph. However, incorporating deep learning for SMT is still under-explored due to several obstacles: 1) the combinatorial complexity of searching for the correspondence in the target graph; 2) the correspondence mining is restricted by various cognitive theory-driven constraints. To address both challenges, we propose a novel framework for Analogical Reasoning (DeepGAR) that identifies the correspondence between source and target domains by assuring cognitive theory-driven constraints. Specifically, we design a geometric constraint embedding space to induce subgraph relation from node embeddings for efficient subgraph search. Furthermore, we develop novel learning and optimization strategies that could end-to-end identify correspondences that are strictly consistent with constraints driven by the cognitive theory. Extensive experiments are conducted on synthetic and real-world datasets to demonstrate the effectiveness of the proposed DeepGAR over existing methods.


title: Center-Outward Multiple-Output Lorenz Curves and Gini Indices a measure transportation approach

abstract: Based on measure transportation ideas and the related concepts of center-outward quantile functions, we propose multiple-output center-outward generalizations of the traditional univariate concepts of Lorenz and concentration functions, and the related Gini and Kakwani coefficients. These new concepts have a natural interpretation, either in terms of contributions of central ("middle-class") regions to the expectation of some variable of interest, or in terms of the physical notions of work and energy, which sheds new light on the nature of economic and social inequalities. Importantly, the proposed concepts pave the way to statistically sound definitions, based on multiple variables, of quantiles and quantile regions, and the concept of "middle class," of high relevance in various socio-economic contexts.


title: PATHFINDER: Designing Stimuli for Neuromodulation through data-driven inverse estimation of non-linear functions

abstract: There has been tremendous interest in designing stimuli (e.g. electrical currents) that produce desired neural responses, e.g., for inducing therapeutic effects for treatments. Traditionally, the design of such stimuli has been model-driven. Due to challenges inherent in modeling neural responses accurately, data-driven approaches offer an attractive alternative. The problem of data-driven stimulus design can be thought of as estimating an inverse of a non-linear ``forward" mapping, which takes in as inputs the stimulus parameters and outputs the corresponding neural responses. In most cases of interest, the forward mapping is many-to-one, and hence difficult to invert using traditional methods. Existing methods estimate the inverse by using conditional density estimation methods or numerically inverting an estimated forward mapping, but both approaches tend to perform poorly at small sample sizes. In this work, we develop a new optimization framework called PATHFINDER, which allows us to use regression methods for estimating an inverse mapping. We use toy examples to illustrate key aspects of PATHFINDER, and show, on computational models of biological neurons, that PATHFINDER can outperform existing methods at small sample sizes. The data-efficiency of PATHFINDER is especially valuable in stimulus design as collecting data is expensive in this domain.


title: Hybrid Auxiliary Field Quantum Monte Carlo for Molecular Systems

abstract: We propose a quantum Monte Carlo approach to solve the ground state many-body Schrodinger equation for the electronic ground state. The method combines optimization from variational Monte Carlo and propagation from auxiliary field quantum Monte Carlo, in a way that significantly alleviates the sign problem. In application to molecular systems, we obtain highly accurate results for configurations dominated by either dynamic or static electronic correlation.


title: Identifiability of dynamic networks: the essential r\^ole of dources and dinks

abstract: The paper [1] presented the first results on generic identifiability of dynamic networks with partial excitation and partial measurements, i.e. networks where not all nodes are excited or not all nodes are measured. One key contribution of that paper was to establish a set of necessary conditions on the excitation and measurement pattern (EMP) that guarantee generic identifiability. In a nutshell, these conditions established that all sources must be excited and all sinks measured, and that all other nodes must be either excited or measured. In the present paper, we show that two other types of nodes, which are defined by the local topology of the network, play an essential r\^ole in the search for a valid EMP, i.e. one that guarantees generic identifiability. We have called these nodes dources and dinks. We show that a network is generically identifiable only if, in addition to the above mentioned conditions, all dources are excited and all dinks are measured. We also show that sources and dources are the only nodes in a network that always need to be excited, and that sinks and dinks are the only nodes that need to be measured for an EMP to be valid.


title: On the wave turbulence theory of 2D gravity waves, I: deterministic energy estimates

abstract: Our goal in this paper is to initiate the rigorous investigation of wave turbulence and derivation of wave kinetic equations (WKE) for water waves models. This problem has received intense attention in recent years in the context of semilinear models, such as semilinear Schr\"odinger equations or multi-dimensional KdV-type equations. However, our situation here is different since the water waves equations are quasilinear and the solutions cannot be constructed by iteration of the Duhamel formula due to unavoidable derivative loss. This is the first of two papers in which we design a new strategy to address this issue, in the context of 2D gravity waves.


title: Structure-Enhanced Deep Reinforcement Learning for Optimal Transmission Scheduling

abstract: Remote state estimation of large-scale distributed dynamic processes plays an important role in Industry 4.0 applications. In this paper, by leveraging the theoretical results of structural properties of optimal scheduling policies, we develop a structure-enhanced deep reinforcement learning (DRL) framework for optimal scheduling of a multi-sensor remote estimation system to achieve the minimum overall estimation mean-square error (MSE). In particular, we propose a structure-enhanced action selection method, which tends to select actions that obey the policy structure. This explores the action space more effectively and enhances the learning efficiency of DRL agents. Furthermore, we introduce a structure-enhanced loss function to add penalty to actions that do not follow the policy structure. The new loss function guides the DRL to converge to the optimal policy structure quickly. Our numerical results show that the proposed structure-enhanced DRL algorithms can save the training time by 50% and reduce the remote estimation MSE by 10% to 25%, when compared to benchmark DRL algorithms.

categories: cs.IT cs.AI cs.LG cs.SY eess.SP eess.SY math.IT


title: Instability in clinical risk stratification models using deep learning

abstract: While it has been well known in the ML community that deep learning models suffer from instability, the consequences for healthcare deployments are under characterised. We study the stability of different model architectures trained on electronic health records, using a set of outpatient prediction tasks as a case study. We show that repeated training runs of the same deep learning model on the same training data can result in significantly different outcomes at a patient level even though global performance metrics remain stable. We propose two stability metrics for measuring the effect of randomness of model training, as well as mitigation strategies for improving model stability.


title: Depositing boron on Cu(111): Borophene or boride?

abstract: Large-area single-crystal surface structures were successfully prepared on Cu(111) substrate with boron deposition, which is critical for prospective applications. However, the proposed borophene structures do not match the scanning tunneling microscopy (STM) results very well, while the proposed copper boride is at odds with the traditional knowledge that ordered copper-rich borides normally do not exist due to small difference in electronegativity and large difference in atomic size. To clarify the controversy and elucidate the formation mechanism of the unexpected copper boride, we conducted systematic STM, X-ray photoelectron spectroscopy and angle-resolved photoemission spectroscopy investigations, confirming the synthesis of two-dimensional copper boride rather than borophene on Cu(111) after boron deposition under ultrahigh vacuum. First-principles calculations with defective surface models further indicate that boron atoms tend to react with Cu atoms near terrace edges or defects, which in turn shapes the intermediate structures of copper boride and leads to the formation of stable Cu-B monolayer via large-scale surface reconstruction eventually.


title: Discrete Lagrangian Neural Networks with Automatic Symmetry Discovery

abstract: By one of the most fundamental principles in physics, a dynamical system will exhibit those motions which extremise an action functional. This leads to the formation of the Euler-Lagrange equations, which serve as a model of how the system will behave in time. If the dynamics exhibit additional symmetries, then the motion fulfils additional conservation laws, such as conservation of energy (time invariance), momentum (translation invariance), or angular momentum (rotational invariance). To learn a system representation, one could learn the discrete Euler-Lagrange equations, or alternatively, learn the discrete Lagrangian function $\mathcal{L}_d$ which defines them. Based on ideas from Lie group theory, in this work we introduce a framework to learn a discrete Lagrangian along with its symmetry group from discrete observations of motions and, therefore, identify conserved quantities. The learning process does not restrict the form of the Lagrangian, does not require velocity or momentum observations or predictions and incorporates a cost term which safeguards against unwanted solutions and against potential numerical issues in forward simulations. The learnt discrete quantities are related to their continuous analogues using variational backward error analysis and numerical results demonstrate the improvement such models can have both qualitatively and quantitatively even in the presence of noise.


title: Joint Embedding Predictive Architectures Focus on Slow Features

abstract: Many common methods for learning a world model for pixel-based environments use generative architectures trained with pixel-level reconstruction objectives. Recently proposed Joint Embedding Predictive Architectures (JEPA) offer a reconstruction-free alternative. In this work, we analyze performance of JEPA trained with VICReg and SimCLR objectives in the fully offline setting without access to rewards, and compare the results to the performance of the generative architecture. We test the methods in a simple environment with a moving dot with various background distractors, and probe learned representations for the dot's location. We find that JEPA methods perform on par or better than reconstruction when distractor noise changes every time step, but fail when the noise is fixed. Furthermore, we provide a theoretical explanation for the poor performance of JEPA-based methods with fixed noise, highlighting an important limitation.


title: NeuroSketch: Fast and Approximate Evaluation of Range Aggregate Queries with Neural Networks

abstract: Range aggregate queries (RAQs) are an integral part of many real-world applications, where, often, fast and approximate answers for the queries are desired. Recent work has studied answering RAQs using machine learning (ML) models, where a model of the data is learned to answer the queries. However, there is no theoretical understanding of why and when the ML based approaches perform well. Furthermore, since the ML approaches model the data, they fail to capitalize on any query specific information to improve performance in practice. In this paper, we focus on modeling ``queries'' rather than data and train neural networks to learn the query answers. This change of focus allows us to theoretically study our ML approach to provide a distribution and query dependent error bound for neural networks when answering RAQs. We confirm our theoretical results by developing NeuroSketch, a neural network framework to answer RAQs in practice. Extensive experimental study on real-world, TPC-benchmark and synthetic datasets show that NeuroSketch answers RAQs multiple orders of magnitude faster than state-of-the-art and with better accuracy.


title: A two dimensional fluid model for TCP/AQM analysis

abstract: This work proposes a new mathematical model for the TCP/AQM system that aims to improve the accuracy of existing fluid models, especially with respect to the sequential events that occur in the network. The analysis is based on the consideration of two time bases, one at the queue's router level and the other at the congestion window level, which leads to the derivation of a new nonlinear two-dimensional fluid model for Internet congestion control. To avoid the difficult task of assessing stability of a 2D nonlinear dynamic model, we perform a local stability analysis of a 2D linear TCP AQM model. By constructing a new two dimensional second order Bessel Legendre Lyapunov functional, new matrix inequalities are derived to evaluate the stability of the 0-input system and to synthesize a feedback controller. Finally, two Internet traffic scenarios, with state space matrices for replicability, are presented, demonstrating the validity of the theoretical results.


title: Investigation of the tetraquark states $Qq\bar{Q} \bar{q}$ in the improved chromomagnetic interaction model

abstract: In the framework of the improved chromomagnetic interaction model, we complete a systematic study of the $S$-wave tetraquark states $Qq\bar{Q}\bar{q}$ ($Q=c,b$, and $q=u,d,s$) with different quantum numbers, $J^{PC}=0^{+(+)}$, $1^{+(\pm)}$, and $2^{+(+)}$. The mass spectra of tetraquark states are predicted and the possible decay channels are analyzed by considering both the angular momentum and $\mathcal{C}$-parity conservation. The recently observed hidden-charm tetraquark states with strangeness, such as $Z_{cs}(3985)^-$, $X(3960)$, and $Z_{cs}(4220)^+$, can be well explained in our model. Besides, based on the wave function of each tetraquark state, we find that the low-lying states of each $Qq\bar{Q}\bar{q}$ configuration have a large overlap to the $Q\bar Q$ and $q\bar q$ meson basis, instead of $Q\bar q$ and $q\bar Q$ meson basis. This indicates one can search these tetraquark states in future experiments via the channel of $Q\bar Q$ and $q\bar q$ mesons.


title: Context-aware learning of hierarchies of low-fidelity models for multi-fidelity uncertainty quantification

abstract: Multi-fidelity Monte Carlo methods leverage low-fidelity and surrogate models for variance reduction to make tractable uncertainty quantification even when numerically simulating the physical systems of interest with high-fidelity models is computationally expensive. This work proposes a context-aware multi-fidelity Monte Carlo method that optimally balances the costs of training low-fidelity models with the costs of Monte Carlo sampling. It generalizes the previously developed context-aware bi-fidelity Monte Carlo method to hierarchies of multiple models and to more general types of low-fidelity models. When training low-fidelity models, the proposed approach takes into account the context in which the learned low-fidelity models will be used, namely for variance reduction in Monte Carlo estimation, which allows it to find optimal trade-offs between training and sampling to minimize upper bounds of the mean-squared errors of the estimators for given computational budgets. This is in stark contrast to traditional surrogate modeling and model reduction techniques that construct low-fidelity models with the primary goal of approximating well the high-fidelity model outputs and typically ignore the context in which the learned models will be used in upstream tasks. The proposed context-aware multi-fidelity Monte Carlo method applies to hierarchies of a wide range of types of low-fidelity models such as sparse-grid and deep-network models. Numerical experiments with the gyrokinetic simulation code \textsc{Gene} show speedups of up to two orders of magnitude compared to standard estimators when quantifying uncertainties in small-scale fluctuations in confined plasma in fusion reactors. This corresponds to a runtime reduction from 72 days to about four hours on one node of the Lonestar6 supercomputer at the Texas Advanced Computing Center.

categories: math.NA cs.LG cs.NA physics.comp-ph stat.CO


title: Natural parameter conditions for singular perturbations of chemical and biochemical reaction networks

abstract: We consider reaction networks that admit a singular perturbation reduction in a certain parameter range. The focus of this paper is on deriving "small parameters" (briefly for small perturbation parameters), to gauge the accuracy of the reduction, in a manner that is consistent, amenable to computation and permits an interpretation in chemical or biochemical terms. Our work is based on local timescale estimates via ratios of the real parts of eigenvalues of the Jacobian near critical manifolds. This approach modifies the one introduced by Segel and Slemrod and is familiar from computational singular perturbation theory. While parameters derived by this method cannot provide universal quantitative estimates for the accuracy of a reduction, they represent a critical first step toward this end. Working directly with eigenvalues is generally unfeasible, and at best cumbersome. Therefore we focus on the coefficients of the characteristic polynomial to derive parameters, and relate them to timescales. Thus, we obtain distinguished parameters for systems of arbitrary dimension, with particular emphasis on reduction to dimension one. As a first application, we discuss the Michaelis--Menten reaction mechanism system in various settings, with new and perhaps surprising results. We proceed to investigate more complex enzyme catalyzed reaction mechanisms (uncompetitive, competitive inhibition and cooperativity) of dimension three, with reductions to dimension one and two. The distinguished parameters we derive for these three-dimensional systems are new. In fact, no rigorous derivation of small parameters seems to exist in the literature so far. Numerical simulations are included to illustrate the efficacy of the parameters obtained, but also to show that certain limitations must be observed.


title: Non-reversible Parallel Tempering for Deep Posterior Approximation

abstract: Parallel tempering (PT), also known as replica exchange, is the go-to workhorse for simulations of multi-modal distributions. The key to the success of PT is to adopt efficient swap schemes. The popular deterministic even-odd (DEO) scheme exploits the non-reversibility property and has successfully reduced the communication cost from $O(P^2)$ to $O(P)$ given sufficiently many $P$ chains. However, such an innovation largely disappears in big data due to the limited chains and few bias-corrected swaps. To handle this issue, we generalize the DEO scheme to promote non-reversibility and propose a few solutions to tackle the underlying bias caused by the geometric stopping time. Notably, in big data scenarios, we obtain an appealing communication cost $O(P\log P)$ based on the optimal window size. In addition, we also adopt stochastic gradient descent (SGD) with large and constant learning rates as exploration kernels. Such a user-friendly nature enables us to conduct approximation tasks for complex posteriors without much tuning costs.


title: Tate classes and endoscopy for $\operatorname{GSp}_4$ over totally real fields

abstract: The theory of endoscopy predicts the existence of large families of Tate classes on certain products of Shimura varieties, and it is natural to ask in what cases one can construct algebraic cycles giving rise to these Tate classes. This paper takes up the case of Tate classes arising from the Yoshida lift: these are Tate cycles in middle degree on the Shimura variety for the group $\operatorname{Res}_{F/\mathbb Q} (\operatorname{GL}_2 \times \operatorname{GSp}_4)$, where $F$ is a totally real field. A special case is the family of Tate classes which reflect the appearance of two-dimensional Galois representations in the middle cohomology of both a modular curve and a Siegel modular threefold. We show that a natural algebraic cycle generates exactly the Tate classes which are associated to \emph{generic} members of the endoscopic $L$-packets on $\operatorname{GSp}_{4,F}$. In the non-generic case, we give an alternate construction, which shows that the predicted Tate classes arise from Hodge cycles.


title: Pseudo-value regression of clustered multistate current status data with informative cluster sizes

abstract: Multistate current status (CS) data presents a more severe form of censoring due to the single observation of study participants transitioning through a sequence of well-defined disease states at random inspection times. Moreover, these data may be clustered within specified groups, and informativeness of the cluster sizes may arise due to the existing latent relationship between the transition outcomes and the cluster sizes. Failure to adjust for this informativeness may lead to a biased inference. Motivated by a clinical study of periodontal disease (PD), we propose an extension of the pseudo-value approach to estimate covariate effects on the state occupation probabilities (SOP) for these clustered multistate CS data with informative cluster or intra-cluster group sizes. In our approach, the proposed pseudo-value technique initially computes marginal estimators of the SOP utilizing nonparametric regression. Next, the estimating equations based on the corresponding pseudo-values are reweighted by functions of the cluster sizes to adjust for informativeness. We perform a variety of simulation studies to study the properties of our pseudo-value regression based on the nonparametric marginal estimators under different scenarios of informativeness. For illustration, the method is applied to the motivating PD dataset, which encapsulates the complex data-generation mechanism.


title: Macroscopic quantum correlation in a delayed-choice quantum eraser scheme

abstract: Quantum entanglement is known as a unique feature of quantum mechanics, which cannot be obtained from classical physics. Recently, a coherence interpretation has been conducted for the delayed-choice quantum eraser using coherent photon pairs, where phase-locked symmetric frequency detuning between paired photons plays an essential role for selective measurement-caused nonlocal correlation. Here, a macroscopic version of the nonlocal correlation is presented using orthogonally polarized optical fields in a continuous wave quantum eraser scheme in a Mach-Zehnder interferometer (MZI). The resulting polarization projection of each MZI output fields onto a rotated polarizer satisfies the violation of the cause-effect relation. Based on this macroscopic quantum eraser, the intensity product between two projected output fields satisfies the inseparable joint-parameter relation if the intensity product is selectively measured through a low pass filter to block beating signals between them.


title: SeDR: Segment Representation Learning for Long Documents Dense Retrieval

abstract: Recently, Dense Retrieval (DR) has become a promising solution to document retrieval, where document representations are used to perform effective and efficient semantic search. However, DR remains challenging on long documents, due to the quadratic complexity of its Transformer-based encoder and the finite capacity of a low-dimension embedding. Current DR models use suboptimal strategies such as truncating or splitting-and-pooling to long documents leading to poor utilization of whole document information. In this work, to tackle this problem, we propose Segment representation learning for long documents Dense Retrieval (SeDR). In SeDR, Segment-Interaction Transformer is proposed to encode long documents into document-aware and segment-sensitive representations, while it holds the complexity of splitting-and-pooling and outperforms other segment-interaction patterns on DR. Since GPU memory requirements for long document encoding causes insufficient negatives for DR training, Late-Cache Negative is further proposed to provide additional cache negatives for optimizing representation learning. Experiments on MS MARCO and TREC-DL datasets show that SeDR achieves superior performance among DR models, and confirm the effectiveness of SeDR on long document retrieval.


title: Crossed modules, non-abelian extensions of associative conformal algebras and Wells exact sequences

abstract: In this paper, we introduce the notions of crossed module of associative conformal algebras, 2-term strongly homotopy associative conformal algebras, and discuss the relationship between them and the 3-th Hochschild cohomology of associative conformal algebras. We classify the non-abelian extensions by introducing the non-abelian cohomology. We show that non-abelian extensions of an associative conformal algebra can be viewed as Maurer-Cartan elements of a suitable differential graded Lie algebra, and prove that the Deligne groupoid of this differential graded Lie algebra corresponds one to one with the non-abelian cohomology. Based on this classification, we study the inducibility of a pair of automorphisms about a non-abelian extension of associative conformal algebras, and give the fundamental sequence of Wells in the context of associative conformal algebras. Finally, we consider the extensibility of a pair of derivations about an abelian extension of associative conformal algebras, and give an exact sequence of Wells type.


title: Mask Off: Analytic-based Malware Detection By Transfer Learning and Model Personalization

abstract: The vulnerability of smartphones to cyberattacks has been a severe concern to users arising from the integrity of installed applications (\textit{apps}). Although applications are to provide legitimate and diversified on-the-go services, harmful and dangerous ones have also uncovered the feasible way to penetrate smartphones for malicious behaviors. Thorough application analysis is key to revealing malicious intent and providing more insights into the application behavior for security risk assessments. Such in-depth analysis motivates employing deep neural networks (DNNs) for a set of features and patterns extracted from applications to facilitate detecting potentially dangerous applications independently. This paper presents an Analytic-based deep neural network, Android Malware detection (ADAM), that employs a fine-grained set of features to train feature-specific DNNs to have consensus on the application labels when their ground truth is unknown. In addition, ADAM leverages the transfer learning technique to obtain its adjustability to new applications across smartphones for recycling the pre-trained model(s) and making them more adaptable by model personalization and federated learning techniques. This adjustability is also assisted by federated learning guards, which protect ADAM against poisoning attacks through model analysis. ADAM relies on a diverse dataset containing more than 153000 applications with over 41000 extracted features for DNNs training. The ADAM's feature-specific DNNs, on average, achieved more than 98% accuracy, resulting in an outstanding performance against data manipulation attacks.


title: Learning to Generate Image Embeddings with User-level Differential Privacy

abstract: Small on-device models have been successfully trained with user-level differential privacy (DP) for next word prediction and image classification tasks in the past. However, existing methods can fail when directly applied to learn embedding models using supervised training data with a large class space. To achieve user-level DP for large image-to-embedding feature extractors, we propose DP-FedEmb, a variant of federated learning algorithms with per-user sensitivity control and noise addition, to train from user-partitioned data centralized in the datacenter. DP-FedEmb combines virtual clients, partial aggregation, private local fine-tuning, and public pretraining to achieve strong privacy utility trade-offs. We apply DP-FedEmb to train image embedding models for faces, landmarks and natural species, and demonstrate its superior utility under same privacy budget on benchmark datasets DigiFace, EMNIST, GLD and iNaturalist. We further illustrate it is possible to achieve strong user-level DP guarantees of $\epsilon<4$ while controlling the utility drop within 5%, when millions of users can participate in training.


title: Behavior of a Chiral Condensate Around Astrophysical-Mass Schwarschild and Reissner-Nordstr\"om Black Holes

abstract: In this work, we develop a perturbative method to describe the behavior of a chiral condensate around a spherical black hole whose mass is astrophysically realistic. We use the inverse mass as the expansion parameter for our perturbative series. We test this perturbative method in the case of a Schwarzschild black hole, and we find that it agrees well with previous numerical results. For an astrophysical-mass Schwarzschild black hole, the leading order contribution to the condensate is much larger (in most of space) than the next-to-leading order contribution, providing further evidence for the validity of the perturbative approach. The size of the bubble of restored chiral symmetry is directly proportional to the size of the black hole. Next, we apply this perturbative method to a Reissner-Nordstr\"om (RN) black hole. We find that, as the charge-to-mass ratio increases, the bubble of restored chiral symmetry becomes larger relative to the black hole. This effect is particularly pronounced for near-extremal RN black holes. The case of an extremal RN black hole provides an interesting counterexample to the standard thermal explanation for the formation of a bubble of restored chiral symmetry around a black hole.


title: An integral-like numerical approach for solving Burgers' equation

abstract: An unconventional approach is applied to solve the one-dimensional Burgers' equation. It is based on spline polynomial interpolations and Hopf-Cole transformation. Taylor expansion is used to approximate the exponential term in the transformation, then the analytical solution of the simplified equation is discretized to form a numerical scheme, involving various special functions. The derived scheme is explicit and adaptable for parallel computing. However, some types of boundary condition cannot be specified straightforwardly. Three test cases were employed to examine its accuracy, stability, and parallel scalability. In the aspect of accuracy, the schemes employed cubic and quintic spline interpolation performs equally well, managing to reduce the $\ell_{1}$, $\ell_{2}$ and $\ell_{\infty}$ error norms down to the order of $10^{-4}$. Due to the transformation, their stability condition $\nu \Delta t/\Delta x^2 > 0.02$ includes the viscosity/diffusion coefficient $\nu$. From the condition, the schemes can run at a large time step size $\Delta t$ even when grid spacing $\Delta x$ is small. These characteristics suggest that the method is more suitable for operational use than for research purposes.