title: The cutoff profile for exclusion processes in any dimension

abstract: Consider symmetric simple exclusion processes, with or without Glauber dynamics on the boundary set, on a sequence of connected unweighted graphs $G_N=(V_N,E_N)$ which converge geometrically and spectrally to a compact connected metric measure space. Under minimal assumptions, we prove not only that total variation cutoff occurs at times $t_N=\log|V_N|/(2\lambda^N_1)$, where $|V_N|$ is the cardinality of $V_N$, and $\lambda^N_1$ is the lowest nonzero eigenvalue of the nonnegative graph Laplacian; but also the limit profile for the total variation distance to stationarity. The assumptions are shown to hold on the $D$-dimensional Euclidean lattices for any $D\geq 1$, as well as on self-similar fractal spaces. Our approach is decidedly analytic and does not use extensive coupling arguments. We identify a new observable in the exclusion process -- the cutoff semimartingales -- obtained by scaling and shifting the density fluctuation fields. Using the entropy method, we prove a functional CLT for the cutoff semimartingales converging to an infinite-dimensional Brownian motion, provided that the process is started from a deterministic configuration or from stationarity. This reduces the original problem to computing the total variation distance between the two versions of Brownian motions, which share the same covariance and whose initial conditions differ only in the coordinates corresponding to the first eigenprojection.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Deep Unfolding of Iteratively Reweighted ADMM for Wireless RF Sensing

abstract: We address the detection of material defects, which are inside a layered material structure using compressive sensing based multiple-input and multiple-output (MIMO) wireless radar. Here, the strong clutter due to the reflection of the layered structure's surface often makes the detection of the defects challenging. Thus, sophisticated signal separation methods are required for improved defect detection. In many scenarios, the number of defects that we are interested in is limited and the signaling response of the layered structure can be modeled as a low-rank structure. Therefore, we propose joint rank and sparsity minimization for defect detection. In particular, we propose a non-convex approach based on the iteratively reweighted nuclear and $\ell_1-$norm (a double-reweighted approach) to obtain a higher accuracy compared to the conventional nuclear norm and $\ell_1-$norm minimization. To this end, an iterative algorithm is designed to estimate the low-rank and sparse contributions. Further, we propose deep learning to learn the parameters of the algorithm (i.e., algorithm unfolding) to improve the accuracy and the speed of convergence of the algorithm. Our numerical results show that the proposed approach outperforms the conventional approaches in terms of mean square errors of the recovered low-rank and sparse components and the speed of convergence.

categories: eess.SP cs.CV cs.IT cs.LG math.IT stat.ML


title: Renormalon subtraction in OPE using Fourier transform: Formulation and application to various observables

abstract: Properly separating and subtracting renormalons in the framework of the operator product expansion (OPE) is a way to realize high precision computation of QCD effects in high energy physics. We propose a new method (FTRS method), which enables to subtract multiple renormalons simultaneously from a general observable. It utilizes a property of Fourier transform, and the leading Wilson coefficient is written in a one-parameter integral form whose integrand has suppressed (or vanishing) renormalons. The renormalon subtraction scheme coincides with the usual principal-value prescription at large orders. We perform test analyses and subtract the ${\cal O}(\Lambda_{\rm QCD}^4)$ renormalon from the Adler function, the ${\cal O}(\Lambda_{\rm QCD}^2)$ renormalon from the $B\to X_ul\bar{\nu}$ decay width, and the ${\cal O}(\Lambda_{\rm QCD})$ and ${\cal O}(\Lambda_{\rm QCD}^2)$ renormalons from the $B,\,D$ meson masses. The analyses show good consistency with theoretical expectations, such as improved convergence and scale dependence. In particular we obtain $\bar{\Lambda}_{\rm FTRS}=0.495\pm0.053~\text{GeV}$ and$ (\mu_\pi^2)_{\rm FTRS}=-0.12\pm 0.23~\text{GeV}^2$ for the non-perturbative parameters of HQET. We explain the formulation and analyses in detail.


title: A Computational Model of Representation Learning in the Brain Cortex, Integrating Unsupervised and Reinforcement Learning

abstract: A common view on the brain learning processes proposes that the three classic learning paradigms -- unsupervised, reinforcement, and supervised -- take place in respectively the cortex, the basal-ganglia, and the cerebellum. However, dopamine outbursts, usually assumed to encode reward, are not limited to the basal ganglia but also reach prefrontal, motor, and higher sensory cortices. We propose that in the cortex the same reward-based trial-and-error processes might support not only the acquisition of motor representations but also of sensory representations. In particular, reward signals might guide trial-and-error processes that mix with associative learning processes to support the acquisition of representations better serving downstream action selection. We tested the soundness of this hypothesis with a computational model that integrates unsupervised learning (Contrastive Divergence) and reinforcement learning (REINFORCE). The model was tested with a task requiring different responses to different visual images grouped in categories involving either colour, shape, or size. Results show that a balanced mix of unsupervised and reinforcement learning processes leads to the best performance. Indeed, excessive unsupervised learning tends to under-represent task-relevant features while excessive reinforcement learning tends to initially learn slowly and then to incur in local minima. These results stimulate future empirical studies on category learning directed to investigate similar effects in the extrastriate visual cortices. Moreover, they prompt further computational investigations directed to study the possible advantages of integrating unsupervised and reinforcement learning processes.


title: Fully {\it ab-initio} electronic structure of Ca$_{2}$RuO$_{4}$

abstract: The reliable {\it ab-initio} description of strongly correlated materials is a long-sought capability in condensed matter physics. The $GW$+EDMFT method is a promising scheme, which provides a self-consistent description of correlations and screening, and does not require user-provided parameters. In order to test the reliability of this approach we apply it to the experimentally well characterized perovskite compound Ca$_2$RuO$_4$, in which a temperature-dependent structural deformation drives a paramagnetic metal-insulator transition. Our results demonstrate that the nonlocal polarization and self-energy components introduced by $GW$ are essential for setting the correct balance between interactions and bandwidths, and that the $GW$+EDMFT scheme produces remarkably accurate predictions of the electronic properties of this strongly correlated material.


title: Accelerated Corrosion of High Entropy Alloys under Tensile Stress

abstract: High entropy alloys are finding significant scientific interest due to their exotic microstructures and exceptional properties resulting thereof. These alloys have excellent corrosion resistance and may find broad range of applications from bio-implants, aerospace components and nuclear industry. A critical performance metric that determines the application worthiness of the alloys is the resilience of stressed structural members in a corrosive environment. This study reports the results from a novel experimental setup to quantify the corrosion rate under uniaxial tensile stress in a single phase fcc Al0.1CoCrFeNi high entropy alloy rods. Under a uniform uniaxial applied stress of 600 MPa, the corrosion current density was observed to increase by three orders of magnitude and ~150 mV drop in corrosion potential. The mechanism of accelerated corrosion is identified as surface passivation layer breakdown, pit initiation on un-passivated surface and rapid pit-propagation along the loading direction.


title: On the "mementum" of Meme Stocks

abstract: The meme stock phenomenon is yet to be explored. In this note, we provide evidence that these stocks display common stylized facts on the dynamics of price, trading volume, and social media activity. Using a regime-switching cointegration model, we identify the meme stock "mementum" which exhibits a different characterization with respect to other stocks with high volumes of activity (persistent and not) on social media. Understanding these properties helps the investors and market authorities in their decision.


title: Long-term X-ray evolution of SDSS J134244.4+053056.1: A more than 18 year-old, long-lived IMBH-TDE candidate

abstract: SDSS J134244.4+053056 is a tidal disruption event candidate with strong temporal coronal line emitters and a long fading, mid-infrared dust echo. We present detailed analyses of X-ray emission from a Swift/XRT observation in 2009 and the most recent XMM-Newton/pn observation in 2020. The two spectra can be modeled with hard and soft components. While no significant variability is detected in the hard component above 2 keV between these two observations, the soft X-ray emission in 0.3-2 keV varies by a factor of $\sim5$. The luminosity of this soft component fades from $\sim1.8\times10^{41}$ to $\sim3.7\times10^{40}$ erg s$^{-1}$ from the observation in Swift to that of XMM-Newton, which are 8 and 19 years after the outburst occurred, respectively. The evolution of luminosity matches with the $t^{-5/3}$ decline law well; there is a soft X-ray peak luminosity of 10$^{44}$ erg s$^{-1}$ at the time of the optical flare. Furthermore, the spectra of the soft component harden slightly in the decay phase, in which the photon index $\Gamma$ varies from $4.8^{+1.2}_{-0.9}$ to $3.7\pm0.5$, although they are consistent with each other if we consider the uncertainties. Additionally, by comparing the BH mass estimate between the $M-\sigma$ correlation, the broad H$\alpha$ emission, and the fundamental plane relation of BH accretion, we find that a value of $\sim10^{5}$Msun is favored. If so, taking its X-ray spectral variation, luminosity evolution, and further support from theory into account, we suggest that SDSS J134244.4+053056 is a long-lived tidal disruption event candidate lasting more than 18 years with an intermediate-mass black hole.


title: Learning by Transference: Training Graph Neural Networks on Growing Graphs

abstract: Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to scalability limitations. Leveraging the graphon -- the limit object of a graph -- in this paper we consider the problem of learning a graphon neural network (WNN) -- the limit object of a GNN -- by training GNNs on graphs sampled from the graphon. Under smoothness conditions, we show that: (i) the expected distance between the learning steps on the GNN and on the WNN decreases asymptotically with the size of the graph, and (ii) when training on a sequence of growing graphs, gradient descent follows the learning direction of the WNN. Inspired by these results, we propose a novel algorithm to learn GNNs on large-scale graphs that, starting from a moderate number of nodes, successively increases the size of the graph during training. This algorithm is further benchmarked on a decentralized control problem, where it retains comparable performance to its large-scale counterpart at a reduced computational cost.


title: Detection of marine floating plastic using Sentinel-2 imagery and machine learning models

abstract: The increasing level of marine plastic pollution poses severe threats to the marine ecosystem and biodiversity. The present study attempted to explore the full functionality of open Sentinel satellite data and ML models for detecting and classifying floating plastic debris in Mytilene (Greece), Limassol (Cyprus), Calabria (Italy), and Beirut (Lebanon). Two ML models, i.e. Support Vector Machine (SVM) and Random Forest (RF) were utilized to carry out the classification analysis. In-situ plastic location data was collected from the control experiment conducted in Mytilene, Greece and Limassol, Cyprus, and the same was considered for training the models. Both remote sensing bands and spectral indices were used for developing the ML models. A spectral signature profile for plastic was created for discriminating the floating plastic from other marine debris. A newly developed index, kernel Normalized Difference Vegetation Index (kNDVI), was incorporated into the modelling to examine its contribution to model performances. Both SVM and RF were performed well in five models and test case combinations. Among the two ML models, the highest performance was measured for the RF. The inclusion of kNDVI was found effective and increased the model performances, reflected by high balanced accuracy measured for model 2 (~80% to ~98 % for SVM and ~87% to ~97 % for RF). Using the best-performed model, an automated floating plastic detection system was developed and tested in Calabria and Beirut. For both sites, the trained model had detected the floating plastic with ~99% accuracy. Among the six predictors, the FDI was found the most important variable for detecting marine floating plastic. These findings collectively suggest that high-resolution remote sensing imagery and the automated ML models can be an effective alternative for the cost-effective detection of marine floating plastic.


title: Neurons on Amoebae

abstract: We apply methods of machine-learning, such as neural networks, manifold learning and image processing, in order to study 2-dimensional amoebae in algebraic geometry and string theory. With the help of embedding manifold projection, we recover complicated conditions obtained from so-called lopsidedness. For certain cases it could even reach $\sim99\%$ accuracy, in particular for the lopsided amoeba of $F_0$ with positive coefficients which we place primary focus. Using weights and biases, we also find good approximations to determine the genus for an amoeba at lower computational cost. In general, the models could easily predict the genus with over $90\%$ accuracies. With similar techniques, we also investigate the membership problem, and image processing of the amoebae directly.


title: Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models

abstract: We analyze a class of stochastic gradient algorithms with momentum on a high-dimensional random least squares problem. Our framework, inspired by random matrix theory, provides an exact (deterministic) characterization for the sequence of loss values produced by these algorithms which is expressed only in terms of the eigenvalues of the Hessian. This leads to simple expressions for nearly-optimal hyperparameters, a description of the limiting neighborhood, and average-case complexity. As a consequence, we show that (small-batch) stochastic heavy-ball momentum with a fixed momentum parameter provides no actual performance improvement over SGD when step sizes are adjusted correctly. For contrast, in the non-strongly convex setting, it is possible to get a large improvement over SGD using momentum. By introducing hyperparameters that depend on the number of samples, we propose a new algorithm sDANA (stochastic dimension adjusted Nesterov acceleration) which obtains an asymptotically optimal average-case complexity while remaining linearly convergent in the strongly convex setting without adjusting parameters.


title: Latent class growth analysis for ordinal response data in the Distress Assessment and Response Tool: an evaluation of state-of-the-art implementations

abstract: Latent class growth analysis is a popular approach to identify underlying subpopulations. Several implementations, such as LCGA (Mplus), Proc Traj (SAS) and lcmm (R) are specially designed for this purpose. Motivated by data collection of psychological instruments over time in a large North American cancer centre, we compare these implementations using various simulated Edmonton Symptom Assessment System revised (ESAS-r) scores, an ordinal outcome from 0 to 10, as well as the real data consisting of more than 20,000 patients. We found that Mplus and lcmm lead to high correct classification rate, but Proc Traj over estimated the number of classes and failed to converge. While Mplus is computationally faster than lcmm, it does not allow more than 10 levels. We therefore suggest first analyzing data on the ordinal scale using lcmm. If computational time becomes an issue, then one can group the scores into categories and implement them in Mplus.


title: Condensation transition and ensemble inequivalence in the Discrete Nonlinear Schr\"odinger Equation

abstract: The thermodynamics of the discrete nonlinear Schr\"odinger equation in the vicinity of infinite temperature is explicitly solved in the microcanonical ensemble by means of large-deviation techniques. A first-order phase transition between a thermalized phase and a condensed (localized) one occurs at the infinite-temperature line. Inequivalence between statistical ensembles characterizes the condensed phase, where the grand-canonical representation does not apply. The control over finite size corrections of the microcanonical partition function allows to design an experimental test of delocalized negative-temperature states in lattices of cold atoms.


title: Formalizing Distribution Inference Risks

abstract: Property inference attacks reveal statistical properties about a training set but are difficult to distinguish from the primary purposes of statistical machine learning, which is to produce models that capture statistical properties about a distribution. Motivated by Yeom et al.'s membership inference framework, we propose a formal and generic definition of property inference attacks. The proposed notion describes attacks that can distinguish between possible training distributions, extending beyond previous property inference attacks that infer the ratio of a particular type of data in the training data set. In this paper, we show how our definition captures previous property inference attacks as well as a new attack that reveals the average degree of nodes of a training graph and report on experiments giving insight into the potential risks of property inference attacks.


title: Superconsistency of Tests in High Dimensions

abstract: To assess whether there is some signal in a big database, aggregate tests for the global null hypothesis of no effect are routinely applied in practice before more specialized analysis is carried out. Although a plethora of aggregate tests is available, each test has its strengths but also its blind spots. In a Gaussian sequence model, we study whether it is possible to obtain a test with substantially better consistency properties than the likelihood ratio (i.e., Euclidean norm based) test. We establish an impossibility result, showing that in the high-dimensional framework we consider, the set of alternatives for which a test may improve upon the likelihood ratio test -- that is, its superconsistency points -- is always asymptotically negligible in a relative volume sense.


title: Synthesis of standard 12-lead electrocardiograms using two dimensional generative adversarial network

abstract: This paper proposes a two-dimensional (2D) bidirectional long short-term memory generative adversarial network (GAN) to produce synthetic standard 12-lead ECGs corresponding to four types of signals: left ventricular hypertrophy (LVH), left branch bundle block (LBBB), acute myocardial infarction (ACUTMI), and Normal. It uses a fully automatic end-to-end process to generate and verify the synthetic ECGs that does not require any visual inspection. The proposed model is able to produce synthetic standard 12-lead ECG signals with success rates of 98% for LVH, 93% for LBBB, 79% for ACUTMI, and 59% for Normal. Statistical evaluation of the data confirms that the synthetic ECGs are not biased towards or overfitted to the training ECGs, and span a wide range of morphological features. This study demonstrates that it is feasible to use a 2D GAN to produce standard 12-lead ECGs suitable to augment artificially a diverse database of real ECGs, thus providing a possible solution to the demand for extensive ECG datasets.


title: Can a single neuron learn predictive uncertainty?

abstract: Uncertainty estimation methods using deep learning approaches strive against separating how uncertain the state of the world manifests to us via measurement (objective end) from the way this gets scrambled with the model specification and training procedure used to predict such state (subjective means) -- e.g., number of neurons, depth, connections, priors (if the model is bayesian), weight initialization, etc. This poses the question of the extent to which one can eliminate the degrees of freedom associated with these specifications and still being able to capture the objective end. Here, a novel non-parametric quantile estimation method for continuous random variables is introduced, based on the simplest neural network architecture with one degree of freedom: a single neuron. Its advantage is first shown in synthetic experiments comparing with the quantile estimation achieved from ranking the order statistics (specifically for small sample size) and with quantile regression. In real-world applications, the method can be used to quantify predictive uncertainty under the split conformal prediction setting, whereby prediction intervals are estimated from the residuals of a pre-trained model on a held-out validation set and then used to quantify the uncertainty in future predictions -- the single neuron used here as a structureless ``thermometer'' that measures how uncertain the pre-trained model is. Benchmarking regression and classification experiments demonstrate that the method is competitive in quality and coverage with state-of-the-art solutions, with the added benefit of being more computationally efficient.


title: A variational approach for the ground state profile of a trapped spinor-BEC: A detailed study of phase transition in spin-1 condensate at zero magnetic field

abstract: In this article we introduce a multi-modal variational method to analytically estimate the full number- and corresponding energy-density profile of a spin-1 Bose-Einstein condensate (BEC) for a number of particles as low as 500 under harmonic confinement. To apply this method, we consider a system of spin-1 BEC under three-dimensional isotropic and effective one-dimensional harmonic confinement in the absence (negligible presence) of the magnetic field which has ground state candidates of comparable energy. It should be noted that in such circumstances kinetic energy contribution to the ground state cannot be neglected which puts the applicability of Thomas-Fermi approximation to question. For anti-ferromagnetic condensates, the T-F approximated energy difference between the competing stationary states (ground state and the first excited state) is approximately 0.3\%. As T-F approximation is only good for condensates with a large number of particles, T-F approximated predictions can completely go wrong especially for small condensates. This is where comes the role of a detailed analysis using our variational method, which incorporates the kinetic energy contribution and accurately estimates the number- and energy-density profile even for condensates having a small number of particles. Results of our analytical method are supported by numerical simulation. This variational method is general and can be extended to other similar/higher-dimensional problems to get results beyond the accuracy of the Thomas-Fermi approximation.


title: Crystal field effects in the zig-zag chain compound SrTm$_2$O$_4$

abstract: The single ion properties of the zig-zag chain compound SrTm$_2$O$_4$ have been investigated using heat capacity, magnetic susceptibility, magnetization, inelastic neutron scattering, and polarized muon spectroscopy. Two crystal field models are employed to estimate the single ion properties; a Density Function Theory based model and an effective charge model based on the Hutchings point charge model. The latter describes our experimental results well. This model estimates an easy-axis anisotropy for one of the Tm$^{3+}$ sites and an easy-plane anisotropy for the second site. It also predicts a mixed ground state with dominating $J = 0$ characteristics for both sites. Additionally, muon spin rotation/relaxation ($\mu^+$SR) spectra reveal oscillations, typically a sign of long-range magnetic order. However, the temperature dependence of the precession frequency and the relaxation rates indicate that the system is in an extended critical regime and the observed relaxation is actually dynamic.


title: Deep Learning 3D Dose Prediction for Conventional Lung IMRT Using Consistent/Unbiased Automated Plans

abstract: Deep learning (DL) 3D dose prediction has recently gained a lot of attention. However, the variability of plan quality in the training dataset, generated manually by planners with wide range of expertise, can dramatically effect the quality of the final predictions. Moreover, any changes in the clinical criteria requires a new set of manually generated plans by planners to build a new prediction model. In this work, we instead use consistent plans generated by our in-house automated planning system (named ``ECHO'') to train the DL model. ECHO (expedited constrained hierarchical optimization) generates consistent/unbiased plans by solving large-scale constrained optimization problems sequentially. If the clinical criteria changes, a new training data set can be easily generated offline using ECHO, with no or limited human intervention, making the DL-based prediction model easily adaptable to the changes in the clinical practice. We used 120 conventional lung patients (100 for training, 20 for testing) with different beam configurations and trained our DL-model using manually-generated as well as automated ECHO plans. We evaluated different inputs: (1) CT+(PTV/OAR)contours, and (2) CT+contours+beam configurations, and different loss functions: (1) MAE (mean absolute error), and (2) MAE+DVH (dose volume histograms). The quality of the predictions was compared using different DVH metrics as well as dose-score and DVH-score, recently introduced by the AAPM knowledge-based planning grand challenge. The best results were obtained using automated ECHO plans and CT+contours+beam as training inputs and MAE+DVH as loss function.


title: A Comprehensive Assessment of Dialog Evaluation Metrics

abstract: Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel, dialog-specific metrics that correlate better with human judgements. Due to the fast pace of research, many of these metrics have been assessed on different datasets and there has as yet been no time for a systematic comparison between them. To this end, this paper provides a comprehensive assessment of recently proposed dialog evaluation metrics on a number of datasets. In this paper, 23 different automatic evaluation metrics are evaluated on 10 different datasets. Furthermore, the metrics are assessed in different settings, to better qualify their respective strengths and weaknesses. Metrics are assessed (1) on both the turn level and the dialog level, (2) for different dialog lengths, (3) for different dialog qualities (e.g., coherence, engaging), (4) for different types of response generation models (i.e., generative, retrieval, simple models and state-of-the-art models), (5) taking into account the similarity of different metrics and (6) exploring combinations of different metrics. This comprehensive assessment offers several takeaways pertaining to dialog evaluation metrics in general. It also suggests how to best assess evaluation metrics and indicates promising directions for future work.


title: Neutron star mergers as the astrophysical site of the r-process in the Milky Way and its satellite galaxies

abstract: Recent progress of nucleosynthesis work as well as the discovery of a kilonova associated with the gravitational-wave source GW170817 indicates that neutron star mergers (NSM) can be a site of the r-process. Several studies of galactic chemical evolution, however, have pointed out inconsistencies between this idea and the observed stellar abundance signatures in the Milky Way: (a) the presence of Eu at low (halo) metallicity and (b) the descending trend of Eu/Fe at high (disc) metallicity. In this study, we explore the galactic chemical evolution of the Milky Way's halo, disc and satellite dwarf galaxies. Particular attention is payed to the forms of delay-time distributions for both type Ia supernovae (SN Ia) and NSMs. The Galactic halo is modeled as an ensemble of independently evolving building-block galaxies with different masses. The single building blocks as well as the disc and satellite dwarfs are treated as well-mixed one-zone systems. Our results indicate that the aforementioned inconsistencies can be resolved and thus NSMs can be the unique r-process site in the Milky Way, provided that the delay-time distributions satisfy the following conditions: (i) a long delay (~1 Gyr) for the appearance of the first SN Ia (or a slow early increase of its number) and (ii) an additional early component providing >~ 50% of all NSMs with a delay of ~0.1 Gyr. In our model, r-process-enhanced and r-process-deficient stars in the halo appear to have originated from ultra-faint dwarf-sized and massive building blocks, respectively. Our results also imply that the natal kicks of binary neutron stars have a little impact on the evolution of Eu in the disc.


title: Multiphase field modeling of grain boundary migration mediated by emergent disconnections

abstract: Knowledge about grain boundary migration is a prerequisite for understanding and ultimately modulating the properties of polycrystalline materials. Evidence from experiments and molecular dynamics (MD) simulations suggests that the formation and motion of disconnections is a mechanism for grain boundary migration. Here, grain boundary migration is modeled using a multiphase field model based on the principle of minimum dissipation potential with nonconvex boundary energy, along with a stochastic model for thermal nucleation of disconnection pairs. In this model, disconnections arise spontaneously in the presence of an elastic driving force, and that their motion mediates boundary migration. The effect is due to the fact that the formation of the disconnections pairs results in a stress concentration, causing the elastic driving force to exceed the threshold value and driving the propagation of the disconnection along the interface. The model is applied to study the propagation/annihilation of single disconnection pairs, the relaxation of a perturbed interface, and shear coupling at various temperatures. The results are consistent with the current understanding of disconnections, and capture the effect of thermal softening.


title: Bootstrapping octagons in reduced kinematics from $A_2$ cluster algebras

abstract: Multi-loop scattering amplitudes/null polygonal Wilson loops in ${\mathcal N}=4$ super-Yang-Mills are known to simplify significantly in reduced kinematics, where external legs/edges lie in an $1+1$ dimensional subspace of Minkowski spacetime (or boundary of the $\rm AdS_3$ subspace). Since the edges of a $2n$-gon with even and odd labels go along two different null directions, the kinematics is reduced to two copies of $G(2,n)/T \sim A_{n{-}3}$. In the simplest octagon case, we conjecture that all loop amplitudes and Feynman integrals are given in terms of two overlapping $A_2$ functions (a special case of two-dimensional harmonic polylogarithms): in addition to the letters $v, 1+v, w, 1+w$ of $A_1 \times A_1$, there are two letters $v-w, 1- v w$ mixing the two sectors but they never appear together in the same term; these are the reduced version of four-mass-box algebraic letters. Evidence supporting our conjecture includes all known octagon amplitudes as well as new computations of multi-loop integrals in reduced kinematics. By leveraging this alphabet and conditions on first and last entries, we initiate a bootstrap program in reduced kinematics: within the remarkably simple space of overlapping $A_2$ functions, we easily obtain octagon amplitudes up to two-loop NMHV and three-loop MHV. We also briefly comment on the generalization to $2n$-gons in terms of $A_2$ functions and beyond.


title: Application of optimal spline subspaces for the removal of spurious outliers in isogeometric discretizations

abstract: We show that isogeometric Galerkin discretizations of eigenvalue problems related to the Laplace operator subject to any standard type of homogeneous boundary conditions have no outliers in certain optimal spline subspaces. Roughly speaking, these optimal subspaces are obtained from the full spline space defined on certain uniform knot sequences by imposing specific additional boundary conditions. The spline subspaces of interest have been introduced in the literature some years ago when proving their optimality with respect to Kolmogorov $n$-widths in $L^2$-norm for some function classes. The eigenfunctions of the Laplacian -- with any standard type of homogeneous boundary conditions -- belong to such classes. Here we complete the analysis of the approximation properties of these optimal spline subspaces. In particular, we provide explicit $L^2$ and $H^1$ error estimates with full approximation order for Ritz projectors in the univariate and in the multivariate tensor-product setting. Besides their intrinsic interest, these estimates imply that, for a fixed number of degrees of freedom, all the eigenfunctions and the corresponding eigenvalues are well approximated, without loss of accuracy in the whole spectrum when compared to the full spline space. Moreover, there are no spurious values in the approximated spectrum. In other words, the considered subspaces provide accurate outlier-free discretizations in the univariate and in the multivariate tensor-product case. This main contribution is complemented by an explicit construction of B-spline-like bases for the considered spline subspaces. The role of such spaces as accurate discretization spaces for addressing general problems with non-homogeneous boundary behavior is discussed as well.


title: Optimal Eddy Viscosity in Closure Models for 2D Turbulent Flows

abstract: We consider the question of fundamental limitations on the performance of eddy-viscosity closure models for turbulent flows, focusing on the Leith model for 2D {Large-Eddy Simulation}. Optimal eddy viscosities depending on the magnitude of the vorticity gradient are determined subject to minimum assumptions by solving PDE-constrained optimization problems defined such that the corresponding optimal Large-Eddy Simulation best matches the filtered Direct Numerical Simulation. First, we consider pointwise match in the physical space and the main finding is that with a fixed cutoff wavenumber $k_c$, the performance of the Large-Eddy Simulation systematically improves as the regularization in the solution of the optimization problem is reduced and this is achieved with the optimal eddy viscosities exhibiting increasingly irregular behavior with rapid oscillations. Since the optimal eddy viscosities do not converge to a well-defined limit as the regularization vanishes, we conclude that in this case the problem of finding an optimal eddy viscosity does not in fact have a solution and is thus ill-posed. We argue that this observation is consistent with the physical intuition concerning closure problems. The second problem we consider involves matching time-averaged vorticity spectra over small wavenumbers. It is shown to be better behaved and to produce physically reasonable optimal eddy viscosities. We conclude that while better behaved and hence practically more useful eddy viscosities can be obtained with stronger regularization or by matching quantities defined in a statistical sense, the corresponding Large-Eddy Simulations will not achieve their theoretical performance limits.


title: The impact of MR-guided attenuation correction (compared to CTbased AC) on the diagnosis of anosmia based on 99m-Tc EthylCysteinate-Dimer SPECT images

abstract: 99m-Tc Ethyl-Cysteinate-Dimer SPECT and MR imaging play a significant role in diagnosing anosmia. In this study, two-tissue class and three-tissue class attenuation maps (2C-MR and 3CMR) obtained from MR images were compared with CT-based attenuation correction (CTAC). Afterward, the presence of hypo-perfusion in brain lobes was evaluated in SPECT images. The 2C-MRAC map was generated through segmentation of T1-W MR images into air and soft-tissue, while in the 3C-MRAC map, the cortical bone was also considered. For investigating MRAC approaches, the difference between activity concentration (ACC) values was estimated in 144 volumes of interest. Ten normal and fourteen anosmic patients were compared by calculating the average normalized count and standard uptake value ratio parameters in the brain lobes. The comparison between attenuation correction strategies represented that MRAC images resulted in underestimation of the ACC values which was more substantial in the cortical area rather than in central regions (maximum 9% vs. 6% for 2C-MR and maximum 5.5% vs. 3.5% for 3C-MR). Nevertheless, there was a strong correlation between the MRAC and CTAC methods with a correlation coefficient of 0.7 for both 2C-MR and 3C-MR. The statistical analysis between normal and affected groups indicated the hypoperfusion in the cortex of Lh_frontal, Rh and Lh_temporal lobes with p-values < 0.05. Using MRAC resulted in underestimation of activity concentration which was partly eliminated by considering the cortical bone in the 3C-MR attenuation map. Hypo-perfusion was perceived in Frontal and Temporal lobes in SPECT-MRAC images of the anosmic group.


title: The evolving usefulness of the Test-Negative Design in studying risk factors for COVID-19 due to changes in testing policy

abstract: This paper is a short extension of our previous paper [arXiv:2004.06033] about the use of the Test-Negative design to study risk factors for COVID-19 [See: PubMed and ArXiv reference below] Reason for the extension is that the conditions under which people refer themselves for testing have greatly changed: originally, in most countries priority was given to people with symptoms, but nowadays people without symptoms are also tested for different reasons, e.g., during contact tracing, or to be allowed on an (international) flight. Interestingly, this opens new possibilities to separately investigate risk factors for infection and risk factors for becoming diseased. To use this new situation to best effect, one has to think carefully about how to elucidate the different reasons for testing and what analyses one might do with the different groups.


title: Refiner: Refining Self-attention for Vision Transformers

abstract: Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more complex architectures or training methods to address the data-efficiency issue of ViTs. However, few of them explore improving the self-attention mechanism, a key factor distinguishing ViTs from CNNs. Different from existing works, we introduce a conceptually simple scheme, called refiner, to directly refine the self-attention maps of ViTs. Specifically, refiner explores attention expansion that projects the multi-head attention maps to a higher-dimensional space to promote their diversity. Further, refiner applies convolutions to augment local patterns of the attention maps, which we show is equivalent to a distributed local attention features are aggregated locally with learnable kernels and then globally aggregated with self-attention. Extensive experiments demonstrate that refiner works surprisingly well. Significantly, it enables ViTs to achieve 86% top-1 classification accuracy on ImageNet with only 81M parameters.


title: No Future in Black Holes

abstract: The black hole information paradox has been with us for some time. We outline the nature of the paradox. We then propose a resolution based on an examination of the properties of quantum gravity under circumstances that give rise to a classical singularity. We show that the gravitational wavefunction vanishes as one gets close to the classical singularity. This results in a future boundary condition inside the black hole that allows for quantum information to be recovered in the evaporation process.


title: How to handle negative interest rates in a CIR framework

abstract: In this paper, we propose a new model to address the problem of negative interest rates that preserves the analytical tractability of the original Cox-Ingersoll-Ross (CIR) model without introducing a shift to the market interest rates, because it is defined as the difference of two independent CIR processes. The strength of our model lies within the fact that it is very simple and can be calibrated to the market zero yield curve using an analytical formula. We run several numerical experiments at two different dates, once with a partially sub-zero interest rate and once with a fully negative interest rate. In both cases, we obtain good results in the sense that the model reproduces the market term structures very well. We then simulate the model using the Euler-Maruyama scheme and examine the mean, variance and distribution of the model. The latter agrees with the skewness and fat tail seen in the original CIR model. In addition, we compare the model's zero coupon prices with market prices at different future points in time. Finally, we test the market consistency of the model by evaluating swaptions with different tenors and maturities.


title: Diverse Pretrained Context Encodings Improve Document Translation

abstract: We propose a new architecture for adapting a sentence-level sequence-to-sequence transformer by incorporating multiple pretrained document context signals and assess the impact on translation performance of (1) different pretraining approaches for generating these signals, (2) the quantity of parallel data for which document context is available, and (3) conditioning on source, target, or source and target contexts. Experiments on the NIST Chinese-English, and IWSLT and WMT English-German tasks support four general conclusions: that using pretrained context representations markedly improves sample efficiency, that adequate parallel data resources are crucial for learning to use document context, that jointly conditioning on multiple context representations outperforms any single representation, and that source context is more valuable for translation performance than target side context. Our best multi-context model consistently outperforms the best existing context-aware transformers.


title: Understanding matched filters for precision cosmology

abstract: Matched filters are routinely used in cosmology in order to detect galaxy clusters from mm observations through their thermal Sunyaev-Zeldovich (tSZ) signature. In addition, they naturally provide an observable, the detection signal-to-noise or significance, which can be used as a mass proxy in number counts analyses of tSZ-selected cluster samples. In this work, we show that this observable is, in general, non-Gaussian, and that it suffers from a positive bias, which we refer to as optimisation bias. Both aspects arise from the fact that the signal-to-noise is constructed through an optimisation operation on noisy data, and hold even if the cluster signal is modelled perfectly well, no foregrounds are present, and the noise is Gaussian. After reviewing the general mathematical formalism underlying matched filters, we study the statistics of the signal-to-noise with a set Monte Carlo mock observations, finding it to be well-described by a unit-variance Gaussian for signal-to-noise values of 6 and above, and quantify the magnitude of the optimisation bias, for which we give an approximate expression that may be used in practice. We also consider the impact of the bias on the cluster number counts of Planck and the Simons Observatory (SO), finding it to be negligible for the former and potentially significant for the latter.


title: Incremental False Negative Detection for Contrastive Learning

abstract: Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic relationship among instances and sometimes undesirably repels the anchor from the semantically similar samples, termed as "false negatives". In this work, we show that the unfavorable effect from false negatives is more significant for the large-scale datasets with more semantic concepts. To address the issue, we propose a novel self-supervised contrastive learning framework that incrementally detects and explicitly removes the false negative samples. Specifically, following the training process, our method dynamically detects increasing high-quality false negatives considering that the encoder gradually improves and the embedding space becomes more semantically structural. Next, we discuss two strategies to explicitly remove the detected false negatives during contrastive learning. Extensive experiments show that our framework outperforms other self-supervised contrastive learning methods on multiple benchmarks in a limited resource setup.


title: Person Re-Identification with a Locally Aware Transformer

abstract: Person Re-Identification is an important problem in computer vision-based surveillance applications, in which the same person is attempted to be identified from surveillance photographs in a variety of nearby zones. At present, the majority of Person re-ID techniques are based on Convolutional Neural Networks (CNNs), but Vision Transformers are beginning to displace pure CNNs for a variety of object recognition tasks. The primary output of a vision transformer is a global classification token, but vision transformers also yield local tokens which contain additional information about local regions of the image. Techniques to make use of these local tokens to improve classification accuracy are an active area of research. We propose a novel Locally Aware Transformer (LA-Transformer) that employs a Parts-based Convolution Baseline (PCB)-inspired strategy for aggregating globally enhanced local classification tokens into an ensemble of $\sqrt{N}$ classifiers, where $N$ is the number of patches. An additional novelty is that we incorporate blockwise fine-tuning which further improves re-ID accuracy. LA-Transformer with blockwise fine-tuning achieves rank-1 accuracy of $98.27 \%$ with standard deviation of $0.13$ on the Market-1501 and $98.7\%$ with standard deviation of $0.2$ on the CUHK03 dataset respectively, outperforming all other state-of-the-art published methods at the time of writing.


title: OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization

abstract: Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when training and test data are sampled from different distributions. While a plethora of algorithms have been proposed for OoD generalization, our understanding of the data used to train and evaluate these algorithms remains stagnant. In this work, we first identify and measure two distinct kinds of distribution shifts that are ubiquitous in various datasets. Next, through extensive experiments, we compare OoD generalization algorithms across two groups of benchmarks, each dominated by one of the distribution shifts, revealing their strengths on one shift as well as limitations on the other shift. Overall, we position existing datasets and algorithms from different research areas seemingly unconnected into the same coherent picture. It may serve as a foothold that can be resorted to by future OoD generalization research. Our code is available at https://github.com/ynysjtu/ood_bench.


title: Error Loss Networks

abstract: A novel model called error loss network (ELN) is proposed to build an error loss function for supervised learning. The ELN is in structure similar to a radial basis function (RBF) neural network, but its input is an error sample and output is a loss corresponding to that error sample. That means the nonlinear input-output mapper of ELN creates an error loss function. The proposed ELN provides a unified model for a large class of error loss functions, which includes some information theoretic learning (ITL) loss functions as special cases. The activation function, weight parameters and network size of the ELN can be predetermined or learned from the error samples. On this basis, we propose a new machine learning paradigm where the learning process is divided into two stages: first, learning a loss function using an ELN; second, using the learned loss function to continue to perform the learning. Experimental results are presented to demonstrate the desirable performance of the new method.


title: Self-Supervised Graph Learning with Proximity-based Views and Channel Contrast

abstract: We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various prediction tasks, such a paradigm falls short of capturing nodes' similarities over a long distance, which proves to be important for high-quality learning. To tackle this problem, we strengthen the graph with two additional graph views, in which nodes are directly linked to those with the most similar features or local structures. Not restricted by connectivity in the original graph, the generated views allow the model to enhance its expressive power with new and complementary perspectives from which to look at the relationship between nodes. Following a contrastive learning approach, we propose a method that aims to maximize the agreement between representations across generated views and the original graph. We also propose a channel-level contrast approach that greatly reduces computation cost, compared to the commonly used node level contrast, which requires computation cost quadratic in the number of nodes. Extensive experiments on seven assortative graphs and four disassortative graphs demonstrate the effectiveness of our approach.


title: Truthful allocation in graphs and hypergraphs

abstract: We study truthful mechanisms for allocation problems in graphs, both for the minimization (i.e., scheduling) and maximization (i.e., auctions) setting. The minimization problem is a special case of the well-studied unrelated machines scheduling problem, in which every given task can be executed only by two pre-specified machines in the case of graphs or a given subset of machines in the case of hypergraphs. This corresponds to a multigraph whose nodes are the machines and its hyperedges are the tasks. This class of problems belongs to multidimensional mechanism design, for which there are no known general mechanisms other than the VCG and its generalization to affine minimizers. We propose a new class of mechanisms that are truthful and have significantly better performance than affine minimizers in many settings. Specifically, we provide upper and lower bounds for truthful mechanisms for general multigraphs, as well as special classes of graphs such as stars, trees, planar graphs, $k$-degenerate graphs, and graphs of a given treewidth. We also consider the objective of minimizing or maximizing the $L^p$-norm of the values of the players, a generalization of the makespan minimization that corresponds to $p=\infty$, and extend the results to any $p>0$.


title: Stability to Deformations of Manifold Filters and Manifold Neural Networks

abstract: The paper defines and studies manifold (M) convolutional filters and neural networks (NNs). \emph{Manifold} filters and MNNs are defined in terms of the Laplace-Beltrami operator exponential and are such that \emph{graph} (G) filters and neural networks (NNs) are recovered as discrete approximations when the manifold is sampled. These filters admit a spectral representation which is a generalization of both the spectral representation of graph filters and the frequency response of standard convolutional filters in continuous time. The main technical contribution of the paper is to analyze the stability of manifold filters and MNNs to smooth deformations of the manifold. This analysis generalizes known stability properties of graph filters and GNNs and it is also a generalization of known stability properties of standard convolutional filters and neural networks in continuous time. The most important observation that follows from this analysis is that manifold filters, same as graph filters and standard continuous time filters, have difficulty discriminating high frequency components in the presence of deformations. This is a challenge that can be ameliorated with the use of manifold, graph, or continuous time neural networks. The most important practical consequence of this analysis is to shed light on the behavior of graph filters and GNNs in large-scale graphs.


title: Fermi isospectrality for discrete periodic Schrodinger operators

abstract: Let $\Gamma=q_1\mathbb{Z}\oplus q_2 \mathbb{Z}\oplus\cdots\oplus q_d\mathbb{Z}$, where $q_l\in \mathbb{Z}_+$, $l=1,2,\cdots,d$. Let $\Delta+V$ be the discrete Schr\"odinger operator, where $\Delta$ is the discrete Laplacian on $\mathbb{Z}^d$ and the potential $V:\mathbb{Z}^d\to \mathbb{R}$ is $\Gamma$-periodic. We prove three rigidity theorems for discrete periodic Schr\"odinger operators in any dimension $d\geq 3$: (1) if at some energy level, Fermi varieties of the $\Gamma$-periodic potential $V$ and the $\Gamma$-periodic potential $Y$ are the same (this feature is referred to as {\it Fermi isospectrality} of $V$ and $Y$), and $Y $ is a separable function, then $V$ is separable; (2) if potentials $V$ and $Y$ are Fermi isospectral and both $V=\bigoplus_{j=1}^rV_j$ and $Y=\bigoplus_{j=1}^r Y_j$ are separable functions, then, up to a constant, lower dimensional decompositions $V_j$ and $Y_j$ are Floquet isospectral, $j=1,2,\cdots,r$; (3) if a potential $V$ and the zero potential are Fermi isospectral, then $V$ is zero. In particular, all conclusions in (1), (2) and (3) hold if we replace the assumption "Fermi isospectrality" with a stronger assumption "Floquet isospectrality".


title: Deep Neural Network-based Enhancement for Image and Video Streaming Systems: A Survey and Future Directions

abstract: Internet-enabled smartphones and ultra-wide displays are transforming a variety of visual apps spanning from on-demand movies and 360{\deg} videos to video-conferencing and live streaming. However, robustly delivering visual content under fluctuating networking conditions on devices of diverse capabilities remains an open problem. In recent years, advances in the field of deep learning on tasks such as super-resolution and image enhancement have led to unprecedented performance in generating high-quality images from low-quality ones, a process we refer to as neural enhancement. In this paper, we survey state-of-the-art content delivery systems that employ neural enhancement as a key component in achieving both fast response time and high visual quality. We first present the components and architecture of existing content delivery systems, highlighting their challenges and motivating the use of neural enhancement models as a countermeasure. We then cover the deployment challenges of these models and analyze existing systems and their design decisions in efficiently overcoming these technical challenges. Additionally, we underline the key trends and common approaches across systems that target diverse use-cases. Finally, we present promising future directions based on the latest insights from deep learning research to further boost the quality of experience of content delivery systems.


title: Galaxy Morphologies Revealed with Subaru HSC and Super-Resolution Techniques I: Major Merger Fractions of L_UV~3-15 L_UV* Dropout Galaxies at z~4-7

abstract: We perform a super-resolution analysis of the Subaru Hyper Suprime-Cam (HSC) images to estimate the major merger fractions of z~4-7 dropout galaxies at the bright end of galaxy UV luminosity functions (LFs). Our super-resolution technique improves the spatial resolution of the ground-based HSC images, from ~1" to <~0."1, which is comparable to that of the Hubble Space Telescope, allowing us to identify z~4-7 bright major mergers at a high completeness value of >~90%. We apply the super-resolution technique to 6412, 16, 94, and 13 very bright dropout galaxies at z~4, 5, 6, and 7, respectively, in a UV luminosity range of L_UV~3-15 L_UV* corresponding to -24<~M_UV<~-22. The major merger fractions are estimated to be f_merger~10-20% at z~4 and ~50-70% at z~5-7, which shows no f_merger difference compared to those of a control faint galaxy sample. Based on the f_merger estimates, we verify contributions of source blending effects and major mergers to the bright-end of double power-law (DPL) shape of z~4-7 galaxy UV LFs. While these two effects partly explain the DPL shape at L_UV~3-10 L_UV*, the DPL shape cannot be explained at the very bright end of L_UV>~10 L_UV*, even after the AGN contribution is subtracted. The results support scenarios in which other additional mechanisms such as insignificant mass quenching and low dust obscuration contribute to the DPL shape of galaxy UV LFs.


title: Connectedness of graphs arising from the dual Steenrod algebra

abstract: We establish connectedness criteria for graphs associated to monomials in certain quotients of the mod 2 dual Steenrod algebra. We also investigate questions about trees and Hamilton cycles in the context of these graphs. Finally, we improve upon a known connection between the graph theoretic interpretation of the mod 2 dual Steenrod algebra and its structure as a Hopf algebra.


title: Encouraging Neural Machine Translation to Satisfy Terminology Constraints

abstract: We present a new approach to encourage neural machine translation to satisfy lexical constraints. Our method acts at the training step and thereby avoiding the introduction of any extra computational overhead at inference step. The proposed method combines three main ingredients. The first one consists in augmenting the training data to specify the constraints. Intuitively, this encourages the model to learn a copy behavior when it encounters constraint terms. Compared to previous work, we use a simplified augmentation strategy without source factors. The second ingredient is constraint token masking, which makes it even easier for the model to learn the copy behavior and generalize better. The third one, is a modification of the standard cross entropy loss to bias the model towards assigning high probabilities to constraint words. Empirical results show that our method improves upon related baselines in terms of both BLEU score and the percentage of generated constraint terms.


title: Approximation of solutions of DDEs under nonstandard assumptions via Euler scheme

abstract: We deal with approximation of solutions of delay differential equations (DDEs) via the classical Euler algorithm. We investigate the pointwise error of the Euler scheme under nonstandard assumptions imposed on the right-hand side function $f$. Namely, we assume that $f$ is globally of at most linear growth, satisfies globally one-side Lipschitz condition but it is only locally H\"older continuous. We provide a detailed error analysis of the Euler algorithm under such nonstandard regularity conditions. Moreover, we report results of numerical experiments.


title: Extending Reference Broadcast Infrastructure Synchronization Protocol in IEEE 802.11 as Enabler for the IIoT

abstract: Realizing the industrial Internet of Things, more andmore mobile use cases will emerge in the industrial landscape,requiring both novel concepts and smooth integration into legacydeployments.Since accurate time synchronization is particularly challengingfor wireless devices, we propose a concept for simple but accuratesynchronization in IEEE 802.11 wireless local area network thatextends the Reference Broadcast Infrastructure Synchronizationprotocol, and a suitable integration of IEEE 802.1AS that is partof the IEEE time-sensitive networking standards. In addition,the concept is evaluated with a testbed using commercial off-the-shelf hardware and a realistic discrete automation demonstratorequipped mostly with industrial components. By using the afore-mentioned devices for wireless communications, this concept canbe directly applied in existing industrial solutions, thus achievingthe proposed results. It is shown that the achieved synchronicity issuitable for a wide range of mandatory mobile use cases, which aremost important for a fully functional industrial Internet of Things.


title: Density functional theory driven phononic thermal conductivity prediction of biphenylene: A comparison with graphene

abstract: The thermal transport properties of biphenylene network (BPN), a novel sp2 -hybridized two-dimensional allotrope of carbon atoms recently realized in experiments [Fan et al., Science, 372 852-856 (2021)], are studied using the density functional theory-driven solution of the Boltzmann transport equation. The thermal transport in BPN is anisotropic and the obtained thermal conductivities are more than an order of magnitude lower than that in graphene, despite similar sp2-hybridized planar-structure of both allotropes. The lower thermal conductivity in BPN is found to originate from enhanced anharmonicity which in turn is a result of reduced crystal symmetry of BPN.


title: Reveal of Vision Transformers Robustness against Adversarial Attacks

abstract: The major part of the vanilla vision transformer (ViT) is the attention block that brings the power of mimicking the global context of the input image. For better performance, ViT needs large-scale training data. To overcome this data hunger limitation, many ViT-based networks, or hybrid-ViT, have been proposed to include local context during the training. The robustness of ViTs and its variants against adversarial attacks has not been widely investigated in the literature like CNNs. This work studies the robustness of ViT variants 1) against different Lp-based adversarial attacks in comparison with CNNs, 2) under adversarial examples (AEs) after applying preprocessing defense methods and 3) under the adaptive attacks using expectation over transformation (EOT) framework. To that end, we run a set of experiments on 1000 images from ImageNet-1k and then provide an analysis that reveals that vanilla ViT or hybrid-ViT are more robust than CNNs. For instance, we found that 1) Vanilla ViTs or hybrid-ViTs are more robust than CNNs under Lp-based attacks and under adaptive attacks. 2) Unlike hybrid-ViTs, Vanilla ViTs are not responding to preprocessing defenses that mainly reduce the high frequency components. Furthermore, feature maps, attention maps, and Grad-CAM visualization jointly with image quality measures, and perturbations' energy spectrum are provided for an insight understanding of attention-based models.


title: Light dark matter, rare $B$ decays with missing energy in $L_{\mu}-L_{\tau}$ model with a scalar leptoquark

abstract: We investigate the phenomenology of light GeV-scale fermionic dark matter in $U(1)_{L_\mu - L_{\tau}}$ gauge extension of the Standard Model. Heavy neutral fermions alongside with a $S_1(\overline{3}$,$1$,$1/3$) scalar leptoquark and an inert scalar doublet are added to address the flavor anomalies and light neutrino mass respectively. The light gauge boson associated with $U(1)_{L_\mu-L_\tau}$ gauge group mediates dark to visible sector and helps to obtain the correct relic density. Aided with a colored scalar, we constrain the new model parameters by using the branching ratios of various $b \to sll$ and $b \to s \gamma$ decay processes as well as the lepton flavour non-universality observables $R_{K^{(*)}}$ and then show the implication on the branching ratios of some rare semileptonic $B \to (K^{(*)}, \phi)+$ missing energy, processes.


title: The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves

abstract: In the new era of very large telescopes, where data is crucial to expand scientific knowledge, we have witnessed many deep learning applications for the automatic classification of lightcurves. Recurrent neural networks (RNNs) are one of the models used for these applications, and the LSTM unit stands out for being an excellent choice for the representation of long time series. In general, RNNs assume observations at discrete times, which may not suit the irregular sampling of lightcurves. A traditional technique to address irregular sequences consists of adding the sampling time to the network's input, but this is not guaranteed to capture sampling irregularities during training. Alternatively, the Phased LSTM unit has been created to address this problem by updating its state using the sampling times explicitly. In this work, we study the effectiveness of the LSTM and Phased LSTM based architectures for the classification of astronomical lightcurves. We use seven catalogs containing periodic and nonperiodic astronomical objects. Our findings show that LSTM outperformed PLSTM on 6/7 datasets. However, the combination of both units enhances the results in all datasets.


title: A multivariate Gaussian random field prior against spatial confounding

abstract: Spatial models are used in a variety research areas, such as environmental sciences, epidemiology, or physics. A common phenomenon in many spatial regression models is spatial confounding. This phenomenon takes place when spatially indexed covariates modeling the mean of the response are correlated with the spatial random effect. As a result, estimates for regression coefficients of the covariates can be severely biased and interpretation of these is no longer valid. Recent literature has shown that typical solutions for reducing spatial confounding can lead to misleading and counterintuitive results. In this paper, we develop a computationally efficient spatial model in a Bayesian framework integrating novel prior structure that reduces spatial confounding. Starting from the univariate case, we extend our prior structure to case of multiple spatially confounded covariates. In a simulation study, we show that our novel model flexibly detects and reduces spatial confounding in spatial datasets, and it performs better than typically used methods such as restricted spatial regression. These results are promising for any applied researcher who wishes to interpret covariate effects in spatial regression models. As a real data illustration, we study the effect of elevation and temperature on the mean of daily precipitation in Germany.


title: Unsupervised Action Segmentation for Instructional Videos

abstract: In this paper we address the problem of automatically discovering atomic actions in unsupervised manner from instructional videos, which are rarely annotated with atomic actions. We present an unsupervised approach to learn atomic actions of structured human tasks from a variety of instructional videos based on a sequential stochastic autoregressive model for temporal segmentation of videos. This learns to represent and discover the sequential relationship between different atomic actions of the task, and which provides automatic and unsupervised self-labeling.


title: Coherent exciton-exciton interactions and exciton dynamics in a MoSe\textsubscript{2}/WSe\textsubscript{2} heterostructure

abstract: Coherent coupling between excitons is at the heart of many-body interactions with transition metal dichalcogenide (TMD) heterostructures as an emergent platform for the investigation of these interactions. We employ multi-dimensional coherent spectroscopy on monolayer MoSe\textsubscript{2}/WSe\textsubscript{2} heterostructures and observe coherent coupling between excitons spatially localized in monolayer MoSe$_2$ and WSe$_2$. Through many-body spectroscopy, we further observe the absorption state arising from free interlayer electron-hole pairs. This observation yields a spectroscopic measurement of the interlayer exciton binding energy of about 250 meV.


title: Chiral phonons in honeycomb sublattice of layered CoSn-like compounds

abstract: Hexagonal and kagome lattices exhibit extraordinary electronic properties. It is a natural consequence of additional discrete degree of freedom associated with a valley or the occurence of electronic flat-bands. Combination of both types of lattices, observed in CoSn-like compounds, leads not only to the topological electronic behavior, but also to the emergence of chiral phonon modes. Here, we study CoSn-like compounds in the context of realization of chiral phonons. Previous theoretical studies demonstrated that the chiral phonons can be found in ideal two-dimensional hexagonal or kagome lattices. However, it turns out that in the case of CoSn-like systems with the $P6/mmm$ symmetry, the kagome lattice formed by $d$-block element is decorated by the additional $p$-block atom. This results in a two dimensional triangular lattice of atoms with non-equal masses and the absence of chiral phonons in the kagome plane. Contrary to this, the interlayer hexagonal lattice of $p$-block atoms is preserved and allows for the realization of chiral phonons. We discuss properties of these chiral phonons in seven CoSn-like compounds and demonstrate that they do not depend on atomic mass ratio or the presence of intrinsic magnetic order. The chiral phonons of $d$-block atoms can be restored by removing the inversion symmetry. The latter is possible in the crystal structure of CoGe and RhPb with the reduced symmetry ($P\bar{6}2m$) and distorted-kagome-like lattice.


title: Training Strategies for Deep Learning Gravitational-Wave Searches

abstract: Compact binary systems emit gravitational radiation which is potentially detectable by current Earth bound detectors. Extracting these signals from the instruments' background noise is a complex problem and the computational cost of most current searches depends on the complexity of the source model. Deep learning may be capable of finding signals where current algorithms hit computational limits. Here we restrict our analysis to signals from non-spinning binary black holes and systematically test different strategies by which training data is presented to the networks. To assess the impact of the training strategies, we re-analyze the first published networks and directly compare them to an equivalent matched-filter search. We find that the deep learning algorithms can generalize low signal-to-noise ratio (SNR) signals to high SNR ones but not vice versa. As such, it is not beneficial to provide high SNR signals during training, and fastest convergence is achieved when low SNR samples are provided early on. During testing we found that the networks are sometimes unable to recover any signals when a false alarm probability $<10^{-3}$ is required. We resolve this restriction by applying a modification we call unbounded Softmax replacement (USR) after training. With this alteration we find that the machine learning search retains $\geq 91.5\%$ of the sensitivity of the matched-filter search down to a false-alarm rate of 1 per month.


title: Imputation Scores

abstract: Given the prevalence of missing data in modern statistical research, a broad range of methods is available for any given imputation task. How does one choose the `best' imputation method in a given application? The standard approach is to select some observations, set their status to missing, and compare prediction accuracy of the methods under consideration of these observations. Besides having to somewhat artificially mask observations, a shortcoming of this approach is that imputations based on the conditional mean will rank highest if predictive accuracy is measured with quadratic loss. In contrast, we want to rank highest an imputation that can sample from the true conditional distributions. In this paper, we develop a framework called "Imputation Scores" (I-Scores) for assessing missing value imputations. We provide a specific I-Score based on density ratios and projections, that is applicable to discrete and continuous data. It does not require to mask additional observations for evaluations and is also applicable if there are no complete observations. The population version is shown to be proper in the sense that the highest rank is assigned to an imputation method that samples from the correct conditional distribution. The propriety is shown under the missing completely at random (MCAR) assumption but is also shown to be valid under missing at random (MAR) with slightly more restrictive assumptions. We show empirically on a range of data sets and imputation methods that our score consistently ranks true data high(est) and is able to avoid pitfalls usually associated with performance measures such as RMSE. Finally, we provide the R-package Iscores available on CRAN with an implementation of our method.


title: Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence

abstract: We investigate the reasons for the performance degradation incurred with batch-independent normalization. We find that the prototypical techniques of layer normalization and instance normalization both induce the appearance of failure modes in the neural network's pre-activations: (i) layer normalization induces a collapse towards channel-wise constant functions; (ii) instance normalization induces a lack of variability in instance statistics, symptomatic of an alteration of the expressivity. To alleviate failure mode (i) without aggravating failure mode (ii), we introduce the technique "Proxy Normalization" that normalizes post-activations using a proxy distribution. When combined with layer normalization or group normalization, this batch-independent normalization emulates batch normalization's behavior and consistently matches or exceeds its performance.


title: Observation of the mass difference between neutral charm-meson eigenstates

abstract: A measurement of mixing and $C\!P$ violation in neutral charm mesons is performed using data reconstructed in proton-proton collisions collected by the LHCb experiment from 2016 to 2018, corresponding to an integrated luminosity of 5.4$\textrm{fb}^{-1}$. A total of $30.6$ million $D^{0}\rightarrow K^{0}_{\mathrm{S}}\pi^{+}\pi^{-}$ decays are analyzed using a method optimized for the measurement of the mass difference between neutral charm-meson eigenstates. Allowing for $C\!P$ violation in mixing and in the interference between mixing and decay, the mass and decay-width differences are measured to be $x_{C\!P} = \left[3.97\pm0.46\textrm{(stat)}\pm 0.29\textrm{(syst)}\right]\times10^{-3}$ and $y_{C\!P} = \left[4.59\pm1.20\textrm{(stat)}\pm0.85\textrm{(syst)}\right]\times10^{-3}$, respectively. The $C\!P$-violating parameters are measured as $\Delta x = \left[-0.27\pm0.18\textrm{(stat)}\pm0.01\textrm{(syst)}\right]\times10^{-3}$ and $\Delta y = \left[0.20\pm0.36\textrm{(stat)}\pm0.13\textrm{(syst)}\right]\times10^{-3}$. This is the first observation of a nonzero mass difference in the $D^0$ meson system, with a significance exceeding seven standard deviations. The data are consistent with $C\!P$ symmetry, and improve existing constraints on the associated parameters.


title: Spectrum of Strongly Regular Graphs under Graph Operators

abstract: In this paper, we show that if G is strongly regular then the Gallai graph and the anti-Gallai graph of G are edge-regular. We also identify conditions under which the Gallai and anti-Gallai graphs are themselves strongly regular, as well as conditions under which they are 2-connected. We include also a number of concrete examples and a discussion of spectral properties of the Gallai and anti-Gallai graphs.


title: Efficient Training of Visual Transformers with Small Datasets

abstract: Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger representation capacity. However, the lack of the typical convolutional inductive bias makes these models more data-hungry than common CNNs. In fact, some local properties of the visual domain which are embedded in the CNN architectural design, in VTs should be learned from samples. In this paper, we empirically analyse different VTs, comparing their robustness in a small training-set regime, and we show that, despite having a comparable accuracy when trained on ImageNet, their performance on smaller datasets can be largely different. Moreover, we propose a self-supervised task which can extract additional information from images with only a negligible computational overhead. This task encourages the VTs to learn spatial relations within an image and makes the VT training much more robust when training data are scarce. Our task is used jointly with the standard (supervised) training and it does not depend on specific architectural choices, thus it can be easily plugged in the existing VTs. Using an extensive evaluation with different VTs and datasets, we show that our method can improve (sometimes dramatically) the final accuracy of the VTs. Our code is available at: https://github.com/yhlleo/VTs-Drloc.


title: The Inductive Bias of Quantum Kernels

abstract: It has been hypothesized that quantum computers may lend themselves well to applications in machine learning. In the present work, we analyze function classes defined via quantum kernels. Quantum computers offer the possibility to efficiently compute inner products of exponentially large density operators that are classically hard to compute. However, having an exponentially large feature space renders the problem of generalization hard. Furthermore, being able to evaluate inner products in high dimensional spaces efficiently by itself does not guarantee a quantum advantage, as already classically tractable kernels can correspond to high- or infinite-dimensional reproducing kernel Hilbert spaces (RKHS). We analyze the spectral properties of quantum kernels and find that we can expect an advantage if their RKHS is low dimensional and contains functions that are hard to compute classically. If the target function is known to lie in this class, this implies a quantum advantage, as the quantum computer can encode this inductive bias, whereas there is no classically efficient way to constrain the function class in the same way. However, we show that finding suitable quantum kernels is not easy because the kernel evaluation might require exponentially many measurements. In conclusion, our message is a somewhat sobering one: we conjecture that quantum machine learning models can offer speed-ups only if we manage to encode knowledge about the problem at hand into quantum circuits, while encoding the same bias into a classical model would be hard. These situations may plausibly occur when learning on data generated by a quantum process, however, they appear to be harder to come by for classical datasets.


title: Towards robust and domain agnostic reinforcement learning competitions

abstract: Reinforcement learning competitions have formed the basis for standard research benchmarks, galvanized advances in the state-of-the-art, and shaped the direction of the field. Despite this, a majority of challenges suffer from the same fundamental problems: participant solutions to the posed challenge are usually domain-specific, biased to maximally exploit compute resources, and not guaranteed to be reproducible. In this paper, we present a new framework of competition design that promotes the development of algorithms that overcome these barriers. We propose four central mechanisms for achieving this end: submission retraining, domain randomization, desemantization through domain obfuscation, and the limitation of competition compute and environment-sample budget. To demonstrate the efficacy of this design, we proposed, organized, and ran the MineRL 2020 Competition on Sample-Efficient Reinforcement Learning. In this work, we describe the organizational outcomes of the competition and show that the resulting participant submissions are reproducible, non-specific to the competition environment, and sample/resource efficient, despite the difficult competition task.


title: A simple alternative to the Breit-Wigner distribution

abstract: First, we discuss the conditions under which the non-relativistic and relativistic types of the Breit-Wigner energy distributions are obtained. Then, upon insisting on the correct normalization of the energy distribution, we introduce a Flatt\'{e}-like relativistic distribution -- denominated as Sill distribution -- that (i) contains left-threshold effects, (ii) is properly normalized for any decay width, (iii) can be obtained as an appropriate limit in which the decay width is a constant, (iv) is easily generalized to the multi-channel case (v) as well as to a convoluted form in case of a decay chain and -- last but not least -- (vi) is simple to deal with. We compare the Sill distribution to spectral functions derived within specific QFT models and show that it fairs well in concrete examples that involve a fit to experimental data for the $\rho$, $a_1(1260)$, and $K^*(982)$ mesons as well as the $\Delta(1232)$ baryon. We also present a study of the $f_2(1270)$ which has more than one possible decay channels. Finally, we discuss the limitations of the Sill distribution using the $a_0(980)$-$a_0(1450)$ and the $K_0^\ast(700)$-$K_0^\ast(1430)$ resonances as examples.


title: Smart Village: An IoT Based Digital Transformation

abstract: Almost 46% of the world's population resides in a rural landscape. Smart villages, alongside smart cities, are in need of time for future economic growth, improved agriculture, better health, and education. The smart village is a concept that improves the traditional rural aspects with the help of digital transformation. The smart village is built up using heterogeneous digital technologies pillared around the Internet-of-Thing (IoT). There exist many opportunities in research to design a low-cost, secure, and efficient technical ecosystem. This article identifies the key application areas, where the IoT can be applied in the smart village. The article also presents a comparative study of communication technology options.


title: Multivariate blowup-polynomials of graphs

abstract: In recent joint work (2021), we introduced a novel multivariate polynomial attached to every metric space - in particular, to every finite simple connected graph $G$ - and showed it has several attractive properties. First, it is multi-affine and real-stable (leading to a hitherto unstudied delta-matroid for each graph $G$). Second, the polynomial specializes to (a transform of) the characteristic polynomial $\chi_{D_G}$ of the distance matrix $D_G$; as well as recovers the entire graph, where $\chi_{D_G}$ cannot do so. Third, the polynomial encodes the determinants of a family of graphs formed from $G$, called the blowups of $G$. In this short note, we exhibit the applicability of these tools and techniques to other graph-matrices and their characteristic polynomials. As a particular case, we will see that the adjacency characteristic polynomial $\chi_{A_G}$ is in fact the shadow of a richer multivariate blowup-polynomial, which is similarly multi-affine and real-stable. Moreover, this polynomial encodes not only the aforementioned three properties, but also yields additional information for specific families of graphs.


title: A continued learning approach for model-informed precision dosing: updating models in clinical practice

abstract: Model-informed precision dosing (MIPD) is a quantitative dosing framework that combines prior knowledge on the drug-disease-patient system with patient data from therapeutic drug/ biomarker monitoring (TDM) to support individualized dosing in ongoing treatment.Structural models and prior parameter distributions used in MIPD approaches typically build on prior clinical trials that involve only a limited number of patients selected according to some exclusion/inclusion criteria. Compared to the prior clinical trial population, the patient population in clinical practice can be expected to include also altered behavior and/or increased interindividual variability, the extent of which, however, is typically unknown. Here, we address the question of how to adapt and refine models on the level of the model parameters to better reflect this real-world diversity. We propose an approach for continued learning across patients during MIPD using a sequential hierarchical Bayesian framework. The approach builds on two stages to separate the update of the individual patient parameters from updating the population parameters. Consequently, it enables continued learning across hospitals or study centers, since only summary patient data (on the level of model parameters) need to be shared, but no individual TDM data. We illustrate this continued learning approach with neutrophil-guided dosing of paclitaxel. The present study constitutes an important step towards building confidence in MIPD and eventually establishing MIPD increasingly in everyday therapeutic use.


title: Energy-Efficient Naming in Beeping Networks

abstract: A single-hop beeping network is a distributed communication model in which all stations can communicate with one another by transmitting only one-bit messages, called beeps. This paper focuses on resolving the distributed computing area's two fundamental problems: naming and counting problems. We are particularly interested in optimizing the energy complexity and the running time of algorithms to resolve these problems. Our contribution is to design randomized algorithms with an optimal running time of O(n log n) and an energy complexity of O(log n) for both the naming and counting problems on single-hop beeping networks of n stations.


title: Time-Reversal-Based Quantum Metrology with Many-Body Entangled States

abstract: In quantum metrology, entanglement represents a valuable resource that can be used to overcome the Standard Quantum Limit (SQL) that bounds the precision of sensors that operate with independent particles. Measurements beyond the SQL are typically enabled by relatively simple entangled states (squeezed states with Gaussian probability distributions), where quantum noise is redistributed between different quadratures. However, due to both fundamental limitations and the finite measurement resolution achieved in practice, sensors based on squeezed states typically operate far from the true fundamental limit of quantum metrology, the Heisenberg Limit. Here, by implementing an effective time-reversal protocol through a controlled sign change in an optically engineered many-body Hamiltonian, we demonstrate atomic-sensor performance with non-Gaussian states beyond the limitations of spin squeezing, and without the requirement of extreme measurement resolution. Using a system of 350 neutral $^{171}$Yb atoms, this signal amplification through time-reversed interaction (SATIN) protocol achieves the largest sensitivity improvement beyond the SQL ($11.8 \pm 0.5$~dB) demonstrated in any interferometer to date. Furthermore, we demonstrate a precision improving in proportion to the particle number (Heisenberg scaling), at fixed distance of 12.6~dB from the Heisenberg Limit. These results pave the way for quantum metrology using complex entangled states, with potential broad impact in science and technology. Potential applications include searches for dark matter and for physics beyond the standard model, tests of the fundamental laws of physics, timekeeping, and geodesy.


title: HERS Superpixels: Deep Affinity Learning for Hierarchical Entropy Rate Segmentation

abstract: Superpixels serve as a powerful preprocessing tool in numerous computer vision tasks. By using superpixel representation, the number of image primitives can be largely reduced by orders of magnitudes. With the rise of deep learning in recent years, a few works have attempted to feed deeply learned features / graphs into existing classical superpixel techniques. However, none of them are able to produce superpixels in near real-time, which is crucial to the applicability of superpixels in practice. In this work, we propose a two-stage graph-based framework for superpixel segmentation. In the first stage, we introduce an efficient Deep Affinity Learning (DAL) network that learns pairwise pixel affinities by aggregating multi-scale information. In the second stage, we propose a highly efficient superpixel method called Hierarchical Entropy Rate Segmentation (HERS). Using the learned affinities from the first stage, HERS builds a hierarchical tree structure that can produce any number of highly adaptive superpixels instantaneously. We demonstrate, through visual and numerical experiments, the effectiveness and efficiency of our method compared to various state-of-the-art superpixel methods.


title: Direct evidence of jets emanating from droplets at the Rayleigh charge-induced instability point

abstract: Highly charged liquid droplets are unstable above the critical charge squared-to-volume ratio given by the Rayleigh limit. The instability leads to ion ejection from jets formed on the droplet's surface. Despite the many experiments that have been performed to capture the jet formation the precise fission mechanism has not yet been observed because of its brief transient nature. Here, we present the first atomistic simulations that reveal the mechanism of Rayleigh fission. We demonstrate that ion ejection takes place through a drop's deformation from a spherical into a distinct shape that contains a conical protrusion. We assert that the latter state is a free energy minimum along an order parameter that measures the degree of droplet asphericity. The charged droplet's long-time evolution proceeds by alternating between the two minima above and below the critical value that are reached through solvent evaporation and ion ejection, respectively. For the first time, this mechanism allows one to explain the nature of the progeny droplets and the percentage of charge lost during fission. We determine that the cone half-angle is close to the value predicted from the solution of the electrostatic equation for the dielectric liquid. It is found that the conical deformation is independent of the effect of electrohydrodynamic forces reported in experiments. Contrary to the experimental observations of two diametrically opposite jets for droplets suspended in the electric field, we found that a single jet is formed at the Rayleigh limit. This indicates that super-charged droplet states may have been detected in the experiments.

categories: physics.flu-dyn cond-mat.mes-hall cond-mat.soft physics.atm-clus


title: Complex Ground-State and Excitation Energies in Coupled-Cluster Theory

abstract: Since in coupled-cluster (CC) theory ground-state and excitation energies are eigenvalues of a non-Hermitian matrix, these energies can in principle take on complex values. In this paper we discuss the appearance of complex energy values in CC calculations from a mathematical perspective. We analyze the behaviour of the eigenvalues of Hermitian matrices that are perturbed (in a non-Hermitian manner) by a real parameter. Based on these results we show that for CC calculations with real-valued Hamiltonian matrices the ground-state energy generally takes a real value. Furthermore, we show that in the case of real-valued Hamiltonian matrices complex excitation energies only occur in the context of conical intersections. In such a case, unphysical consequences are encountered such as a wrong dimension of the intersection seam, large numerical deviations from full configuration-interaction (FCI) results, and the square-root-like behaviour of the potential surfaces near the conical intersection. In the case of CC calculations with complex-valued Hamiltonian matrix elements, it turns out that complex energy values are to be expected for ground and excited states when no symmetry is present. We confirm the occurrence of complex energies by sample calculations using a six-state model and by CC calculations for the H2O molecule in a strong magnetic field. We furthermore show that symmetry can prevent the occurrence of complex energy values. Lastly, we demonstrate that in most cases the real part of the complex energy values provides a very good approximation to the FCI energy.


title: Functional law of large numbers and PDEs for epidemic models with infection-age dependent infectivity

abstract: We study epidemic models where the infectivity of each individual is a random function of the infection age (the elapsed time of infection). To describe the epidemic evolution dynamics, we use a stochastic process that tracks the number of individuals at each time that have been infected for less than or equal to a certain amount of time, together with the aggregate infectivity process. We establish the functional law of large numbers (FLLN) for the stochastic processes that describe the epidemic dynamics. The limits are described by a set of deterministic integral equations, which has a further characterization using PDEs under some regularity conditions. The solutions are characterized with boundary conditions that are given by a system of Volterra equations. We also characterize the equilibrium points for the PDEs in the SIS model with infection-age dependent infectivity. To establish the FLLNs, we employ a useful criterion for weak convergence for the two-parameter processes together with useful representations for the relevant processes via Poisson random measures.


title: Multi-wavelength properties of the 2021 periastron passage of PSR B1259-63

abstract: PSR B1259-63 is a gamma-ray binary system hosting a radio pulsar orbiting around a O9.5Ve star, LS 2883, with a period of ~3.4 years. The interaction of the pulsar wind with the LS 2883 outflow leads to unpulsed broadband emission in the radio, X-ray, GeV, and TeV domains. One of the most unusual features of the system is an outburst at GeV energies around the periastron, during which the energy release substantially exceeds the spin down luminosity under the assumption of the isotropic energy release. In this paper, we present the first results of a recent multi-wavelength campaign (radio, optical, and X-ray bands) accompanied by the analysis of publicly available GeV Fermi/LAT data. The campaign covered a period of more than 100 days around the 2021 periastron and revealed substantial differences from previously observed passages. We report a major delay of the GeV flare, weaker X-ray flux during the peaks, which are typically attributed to the times when the pulsar crosses the disk, and the appearance of a third X-ray peak never observed before. We argue that these features are consistent with the emission cone model of Chernyakova et al (2020) in the case of a sparser and clumpier disk of the Be star.


title: DSelect-k: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning

abstract: The Mixture-of-Experts (MoE) architecture is showing promising results in improving parameter sharing in multi-task learning (MTL) and in scaling high-capacity neural networks. State-of-the-art MoE models use a trainable sparse gate to select a subset of the experts for each input example. While conceptually appealing, existing sparse gates, such as Top-k, are not smooth. The lack of smoothness can lead to convergence and statistical performance issues when training with gradient-based methods. In this paper, we develop DSelect-k: a continuously differentiable and sparse gate for MoE, based on a novel binary encoding formulation. The gate can be trained using first-order methods, such as stochastic gradient descent, and offers explicit control over the number of experts to select. We demonstrate the effectiveness of DSelect-k on both synthetic and real MTL datasets with up to $128$ tasks. Our experiments indicate that DSelect-k can achieve statistically significant improvements in prediction and expert selection over popular MoE gates. Notably, on a real-world, large-scale recommender system, DSelect-k achieves over $22\%$ improvement in predictive performance compared to Top-k. We provide an open-source implementation of DSelect-k.


title: FairCal: Fairness Calibration for Face Verification

abstract: Despite being widely used, face recognition models suffer from bias: the probability of a false positive (incorrect face match) strongly depends on sensitive attributes such as the ethnicity of the face. As a result, these models can disproportionately and negatively impact minority groups, particularly when used by law enforcement. The majority of bias reduction methods have several drawbacks: they use an end-to-end retraining approach, may not be feasible due to privacy issues, and often reduce accuracy. An alternative approach is post-processing methods that build fairer decision classifiers using the features of pre-trained models, thus avoiding the cost of retraining. However, they still have drawbacks: they reduce accuracy (AGENDA, PASS, FTC), or require retuning for different false positive rates (FSN). In this work, we introduce the Fairness Calibration (FairCal) method, a post-training approach that simultaneously: (i) increases model accuracy (improving the state-of-the-art), (ii) produces fairly-calibrated probabilities, (iii) significantly reduces the gap in the false positive rates, (iv) does not require knowledge of the sensitive attribute, and (v) does not require retraining, training an additional model, or retuning. We apply it to the task of Face Verification, and obtain state-of-the-art results with all the above advantages.