title: AIP: Adversarial Iterative Pruning Based on Knowledge Transfer for Convolutional Neural Networks

abstract: With the increase of structure complexity, convolutional neural networks (CNNs) take a fair amount of computation cost. Meanwhile, existing research reveals the salient parameter redundancy in CNNs. The current pruning methods can compress CNNs with little performance drop, but when the pruning ratio increases, the accuracy loss is more serious. Moreover, some iterative pruning methods are difficult to accurately identify and delete unimportant parameters due to the accuracy drop during pruning. We propose a novel adversarial iterative pruning method (AIP) for CNNs based on knowledge transfer. The original network is regarded as the teacher while the compressed network is the student. We apply attention maps and output features to transfer information from the teacher to the student. Then, a shallow fully-connected network is designed as the discriminator to allow the output of two networks to play an adversarial game, thereby it can quickly recover the pruned accuracy among pruning intervals. Finally, an iterative pruning scheme based on the importance of channels is proposed. We conduct extensive experiments on the image classification tasks CIFAR-10, CIFAR-100, and ILSVRC-2012 to verify our pruning method can achieve efficient compression for CNNs even without accuracy loss. On the ILSVRC-2012, when removing 36.78% parameters and 45.55% floating-point operations (FLOPs) of ResNet-18, the Top-1 accuracy drop are only 0.66%. Our method is superior to some state-of-the-art pruning schemes in terms of compressing rate and accuracy. Moreover, we further demonstrate that AIP has good generalization on the object detection task PASCAL VOC.


title: Zero Shot on the Cold-Start Problem: Model-Agnostic Interest Learning for Recommender Systems

abstract: User behavior has been validated to be effective in revealing personalized preferences for commercial recommendations. However, few user-item interactions can be collected for new users, which results in a null space for their interests, i.e., the cold-start dilemma. In this paper, a two-tower framework, namely, the model-agnostic interest learning (MAIL) framework, is proposed to address the cold-start recommendation (CSR) problem for recommender systems. In MAIL, one unique tower is constructed to tackle the CSR from a zero-shot view, and the other tower focuses on the general ranking task. Specifically, the zero-shot tower first performs cross-modal reconstruction with dual auto-encoders to obtain virtual behavior data from highly aligned hidden features for new users; and the ranking tower can then output recommendations for users based on the completed data by the zero-shot tower. Practically, the ranking tower in MAIL is model-agnostic and can be implemented with any embedding-based deep models. Based on the co-training of the two towers, the MAIL presents an end-to-end method for recommender systems that shows an incremental performance improvement. The proposed method has been successfully deployed on the live recommendation system of NetEase Cloud Music to achieve a click-through rate improvement of 13% to 15% for millions of users. Offline experiments on real-world datasets also show its superior performance in CSR. Our code is available.


title: Astrophysical information from the Rayleigh-Jeans Tail of the CMB

abstract: One of the explanations for the recent EDGES-LOW band 21-cm measurements of a strong absorption signal around 80~MHz is the presence of an excess radio background to the Cosmic Microwave Background (CMB). Such excess can be produced by the decay of unstable particles into small mass dark photons which have a non-zero mixing angle with electromagnetism. We use the EDGES-LOW band measurements to derive joint constraints on the properties of the early galaxies and the parameters of such a particle physics model for the excess radio background. A Bayesian analysis shows that a high star formation efficiency and X-ray emission of $4-7 \times 10^{48} ~\rm erg$ per solar mass in stars are required along with a suppression of star formation in halos with virial temperatures $\lesssim 2\times 10^4$ K. The same analysis also suggests a 68 percent credible intervals for the mass of the decaying dark matter particles, it's lifetime, dark photon mass and the mixing angle of the dark and ordinary photon oscillation of $[10^{-3.5}, 10^{-2.4}]$ eV, $[10^{1.1}, 10^{2.7}]\times 13.8 ~\rm Gyr$, $[10^{-12.2}, 10^{-10}]$ eV and $[10^{-7}, 10^{-5.6}]$ respectively. This implies an excess radio background which is $\approx 5.7$ times stronger than the CMB around 80~MHz. This value is a factor $\sim 3$ higher than the previous predictions which used a simplified model for the 21-cm signal.


title: On extension of the motivic cohomology beyond smooth schemes

abstract: We construct an algebraic-cycle based model for the motivic cohomology on the category of schemes of finite type over a field, where schemes may admit arbitrary singularities and may be non-reduced. We show that our theory is functorial on the category, that it detects nilpotence, and that its restriction to the subcategory of smooth schemes agrees with the pre-existing motivic cohomology theory, which is the higher Chow theory of S. Bloch (Adv. Math., 1986). A few structures and applications are discussed.


title: Gauss-Bonnet theorems associated to deformed Schouten-Van Kampen connection in the affine group and the group of rigid motions of the Minkowski plane

abstract: In this paper, we define deformed Schouten-Van Kampen connections which are metric connections and compute sub-Riemannian limits of Gaussian curvature for a Euclidean C2-smooth surface associated to deformed Schouten-Van Kampen connections with two kinds of distributions in the affine group and the group of rigid motions of the Minkowski plane away from characteristic points and signed geodesic curvature for Euclidean C2-smooth curves on surfaces. According to above results, we get Gauss-Bonnet theorems associated to two kinds of deformed Schouten-Van Kampen connections in the affine group and the group of rigid motions of the Minkowski plane.


title: Heavy-quark effects on cold quark matter and self-bound stars

abstract: Heavy-quark effects on the equation of state for cold and dense quark matter are obtained from perturbative QCD, yielding observables parametrized only by the renormalization scale. In particular, we investigate the thermodynamics of charm quark matter under the constraints of $\beta$ equilibrium and electric charge neutrality in a region of densities where perturbative QCD is, in principle, much more reliable. Finally, we analyze the stability of charm stars, a possible new branch of ultradense, self-bound compact stars, and find that they are unstable under radial oscillations.


title: Self-balanced Learning For Domain Generalization

abstract: Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the source data is well-balanced in terms of both domain and class. However, real-world training data collected with different composition biases often exhibits severe distribution gaps for domain and class, leading to substantial performance degradation. In this paper, we propose a self-balanced domain generalization framework that adaptively learns the weights of losses to alleviate the bias caused by different distributions of the multi-domain source data. The self-balanced scheme is based on an auxiliary reweighting network that iteratively updates the weight of loss conditioned on the domain and class information by leveraging balanced meta data. Experimental results demonstrate the effectiveness of our method overwhelming state-of-the-art works for domain generalization.


title: Production of neutron-rich heavy nuclei around N = 162 in multinucleon transfer reactions

abstract: Within the framework of the dinuclear system model, the production mechanism of neutron-rich heavy nuclei around N = 162 has been investigated systematically. The isotopic yields in the multinucleon transfer reaction of $^{238}$U + $^{248}$Cm was analyzed and compared the available experimental data. Systematics on the production of superheavy nuclei via $^{238}$U on $^{252,254}$Cf, $^{254}$Es and $^{257}$Fm is investigated. It is found that the shell effect is of importance in the formation of neutron-rich nuclei around N=162 owing to the enhancement of fission barrier. The fragments in the multinucleon transfer reactions manifest the broad isotopic distribution and are dependent on the beam energy. The polar angles of the fragments tend to the forward emission with increasing the beam energy. The production cross sections of new isotopes are estimated and heavier targets are available for the neutron-rich superheavy nucleus formation. The optimal system and beam energy are proposed for the future experimental measurements.


title: Through the Looking Glass: Diminishing Occlusions in Robot Vision Systems with Mirror Reflections

abstract: The quality of robot vision greatly affects the performance of automation systems, where occlusions stand as one of the biggest challenges. If the target is occluded from the sensor, detecting and grasping such objects become very challenging. For example, when multiple robot arms cooperate in a single workplace, occlusions will be created under the robot arm itself and hide objects underneath. While occlusions can be greatly reduced by installing multiple sensors, the increase in sensor costs cannot be ignored. Moreover, the sensor placements must be rearranged every time the robot operation routine and layout change. To diminish occlusions, we propose the first robot vision system with tilt-type mirror reflection sensing. By instantly tilting the sensor itself, we obtain two sensing results with different views: conventional direct line-of-sight sensing and non-line-of-sight sensing via mirror reflections. Our proposed system removes occlusions adaptively by detecting the occlusions in the scene and dynamically configuring the sensor tilt angle to sense the detected occluded area. Thus, sensor rearrangements are not required even after changes in robot operation or layout. Since the required hardware is the tilt-unit and a commercially available mirror, the cost increase is marginal. Through experiments, we show that our system can achieve a similar detection accuracy as systems with multiple sensors, regardless of the single-sensor implementation.


title: Sheaves of modules on atomic sites and discrete representations of topological groups

abstract: The main goal of this paper is to establish close relations among sheaves of modules on atomic sites, representations of categories, and discrete representations of topological groups. We characterize sheaves of modules on atomic sites as saturated representations, and show that the category of sheaves is equivalent to the Serre quotient of the category of presheaves by the category of torsion presheaves. Consequently, the sheafification functor and sheaf cohomology functors are interpreted by localization functors, section functors, and derived functors of torsion functor in representation theory. These results as well as a classical theorem of Artin provides us a new approach to study discrete representations of topological groups. In particular, by importing established facts in representation stability theory, we explicitly classify simple or indecomposable injective discrete representations of some discrete topological groups such as the infinite symmetric group, the infinite general or special linear group over a finite field, and the automorphism group of the linearly ordered set $\mathbb{Q}$. We also show that discrete representations of these topological groups satisfy a certain stability property.


title: Constant weighted mean curvature hypersurfaces in Shrinking Ricci Solitons

abstract: In this paper, we study constant weighted mean curvature hypersurfaces in shrinking Ricci solitons. First, we show that a constant weighted mean curvature hypersurface with finite weighted volume cannot lie in a region determined by a special level set of the potential function, unless it is the level set. Next, we show that a compact constant weighted mean curvature hypersurface with a certain upper bound or lower bound on the mean curvature is a level set of the potential function. We can apply both results to the cylinder shrinking Ricci soliton ambient space. Finally, we show that a constant weighted mean curvature hypersurface in the Gaussian shrinking Ricci soliton (not necessarily properly immersed) with a certain assumption on the integral of the second fundamental form must be a generalized cylinder.


title: How Does Adversarial Fine-Tuning Benefit BERT?

abstract: Adversarial training (AT) is one of the most reliable methods for defending against adversarial attacks in machine learning. Variants of this method have been used as regularization mechanisms to achieve SOTA results on NLP benchmarks, and they have been found to be useful for transfer learning and continual learning. We search for the reasons for the effectiveness of AT by contrasting vanilla and adversarially fine-tuned BERT models. We identify partial preservation of BERT's syntactic abilities during fine-tuning as the key to the success of AT. We observe that adversarially fine-tuned models remain more faithful to BERT's language modeling behavior and are more sensitive to the word order. As concrete examples of syntactic abilities, an adversarially fine-tuned model could have an advantage of up to 38% on anaphora agreement and up to 11% on dependency parsing. Our analysis demonstrates that vanilla fine-tuning oversimplifies the sentence representation by focusing heavily on a small subset of words. AT, however, moderates the effect of these influential words and encourages representational diversity. This allows for a more hierarchical representation of a sentence and leads to the mitigation of BERT's loss of syntactic abilities.


title: Energy Minimization for IRS-aided WPCNs with Non-linear Energy Harvesting Model

abstract: This paper considers an intelligent reflecting surface(IRS)-aided wireless powered communication network (WPCN), where devices first harvest energy from a power station (PS) in the downlink (DL) and then transmit information using non-orthogonal multiple access (NOMA) to a data sink in the uplink (UL). However, most existing works on WPCNs adopted the simplified linear energy-harvesting model and also cannot guarantee strict user quality-of-service requirements. To address these issues, we aim to minimize the total transmit energy consumption at the PS by jointly optimizing the resource allocation and IRS phase shifts over time, subject to the minimum throughput requirements of all devices. The formulated problem is decomposed into two subproblems, and solved iteratively in an alternative manner by employing difference of convex functions programming, successive convex approximation, and penalty-based algorithm. Numerical results demonstrate the significant performance gains achieved by the proposed algorithm over benchmark schemes and reveal the benefits of integrating IRS into WPCNs. In particular, employing different IRS phase shifts over UL and DL outperforms the case with static IRS beamforming.


title: Long time and Painleve-type asymptotics for the Sasa-Satsuma equation in solitonic space time regions

abstract: The Sasa-Satsuma equation with $3 \times 3 $ Lax representation is one of the integrable extensions of the nonlinear Schr\"{o}dinger equation. In this paper, we consider the Cauchy problem of the Sasa-Satsuma equation with generic decaying initial data. Based on the Rieamnn-Hilbert problem characterization for the Cauchy problem and the $\overline{\partial}$-nonlinear steepest descent method, we find qualitatively different long time asymptotic forms for the Sasa-Satsuma equation in three solitonic space-time regions: (1)\ For the region $x<0, |x/t|=\mathcal{O}(1)$, the long time asymptotic is given by $$q(x,t)=u_{sol}(x,t| \sigma_{d}(\mathcal{I})) + t^{-1/2} h + \mathcal{O} (t^{-3/4}). $$ in which the leading term is $N(I)$ solitons, the second term the second $t^{-1/2}$ order term is soliton-radiation interactions and the third term is a residual error from a $\overline\partial$ equation. (2)\ For the region $ x>0, |x/t|=\mathcal{O}(1)$, the long time asymptotic is given by $$ u(x,t)= u_{sol}(x,t| \sigma_{d}(\mathcal{I})) + \mathcal{O}(t^{-1}).$$ in which the leading term is $N(I)$ solitons, the second term is a residual error from a $\overline\partial$ equation. (3) \ For the region $ |x/t^{1/3}|=\mathcal{O}(1)$, the Painleve asymptotic is found by $$ u(x,t)= \frac{1}{t^{1/3}} u_{P} \left(\frac{x}{t^{1/3}} \right) + \mathcal{O} \left(t^{2/(3p)-1/2} \right), \qquad 4<p < \infty.$$ in which the leading term is a solution to a modified Painleve $\mathrm{II}$ equation, the second term is a residual error from a $\overline\partial$ equation.


title: 3D Parameter Maps of Red Clump Stars in the Milky Way -- Absolute Magnitudes and Intrinsic Colors

abstract: Red clump stars (RCs) are useful tracers of distances, extinction, chemical abundances, and Galactic structures and kinematics. Accurate estimation of the RC parameters -- absolute magnitude and intrinsic color -- is the basis for obtaining high-precision RC distances. By combining astrometric data from Gaia, spectroscopic data from APOGEE and LAMOST, and multi-band photometric data from Gaia, APASS, Pan-STARRS1, 2MASS, and WISE surveys, we use the Gaussian process regression to train machine learners to derive the multi-band absolute magnitudes $M_\lambda$ and intrinsic colors $(\lambda_1-\lambda_2)_0$ for each spectral RC. The dependence of $M_\lambda$ on metallicity decreases from optical to infrared bands, while the dependence of $M_\lambda$ on age is relatively similar in each band. $(\lambda_1-\lambda_2)_0$ are more affected by metallicity than age. The RC parameters are not suitable to be represented by simple constants but are related to the Galactic stellar population structure. By analyzing the variation of $M_\lambda$ and $(\lambda_1-\lambda_2)_0$ in the spatial distribution, we construct $(R, z)$ dependent maps of mean absolute magnitudes and mean intrinsic colors of the Galactic RCs. Through external and internal validation, we find that using three-dimensional (3D) parameter maps to determine RC parameters avoids systematic bias and reduces dispersion by about 20% compared to using constant parameters. Based on Gaia's EDR3 parallax, our 3D parameter maps, and extinction-distance profile selection, we obtain a photometric RC sample containing 11 million stars with distance and extinction measurements.


title: BotNet: A Simulator for Studying the Effects of Accurate Communication Models on Multi-agent and Swarm Control

abstract: Decentralized control in multi-robot systems is dependent on accurate and reliable communication between agents. Important communication factors, such as latency and packet delivery ratio, are strong functions of the number of agents in the network. Findings from studies of mobile and high node-count radio-frequency (RF) mesh networks have only been transferred to the domain of multi-robot systems to a limited extent, and typical multi-agent robotic simulators often depend on simple propagation models that do not reflect the behavior of realistic RF networks. In this paper, we present a new open source swarm robotics simulator, BotNet, with an embedded standards-compliant time-synchronized channel hopping (6TiSCH) RF mesh network simulator. Using this simulator we show how more accurate communications models can limit even simple multi-robot control tasks such as flocking and formation control, with agent counts ranging from 10 up to 2500 agents. The experimental results are used to motivate changes to the inter-robot communication propagation models and other networking components currently used in practice in order to bridge the sim-to-real gap.


title: SN 2018agk: A Prototypical Type Ia Supernova with a Smooth Power-law Rise in Kepler (K2)

abstract: We present the 30-min cadence Kepler/K2 light curve of the Type Ia supernova (SN Ia) SN 2018agk, covering approximately one week before explosion, the full rise phase and the decline until 40 days after peak. We additionally present ground-based observations in multiple bands within the same time range, including the 1-day cadence DECam observations within the first $\sim$5 days after the first light. The Kepler early light curve is fully consistent with a single power-law rise, without evidence of any bump feature. We compare SN 2018agk with a sample of other SNe~Ia without early excess flux from the literature. We find that SNe Ia without excess flux have slowly-evolving early colors in a narrow range ($g-i\approx -0.20\pm0.20$ mag) within the first $\sim 10$ days. On the other hand, among SNe Ia detected with excess, SN 2017cbv and SN 2018oh tend to be bluer, while iPTF16abc's evolution is similar to normal SNe Ia without excess in $g-i$. We further compare the Kepler light curve of SN 2018agk with companion-interaction models, and rule out the existence of a typical non-degenerate companion undergoing Roche-lobe overflow at viewing angles smaller than $45^{\circ}$.


title: Dynein-inspired multilane exclusion process with open boundary conditions

abstract: Motivated by the sidewise motions of dynein motors shown in experiments, we use a variant of the exclusion process to model the multistep dynamics of dyneins on a cylinder with open ends. Due to the varied step sizes of the particles in a quasi-two-dimensional topology, we observe the emergence of a novel phase diagram depending on the various load conditions. Under high-load conditions, our numerical findings yield results similar to the TASEP model with the presence of all three standard TASEP phases, namely the low-density (LD), high-density (HD), and maximal-current (MC) phases. However, for medium- to low-load conditions, for all chosen influx and outflux rates, we only observe the LD and HD phases, and the maximal-current phase disappears. Further, we also measure the dynamics for a single dynein particle which is logarithmically slower than a TASEP particle with a shorter waiting time. Our results also confirm experimental observations of the dwell time distribution. The dwell time distribution for dyneins is exponential in less crowded conditions, whereas a double exponential emerges under overcrowded conditions.


title: Upper bounds on the length function for covering codes with covering radius $R$ and codimension $tR+1$

abstract: The length function $\ell_q(r,R)$ is the smallest length of a $ q $-ary linear code with codimension (redundancy) $r$ and covering radius $R$. In this work, new upper bounds on $\ell_q(tR+1,R)$ are obtained in the following forms: \begin{equation*} \begin{split} &(a)~\ell_q(r,R)\le cq^{(r-R)/R}\cdot\sqrt[R]{\ln q},~ R\ge3,~r=tR+1,~t\ge1, &\phantom{(a)~} q\text{ is an arbitrary prime power},~c\text{ is independent of }q. \end{split} \end{equation*} \begin{equation*} \begin{split} &(b)~\ell_q(r,R)< 3.43Rq^{(r-R)/R}\cdot\sqrt[R]{\ln q},~ R\ge3,~r=tR+1,~t\ge1, &\phantom{(b)~} q\text{ is an arbitrary prime power},~q\text{ is large enough}. \end{split} \end{equation*} In the literature, for $q=(q')^R$ with $q'$ a prime power, smaller upper bounds are known; however, when $q$ is an arbitrary prime power, the bounds of this paper are better than the known ones. For $t=1$, we use a one-to-one correspondence between $[n,n-(R+1)]_qR$ codes and $(R-1)$-saturating $n$-sets in the projective space $\mathrm{PG}(R,q)$. A new construction of such saturating sets providing sets of small size is proposed. Then the $[n,n-(R+1)]_qR$ codes, obtained by geometrical methods, are taken as the starting ones in the lift-constructions (so-called "$q^m$-concatenating constructions") for covering codes to obtain infinite families of codes with growing codimension $r=tR+1$, $t\ge1$.


title: Iterative Filter Adaptive Network for Single Image Defocus Deblurring

abstract: We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle spatially-varying and large defocus blur. For adaptively handling spatially-varying blur, IFAN predicts pixel-wise deblurring filters, which are applied to defocused features of an input image to generate deblurred features. For effectively managing large blur, IFAN models deblurring filters as stacks of small-sized separable filters. Predicted separable deblurring filters are applied to defocused features using a novel Iterative Adaptive Convolution (IAC) layer. We also propose a training scheme based on defocus disparity estimation and reblurring, which significantly boosts the deblurring quality. We demonstrate that our method achieves state-of-the-art performance both quantitatively and qualitatively on real-world images.


title: EEG-connectivity: A fundamental guide and checklist for optimal study design and evaluation

abstract: Brain connectivity can be estimated through a wide number of analyses applied to electroencephalographic (EEG) data. However, substantial heterogeneity in the implementation of connectivity methods exist. Heterogeneity in conceptualization of connectivity measures, data collection, or data pre-processing may be associated with variability in robustness of measurement. While it is difficult to compare the results of studies using different EEG connectivity measures, standardization of processing and reporting may facilitate the task. We discuss how factors such as referencing, epoch length and number, controls for volume conduction, artefact removal, and statistical control of multiple comparisons influence the EEG connectivity estimate for connectivity measures, and what can be done to control for potential confounds associated with these factors. Based on the results reported in previous literature, this article presents recommendations and a novel checklist developed for quality assessment of EEG connectivity studies. This checklist and its recommendations are made in an effort to draw attention to factors that may influence connectivity estimates and factors that need to be improved in future research. Standardization of procedures and reporting in EEG connectivity may lead to EEG connectivity studies to be made more synthesisable and comparable despite variations in the methodology underlying connectivity estimates.


title: First deep images catalogue of extended IPHAS PNe

abstract: We present the first instalment of a deep imaging catalogue containing 58 True, Likely and Possible extended PNe detected with the Isaac Newton Telescope Photometric H$\alpha$ Survey (IPHAS). The three narrow-band filters in the emission lines of H$\alpha$, [N II] $\lambda$6584 \r{A} and [O III] $\lambda$5007 \r{A} used for this purpose allowed us to improve our description of the morphology and dimensions of the nebulae. In some cases even the nature of the source has been reassessed. We were then able to unveil new macro-and micro-structures, which will without a doubt contribute to a more accurate analysis of these PNe. It has been also possible to perform a primary classification of the targets based on their ionization level. A Deep Learning classification tool has also been tested. We expect that all the PNe from the IPHAS catalogue of new extended planetary nebulae will ultimately be part of this deep H$\alpha$, [N II] and [O III] imaging catalogue.


title: Coupling disorder in a population of swarmalators

abstract: We consider a population of two-dimensional oscillators with random couplings, and explore the collective states. The coupling strength between oscillators is randomly quenched with two values one of which is positive while the other is negative, and the oscillators can spatially {\it{move}} depending on the state variables for phase and position. We find that the system shows the phase transition from the incoherent state to the fully synchronized one at a proper ratio of the number of positive couplings to the total. The threshold is numerically measured, and analytically predicted by the linear stability analysis of the fully synchronized state. It is found that the random couplings induces the long-term state patterns appearing for constant strength. The oscillators move to the places where the randomly quenched couplings work as if annealed. We further observe that the system with mixed randomnesses for quenched couplings shows the combination of the deformed patterns understandable with each annealed averages.


title: Systematics on production of superheavy nuclei $Z = 119-122$ in fusion-evaporation reactions

abstract: The fusion dynamics on the formation of superheavy nuclei is investigated thoroughly within the dinuclear system model. The Monte Carlo approach is implemented into the nucleon transfer process for including all possible orientations, at which the dinuclear system is assumed to be formed at the touching configuration of dinuclear fragments. The production cross sections of superheavy nuclei Cn, Fl, Lv, Ts and Og are calculated and compared with the available data from Dubna. The evaporation residue excitation functions in the channels of pure neutrons and charged particles are analyzed systematically. The combinations with $^{44}$Sc, $^{48,50}$Ti, $^{49,51}$V, $^{52,54}$Cr, $^{58,62}$Fe and $^{62,64}$Ni bombarding the actinide nuclides $^{238}$U, $^{244}$Pu, $^{248}$Cm, $^{247,249}$Bk, $^{249,251}$Cf, $^{252}$Es and $^{243}$Am are calculated for producing the superheavy elements with Z=119-122. It is found that the production cross sections sensitively depend on the neutron richness of reaction system. The structure of evaporation residue excitation function is related to the neutron separation energy and fission barrier of compound nucleus.


title: BM UMa: a middle shallow contact binary at pre-transition stage of evolution from W-type to A-type

abstract: In this study, all unpublished time series photometric data of BM UMa ($q \sim$ 2.0, P = 0.2712\,d) from available archives were re-investigated together with new data taken from the TNT-2.4m of the Thai National Observatory (TNO). Based on period analysis, there is a short-term variation superimposed on the long-term period decrease. The trend of period change can be fitted with a downward parabolic curve indicating a period decrease at a rate of $\mathrm{d}P/\mathrm{d}t = -3.36(\pm 0.02)\times10^{-8}$ d $\textrm{yr}^{-1}$. This long-term period decrease can be explained by mass transfer from the more massive component ($M_2 \sim 0.79 M_{\odot}$) to the less massive one ($M_1 \sim 0.39 M_{\odot}$), combination with AML. For photometric study, we found that the binary consists of K0\,V stars and at the middle shallow contact phase with evolution of fill-out factor from 8.8\,\% (in 2007) to 23.2\,\% (in 2020). Those results suggest that the binary is at pre-transition stage of evolution from W-type to A-type, agreeing to the results of statistical study of W-type contact binaries. The mass of $M_2$ will be decreased close to or below $M_1$ and the mass ratio will be decreased ($q < 1.0$). By this way, the binary will evolve into A-type as a deeper normal over-contact system with period increase. Finally the binary will end as a merger or a rapid-rotating single star when the mass ratio meet the critical value ($q < 0.094$), as well as produce a red nova.


title: An Efficient Finite Element Iterative Method for Solving a Nonuniform Size Modified Poisson-Boltzmann Ion Channel Model

abstract: In this paper, a nonuniform size modified Poisson-Boltzmann ion channel (nuSMPBIC) model is presented as a nonlinear system of an electrostatic potential and multiple ionic concentrations. It mixes nonlinear algebraic equations with a Poisson boundary value problem involving Dirichlet-Neumann mixed boundary value conditions and a membrane surface charge density to reflect the effects of ion sizes and membrane charges on electrostatics and ionic concentrations. To overcome the difficulties of strong singularities and exponential nonlinearities, it is split into three submodels with a solution of Model 1 collecting all the singular points and Models 2 and 3 much easier to solve numerically than the original nuSMPBIC model. A damped two-block iterative method is then presented to solve Model 3, along with a novel modified Newton iterative scheme for solving each related nonlinear algebraic system. To this end, an effective nuSMPBIC finite element solver is derived and then implemented as a program package that works for an ion channel protein with a three-dimensional molecular structure and a mixture solution of multiple ionic species. Numerical results for a voltage-dependent anion channel (VDAC) in a mixture of four ionic species demonstrate a fast convergence rate of the damped two-block iterative method, the high performance of the software package, and the importance of considering nonuniform ion sizes. Moreover, the nuSMPBIC model is validated by the anion selectivity property of VDAC.


title: Segmentation Fault: A Cheap Defense Against Adversarial Machine Learning

abstract: Recently published attacks against deep neural networks (DNNs) have stressed the importance of methodologies and tools to assess the security risks of using this technology in critical systems. Efficient techniques for detecting adversarial machine learning helps establishing trust and boost the adoption of deep learning in sensitive and security systems. In this paper, we propose a new technique for defending deep neural network classifiers, and convolutional ones in particular. Our defense is cheap in the sense that it requires less computation power despite a small cost to pay in terms of detection accuracy. The work refers to a recently published technique called ML-LOO. We replace the costly pixel by pixel leave-one-out approach of ML-LOO by adopting coarse-grained leave-one-out. We evaluate and compare the efficiency of different segmentation algorithms for this task. Our results show that a large gain in efficiency is possible, even though penalized by a marginal decrease in detection accuracy.


title: Entanglement-based quantum key distribution with a blinking-free quantum dot operated at a temperature up to 20 K

abstract: Entanglement-based quantum key distribution promises enhanced robustness against eavesdropping and compatibility with future quantum networks. Among other sources, semiconductor quantum dots can generate polarization-entangled photon pairs with near-unity entanglement fidelity and a multi-photon emission probability close to zero even at maximum brightness. These properties have been demonstrated under resonant two-photon excitation (TPE) and at operation temperatures between 4 and 8 K. However, source blinking is often reported under TPE conditions, limiting the maximum achievable photon rate. In addition, operation temperatures reachable with compact cryo-coolers could facilitate the widespread deployment of quantum dots, e.g. in satellite-based quantum communication. Here we demonstrate blinking-free emission of highly entangled photon pairs from GaAs quantum dots embedded in a p-i-n diode. High fidelity entanglement persists at temperatures of at least 20 K, which we use to implement fiber-based quantum key distribution between two building with an average key rate of 55 bits/s and a qubit error rate of 8.4%. We are confident that by combining electrical control with already demonstrated photonic and strain engineering, quantum dots will keep approaching the ideal source of entangled photons for real world applications.


title: A review of mobile robot motion planning methods: from classical motion planning workflows to reinforcement learning-based architectures

abstract: Motion planning is critical to realize the autonomous operation of mobile robots. As the complexity and randomness of robot application scenarios increase, the planning capability of the classical hierarchical motion planners is challenged. With the development of machine learning, deep reinforcement learning (DRL)-based motion planner has gradually become a research hotspot due to its several advantageous features. DRL-based motion planner is model-free and does not rely on the prior structured map. Most importantly, DRL-based motion planner achieves the unification of the global planner and the local planner. In this paper, we provide a systematic review of various motion planning methods. First, we summarize the representative and state-of-the-art works for each submodule of the classical motion planning architecture and analyze their performance features. Subsequently, we concentrate on summarizing RL-based motion planning approaches, including motion planners combined with RL improvements, map-free RL-based motion planners, and multi-robot cooperative planning methods. Last but not least, we analyze the urgent challenges faced by these mainstream RL-based motion planners in detail, review some state-of-the-art works for these issues, and propose suggestions for future research.


title: Cross-Lingual Text Classification of Transliterated Hindi and Malayalam

abstract: Transliteration is very common on social media, but transliterated text is not adequately handled by modern neural models for various NLP tasks. In this work, we combine data augmentation approaches with a Teacher-Student training scheme to address this issue in a cross-lingual transfer setting for fine-tuning state-of-the-art pre-trained multilingual language models such as mBERT and XLM-R. We evaluate our method on transliterated Hindi and Malayalam, also introducing new datasets for benchmarking on real-world scenarios: one on sentiment classification in transliterated Malayalam, and another on crisis tweet classification in transliterated Hindi and Malayalam (related to the 2013 North India and 2018 Kerala floods). Our method yielded an average improvement of +5.6% on mBERT and +4.7% on XLM-R in F1 scores over their strong baselines.


title: Spike time displacement based error backpropagation in convolutional spiking neural networks

abstract: We recently proposed the STiDi-BP algorithm, which avoids backward recursive gradient computation, for training multi-layer spiking neural networks (SNNs) with single-spike-based temporal coding. The algorithm employs a linear approximation to compute the derivative of the spike latency with respect to the membrane potential and it uses spiking neurons with piecewise linear postsynaptic potential to reduce the computational cost and the complexity of neural processing. In this paper, we extend the STiDi-BP algorithm to employ it in deeper and convolutional architectures. The evaluation results on the image classification task based on two popular benchmarks, MNIST and Fashion-MNIST datasets with the accuracies of respectively 99.2% and 92.8%, confirm that this algorithm has been applicable in deep SNNs. Another issue we consider is the reduction of memory storage and computational cost. To do so, we consider a convolutional SNN (CSNN) with two sets of weights: real-valued weights that are updated in the backward pass and their signs, binary weights, that are employed in the feedforward process. We evaluate the binary CSNN on two datasets of MNIST and Fashion-MNIST and obtain acceptable performance with a negligible accuracy drop with respect to real-valued weights (about $0.6%$ and $0.8%$ drops, respectively).


title: Exponential Integrators for Resistive Magnetohydrodynamics: Matrix-free Leja Interpolation and Efficient Adaptive Time Stepping

abstract: We propose a novel algorithm for the temporal integration of the resistive magnetohydrodynamics (MHD) equations. The approach is based on exponential Rosenbrock schemes in combination with Leja interpolation. It naturally preserves Gauss's law for magnetism and is unencumbered by the stability constraints observed for explicit methods. Remarkable progress has been achieved in designing exponential integrators and computing the required matrix functions efficiently. However, employing them in MHD simulations of realistic physical scenarios requires a matrix-free implementation. We show how an efficient algorithm based on Leja interpolation that only uses the right-hand side of the differential equation (i.e. matrix free), can be constructed. We further demonstrate that it outperforms Krylov-based exponential integrators as well as explicit and implicit methods using test models of magnetic reconnection and the Kelvin--Helmholtz instability. Furthermore, an adaptive step-size strategy that gives excellent and predictable performance, particularly in the lenient- to intermediate-tolerance regime that is often of importance in practical applications, is employed.

categories: math.NA astro-ph.IM cs.NA physics.comp-ph


title: Evaluation of Euler Number of Complex Grassmann Manifold G(k, N) via Mathai-Quillen Formalism

abstract: In this paper, we provide a recipe for computing Euler number of Grassmann manifold G(k,N) by using Mathai-Quillen formalism (MQ formalism) and Atiyah-Jeffrey construction. Especially, we construct path-integral representation of Euler number of G(k,N). Our model corresponds to a finite dimensional toy-model of topological Yang-Mills theory which motivated Atiyah-Jeffrey construction. As a by-product, we construct free fermion realization of cohomology ring of G(k,N).


title: Towards Out-Of-Distribution Generalization: A Survey

abstract: Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in real-world applications, this $i.i.d.$ assumption often fails to hold due to unforeseen distributional shifts, leading to considerable degradation in model performance upon deployment. This observed discrepancy indicates the significance of investigating the Out-of-Distribution (OOD) generalization problem. OOD generalization is an emerging topic of machine learning research that focuses on complex scenarios wherein the distributions of the test data differ from those of the training data. This paper represents the first comprehensive, systematic review of OOD generalization, encompassing a spectrum of aspects from problem definition, methodological development, and evaluation procedures, to the implications and future directions of the field. Our discussion begins with a precise, formal characterization of the OOD generalization problem. Following that, we categorize existing methodologies into three segments: unsupervised representation learning, supervised model learning, and optimization, according to their positions within the overarching learning process. We provide an in-depth discussion on representative methodologies for each category, further elucidating the theoretical links between them. Subsequently, we outline the prevailing benchmark datasets employed in OOD generalization studies. To conclude, we overview the existing body of work in this domain and suggest potential avenues for future research on OOD generalization. A summary of the OOD generalization methodologies surveyed in this paper can be accessed at http://out-of-distribution-generalization.com.


title: Tamagawa Products for Elliptic Curves Over Number Fields

abstract: In recent work, Griffin, Ono, and Tsai constructs an $L-$series to prove that the proportion of short Weierstrass elliptic curves over $\mathbb{Q}$ with trivial Tamagawa product is $0.5054\dots$ and that the average Tamagawa product is $1.8183\dots$. Following their work, we generalize their $L-$series over arbitrary number fields $K$ to be \[L_{\mathrm{Tam}}(K; s):=\sum_{m=1}^{\infty}\frac{P_{\mathrm{Tam}}(K; m)}{m^s},\] where $P_{\mathrm{Tam}}(K;m)$ is the proportion of short Weierstrass elliptic curves over $K$ with Tamagawa product $m$. We then construct Markov chains to compute the exact values of $P_{\mathrm{Tam}}(K;m)$ for all number fields $K$ and positive integers $m$. As a corollary, we also compute the average Tamagawa product $L_{\mathrm{Tam}}(K;-1)$. We then use these results to uniformly bound $P_{\mathrm{Tam}}(K;1)$ and $L_{\mathrm{Tam}}(K,-1)$ in terms of the degree of $K$. Finally, we show that there exist sequences of $K$ for which $P_{\mathrm{Tam}}(K;1)$ tends to $0$ and $L_{\mathrm{Tam}}(K;-1)$ to $\infty$, as well as sequences of $K$ for which $P_{\mathrm{Tam}}(K;1)$ and $L_{\mathrm{Tam}}(K;-1)$ tend to $1$.


title: Floquet topological $d+id$ superconductivity induced by chiral many-body interactions

abstract: We study how a $d$-wave superconductivity is changed when illuminated by circularly-polarised light (CPL) in the repulsive Hubbard model in the strong-coupling regime. We adopt the Floquet formalism for the Gutzwiller-projected effective Hamiltonian with the time-periodic Schrieffer-Wolff transformation. We find that CPL induces a topological superconductivity with a $d+id$ pairing, which arises from the chiral spin coupling and the three-site term generated by the CPL. The latter term remains significant even for low frequencies and low intensities of the CPL. This is clearly reflected in the obtained phase diagram against the laser intensity and temperature for various frequencies red-detuned from the Hubbard $U$, with the transient dynamics also examined. The phenomenon revealed here can open a novel, dynamical way to induce a topological superconductivity.


title: First-order Phase Transition and Resulted Expansion in Momentum Space

abstract: We point out, according to the principle of entropy growth, that the volume occupied by the system in the momentum space should expand during the first-order phase transition. Such an expansion is visualized by the simulation using the transport model based on a NJL-typed Lagrangian, and quantified by several observables, some of which, proposed for the first time in this article, could be the probes of the first-order phase transition either between the quark gluon plasma and the hadronic phase taking place in the heavy-ion collisions or of the other expanding systems.


title: Learning Optimal Prescriptive Trees from Observational Data

abstract: We consider the problem of learning an optimal prescriptive tree (i.e., an interpretable treatment assignment policy in the form of a binary tree) of moderate depth, from observational data. This problem arises in numerous socially important domains such as public health and personalized medicine, where interpretable and data-driven interventions are sought based on data gathered in deployment -- through passive collection of data -- rather than from randomized trials. We propose a method for learning optimal prescriptive trees using mixed-integer optimization (MIO) technology. We show that under mild conditions our method is asymptotically exact in the sense that it converges to an optimal out-of-sample treatment assignment policy as the number of historical data samples tends to infinity. Contrary to existing literature, our approach: 1) does not require data to be randomized, 2) does not impose stringent assumptions on the learned trees, and 3) has the ability to model domain specific constraints. Through extensive computational experiments, we demonstrate that our asymptotic guarantees translate to significant performance improvements in finite samples, as well as showcase our uniquely flexible modeling power by incorporating budget and fairness constraints.


title: Dynamic Sliding Window for Meeting Summarization

abstract: Recently abstractive spoken language summarization raises emerging research interest, and neural sequence-to-sequence approaches have brought significant performance improvement. However, summarizing long meeting transcripts remains challenging. Due to the large length of source contents and targeted summaries, neural models are prone to be distracted on the context, and produce summaries with degraded quality. Moreover, pre-trained language models with input length limitations cannot be readily applied to long sequences. In this work, we first analyze the linguistic characteristics of meeting transcripts on a representative corpus, and find that the sentences comprising the summary correlate with the meeting agenda. Based on this observation, we propose a dynamic sliding window strategy for meeting summarization. Experimental results show that performance benefit from the proposed method, and outputs obtain higher factual consistency than the base model.


title: SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory

abstract: Lip reading, aiming to recognize spoken sentences according to the given video of lip movements without relying on the audio stream, has attracted great interest due to its application in many scenarios. Although prior works that explore lip reading have obtained salient achievements, they are all trained in a non-simultaneous manner where the predictions are generated requiring access to the full video. To breakthrough this constraint, we study the task of simultaneous lip reading and devise SimulLR, a simultaneous lip Reading transducer with attention-guided adaptive memory from three aspects: (1) To address the challenge of monotonic alignments while considering the syntactic structure of the generated sentences under simultaneous setting, we build a transducer-based model and design several effective training strategies including CTC pre-training, model warm-up and curriculum learning to promote the training of the lip reading transducer. (2) To learn better spatio-temporal representations for simultaneous encoder, we construct a truncated 3D convolution and time-restricted self-attention layer to perform the frame-to-frame interaction within a video segment containing fixed number of frames. (3) The history information is always limited due to the storage in real-time scenarios, especially for massive video data. Therefore, we devise a novel attention-guided adaptive memory to organize semantic information of history segments and enhance the visual representations with acceptable computation-aware latency. The experiments show that the SimulLR achieves the translation speedup 9.10$\times$ compared with the state-of-the-art non-simultaneous methods, and also obtains competitive results, which indicates the effectiveness of our proposed methods.


title: Change of Basis between Classical Orthogonal Polynomials

abstract: Classical orthogonal polynomials have widespread applications including in numerical integration, solving differential equations, and interpolation. Changing basis between classical orthogonal polynomials can affect the convergence, accuracy, and stability of solutions. We provide a general method for changing basis between any pair of classical orthogonal polynomials by using algebraic expressions called coefficient functions that evaluate to connection coefficients. The method builds directly on previous work on the change of basis groupoid. The scope has fifteen kinds of classical orthogonal polynomials including the classes of Jacobi, Gegenbauer and generalized Laguerre polynomials. The method involves the mappings to and from the monomials for these polynomial bases. Sixteen coefficient functions appear to be new for polynomials that do not have definite parity. We derive the remainder from seven sources in the literature. We give a complete summary of thirty coefficient functions. This enables change of basis to be defined algebraically and uniformly between any pair of classical orthogonal polynomial bases by using a vector dot product to compose two coefficient functions to give a third. A definition of Jacobi polynomials uses a basis of shifted monomials. We find a key new mapping between the monomials and Jacobi polynomials by using a general mapping between shifted monomials and monomials. It yields new mappings for the Chebyshev polynomials of the third and fourth kinds and their shifted versions.


title: On negative spheres in elliptic surfaces

abstract: Using elliptic fibrations with specific singular fibers, we find spheres with very negative self-intersections in elliptic surfaces and in their blow-ups.


title: On squares of Dehn twists about non-separating curves of a non-orientable closed surface

abstract: The level $2$ mapping class group of an orientable closed surface can be generated by squares of Dehn twists about non-separating curves. On the other hand, the level $2$ mapping class group $\mathcal{M}_2(N_g)$ of a non-orientable closed surface $N_g$ can not be generated by only Dehn twists, and so it can not be generated by squares of Dehn twists about non-separating curves. In this paper, we prove that the Dehn twist subgroup of $\mathcal{M}_2(N_g)$ can not be generated by squares of Dehn twists about non-separating curves either. As an application, we give a finite generating set for the subgroup of $\mathcal{M}_2(N_g)$ generated by Dehn twist about separating curves and squares of Dehn twists about non-separating curves. Moreover, we examine about actions on non-separating simple closed curves of $N_g$ by $\mathcal{M}_2(N_g)$.


title: Sea urchin sperm exploit extremum seeking control to find the egg

abstract: Sperm cells perform extremely demanding tasks with minimal capabilities. The cells must quickly navigate in a noisy environment to find an egg within a short time window for successful fertilization without any global positioning information. Many research efforts have been dedicated to deriving mathematical principles that explain their superb navigation strategy. Here we show that the navigation strategy of sea urchin sperm, also known as helical klinotaxis, is a natural implementation of a well-established adaptive control paradigm known as extremum seeking. This bridge between control theory and the biology of taxis in microorganisms is expected to deepen our understanding of the process. For example, the formulation leads to a coarse-grained model of the signaling pathway that offers new insights on the peculiar switching-like behavior between high and low gain steering modes observed in sea urchin sperm. Moreover, it may guide engineers in developing bio-inspired miniaturized robots with minimal sensors.


title: Quasiparticle Interference Studies of Quantum Materials

abstract: Exotic electronic states are realized in novel quantum materials. This field is revolutionized by the topological classification of materials. Such compounds necessarily host unique states on their boundaries. Scanning tunneling microscopy studies of these surface states have provided a wealth of spectroscopic characterization, with the successful cooperation of ab initio calculations. The method of quasiparticle interference imaging proves to be particularly useful for probing the dispersion relation of the surface bands. Herein, how a variety of additional fundamental electronic properties can be probed via this method is reviewed. It is demonstrated how quasiparticle interference measurements entail mesoscopic size quantization and the electronic phase coherence in semiconducting nanowires; helical spin protection and energy-momentum fluctuations in a topological insulator; and the structure of the Bloch wave function and the relative insusceptibility of topological electronic states to surface potential in a topological Weyl semimetal.


title: Cohomologically rigid solvable Lie superalgebras with model filiform and model nilpotent nilradical

abstract: In this paper, we find a family $SL^{n,m}$, in any arbitrary dimensions, of cohomologically rigid solvable Lie superalgebras with nilradical the model filiform Lie superalgebra $L^{n,m}$. Moreover, we exhibit a family of cohomologically rigid solvable Lie superalgebras with nilradical the model nilpotent Lie superalgebra of generic characteristic sequence. Both cases correspond to solvable Lie superalgebras of maximal dimension for a given nilradical. Contrariwise, we will show that the family of Lie superalgebras $SL^{n,m}$ can be deformed if defined over a field of odd characteristic.


title: When are Deep Networks really better than Decision Forests at small sample sizes, and how?

abstract: Deep networks and decision forests (such as random forests and gradient boosted trees) are the leading machine learning methods for structured and tabular data, respectively. Many papers have empirically compared large numbers of classifiers on one or two different domains (e.g., on 100 different tabular data settings). However, a careful conceptual and empirical comparison of these two strategies using the most contemporary best practices has yet to be performed. Conceptually, we illustrate that both can be profitably viewed as "partition and vote" schemes. Specifically, the representation space that they both learn is a partitioning of feature space into a union of convex polytopes. For inference, each decides on the basis of votes from the activated nodes. This formulation allows for a unified basic understanding of the relationship between these methods. Empirically, we compare these two strategies on hundreds of tabular data settings, as well as several vision and auditory settings. Our focus is on datasets with at most 10,000 samples, which represent a large fraction of scientific and biomedical datasets. In general, we found forests to excel at tabular and structured data (vision and audition) with small sample sizes, whereas deep nets performed better on structured data with larger sample sizes. This suggests that further gains in both scenarios may be realized via further combining aspects of forests and networks. We will continue revising this technical report in the coming months with updated results.


title: Signal Processing over Multilayer Graphs: Theoretical Foundations and Practical Applications

abstract: Signal processing over single-layer graphs has become a mainstream tool owing to its power in revealing obscure underlying structures within data signals. However, many real-life datasets and systems, {including those in Internet of Things (IoT)}, are characterized by more complex interactions among distinct entities, which may represent multi-level interactions that are harder to be captured with a single-layer graph, and can be better characterized by multilayers graph connections. Such multilayer or multi-level data structure can be more naturally modeled by high-dimensional multilayer graphs (MLG)}. To generalize traditional graph signal processing (GSP) over multilayer graphs for analyzing multi-level signal features and their interactions, this work proposes a tensor-based framework of multilayer graph signal processing (M-GSP). Specifically, we introduce core concepts of M-GSP and study properties of MLG spectrum space, followed by fundamentals of MLG-based filter design. To illustrate novel aspects of M-GSP, we further explore its link with traditional signal processing and GSP. We provide example applications to demonstrate the efficacy and benefits of applying multilayer graphs and M-GSP in practical scenarios.


title: Image Processing via Multilayer Graph Spectra

abstract: Graph signal processing (GSP) has become an important tool in image processing because of its ability to reveal underlying data structures. Many real-life multimedia datasets, however, exhibit heterogeneous structures across frames. Multilayer graphs (MLG), instead of traditional single-layer graphs, provide better representation of these datasets such as videos and hyperspectral images. To generalize GSP to multilayer graph models and develop multilayer analysis for image processing, this work introduces a tensor-based framework of multilayer graph signal processing (M-GSP) and present useful M-GSP tools for image processing. We then present guidelines for applying M-GSP in image processing and introduce several applications, including RGB image compression, edge detection and hyperspectral image segmentation. Successful experimental results demonstrate the efficacy and promising futures of M-GSP in image processing.


title: Module-Power Prediction from PL Measurements using Deep Learning

abstract: The individual causes for power loss of photovoltaic modules are investigated for quite some time. Recently, it has been shown that the power loss of a module is, for example, related to the fraction of inactive areas. While these areas can be easily identified from electroluminescense (EL) images, this is much harder for photoluminescence (PL) images. With this work, we close the gap between power regression from EL and PL images. We apply a deep convolutional neural network to predict the module power from PL images with a mean absolute error (MAE) of 4.4% or 11.7WP. Furthermore, we depict that regression maps computed from the embeddings of the trained network can be used to compute the localized power loss. Finally, we show that these regression maps can be used to identify inactive regions in PL images as well.


title: Boosting the Conformational Sampling by Combining Replica Exchange with Solute Tempering and Well-Sliced Metadynamics

abstract: Methods that combine collective variable (CV) based enhanced sampling and global tempering approaches are used in speeding-up the conformational sampling and free energy calculation of large and soft systems with a plethora of energy minima. In this paper, a new method of this kind is proposed in which the well-sliced metadynamics approach (WSMTD) is united with Replica Exchange with Solute Tempering (REST2) method. WSMTD employs a divide-and-conquer strategy wherein high-dimensional slices of a free energy surface are independently sampled and combined. The method enables one to accomplish a controlled exploration of the CV-space with a restraining bias as in umbrella sampling (US), and enhance-sampling of one or more orthogonal CVs using a metadynamics (MTD) like bias. The new hybrid method proposed here enables boosting the sampling of more slow degrees of freedom in WSMTD simulations, without the need to specify associated CVs, through a replica exchange scheme within the framework of REST2. The high-dimensional slices of the probability distributions of CVs computed from the united WSMTD and REST2 simulations are subsequently combined using the weighted histogram analysis method (WHAM) to obtain the free energy surface. We show that the new method proposed here is accurate, improves the conformational sampling, and achieves quick convergence in free energy estimates. We demonstrate this by computing the conformational free energy landscapes of solvated alanine tripeptide and Trp-cage mini protein in explicit water.


title: Advanced Laser Technology for Quantum Communications (Tutorial Review)

abstract: Quantum communications is the art of exchanging and manipulating information beyond the capabilities of the conventional technologies using the laws of quantum mechanics. With applications ranging from quantum computing to cryptographic systems with information-theoretic security, there is strong incentive to introduce quantum communications into many areas of the society. However, an important challenge is to develop viable technologies meeting the stringent requirements of low noise and high coherence for quantum state encoding, of high bit rate and low power for the integration with classical communication networks, and of scalable and low-cost production for a practical wide-deployment. This tutorial presents recent advances in laser modulation technologies that have enabled the development of efficient and versatile light sources for quantum communications, with a particular focus on quantum key distribution (QKD). Such approaches have been successfully used to demonstrate several QKD protocols with state-of-the-art performance. The applications and experimental results are reviewed and interpreted in the light of a complete theoretical background, allowing the reader to model and simulate such sources.


title: Learning to Synthesize Programs as Interpretable and Generalizable Policies

abstract: Recently, deep reinforcement learning (DRL) methods have achieved impressive performance on tasks in a variety of domains. However, neural network policies produced with DRL methods are not human-interpretable and often have difficulty generalizing to novel scenarios. To address these issues, prior works explore learning programmatic policies that are more interpretable and structured for generalization. Yet, these works either employ limited policy representations (e.g. decision trees, state machines, or predefined program templates) or require stronger supervision (e.g. input/output state pairs or expert demonstrations). We present a framework that instead learns to synthesize a program, which details the procedure to solve a task in a flexible and expressive manner, solely from reward signals. To alleviate the difficulty of learning to compose programs to induce the desired agent behavior from scratch, we propose to first learn a program embedding space that continuously parameterizes diverse behaviors in an unsupervised manner and then search over the learned program embedding space to yield a program that maximizes the return for a given task. Experimental results demonstrate that the proposed framework not only learns to reliably synthesize task-solving programs but also outperforms DRL and program synthesis baselines while producing interpretable and more generalizable policies. We also justify the necessity of the proposed two-stage learning scheme as well as analyze various methods for learning the program embedding.


title: A globally smooth solution to the relativistic string equation

abstract: We prove the global existence of smooth solution to the relativistic string equation in a class of data that is not small. Our solution admits the feature that the right-travelling wave can be large and the left-travelling wave is sufficiently small, and vice versa. In particular, the large-size solution exists in the whole space, instead of a null strip arising from the short pulse data. This generalizes the result of Liuli-Yang-Yu (Adv. Math. 2018) to the quasilinear setting with non-small data. In addition, in our companion paper, we are able to show the global solution here can also be seen as the non-small perturbations of the plane wave solutions.


title: Higher Auslander correspondence for exact categories

abstract: Inspired by the recent work of Henrard, Kvamme and van Roosmalen [17], we prove a categorified version of higher Auslander correspondence in the context of exact categories. We define n-Auslander exact categories and show that there is a bijection between the equivalence classes of n-cluster tilting subcategories of exact categories and the equivalence classes of n-Auslander exact categories.


title: Combined dark matter searches towards dwarf spheroidal galaxies with Fermi-LAT, HAWC, H.E.S.S., MAGIC, and VERITAS

abstract: Cosmological and astrophysical observations suggest that 85\% of the total matter of the Universe is made of Dark Matter (DM). However, its nature remains one of the most challenging and fundamental open questions of particle physics. Assuming particle DM, this exotic form of matter cannot consist of Standard Model (SM) particles. Many models have been developed to attempt unraveling the nature of DM such as Weakly Interacting Massive Particles (WIMPs), the most favored particle candidates. WIMP annihilations and decay could produce SM particles which in turn hadronize and decay to give SM secondaries such as high energy $\gamma$ rays. In the framework of indirect DM search, observations of promising targets are used to search for signatures of DM annihilation. Among these, the dwarf spheroidal galaxies (dSphs) are commonly favored owing to their expected high DM content and negligible astrophysical background. In this work, we present the very first combination of 20 dSph observations, performed by the Fermi-LAT, HAWC, H.E.S.S., MAGIC, and VERITAS collaborations in order to maximize the sensitivity of DM searches and improve the current results. We use a joint maximum likelihood approach combining each experiment's individual analysis to derive more constraining upper limits on the WIMP DM self-annihilation cross-section as a function of DM particle mass. We present new DM constraints over the widest mass range ever reported, extending from 5 GeV to 100 TeV thanks to the combination of these five different $\gamma$-ray instruments.


title: A Mechanically Verified Theory of Contracts

abstract: Cyber-physical systems (CPS) are assemblies of networked, heterogeneous, hardware, and software components sensing, evaluating, and actuating a physical environment. This heterogeneity induces complexity that makes CPSs challenging to model correctly. Since CPSs often have critical functions, it is however of utmost importance to formally verify them in order to provide the highest guarantees of safety. Faced with CPS complexity, model abstraction becomes paramount to make verification attainable. To this end, assume/guarantee contracts enable component model abstraction to support a sound, structured, and modular verification process. While abstractions of models by contracts are usually proved sound, none of the related contract frameworks themselves have, to the best of our knowledge, been formally proved correct so far. In this aim, we present the formalization of a generic assume/guarantee contract theory in the proof assistant Coq. We identify and prove theorems that ensure its correctness. Our theory is generic, or parametric, in that it can be instantiated and used with any given logic, in particular hybrid logics, in which highly complex cyber-physical systems can uniformly be described.


title: Autonomous Rollator: A Case Study in the Agebots Project

abstract: In this paper, we present an iterative development process for a functional model of an autonomous, location-orienting rollator. An interdisciplinary team was involved in the development, working closely with the end-users. This example shows that the design thinking method is suitable for the development of frontier technology devices in the care sector.


title: Resonant nonlinear response of a nanomechanical system with broken symmetry

abstract: We study the response of a weakly damped vibrational mode of a nanostring resonator to a moderately strong resonant driving force. Because of the geometry of the experiment, the studied flexural vibrations lack inversion symmetry. As we show, this leads to a nontrivial dependence of the vibration amplitude on the force parameters. For a comparatively weak force, the response has the familiar Duffing form, but for a somewhat stronger force, it becomes significantly different. Concurrently there emerge vibrations at twice the drive frequency, a signature of the broken symmetry. Their amplitude and phase allow us to establish the cubic nonlinearity of the potential of the mode as the mechanism responsible for both observations. The developed theory goes beyond the standard rotating-wave approximation. It quantitatively describes the experiment and allows us to determine the nonlinearity parameters.


title: Heterogeneous Graph Neural Network with Multi-view Representation Learning

abstract: Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. However, on the one hand, most of existing heterogeneous graph embedding methods either insufficiently model the local structure under specific semantic, or neglect the heterogeneity when aggregating information from it. On the other hand, representations from multiple semantics are not comprehensively integrated to obtain versatile node embeddings. To address the problem, we propose a Heterogeneous Graph Neural Network with Multi-View Representation Learning (named MV-HetGNN) for heterogeneous graph embedding by introducing the idea of multi-view representation learning. The proposed model consists of node feature transformation, view-specific ego graph encoding and auto multi-view fusion to thoroughly learn complex structural and semantic information for generating comprehensive node representations. Extensive experiments on three real-world heterogeneous graph datasets show that the proposed MV-HetGNN model consistently outperforms all the state-of-the-art GNN baselines in various downstream tasks, e.g., node classification, node clustering, and link prediction.


title: Kondomania

abstract: Originally the Kondo effect describes a scattering mechanism of electrons in metals that have defects with internal quantum mechanical degrees of freedom. The characteristic dynamic interplay between localized and itinerant states occurs in many different forms. It is now clear that the Kondo effect shapes the properties of various classes of quantum materials and is a key to understanding their unusual properties. In the following we outline a selection of the most important developments in this Kondomania.


title: Cohomology of simple modules for ${\mathfrak{sl}}_3(k)$ in characteristic $3$

abstract: In this paper, we calculate cohomology of a classical Lie algebra of type $A_2$ over an algebraically field $k$ of characteristic $p=3$ with coefficients in simple modules. To describe their structure, we will consider them as modules over an algebraic group $SL_3(k).$ In the case of characteristic $p=3,$ there are only two peculiar simple modules: a simple module isomorphic to the quotient module of the adjoint module by the center, and a one-dimensional trivial module. The results on the cohomology of simple nontrivial module are used for calculate the coomology of the adjoint module. We also calculate cohomology of the simple quotient algebra Lie of $A_2$ by the center.


title: Explaining Classes through Word Attribution

abstract: In recent years, several methods have been proposed for explaining individual predictions of deep learning models, yet there has been little study of how to aggregate these predictions to explain how such models view classes as a whole in text classification tasks. In this work, we propose a method for explaining classes using deep learning models and the Integrated Gradients feature attribution technique by aggregating explanations of individual examples in text classification to general descriptions of the classes. We demonstrate the approach on Web register (genre) classification using the XML-R model and the Corpus of Online Registers of English (CORE), finding that the method identifies plausible and discriminative keywords characterizing all but the smallest class.


title: Discretized Integrated Gradients for Explaining Language Models

abstract: As a prominent attribution-based explanation algorithm, Integrated Gradients (IG) is widely adopted due to its desirable explanation axioms and the ease of gradient computation. It measures feature importance by averaging the model's output gradient interpolated along a straight-line path in the input data space. However, such straight-line interpolated points are not representative of text data due to the inherent discreteness of the word embedding space. This questions the faithfulness of the gradients computed at the interpolated points and consequently, the quality of the generated explanations. Here we propose Discretized Integrated Gradients (DIG), which allows effective attribution along non-linear interpolation paths. We develop two interpolation strategies for the discrete word embedding space that generates interpolation points that lie close to actual words in the embedding space, yielding more faithful gradient computation. We demonstrate the effectiveness of DIG over IG through experimental and human evaluations on multiple sentiment classification datasets. We provide the source code of DIG to encourage reproducible research.


title: MELM: Data Augmentation with Masked Entity Language Modeling for Low-Resource NER

abstract: Data augmentation is an effective solution to data scarcity in low-resource scenarios. However, when applied to token-level tasks such as NER, data augmentation methods often suffer from token-label misalignment, which leads to unsatsifactory performance. In this work, we propose Masked Entity Language Modeling (MELM) as a novel data augmentation framework for low-resource NER. To alleviate the token-label misalignment issue, we explicitly inject NER labels into sentence context, and thus the fine-tuned MELM is able to predict masked entity tokens by explicitly conditioning on their labels. Thereby, MELM generates high-quality augmented data with novel entities, which provides rich entity regularity knowledge and boosts NER performance. When training data from multiple languages are available, we also integrate MELM with code-mixing for further improvement. We demonstrate the effectiveness of MELM on monolingual, cross-lingual and multilingual NER across various low-resource levels. Experimental results show that our MELM presents substantial improvement over the baseline methods.


title: A color temperature-based high-speed decolorization: an empirical approach for tone mapping applications

abstract: Grayscale images are fundamental to many image processing applications like data compression, feature extraction, printing and tone mapping. However, some image information is lost when converting from color to grayscale. In this paper, we propose a light-weight and high-speed image decolorization method based on human perception of color temperatures. Chromatic aberration results from differential refraction of light depending on its wavelength. It causes some rays corresponding to cooler colors (like blue, green) to converge before the warmer colors (like red, orange). This phenomena creates a perception of warm colors "advancing" toward the eye, while the cool colors to be "receding" away. In this proposed color to gray conversion model, we implement a weighted blending function to combine red (perceived warm) and blue (perceived cool) channel. Our main contribution is threefold: First, we implement a high-speed color processing method using exact pixel by pixel processing, and we report a $5.7\times$ speed up when compared to other new algorithms. Second, our optimal color conversion method produces luminance in images that are comparable to other state of the art methods which we quantified using the objective metrics (E-score and C2G-SSIM) and a subjective user study. Third, we demonstrate that an effective luminance distribution can be achieved using our algorithm by using global and local tone mapping applications.


title: Double Machine Learning for Partially Linear Mixed-Effects Models with Repeated Measurements

abstract: Traditionally, spline or kernel approaches in combination with parametric estimation are used to infer the linear coefficient (fixed effects) in a partially linear mixed-effects model for repeated measurements. Using machine learning algorithms allows us to incorporate complex interaction structures and high-dimensional variables. We employ double machine learning to cope with the nonparametric part of the partially linear mixed-effects model: the nonlinear variables are regressed out nonparametrically from both the linear variables and the response. This adjustment can be performed with any machine learning algorithm, for instance random forests, which allows to take complex interaction terms and nonsmooth structures into account. The adjusted variables satisfy a linear mixed-effects model, where the linear coefficient can be estimated with standard linear mixed-effects techniques. We prove that the estimated fixed effects coefficient converges at the parametric rate, is asymptotically Gaussian distributed, and semiparametrically efficient. Two simulation studies demonstrate that our method outperforms a penalized regression spline approach in terms of coverage. We also illustrate our proposed approach on a longitudinal dataset with HIV-infected individuals. Software code for our method is available in the R-package dmlalg.


title: Automatic Rule Generation for Time Expression Normalization

abstract: The understanding of time expressions includes two sub-tasks: recognition and normalization. In recent years, significant progress has been made in the recognition of time expressions while research on normalization has lagged behind. Existing SOTA normalization methods highly rely on rules or grammars designed by experts, which limits their performance on emerging corpora, such as social media texts. In this paper, we model time expression normalization as a sequence of operations to construct the normalized temporal value, and we present a novel method called ARTime, which can automatically generate normalization rules from training data without expert interventions. Specifically, ARTime automatically captures possible operation sequences from annotated data and generates normalization rules on time expressions with common surface forms. The experimental results show that ARTime can significantly surpass SOTA methods on the Tweets benchmark, and achieves competitive results with existing expert-engineered rule methods on the TempEval-3 benchmark.


title: Gray Cycles of Maximum Length Related to k-Character Substitutions

abstract: Given a word binary relation $\tau$ we define a $\tau$-Gray cycle over a finite language X to be a permutation w [i] 0$\le$i$\le$|X|--1 of X such that each word wi is an image of the previous word wi--1 by $\tau$. In that framework, we introduce the complexity measure $\lambda$(n), equal to the largest cardinality of a language X having words of length at most n, and such that a $\tau$-Gray cycle over X exists. The present paper is concerned with the relation $\tau$ = $\sigma$ k , the so-called k-character substitution, where (u, v) belongs to $\sigma$ k if, and only if, the Hamming distance of u and v is k. We compute the bound $\lambda$(n) for all cases of the alphabet cardinality and the argument n.


title: Formalizing the Gromov-Hausdorff space

abstract: The Gromov-Hausdorff space is usually defined in textbooks as "the space of all compact metric spaces up to isometry". We describe a formalization of this notion in the Lean proof assistant, insisting on how we need to depart from the usual informal viewpoint of mathematicians on this object to get a rigorous formalization.


title: Using convolutional neural networks for the classification of breast cancer images

abstract: An important part of breast cancer staging is the assessment of the sentinel axillary node for early signs of tumor spreading. However, this assessment by pathologists is not always easy and retrospective surveys often requalify the status of a high proportion of sentinel nodes. Convolutional Neural Networks (CNNs) are a class of deep learning algorithms that have shown excellent performances in the most challenging visual classification tasks, with numerous applications in medical imaging. In this study I compare twelve different CNNs and different hardware acceleration devices for the detection of breast cancer from microscopic images of breast cancer tissue. Convolutional models are trained and tested on two public datasets. The first one is composed of more than 300,000 images of sentinel lymph node tissue from breast cancer patients, while the second one has more than 220,000 images from inductive breast carcinoma tissue, one of the most common forms of breast cancer. Four different hardware acceleration cards were used, with an off-the-shelf deep learning framework. The impact of transfer learning and hyperparameters fine-tuning are tested. Hardware acceleration device performance can improve training time by a factor of five to twelve, depending on the model used. On the other hand, increasing convolutional depth will augment the training time by a factor of four to six times, depending on the acceleration device used. Increasing the depth and the complexity of the model generally improves performance, but the relationship is not linear and also depends on the architecture of the model. The performance of transfer learning is always worse compared to a complete retraining of the model. Fine-tuning the hyperparameters of the model improves the results, with the best model showing a performance comparable to state-of-the-art models.


title: Perfect and nearly perfect separation dimension of complete and random graphs

abstract: The separation dimension of a hypergraph $G$ is the smallest natural number $d$ for which there is an embedding of $G$ into $\mathbb{R}^d$, such that any pair of disjoint edges is separated by some hyperplane normal to one of the axes. The perfect separation dimension further requires that any pair of disjoint edges is separated by the same amount of such (pairwise nonparallel) hyperplanes. While it is known that for any fixed $r \ge 2$, the separation dimension of any $n$-vertex $r$-graph is $O(\log n)$, the perfect separation dimension is much larger. In fact, no polynomial upper-bound for the perfect separation dimension of $r$-uniform hypergraphs is known. In our first result we essentially resolve the case $r=2$, i.e. graphs. We prove that the perfect separation dimension of $K_n$ is linear in $n$, up to a small polylogarithmic factor. In fact, we prove it is at least $n/2-1$ and at most $n(\log n)^{1+o(1)}$. Our second result proves that the perfect separation dimension of almost all graphs is also linear in $n$, up to a logarithmic factor. This follows as a special case of a more general result showing that the perfect separation dimension of the random graph $G(n,p)$ is w.h.p. $\Omega(n p /\log n)$ for a wide range of values of $p$, including all constant $p$. Finally, we prove that significantly relaxing perfection to just requiring that any pair of disjoint edges of $K_n$ is separated the same number of times up to a difference of $c \log n$ for some absolute constant $c$, still requires the dimension to be $\Omega(n)$. This is perhaps surprising as it is known that if we allow a difference of $7\log_2 n$, then the dimension reduces to $O(\log n)$.


title: Preparation and Readout of Multielectron High-Spin States in a Gate-Defined GaAs/AlGaAs Quantum Dot

abstract: We report the preparation and readout of multielectron high-spin states, a three-electron quartet, and a four-electron quintet, in a gate-defined GaAs/AlGaAs single quantum dot using spin filtering by quantum Hall edge states coupled to the dot. The readout scheme consists of mapping from multielectron to two-electron spin states and a subsequent two-electron spin readout, thus obviating the need to resolve dense multielectron energy levels. Using this technique, we measure the relaxations of the high-spin states and find them to be an order of magnitude faster than those of low-spin states. Numerical calculations of spin relaxation rates using the exact diagonalization method agree with the experiment. The technique developed here offers a new tool for the study and application of high-spin states in quantum dots.


title: Lane level context and hidden space characterization for autonomous driving

abstract: For an autonomous vehicle, situation understand-ing is a key capability towards safe and comfortable decision-making and navigation. Information is in general provided bymultiple sources. Prior information about the road topology andtraffic laws can be given by a High Definition (HD) map whilethe perception system provides the description of the spaceand of road entities evolving in the vehicle surroundings. Incomplex situations such as those encountered in urban areas,the road user behaviors are governed by strong interactionswith the others, and with the road network. In such situations,reliable situation understanding is therefore mandatory to avoidinappropriate decisions. Nevertheless, situation understandingis a complex task that requires access to a consistent andnon-misleading representation of the vehicle surroundings. Thispaper proposes a formalism (an interaction lane grid) whichallows to represent, with different levels of abstraction, thenavigable and interacting spaces which must be considered forsafe navigation. A top-down approach is chosen to assess andcharacterize the relevant information of the situation. On a highlevel of abstraction, the identification of the areas of interestwhere the vehicle should pay attention is depicted. On a lowerlevel, it enables to characterize the spatial information in aunified representation and to infer additional information inoccluded areas by reasoning with dynamic objects.


title: Is First Person Vision Challenging for Object Tracking?

abstract: Understanding human-object interactions is fundamental in First Person Vision (FPV). Tracking algorithms which follow the objects manipulated by the camera wearer can provide useful cues to effectively model such interactions. Visual tracking solutions available in the computer vision literature have significantly improved their performance in the last years for a large variety of target objects and tracking scenarios. However, despite a few previous attempts to exploit trackers in FPV applications, a methodical analysis of the performance of state-of-the-art trackers in this domain is still missing. In this paper, we fill the gap by presenting the first systematic study of object tracking in FPV. Our study extensively analyses the performance of recent visual trackers and baseline FPV trackers with respect to different aspects and considering a new performance measure. This is achieved through TREK-150, a novel benchmark dataset composed of 150 densely annotated video sequences. Our results show that object tracking in FPV is challenging, which suggests that more research efforts should be devoted to this problem so that tracking could benefit FPV tasks.


title: Asynchronous and coherent dynamics in balanced excitatory-inhibitory spiking networks

abstract: Dynamic excitatory-inhibitory (E-I) balance is a paradigmatic mechanism invoked to explain the irregular low firing activity observed in the cortex. However, we will show that the E-I balance can be at the origin of other regimes observable in the brain. The analysis is performed by combining simulations of sparse E-I networks composed of N spiking neurons with analytical investigations of low dimensional neural mass models. The bifurcation diagrams, derived for the neural mass model, allow to classify the asynchronous and coherent behaviours emerging any finite in-degree K. In the limit N >> K >> 1 both supra and sub-threshold balanced asynchronous regimes can be observed. Due to structural heterogeneity the asynchronous states are characterized by the splitting of the neurons in three groups: silent, fluctuation and mean driven. The coherent rhythms are characterized by regular or irregular temporal fluctuations joined to spatial coherence similar to coherent fluctuations observed in the cortex over multiple spatial scales. Collective Oscillations (COs) can emerge due to two different mechanisms. A first mechanism similar to the pyramidal-interneuron gamma (PING) one. The second mechanism is intimately related to the presence of current fluctuations, which sustain COs characterized by an essentially simultaneous bursting of the two populations. We observe period-doubling cascades involving the PING-like COs finally leading to the appearance of coherent chaos. For sufficiently strong current fluctuations we report a novel mechanism of frequency locking among collective rhythms promoted by these intrinsic fluctuations. Our analysis suggest that despite PING-like or fluctuation driven COS are observable for any finite in-degree K, in the limit N >> K >> 1 these solutions result in two coexisting balanced regimes: an asynchronous and a fully synchronized one.


title: Self-propulsion of a light-powered microscopic crystalline flapper in water

abstract: A key goal in developing molecular microrobots that mimic real-world animal dynamic behavior is to understand better the self-continuous progressive motion resulting from collective molecular transformation. This study reports, for the first time, the experimental realization of directional swimming of a microcrystal that exhibits self-continuous reciprocating motion in a two-dimensional water tank. Although the reciprocal flip motion of the crystals was like that of a fish wagging its tail fin, many of the crystals swam in the opposite direction to which a fish would swim. Here we explore the directionality generation mechanism and physical features of the swimming behavior by constructing a mathematical model for the crystalline flapper. The results show that a tiny crystal with a less-deformable part in its flip fin exhibits a pull-type stroke swimming, while a crystal with a fin that uniformly deforms exhibits push-type kicking motion.

categories: cond-mat.soft cond-mat.mes-hall nlin.AO nlin.PS physics.chem-ph


title: A globally stable self-similar blowup profile in energy supercritical Yang-Mills theory

abstract: This paper is concerned with the Cauchy problem for an energy-supercritical nonlinear wave equation in odd space dimensions that arises in equivariant Yang-Mills theory. In each dimension, there is a self-similar finite-time blowup solution to this equation known in closed form. It will be proved that this profile is stable in the whole space under small perturbations of the initial data. The blowup analysis is based on a recently developed coordinate system called hyperboloidal similarity coordinates and depends crucially on growth estimates for the free wave evolution, which will be constructed systematically for odd space dimensions in the first part of this paper. This allows to develop a nonlinear stability theory beyond the singularity.


title: Unit-Modulus Wireless Federated Learning Via Penalty Alternating Minimization

abstract: Wireless federated learning (FL) is an emerging machine learning paradigm that trains a global parametric model from distributed datasets via wireless communications. This paper proposes a unit-modulus wireless FL (UMWFL) framework, which simultaneously uploads local model parameters and computes global model parameters via optimized phase shifting. The proposed framework avoids sophisticated baseband signal processing, leading to both low communication delays and implementation costs. A training loss bound is derived and a penalty alternating minimization (PAM) algorithm is proposed to minimize the nonconvex nonsmooth loss bound. Experimental results in the Car Learning to Act (CARLA) platform show that the proposed UMWFL framework with PAM algorithm achieves smaller training losses and testing errors than those of the benchmark scheme.


title: Consistency and prior falsification of training data in seismic deep learning: Application to offshore deltaic reservoir characterization

abstract: Deep learning applications of seismic reservoir characterization often require generation of synthetic data to augment available sparse labeled data. An approach for generating synthetic training data consists of specifying probability distributions modeling prior geologic uncertainty on reservoir properties and forward modeling the seismic data. A prior falsification approach is critical to establish the consistency of the synthetic training data distribution with real seismic data. With the help of a real case study of facies classification with convolutional neural networks (CNNs) from an offshore deltaic reservoir, we highlight several practical nuances associated with training deep learning models on synthetic seismic data. We highlight the issue of overfitting of CNNs to the synthetic training data distribution and propose regularization strategies to address it. We demonstrate the efficacy of our proposed strategies by training the CNN on synthetic data and making robust predictions with real 3D partial stack seismic data.


title: Is happiness u-shaped in age everywhere? A methodological reconsideration for Europe

abstract: A recent contribution to research on age and well-being (Blanchflower 2021) found that the impact of age on happiness is "u-shaped" virtually everywhere: happiness declines towards middle age and subsequently rises, in almost all countries. This paper evaluates that finding for European countries, considering whether it is robust to alternative methodological approaches. The analysis here excludes control variables that are affected by age (noting that those variable are not themselves antecedents of age) and uses data from the entire adult age range (rather than using data only from respondents younger than 70). I also explore the relationship via models that do not impose a quadratic functional form. The paper shows that these alternate approaches do not lead us to perceive a u-shape "everywhere": u-shapes are evident for some countries, but for others the pattern is quite different.


title: SANSformers: Self-Supervised Forecasting in Electronic Health Records with Attention-Free Models

abstract: Despite the proven effectiveness of Transformer neural networks across multiple domains, their performance with Electronic Health Records (EHR) can be nuanced. The unique, multidimensional sequential nature of EHR data can sometimes make even simple linear models with carefully engineered features more competitive. Thus, the advantages of Transformers, such as efficient transfer learning and improved scalability are not always fully exploited in EHR applications. Addressing these challenges, we introduce SANSformer, an attention-free sequential model designed with specific inductive biases to cater for the unique characteristics of EHR data. In this work, we aim to forecast the demand for healthcare services, by predicting the number of patient visits to healthcare facilities. The challenge amplifies when dealing with divergent patient subgroups, like those with rare diseases, which are characterized by unique health trajectories and are typically smaller in size. To address this, we employ a self-supervised pretraining strategy, Generative Summary Pretraining (GSP), which predicts future summary statistics based on past health records of a patient. Our models are pretrained on a health registry of nearly one million patients, then fine-tuned for specific subgroup prediction tasks, showcasing the potential to handle the multifaceted nature of EHR data. In evaluation, SANSformer consistently surpasses robust EHR baselines, with our GSP pretraining method notably amplifying model performance, particularly within smaller patient subgroups. Our results illuminate the promising potential of tailored attention-free models and self-supervised pretraining in refining healthcare utilization predictions across various patient demographics.