title: Clustering of marine-debris- and \emph{Sargassum}-like drifters explained by inertial particle dynamics}

abstract: Drifters designed to mimic floating marine debris and small patches of pelagic \emph{Sargassum} were satellite tracked in four regions across the North Atlantic. Though subjected to the same initial conditions at each site, the tracks of different drifters quickly diverged after deployment. We explain the clustering of drifter types using a recent Maxey-Riley theory for surface ocean inertial particle dynamics applied on multidata-based mesoscale ocean currents and winds from reanalysis. Simulated trajectories of objects at the air-sea interface are significantly improved when represented as inertial (accounting for buoyancy and size), rather than as perfectly Lagrangian (fluid following) particles. Separation distances between simulated and observed trajectories were substantially smaller for debris-like drifters than for \emph{Sargassum}-like drifters, suggesting that additional consideration of its physical properties relative to fluid velocities may be useful. Our findings can be applied to model variability in movements and distribution of diverse objects floating at the ocean surface.


title: A 16 deg$^2$ survey of emission-line galaxies at z<1.6 from HSC-SSP PDR2 and CHORUS

abstract: We have conducted a comprehensive survey of emission-line galaxies at $z\lesssim1.6$ based on narrowband (NB) imaging data taken with Hyper Suprime-Cam (HSC) on the Subaru telescope. In this paper, we update the catalogs of H$\alpha$, [OIII], and [OII] emission-line galaxies using the data from the second Public Data Release (PDR2) of Subaru Strategic Program (SSP) of HSC and Cosmic HydrOgen Reionization Unveiled with Subaru (CHORUS) survey along with the spectroscopic redshifts for 2,019 emission-line galaxies selected with the PDR1 data. The wider effective coverage of NB816 and NB921, 16.3 deg$^2$ and 16.9 deg$^2$ respectively, are available in the Deep and UltraDeep layers of HSC-SSP from the PDR2. The CHORUS survey provides us with data with additional three NBs (NB527, NB718, and NB973) in the COSMOS field in the UltraDeep layer (1.37 deg$^2$). The five NB datasets allow us to investigate the star-forming galaxies presenting emission-lines at 14 specific redshifts ranging from $z\sim1.6$ down to $z\sim0.05$. We revisit the distribution of large-scale structures and luminosity functions (LFs) for the emission-line galaxies with the large samples of 75,377 emission-line galaxies selected. The redshift revolution of LFs shows that the star formation rate densities (SFRDs) decreases monotonically from $z\sim1.6$, which is consistent with the cosmic SFRD ever known. Our samples of emission-line galaxies covering a sufficiently large survey volume are useful to investigate the evolution of star-forming galaxies since the cosmic noon in a wide range of environments including galaxy clusters, filaments, and voids.


title: Reduced Lattices of Synchrony Subspaces and their Indices

abstract: For a regular coupled cell network, synchrony subspaces are the polydiagonal subspaces that are invariant under the network adjacency matrix. The complete lattice of synchrony subspaces of an $n$-cell regular network can be seen as an intersection of the partition lattice of $n$ elements and a lattice of invariant subspaces of the associated adjacency matrix. We assign integer tuples with synchrony subspaces, and use them for identifying equivalent synchrony subspaces to be merged. Based on this equivalence, the initial lattice of synchrony subspaces can be reduced to a lattice of synchrony subspaces which corresponds to a simple eigenvalue case discussed in our previous work. The result is a reduced lattice of synchrony subspaces, which affords a well-defined non-negative integer index that leads to bifurcation analysis in regular coupled cell networks.


title: Automatic Image Labelling at Pixel Level

abstract: The performance of deep networks for semantic image segmentation largely depends on the availability of large-scale training images which are labelled at the pixel level. Typically, such pixel-level image labellings are obtained manually by a labour-intensive process. To alleviate the burden of manual image labelling, we propose an interesting learning approach to generate pixel-level image labellings automatically. A Guided Filter Network (GFN) is first developed to learn the segmentation knowledge from a source domain, and such GFN then transfers such segmentation knowledge to generate coarse object masks in the target domain. Such coarse object masks are treated as pseudo labels and they are further integrated to optimize/refine the GFN iteratively in the target domain. Our experiments on six image sets have demonstrated that our proposed approach can generate fine-grained object masks (i.e., pixel-level object labellings), whose quality is very comparable to the manually-labelled ones. Our proposed approach can also achieve better performance on semantic image segmentation than most existing weakly-supervised approaches.


title: On metric spaces with given transfinite asymptotic dimensions

abstract: For every countable ordinal number $\xi$, we construct a metric space $X_{\xi}$ whose transfinite asymptotic dimension and complementary-finite asymptotic dimension are both $\xi$.


title: Properties of nuclear pastas

abstract: In this Review we study the nuclear pastas as they are expected to be formed in neutron star cores. We start with a study of the pastas formed in nuclear matter (composed of protons and neutrons), we follow with the role of the electron gas on the formation of pastas, and we then investigate the pastas in neutron star matter (nuclear matter embedded in an electron gas).


title: Exponential Convergence for Multiscale Linear Elliptic PDEs via Adaptive Edge Basis Functions

abstract: In this paper, we introduce a multiscale framework based on adaptive edge basis functions to solve second-order linear elliptic PDEs with rough coefficients. One of the main results is that we prove the proposed multiscale method achieves nearly exponential convergence in the approximation error with respect to the computational degrees of freedom. Our strategy is to perform an energy orthogonal decomposition of the solution space into a coarse scale component comprising $a$-harmonic functions in each element of the mesh, and a fine scale component named the bubble part that can be computed locally and efficiently. The coarse scale component depends entirely on function values on edges. Our approximation on each edge is made in the Lions-Magenes space $H_{00}^{1/2}(e)$, which we will demonstrate to be a natural and powerful choice. We construct edge basis functions using local oversampling and singular value decomposition. When local information of the right-hand side is adaptively incorporated into the edge basis functions, we prove a nearly exponential convergence rate of the approximation error. Numerical experiments validate and extend our theoretical analysis; in particular, we observe no obvious degradation in accuracy for high-contrast media problems.


title: Scaling of Energy Dissipation in Nonequilibrium Reaction Networks

abstract: The energy dissipation rate in a nonequilibirum reaction system can be determined by the reaction rates in the underlying reaction network. By developing a coarse-graining process in state space and a corresponding renormalization procedure for reaction rates, we find that energy dissipation rate has an inverse power-law dependence on the number of microscopic states in a coarse-grained state. The dissipation scaling law requires self-similarity of the underlying network, and the scaling exponent depends on the network structure and the flux correlation. Implications of this inverse dissipation scaling law for active flow systems such as microtubule-kinesin mixture are discussed.


title: Sheaf theoretic compactifications of the space of rational quartic plane curves

abstract: Let $R_4$ be the space of rational plane curves of degree $4$. In this paper, we obtain a sheaf theoretic compactification of $R_4$ via the space of $\alpha$-semistable pairs on $\mathbb{P}^2$ and its birational relations through wall-crossings of semistable pairs. We obtain the Poincar\'e polynomial of the compactified space.


title: Widest Paths and Global Propagation in Bounded Value Iteration for Stochastic Games

abstract: Solving stochastic games with the reachability objective is a fundamental problem, especially in quantitative verification and synthesis. For this purpose, bounded value iteration (BVI) attracts attention as an efficient iterative method. However, BVI's performance is often impeded by costly end component (EC) computation that is needed to ensure convergence. Our contribution is a novel BVI algorithm that conducts, in addition to local propagation by the Bellman update that is typical of BVI, global propagation of upper bounds that is not hindered by ECs. To conduct global propagation in a computationally tractable manner, we construct a weighted graph and solve the widest path problem in it. Our experiments show the algorithm's performance advantage over the previous BVI algorithms that rely on EC computation.


title: Analysis of Q-learning with Adaptation and Momentum Restart for Gradient Descent

abstract: Existing convergence analyses of Q-learning mostly focus on the vanilla stochastic gradient descent (SGD) type of updates. Despite the Adaptive Moment Estimation (Adam) has been commonly used for practical Q-learning algorithms, there has not been any convergence guarantee provided for Q-learning with such type of updates. In this paper, we first characterize the convergence rate for Q-AMSGrad, which is the Q-learning algorithm with AMSGrad update (a commonly adopted alternative of Adam for theoretical analysis). To further improve the performance, we propose to incorporate the momentum restart scheme to Q-AMSGrad, resulting in the so-called Q-AMSGradR algorithm. The convergence rate of Q-AMSGradR is also established. Our experiments on a linear quadratic regulator problem show that the two proposed Q-learning algorithms outperform the vanilla Q-learning with SGD updates. The two algorithms also exhibit significantly better performance than the DQN learning method over a batch of Atari 2600 games.


title: Comparing to Learn: Surpassing ImageNet Pretraining on Radiographs By Comparing Image Representations

abstract: In deep learning era, pretrained models play an important role in medical image analysis, in which ImageNet pretraining has been widely adopted as the best way. However, it is undeniable that there exists an obvious domain gap between natural images and medical images. To bridge this gap, we propose a new pretraining method which learns from 700k radiographs given no manual annotations. We call our method as Comparing to Learn (C2L) because it learns robust features by comparing different image representations. To verify the effectiveness of C2L, we conduct comprehensive ablation studies and evaluate it on different tasks and datasets. The experimental results on radiographs show that C2L can outperform ImageNet pretraining and previous state-of-the-art approaches significantly. Code and models are available.


title: Expansiveness, Shadowing and Markov Partition for Anosov Families

abstract: We study Anosov families which are sequences of diffeomorphisms along compact Riemannian manifolds such that the tangent bundle split into expanding and contracting subspaces. In this paper we prove that a certain class of Anosov families: (i) admit canonical coordinates (ii) are expansive, (iii) satisfy the shadowing property, and (iv) exhibit a Markov partition.


title: Hardware Acceleration of Monte-Carlo Sampling for Energy Efficient Robust Robot Manipulation

abstract: Algorithms based on Monte-Carlo sampling have been widely adapted in robotics and other areas of engineering due to their performance robustness. However, these sampling-based approaches have high computational requirements, making them unsuitable for real-time applications with tight energy constraints. In this paper, we investigate 6 degree-of-freedom (6DoF) pose estimation for robot manipulation using this method, which uses rendering combined with sequential Monte-Carlo sampling. While potentially very accurate, the significant computational complexity of the algorithm makes it less attractive for mobile robots, where runtime and energy consumption are tightly constrained. To address these challenges, we develop a novel hardware implementation of Monte-Carlo sampling on an FPGA with lower computational complexity and memory usage, while achieving high parallelism and modularization. Our results show 12X-21X improvements in energy efficiency over low-power and high-end GPU implementations, respectively. Moreover, we achieve real time performance without compromising accuracy.


title: A simple correction for COVID-19 sampling bias

abstract: COVID-19 testing has become a standard approach for estimating prevalence which then assist in public health decision making to contain and mitigate the spread of the disease. The sampling designs used are often biased in that they do not reflect the true underlying populations. For instance, individuals with strong symptoms are more likely to be tested than those with no symptoms. This results in biased estimates of prevalence (too high). Typical post-sampling corrections are not always possible. Here we present a simple bias correction methodology derived and adapted from a correction for publication bias in meta analysis studies. The methodology is general enough to allow a wide variety of customization making it more useful in practice. Implementation is easily done using already collected information. Via a simulation and two real datasets, we show that the bias corrections can provide dramatic reductions in estimation error.


title: Sense of agency, gender, and students' perception in open-ended physics labs

abstract: Instructional physics labs are critical junctures for many STEM majors to develop an understanding of experimentation in the sciences. Students can acquire useful experimental skills and grow their identities as scientists. However, many traditionally-instructed labs do not necessarily involve authentic physics experimentation features in their curricula. Recent research calls for a reformation in undergraduate labs to incorporate more student agency and choice in the learning processes. In our institution, we have adopted open-ended lab teaching in the introductory physics courses. By using reformed curricula that provide higher student agency, we analyzed approximately 100 students in the introductory-level lab courses to examine their views towards the open-ended physics labs. Between the start and the end of the semester, we found a statistically significant shift in students' perceptions about the agency afforded in lab activities. We also examined students' responses to "Which lab unit was your favorite and why?". The analysis showed that majority of the students preferred Project Lab, which had the highest student agency and coding analysis showed that "freedom" was the most frequent response for students' reason for picking Project Lab. Finally, we also examined student views across gender and found no significant gender effect on students' sense of agency.


title: Data Sampling on MDS-resistant 10th Generation Intel Core (Ice Lake)

abstract: Microarchitectural Data Sampling (MDS) is a set of hardware vulnerabilities in Intel CPUs that allows an attacker to leak bytes of data from memory loads and stores across various security boundaries. On affected CPUs, some of these vulnerabilities were patched via microcode updates. Additionally, Intel announced that the newest microarchitectures, namely Cascade Lake and Ice Lake, were not affected by MDS. While Cascade Lake turned out to be vulnerable to the ZombieLoad v2 MDS attack (also known as TAA), Ice Lake was not affected by this attack. In this technical report, we show a variant of MSBDS (CVE2018-12126), an MDS attack, also known as Fallout, that works on Ice Lake CPUs. This variant was automatically synthesized using Transynther, a tool to find new variants of Meltdown-type attacks. Based on the findings of Transynther, we analyze different microcodes regarding this issue, showing that only microcode versions after January 2020 prevent exploitation of the vulnerability. These results show that Transynther is a valuable tool to find new variants, and also to test for regressions possibly introduced with microcode updates.


title: Localization, epidemic transitions, and unpredictability of multistrain epidemics with an underlying genotype network

abstract: Mathematical disease modelling has long operated under the assumption that any one infectious disease is caused by one transmissible pathogen spreading among a population. This paradigm has been useful in simplifying the biological reality of epidemics and has allowed the modelling community to focus on the complexity of other factors such as population structure and interventions. However, there is an increasing amount of evidence that the strain diversity of pathogens, and their interplay with the host immune system, can play a large role in shaping the dynamics of epidemics. Here, we introduce a disease model with an underlying genotype network to account for two important mechanisms. One, the disease can mutate along network pathways as it spreads in a host population. Two, the genotype network allows us to define a genetic distance across strains and therefore to model the transcendence of immunity often observed in real world pathogens. We study the emergence of epidemics in this model, through its epidemic phase transitions, and highlight the role of the genotype network in driving cyclicity of diseases, large scale fluctuations, sequential epidemic transitions, as well as localization around specific strains of the associated pathogen. More generally, our model illustrates the richness of behaviours that are possible even in well-mixed host populations once we consider strain diversity and go beyond the "one disease equals one pathogen" paradigm.


title: The gamma-ray / infrared luminosity correlation of star-forming galaxies

abstract: Context. Near a dozen star-forming galaxies have been detected in gamma-rays by the Fermi observatory in the last decade. A remarkable property of this sample is the quasi-linear relation between the gamma-ray luminosity and the star formation rate, obtained assuming that the latter is well traced by the infra-red luminosity of the galaxies. The non-linearity of this relation has not been fully explained yet. Aims. We aim at determining the biases derived from the use of the infrared luminosity as a proxy for the star formation rate, and shed light onto the more fundamental relation between the latter and the gamma-ray luminosity. We expect to quantify and explain some trends observed in this relation. Methods. We compile from the literature a near-homogeneous set of distances, ultraviolet, optical, infra-red, and gamma-ray fluxes for all known gamma-ray emitting star-forming galaxies. From these data we compute the infra-red and gamma-ray luminosities, and star formation rates. We determine the best-fitting relation between the latter two, and describe the trend using simple, population-oriented models for cosmic-ray transport and cooling. Results. We find that the gamma-ray luminosity-star formation rate relation obtained from infra-red luminosities is biased to shallower slopes. The actual relation is steeper than previous estimates, having a power-law index of 1.35 +- 0.05, in contrast to 1.23 +- 0.06. Conclusions. The unbiased gamma-ray luminosity-star formation rate relation can be explained at high star formation rates by assuming that the cosmic ray cooling region is kiloparsec-sized, and pervaded by mild to fast winds. Combined with previous results about the scaling of wind velocity with star formation rate, our work provides support to advection as the dominant cosmic ray escape mechanism in low-star formation rate galaxies.


title: COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encoder

abstract: Unsupervised image-to-image translation intends to learn a mapping of an image in a given domain to an analogous image in a different domain, without explicit supervision of the mapping. Few-shot unsupervised image-to-image translation further attempts to generalize the model to an unseen domain by leveraging example images of the unseen domain provided at inference time. While remarkably successful, existing few-shot image-to-image translation models find it difficult to preserve the structure of the input image while emulating the appearance of the unseen domain, which we refer to as the content loss problem. This is particularly severe when the poses of the objects in the input and example images are very different. To address the issue, we propose a new few-shot image translation model, COCO-FUNIT, which computes the style embedding of the example images conditioned on the input image and a new module called the constant style bias. Through extensive experimental validations with comparison to the state-of-the-art, our model shows effectiveness in addressing the content loss problem. For code and pretrained models, please check out https://nvlabs.github.io/COCO-FUNIT/ .


title: Convergence Rate of Inertial Forward-Backward Algorithms Based on the Local Error Bound Condition

abstract: The "Inertial Forward-Backward algorithm" (IFB) is a powerful tool for convex nonsmooth minimization problems, it gives the well known "fast iterative shrinkage-thresholding algorithm " (FISTA), which enjoys $O\left( {\frac{1}{{{k^2}}}} \right)$ global convergence rate of function values, however, no convergence of iterates has been proved; by do a small modification, an accelerated IFB called "FISTA\_CD" improves the convergence rate of function values to $o\left( {\frac{1}{{{k^2}}}} \right)$ and shows the weak convergence of iterates. The local error bound condition is extremely useful in analyzing the convergence rates of a host of iterative methods for solving optimization problems, and in practical application, a large number of problems with special structure often satisfy the error bound condition. Naturally, using local error bound condition to derive or improve the convergence rate of IFB is a common means. In this paper, based on the local error bound condition, we exploit an new assumption condition for the important parameter $t_k$ in IFB, and establish the improved convergence rate of function values and strong convergence of the iterates generated by the IFB algorithms with six $t_k$ satisfying the above assumption condition in Hilbert space. It is remarkable that, under the local error bound condition, we establish the strong convergence of the iterates generated by the original FISTA, and prove that the convergence rates of function values for FISTA\_CD is actually related to the value of parameter $a,$ and show that the IFB algorithms with some $t_k$ mentioned above can achieve sublinear convergence rate $o\left( {\frac{1}{{{k^p}}}} \right)$ for any positive integer $p>1$. Some numerical experiments are conducted to illustrate our results.


title: Necessary and sufficient conditions for rank-one generated cones

abstract: A closed convex conic subset $\mathcal{S}$ of the positive semidefinite (PSD) cone is rank-one generated (ROG) if all of its extreme rays are generated by rank-one matrices. The ROG property of $\mathcal{S}$ is closely related to the exactness of SDP relaxations of nonconvex quadratically constrained quadratic programs (QCQPs) related to $\mathcal{S}$. We consider the case where $\mathcal{S}$ is obtained as the intersection of the PSD cone with finitely many homogeneous linear matrix inequalities and conic constraints and identify sufficient conditions that guarantee that $\mathcal{S}$ is ROG. Our general framework allows us to recover a number of well-known results from the literature. In the case of two linear matrix inequalities, we also establish the necessity of our sufficient conditions. This extends one of the few settings from the literature -- the case of one linear matrix inequality and the S-lemma -- where an explicit characterization for the ROG property exists. Finally, we show how our ROG results on cones can be translated into inhomogeneous SDP exactness results and convex hull descriptions in the original space of a QCQP. We close with a few applications of these results; specifically, we recover the well-known perspective reformulation of a simple mixed-binary set via the ROG toolkit.


title: On the Extension of Linear Damping to Quantum Mechanics through Fractionary Momentum Operators Pt. I

abstract: The use of fractional momentum operators and fractionary kinetic energy used to model linear damping in dissipative systems such as resistive circuits and a spring-mass ensambles was extended to a quantum mechanical formalism. Three important associated 1 dimensional problems were solved: the free particle case, the infinite potential well, and the harmonic potential. The wave equations generated reproduced the same type of 2-order ODE observed in classical dissipative systems, and produced quantized energy levels. In the infinite potential well, a zero-point energy emerges, which can be fitted to the rest energy of the particle described by special relativity, given by relationship $E_r=mc^2$. In the harmonic potential, new fractional creation and destruction operators were introduced to solve the problem in the energy basis. The energy eigenvalues found are different to the ones reported by earlier approaches to the quantum damped oscillator problem reported by other authors. In this case, a direct relationship between the relativistic rest energy of the particle and the expected value of the fractionary kinetic energy in the base state was obtained. We conclude that there exists a relationship between fractional kinetic energy and special relativity energies, that remains unclear and needs further exploration, but also conclude that the current form of transforming fractionary momentum operators to the position basis will yield non-observable imaginary momentum quantities, and thus a correction to the way of transforming them needs to be explored further.


title: AdvFlow: Inconspicuous Black-box Adversarial Attacks using Normalizing Flows

abstract: Deep learning classifiers are susceptible to well-crafted, imperceptible variations of their inputs, known as adversarial attacks. In this regard, the study of powerful attack models sheds light on the sources of vulnerability in these classifiers, hopefully leading to more robust ones. In this paper, we introduce AdvFlow: a novel black-box adversarial attack method on image classifiers that exploits the power of normalizing flows to model the density of adversarial examples around a given target image. We see that the proposed method generates adversaries that closely follow the clean data distribution, a property which makes their detection less likely. Also, our experimental results show competitive performance of the proposed approach with some of the existing attack methods on defended classifiers. The code is available at https://github.com/hmdolatabadi/AdvFlow.


title: Modulation of Control Authority in Adaptive HapticShared Control Paradigms

abstract: This paper presents an adaptive haptic shared control framework wherein a driver and an automation system are physically connected through a motorized steering wheel. The automation system is modeled as an intelligent agent that is not only capable of making decisions but also monitoring the human's behavior and adjusting its behavior accordingly. To enable the automation system to smoothly exchange the control authority with the human partner, this paper introduces a novel self-regulating impedance controller for the automation system. To determine an optimal modulation policy, a cost function is defined. The terms of the cost function are assigned to minimize the performance error and reduce the disagreement between the human and automation system. To solve the optimal control problem, we employed a nonlinear model predictive approach and used the continuation generalized minimum residual method to solve the nonlinear cost function. To demonstrate the effectiveness of the proposed approach, simulation studies consider a scenario where the human and the automation system both detect an obstacle and negotiate on controlling the steering wheel so that the obstacle can be avoided safely. The simulations involve four interaction modes addressing the cooperation status (cooperative and uncooperative) and the desired direction of the control transfer (active safety and autopilot).


title: ContourRend: A Segmentation Method for Improving Contours by Rendering

abstract: A good object segmentation should contain clear contours and complete regions. However, mask-based segmentation can not handle contour features well on a coarse prediction grid, thus causing problems of blurry edges. While contour-based segmentation provides contours directly, but misses contours' details. In order to obtain fine contours, we propose a segmentation method named ContourRend which adopts a contour renderer to refine segmentation contours. And we implement our method on a segmentation model based on graph convolutional network (GCN). For the single object segmentation task on cityscapes dataset, the GCN-based segmentation con-tour is used to generate a contour of a single object, then our contour renderer focuses on the pixels around the contour and predicts the category at high resolution. By rendering the contour result, our method reaches 72.41% mean intersection over union (IoU) and surpasses baseline Polygon-GCN by 1.22%.


title: Relaxation times for Bose-Einstein condensation in axion miniclusters

abstract: We study the Bose condensation of scalar dark matter in the presence of both gravitational and self-interactions. Axions and other scalar dark matter in gravitationally bound miniclusters or dark matter halos are expected to condense into Bose-Einstein condensates called Bose stars. This process has been shown to occur through attractive self-interactions of the axion-like particles or through the field's self gravitation. We show that in the high-occupancy regime of scalar dark matter, the Boltzmann collision integral does not describe either gravitaitonal or self-interactions, and derive kinetic equations valid for these interactions. We use this formalism to compute relaxation times for the Bose-Einstein condensation, and find that condensation into Bose stars could occur within the lifetime of the universe. The self-interactions reduce the condensation time only when they are very strong.


title: Exact bounds for dynamical critical exponents of transverse-field Ising chains with a correlated disorder

abstract: This study investigates the dynamical critical exponent of disordered Ising chains under transverse fields to examine the effect of a correlated disorder on quantum phase transitions. The correlated disorder, where the on-site transverse field depends on the nearest-neighbor coupling strengths connecting the site, gives a qualitatively different result from the uncorrelated disorder. In the uncorrelated disorder cases where the transverse field is either homogeneous over sites or random independently of the nearest-neighbor coupling strengths, the dynamical critical exponent is infinite. In contrast, in the presence of the correlated disorder, we analytically show that the dynamical critical exponent is finite. We also show that the dynamical critical exponent depends on the tuning process of the transverse field strengths.


title: How perception of being recognized or not recognized by instructors as a "physics person" impacts male and female students' self-efficacy and performance

abstract: We discuss a study in a first year college introductory physics course for physical science and engineering majors that shows that women, on average, feel less recognized by their physics instructors than men as students who can excel in physics. We also discuss how this lack of perceived positive recognition pertaining to physics can adversely affect their self-efficacy and performance in the course. We recommend that physics instructors not be parsimonious in their praise of students and make a conscious effort to positively recognize their students for their effort and progress whenever an opportunity arises. Interviews with female students suggest that instructors should be careful not to give unintended messages to students, e.g., by praising some students for brilliance or intelligence as opposed to their effort because praising a student for brilliance can convey to other students that they do not have what is required to excel in physics. Interviews also suggest that when students ask instructors for help on physics problems, if instructors inadvertently label those problems as "easy", "trivial" or "obvious", it can also make students feel disparaged. The perception of being belittled by these kinds of unintended comments by instructors as well as a lack of positive recognition for good effort and progress have the potential to most adversely impact students from underrepresented groups including women.


title: How learning environment predicts male and female students' physics motivational beliefs in introductory physics courses

abstract: In this study, we adapt prior identity framework to investigate the effect of learning environment (including perceived recognition, peer interaction and sense of belonging) on students' physics self-efficacy, interest and identity by controlling for their self-efficacy and interest at the beginning of a calculus-based introductory physics course. We surveyed 1203 students, 35% of whom were women. We found that female students' physics self-efficacy and interest were lower than male students' at the beginning of the course, and the gender gaps in these motivational constructs became even larger by the end of the course. Analysis revealed that the decrease in students' physics self-efficacy and interest were mediated by the learning environment and ultimately affected students' physics identity. Our model shows that perceived recognition played a major role in explaining students' physics identity, and students' sense of belonging in physics played an important role in explaining the change in students' physics self-efficacy.


title: A Method for Representing Periodic Functions and Enforcing Exactly Periodic Boundary Conditions with Deep Neural Networks

abstract: We present a simple and effective method for representing periodic functions and enforcing exactly the periodic boundary conditions for solving differential equations with deep neural networks (DNN). The method stems from some simple properties about function compositions involving periodic functions. It essentially composes a DNN-represented arbitrary function with a set of independent periodic functions with adjustable (training) parameters. We distinguish two types of periodic conditions: those imposing the periodicity requirement on the function and all its derivatives (to infinite order), and those imposing periodicity on the function and its derivatives up to a finite order $k$ ($k\geqslant 0$). The former will be referred to as $C^{\infty}$ periodic conditions, and the latter $C^{k}$ periodic conditions. We define operations that constitute a $C^{\infty}$ periodic layer and a $C^k$ periodic layer (for any $k\geqslant 0$). A deep neural network with a $C^{\infty}$ (or $C^k$) periodic layer incorporated as the second layer automatically and exactly satisfies the $C^{\infty}$ (or $C^k$) periodic conditions. We present extensive numerical experiments on ordinary and partial differential equations with $C^{\infty}$ and $C^k$ periodic boundary conditions to verify and demonstrate that the proposed method indeed enforces exactly, to the machine accuracy, the periodicity for the DNN solution and its derivatives.

categories: physics.comp-ph cs.LG cs.NA math.NA physics.flu-dyn


title: Deep PQR: Solving Inverse Reinforcement Learning using Anchor Actions

abstract: We propose a reward function estimation framework for inverse reinforcement learning with deep energy-based policies. We name our method PQR, as it sequentially estimates the Policy, the $Q$-function, and the Reward function by deep learning. PQR does not assume that the reward solely depends on the state, instead it allows for a dependency on the choice of action. Moreover, PQR allows for stochastic state transitions. To accomplish this, we assume the existence of one anchor action whose reward is known, typically the action of doing nothing, yielding no reward. We present both estimators and algorithms for the PQR method. When the environment transition is known, we prove that the PQR reward estimator uniquely recovers the true reward. With unknown transitions, we bound the estimation error of PQR. Finally, the performance of PQR is demonstrated by synthetic and real-world datasets.


title: Free Energy from Replica Wormholes

abstract: Euclidean wormholes -- geometries which connect disconnected boundaries -- present a challenge to a standard quantum mechanical interpretation of the theory. One potential resolution is that the gravitational path integral computes the ensemble average of many theories. The connected topologies contribute to the simplest possible observable: the free energy, which is computed using a replica trick. This is distinct from the replica trick used to compute entanglement entropies, and appears in the computation of any extensive quantity. We argue that both JT gravity and a simplified version of CGHS admit a regime where the contribution of connected replica wormholes to the free energy is larger than that of disconnected topologies. In both theories we find evidence of replica symmetry breaking, which is reminiscent of the behavior of certain spin glasses. We discuss possible insights about ensemble averaging in gravity from this perspective.


title: Modelling remote epidemic transmission in Western Australia and implications for pandemic response

abstract: We develop an agent-based model of disease transmission in remote communities in Western Australia. Despite extreme isolation, we show that the movement of people amongst a large number of small but isolated communities has the effect of causing transmission to spread quickly. Significant movement between remote communities, and regional and urban centres allows for infection to quickly spread to and then among these remote communities. Our conclusions are based on two characteristic features of remote communities in Western Australia: (1) high mobility of people amongst these communities, and (2) relatively high proportion of travellers from very small communities to major population centres. In models of infection initiated in the state capital, Perth, these remote communities are collectively and uniquely vulnerable. Our model and analysis does not account for possibly heightened impact due to preexisting conditions, such additional assumptions would only make the projections of this model more dire. We advocate stringent monitoring and control of movement to prevent significant impact on the indigenous population of Western Australia.


title: Iterated Differential Polynomial Rings over Locally Nilpotent Rings

abstract: We study iterated differential polynomial rings over a locally nilpotent ring and show that a large class of such rings are Behrens radical. This extends results of Chebotar and Chen et al.


title: Motifs for processes on networks

abstract: The study of motifs in networks can help researchers uncover links between the structure and function of networks in biology, sociology, economics, and many other areas. Empirical studies of networks have identified feedback loops, feedforward loops, and several other small structures as "motifs" that occur frequently in real-world networks and may contribute by various mechanisms to important functions in these systems. However, these mechanisms are unknown for many of these motifs. We propose to distinguish between "structure motifs" (i.e., graphlets) in networks and "process motifs" (which we define as structured sets of walks) on networks and consider process motifs as building blocks of processes on networks. Using the steady-state covariances and steady-state correlations in a multivariate Ornstein--Uhlenbeck process on a network as examples, we demonstrate that the distinction between structure motifs and process motifs makes it possible to gain quantitative insights into mechanisms that contribute to important functions of dynamical systems on networks.

categories: physics.soc-ph cs.SI math.DS nlin.AO stat.ME


title: Statistical Inference for Networks of High-Dimensional Point Processes

abstract: Fueled in part by recent applications in neuroscience, the multivariate Hawkes process has become a popular tool for modeling the network of interactions among high-dimensional point process data. While evaluating the uncertainty of the network estimates is critical in scientific applications, existing methodological and theoretical work has primarily addressed estimation. To bridge this gap, this paper develops a new statistical inference procedure for high-dimensional Hawkes processes. The key ingredient for this inference procedure is a new concentration inequality on the first- and second-order statistics for integrated stochastic processes, which summarize the entire history of the process. Combining recent results on martingale central limit theory with the new concentration inequality, we then characterize the convergence rate of the test statistics. We illustrate finite sample validity of our inferential tools via extensive simulations and demonstrate their utility by applying them to a neuron spike train data set.


title: Downsampling for Testing and Learning in Product Distributions

abstract: We study distribution-free property testing and learning problems where the unknown probability distribution is a product distribution over $\mathbb{R}^d$. For many important classes of functions, such as intersections of halfspaces, polynomial threshold functions, convex sets, and $k$-alternating functions, the known algorithms either have complexity that depends on the support size of the distribution, or are proven to work only for specific examples of product distributions. We introduce a general method, which we call downsampling, that resolves these issues. Downsampling uses a notion of "rectilinear isoperimetry" for product distributions, which further strengthens the connection between isoperimetry, testing, and learning. Using this technique, we attain new efficient distribution-free algorithms under product distributions on $\mathbb{R}^d$: 1. A simpler proof for non-adaptive, one-sided monotonicity testing of functions $[n]^d \to \{0,1\}$, and improved sample complexity for testing monotonicity over unknown product distributions, from $O(d^7)$ [Black, Chakrabarty, & Seshadhri, SODA 2020] to $\widetilde O(d^3)$. 2. Polynomial-time agnostic learning algorithms for functions of a constant number of halfspaces, and constant-degree polynomial threshold functions. 3. An $\exp(O(d \log(dk)))$-time agnostic learning algorithm, and an $\exp(O(d \log(dk)))$-sample tolerant tester, for functions of $k$ convex sets; and a $2^{\widetilde O(d)}$ sample-based one-sided tester for convex sets. 4. An $\exp(\widetilde O(k \sqrt d))$-time agnostic learning algorithm for $k$-alternating functions, and a sample-based tolerant tester with the same complexity.


title: Weak Counterexamples to $L^2$ Curvature Estimates for Minimizing Surfaces

abstract: We construct a sequence of smooth minimizing surfaces in a sequence of metrics converging to the standard Euclidean metric, so that they have diverging $L^2$ norm of second fundamental form.


title: A high order kinetic flow solver based on flux reconstruction framework

abstract: The goal of this paper is to develop a high order numerical method based on Kinetic Inviscid Flux (KIF) method and Flux Reconstruction (FR) framework. The KIF aims to find a balance between the excellent merits of Gas-Kinetic Scheme (GKS) and the lower computational costs. The idea of KIF can be viewed as an inviscid-viscous splitting version of the gas-kinetic scheme, and Shu and Ohwada have made the fundamental contribution. The combination of Totally Thermalized Transport (TTT) scheme and Kinetic Flux Vector Splitting (KFVS) method are achieved in KIF. Using a coefficient which is related to time step $\delta t$ and averaged collision time $\tau$, KIF can adjust the weights of TTT and KFVS flux in the simulation adaptively. By doing the inviscid-viscous splitting, KIF is very suitable and easy to integrate into the existing framework. The well understood FR framework is used widely for the advantages of robustness, economical costs and compactness. The combination of KIF and FR is originated by three motivations. The first purpose is to develop a high order method based on the gas kinetic theory. The second reason is to keep the advantages of GKS. The last aim is that the designed method should be more efficient. In present work, we use the KIF method to replace the Riemann flux solver applied in the interfaces of elements. The common solution at the interface is computed according to the gas kinetic theory, which makes the combination of KIF and FR scheme more reasonable and available. The accuracy and performance of present method are validated by several numerical cases. The Taylor-Green vortex problem has been used to verify its potential to simulate turbulent flows.


title: RGB-IR Cross-modality Person ReID based on Teacher-Student GAN Model

abstract: RGB-Infrared (RGB-IR) person re-identification (ReID) is a technology where the system can automatically identify the same person appearing at different parts of a video when light is unavailable. The critical challenge of this task is the cross-modality gap of features under different modalities. To solve this challenge, we proposed a Teacher-Student GAN model (TS-GAN) to adopt different domains and guide the ReID backbone to learn better ReID information. (1) In order to get corresponding RGB-IR image pairs, the RGB-IR Generative Adversarial Network (GAN) was used to generate IR images. (2) To kick-start the training of identities, a ReID Teacher module was trained under IR modality person images, which is then used to guide its Student counterpart in training. (3) Likewise, to better adapt different domain features and enhance model ReID performance, three Teacher-Student loss functions were used. Unlike other GAN based models, the proposed model only needs the backbone module at the test stage, making it more efficient and resource-saving. To showcase our model's capability, we did extensive experiments on the newly-released SYSU-MM01 RGB-IR Re-ID benchmark and achieved superior performance to the state-of-the-art with 49.8% Rank-1 and 47.4% mAP.


title: Graph-Based Social Relation Reasoning

abstract: Human beings are fundamentally sociable -- that we generally organize our social lives in terms of relations with other people. Understanding social relations from an image has great potential for intelligent systems such as social chatbots and personal assistants. In this paper, we propose a simpler, faster, and more accurate method named graph relational reasoning network (GR2N) for social relation recognition. Different from existing methods which process all social relations on an image independently, our method considers the paradigm of jointly inferring the relations by constructing a social relation graph. Furthermore, the proposed GR2N constructs several virtual relation graphs to explicitly grasp the strong logical constraints among different types of social relations. Experimental results illustrate that our method generates a reasonable and consistent social relation graph and improves the performance in both accuracy and efficiency.


title: On Universal Norms for $p$-adic Representations in Higher Rank Iwasawa Theory

abstract: We begin a systematic investigation of universal norms for $p$-adic representations in higher rank Iwasawa theory. After establishing the basic properties of the module of higher rank universal norms we construct an Iwasawa-theoretic pairing that is relevant to this setting. This allows us, for example, to refine the classical Iwasawa Main Conjecture for cyclotomic fields, and also to give applications to various well-known conjectures in arithmetic concerning Iwasawa invariants and leading terms of $L$-functions.


title: Are We There Yet? Evaluating State-of-the-Art Neural Network based Geoparsers Using EUPEG as a Benchmarking Platform

abstract: Geoparsing is an important task in geographic information retrieval. A geoparsing system, known as a geoparser, takes some texts as the input and outputs the recognized place mentions and their location coordinates. In June 2019, a geoparsing competition, Toponym Resolution in Scientific Papers, was held as one of the SemEval 2019 tasks. The winning teams developed neural network based geoparsers that achieved outstanding performances (over 90% precision, recall, and F1 score for toponym recognition). This exciting result brings the question "are we there yet?", namely have we achieved high enough performances to possibly consider the problem of geoparsing as solved? One limitation of this competition is that the developed geoparsers were tested on only one dataset which has 45 research articles collected from the particular domain of Bio-medicine. It is known that the same geoparser can have very different performances on different datasets. Thus, this work performs a systematic evaluation of these state-of-the-art geoparsers using our recently developed benchmarking platform EUPEG that has eight annotated datasets, nine baseline geoparsers, and eight performance metrics. The evaluation result suggests that these new geoparsers indeed improve the performances of geoparsing on multiple datasets although some challenges remain.


title: Reorganizing local image features with chaotic maps: an application to texture recognition

abstract: Despite the recent success of convolutional neural networks in texture recognition, model-based descriptors are still competitive, especially when we do not have access to large amounts of annotated data for training and the interpretation of the model is an important issue. Among the model-based approaches, fractal geometry has been one of the most popular, especially in biological applications. Nevertheless, fractals are part of a much broader family of models, which are the non-linear operators, studied in chaos theory. In this context, we propose here a chaos-based local descriptor for texture recognition. More specifically, we map the image into the three-dimensional Euclidean space, iterate a chaotic map over this three-dimensional structure and convert it back to the original image. From such chaos-transformed image at each iteration we collect local descriptors (here we use local binary patters) and those descriptors compose the feature representation of the texture. The performance of our method was verified on the classification of benchmark databases and in the identification of Brazilian plant species based on the texture of the leaf surface. The achieved results confirmed our expectation of a competitive performance, even when compared with some learning-based modern approaches in the literature.


title: CFD Analysis of Latent Heat Energy Storage System with Different Geometric Configurations and Flow Conditions

abstract: The Latent heat storage technology is being used worldwide to bridge the gap between supply and demand of energy. The material store energy during the charging process (melting) and releases energy during the discharging process (solidification). In spite of having various advantages such as high storage energy density, it suffers from the fact that most Phase Change Materials (PCMs) commonly used have a very low thermal conductivity, hence, very slow charging /discharging times. In the current work, a shell and tube type heat exchanger with phase change material on the shell side and heat transfer fluid on the tube side are considered. The effect of flow rate and inlet temperature of heat transfer fluid on melting and solidification times are investigated with single and double pass (counter and parallel) arrangements of Heat Transfer Fluid (HTF). The major difficulty encountered in the melting of the PCM is the accumulation of solid (unmelted) part at the bottom during the charging process, while the liquid part remains at the top during the discharging process, which decreases the efficiency of the system to quite a great extent. In this study, an attempt has been made to improve the efficiency of the system by considering two configurations (double and triple tube) of the shell and tube heat exchanger and it is found that the latter case has better performance.


title: Distributed Bearing-based Formation Control and Network Localization with Exogenous Disturbances

abstract: This paper presents a generalized robust stability analysis for bearing-based formation control and network localization systems. For an undirected network, we provide a robust stability analysis in the presence of time-varying exogenous disturbances in arbitrary dimensional space. In addition, we compute the explicit upper-bound set of the bearing formation and network localization errors, which provides valuable information for a system design.


title: From deep to Shallow: Equivalent Forms of Deep Networks in Reproducing Kernel Krein Space and Indefinite Support Vector Machines

abstract: In this paper we explore a connection between deep networks and learning in reproducing kernel Krein space. Our approach is based on the concept of push-forward - that is, taking a fixed non-linear transform on a linear projection and converting it to a linear projection on the output of a fixed non-linear transform, pushing the weights forward through the non-linearity. Applying this repeatedly from the input to the output of a deep network, the weights can be progressively "pushed" to the output layer, resulting in a flat network that has the form of a fixed non-linear map (whose form is determined by the structure of the deep network) followed by a linear projection determined by the weight matrices - that is, we take a deep network and convert it to an equivalent (indefinite) kernel machine. We then investigate the implications of this transformation for capacity control and uniform convergence, and provide a Rademacher complexity bound on the deep network in terms of Rademacher complexity in reproducing kernel Krein space. Finally, we analyse the sparsity properties of the flat representation, showing that the flat weights are (effectively) Lp-"norm" regularised with 0<p<1 (bridge regression).


title: Anomaly of the dielectric function of water under confinement and its role in Van der Waals interactions

abstract: We present a theoretical calculation of the changes in the Hamaker constant due to the anomalous reduction of the static dielectric function of water. Under confinement, the dielectric function of water decreases from a bulk value of 79 down to 2. If the confining walls are made of a dielectric material, the Hamaker constant reduces almost by 90\%. However, if the confinement is realized with metallic plates, there is little change in the Hamaker constant. Additionally, we show that confinement can be used to decreases the Debye screening length without changing the salt concentration. This, in turn, is used to change the Hamaker constant in the presence of electrolytes.


title: Model-Based Multi-Agent RL in Zero-Sum Markov Games with Near-Optimal Sample Complexity

abstract: Model-based reinforcement learning (RL), which finds an optimal policy using an empirical model, has long been recognized as one of the corner stones of RL. It is especially suitable for multi-agent RL (MARL), as it naturally decouples the learning and the planning phases, and avoids the non-stationarity problem when all agents are improving their policies simultaneously using samples. Though intuitive and widely-used, the sample complexity of model-based MARL algorithms has not been fully investigated. In this paper, our goal is to address the fundamental question about its sample complexity. We study arguably the most basic MARL setting: two-player discounted zero-sum Markov games, given only access to a generative model. We show that model-based MARL achieves a sample complexity of $\tilde O(|S||A||B|(1-\gamma)^{-3}\epsilon^{-2})$ for finding the Nash equilibrium (NE) value up to some $\epsilon$ error, and the $\epsilon$-NE policies with a smooth planning oracle, where $\gamma$ is the discount factor, and $S,A,B$ denote the state space, and the action spaces for the two agents. We further show that such a sample bound is minimax-optimal (up to logarithmic factors) if the algorithm is reward-agnostic, where the algorithm queries state transition samples without reward knowledge, by establishing a matching lower bound. This is in contrast to the usual reward-aware setting, with a $\tilde\Omega(|S|(|A|+|B|)(1-\gamma)^{-3}\epsilon^{-2})$ lower bound, where this model-based approach is near-optimal with only a gap on the $|A|,|B|$ dependence. Our results not only demonstrate the sample-efficiency of this basic model-based approach in MARL, but also elaborate on the fundamental tradeoff between its power (easily handling the more challenging reward-agnostic case) and limitation (less adaptive and suboptimal in $|A|,|B|$), particularly arises in the multi-agent context.


title: A cellular automata approach to local patterns for texture recognition

abstract: Texture recognition is one of the most important tasks in computer vision and, despite the recent success of learning-based approaches, there is still need for model-based solutions. This is especially the case when the amount of data available for training is not sufficiently large, a common situation in several applied areas, or when computational resources are limited. In this context, here we propose a method for texture descriptors that combines the representation power of complex objects by cellular automata with the known effectiveness of local descriptors in texture analysis. The method formulates a new transition function for the automaton inspired on local binary descriptors. It counterbalances the new state of each cell with the previous state, in this way introducing an idea of "controlled deterministic chaos". The descriptors are obtained from the distribution of cell states. The proposed descriptors are applied to the classification of texture images both on benchmark data sets and a real-world problem, i.e., that of identifying plant species based on the texture of their leaf surfaces. Our proposal outperforms other classical and state-of-the-art approaches, especially in the real-world problem, thus revealing its potential to be applied in numerous practical tasks involving texture recognition at some stage.


title: Peaks in the electronic density of states are not strong predictors of Superconductivity

abstract: Electronic bands near the Fermi energy with minimal energy dispersion in k-space, i.e. "flat bands", are often said to be an important characteristic of superconducting materials. When extending over a significant region of the k-space, this leads to peaks in the electronic density of states. If one could systematically search the calculated electronic structures of materials, already available through the Materials Genome Initiative, for such peaks, then the rate of new superconductor discovery could be accelerated greatly. Here we test whether this characteristic actually distinguishes known superconductors from known non-superconductors. We find that there is an anticorrelation for tetragonal symmetry materials, but that hexagonal symmetry superconductors exhibit such peaks more frequently than hexagonal non-superconductors. More generally, our study's limitations underscore the importance of standardizing digital resources for achieving the accelerated materials discovery paradigm promised by the Materials Genome Initiative.


title: Further results on Hendry's Conjecture

abstract: Recently, a conjecture due to Hendry was disproved which stated that every Hamiltonian chordal graph is cycle extendible. Here we further explore the conjecture, showing that it fails to hold even when a number of extra conditions are imposed. In particular, we show that Hendry's Conjecture fails for strongly chordal graphs, graphs with high connectivity, and if we relax the definition of "cycle extendible" considerably. We also consider the original conjecture from a subtree intersection model point of view, showing that a result of Abuieda et al is nearly best possible.


title: Field-induced Metal-Insulator Transition in $\beta $-EuP$_3$

abstract: Metal-insulator transition (MIT) is one of the most conspicuous phenomena in correlated electron systems. However such transition has rarely been induced by an external magnetic field as the field scale is normally too small compared with the charge gap. In this paper we present the observation of a magnetic-field-driven MIT in a magnetic semiconductor $\beta $-EuP$_3$. Concomitantly, we found a colossal magnetoresistance (CMR) in an extreme way: the resistance drops billionfold at 2 kelvins in a magnetic field less than 3 teslas. We ascribe this striking MIT as a field-driven transition from an antiferromagnetic and paramagnetic insulator to a spin-polarized topological semimetal, in which the spin configuration of $\mathrm{Eu^{2+}}$ cations and spin-orbital coupling (SOC) play a crucial role. As a phosphorene-bearing compound whose electrical properties can be controlled by the application of field, $\beta $-EuP$_3$ may serve as a tantalizing material in the basic research and even future electronics.


title: Simplified Performance Analysis of OWC System Over Atmospheric Turbulence with Pointing Error

abstract: Optical wireless communication (OWC) is highly vulnerable to the atmospheric turbulence and pointing error. Performance analysis of the OWC system under the combined channel effects of pointing errors and atmospheric turbulence is desirable for its efficient deployment. The widely used Gamma- Gamma statistical model for atmospheric turbulence, which consists of Bessel function, generally leads to complicated analytical expressions. In this paper, we consider the three-parameter exponentiated Weibull model for the atmospheric turbulence to analyze the ergodic rate and average signal-to-noise ratio (SNR) performance of a single-link OWC system. We derive simplified analytical expressions on the performance under the combined effect of atmospheric turbulence and pointing errors in terms of system parameters. We also derive approximate expressions on the performance under the atmospheric turbulence by considering negligible pointing error. In order to evaluate the performance at high SNR, we also develop asymptotic bounds on the average SNR and ergodic rate for the considered system. We demonstrate the tightness of derived expressions through numerical and simulation analysis along with a comparison to the performance obtained using the Gamma-Gamma model.


title: Mixture Complexity and Its Application to Gradual Clustering Change Detection

abstract: In model-based clustering using finite mixture models, it is a significant challenge to determine the number of clusters (cluster size). It used to be equal to the number of mixture components (mixture size); however, this may not be valid in the presence of overlaps or weight biases. In this study, we propose to continuously measure the cluster size in a mixture model by a new concept called mixture complexity (MC). It is formally defined from the viewpoint of information theory and can be seen as a natural extension of the cluster size considering overlap and weight bias. Subsequently, we apply MC to the issue of gradual clustering change detection. Conventionally, clustering changes has been considered to be abrupt, induced by the changes in the mixture size or cluster size. Meanwhile, we consider the clustering changes to be gradual in terms of MC; it has the benefits of finding the changes earlier and discerning the significant and insignificant changes. We further demonstrate that the MC can be decomposed according to the hierarchical structures of the mixture models; it helps us to analyze the detail of substructures.


title: CAPP-8TB: Axion Dark Matter Search Experiment around 6.7 $\mu$eV

abstract: CAPP-8TB is an axion dark matter search experiment dedicated to an axion mass search near 6.7 $\mu$eV. The experiment uses a microwave resonant cavity under a strong magnetic field of 8 T produced by a superconducting solenoid magnet in a dilution refrigerator. We describe the experimental configuration used to search for a mass range of 6.62 to 6.82 $\mu$eV in the first phase of the experiment. We also discuss the next phase of the experiment and its prospects.


title: Lipschitz bounds and nonautonomous integrals

abstract: We provide a general approach to Lipschitz regularity of solutions for a large class of vector-valued, nonautonomous variational problems exhibiting nonuniform ellipticity. The functionals considered here range amongst those with unbalanced polynomial growth conditions to those with fast, exponential type growth. The results obtained are sharp with respect to all the data considered and yield new, optimal regularity criteria even in the classical uniformly elliptic case. We give a classification of different types of nonuniform ellipticity, accordingly identifying suitable conditions to get regularity theorems.


title: Decomposition of the diagonal, intermediate Jacobians, and universal codimension-2 cycles in positive characteristic

abstract: We consider the connections among algebraic cycles, abelian varieties, and stable rationality of smooth projective varieties in positive characteristic. Recently Voisin constructed two new obstructions to stable rationality for rationally connected complex projective threefolds by giving necessary and sufficient conditions for the existence of a cohomological decomposition of the diagonal. In this paper, we show how to extend these obstructions to rationally chain connected threefolds in positive characteristic via ell-adic cohomological decomposition of the diagonal. This requires extending results in Hodge theory regarding intermediate Jacobians and Abel--Jacobi maps to the setting of algebraic representatives. For instance, we show that the algebraic representative for codimension-two cycle classes on a geometrically stably rational threefold admits a canonical auto-duality, which in characteristic zero agrees with the principal polarization on the intermediate Jacobian coming from Hodge theory. As an application, we extend a result of Voisin, and show that in characteristic greater than two, a desingularization of a very general quartic double solid with seven nodes fails one of these two new obstructions, while satisfying all of the classical obstructions. More precisely, it does not admit a universal codimension-two cycle class. In the process, we establish some results on the moduli space of nodal degree-four polarized K3 surfaces in positive characteristic.


title: Predication of Inflection Point and Outbreak Size of COVID-19 in New Epicentres

abstract: The coronavirus disease 2019 (COVID-19) had caused more that 8 million infections as of middle June 2020. Recently, Brazil has become a new epicentre of COVID-19, while India and African region are potential epicentres. This study aims to predict the inflection point and outbreak size of these new/potential epicentres at the early phase of the epidemics by borrowing information from more `mature' curves from other countries. We modeled the cumulative cases to the well-known sigmoid growth curves to describe the epidemic trends under the mixed-effect models and using the four-parameter logistic model after power transformations. African region is predicted to have the largest total outbreak size of 3.9 million cases (2.2 to 6 million), and the inflection will come around September 13, 2020. Brazil and India are predicted to have a similar final outbreak size of around 2.5 million cases (1.1 to 4.3 million), with the inflection points arriving June 23 and July 26, respectively. We conclude in Brazil, India, and African the epidemics of COVI19 have not yet passed the inflection points; these regions potentially can take over USA in terms of outbreak size


title: Risk Bounds for Quantile Trend Filtering

abstract: We study quantile trend filtering, a recently proposed method for nonparametric quantile regression with the goal of generalizing existing risk bounds known for the usual trend filtering estimators which perform mean regression. We study both the penalized and the constrained version (of order $r \geq 1$) of univariate quantile trend filtering. Our results show that both the constrained and the penalized version (of order $r \geq 1$) attain the minimax rate up to log factors, when the $(r-1)$th discrete derivative of the true vector of quantiles belongs to the class of bounded variation signals. Moreover we also show that if the true vector of quantiles is a discrete spline with a few polynomial pieces then both versions attain a near parametric rate of convergence. Corresponding results for the usual trend filtering estimators are known to hold only when the errors are sub-Gaussian. In contrast, our risk bounds are shown to hold under minimal assumptions on the error variables. In particular, no moment assumptions are needed and our results hold under heavy-tailed errors. Our proof techniques are general and thus can potentially be used to study other nonparametric quantile regression methods. To illustrate this generality we also employ our proof techniques to obtain new results for multivariate quantile total variation denoising and high dimensional quantile linear regression.


title: Quantifying dip-ramp-plateau for the Laguerre unitary ensemble structure function

abstract: The ensemble average of $| \sum_{j=1}^N e^{i k \lambda_j} |^2$ is of interest as a probe of quantum chaos, as is its connected part, the structure function. Plotting this average for model systems of chaotic spectra reveals what has been termed a dip-ramp-plateau shape. Generalising earlier work of Br\'ezin and Hikami for the Gaussian unitary ensemble, it is shown how the average in the case of the Laguerre unitary ensemble can be reduced to an expression involving the spectral density of the Jacobi unitary ensemble. This facilitates studying the large $N$ limit, and so quantifying the dip-ramp-plateau effect. When the parameter $a$ in the Laguerre weight $x^a e^{-x}$ scales with $N$, quantitative agreement is found with the characteristic features of this effect known for the Gaussian unitary ensemble. However, for the parameter $a$ fixed, the bulk scaled structure function is shown to have the simple functional form ${2 \over \pi} {\rm Arctan} \, k$, and so there is no ramp-plateau transition.


title: Roughness and scaling properties of oxide glass surfaces at the nanoscale

abstract: Using atomistic computer simulations we determine the roughness and topographical features of melt-formed (MS) and fracture surfaces (FS) of oxide glasses. We find that the topography of the MS is described well by the frozen capillary wave theory. The FS are significant rougher than the MS and depend strongly on glass composition. The height-height correlation function for the FS shows an unexpected logarithmic dependence on distance, in contrast to the power-law found in experiments. We thus conclude that on length scales less than 10 nm FS are not self-affine fractals.


title: Lifting Constructions of PDAs for Coded Caching with Linear Subpacketization

abstract: Coded caching is a technique where multicasting and coding opportunities are utilized to achieve better rate-memory tradeoff in cached networks. A crucial parameter in coded caching is subpacketization, which is the number of parts a file is to be split into for coding purposes. The original Maddah-Ali-Niesen scheme has order-optimal rate at a subpacketization growing exponentially with the number of users. In contrast, placement and delivery schemes in coded caching, designed using placement delivery arrays (PDAs), can have linear subpacketization with a penalty in rate. In this work, we propose several constructions of efficient PDAs through lifting, where a base PDA is expanded by replacing each entry by another PDA. By proposing and using the notion of Blackburn-compatibility of PDAs, we provide multiple lifting constructions with increasing coding gains. We compare the constructed coded caching schemes with other existing schemes for moderately high number of users and show that the proposed constructions are versatile and achieve a good rate-memory tradeoff at low subpacketizations.


title: Experimental evidence for a universal threshold characterizing wave-induced sea ice break-up

abstract: Waves can drastically transform a sea ice cover by inducing break-up over vast distances in the course of a few hours. However, relatively few detailed studies have described this phenomenon in a quantitative manner, and the process of sea ice break-up by waves needs to be further parameterized and verified before it can be reliably included in forecasting models. In the present work, we discuss sea ice break-up parameterization and demonstrate the existence of an observational threshold separating breaking and non-breaking cases. This threshold is based on information from two recent field campaigns, supplemented with existing observations of sea ice break-up. The data used cover a wide range of scales, from laboratory-grown sea ice to polar field observations. Remarkably, we show that both field and laboratory observations tend to converge to a single quantitative threshold at which the wave-induced sea ice break-up takes place, which opens a promising avenue for robust parametrization in operational forecasting models.


title: Explaining Deep Neural Networks using Unsupervised Clustering

abstract: We propose a novel method to explain trained deep neural networks (DNNs), by distilling them into surrogate models using unsupervised clustering. Our method can be applied flexibly to any subset of layers of a DNN architecture and can incorporate low-level and high-level information. On image datasets given pre-trained DNNs, we demonstrate the strength of our method in finding similar training samples, and shedding light on the concepts the DNNs base their decisions on. Via user studies, we show that our model can improve the user trust in model's prediction.


title: Structure of accretion flows in the nova-like cataclysmic variable RW Tri

abstract: We obtained photometric observations of the nova-like cataclysmic variable RW Tri and gathered all available AAVSO and other data from the literature. We determined the system parameters and found their uncertainties using the code developed by us to model the light curves of binary systems. New time-resolved optical spectroscopic observations of RW Tri were also obtained to study the properties of emission features produced by the system. The usual interpretation of the single-peaked emission lines in nova-like systems is related to the bi-conical wind from the accretion disc's inner part. However, we found that the Halpha emission profile is comprised of two components with different widths. We argue that the narrow component originates from the irradiated surface of the secondary, while the broader component's source is an extended, low-velocity region in the outskirts of the accretion disc, located opposite to the collision point of the accretion stream and the disc. It appears to be a common feature for long-period nova-like systems -- a point we discuss.


title: Nuclear shape evolution and shape coexistence in Zr and Mo isotopes

abstract: The phenomena of shape evolution and shape coexistence in even-even $^{88-126}$Zr and $^{88-126}$Mo isotopes is studied by employing covariant density functional theory (CDFT) with density-dependent point coupling parameter sets DD-PCX and DD-PC1, and with separable pairing interaction. The results for rms deviation in binding energies, two-neutron separation energy, the differential variation of two-neutron separation energy, and rms charge radii, as a function of neutron number, are presented and compared with available experimental data. In addition to the oblate-prolate shape coexistence in $^{96-110}$Zr isotopes, the correlation between shape transition and discontinuity in the observables are also examined. A smooth trend of charge radii in Mo isotopes is found to be due to the manifestation of triaxiality softness. The observed oblate and prolate minima are related to the low single-particle energy level density around the Fermi level of neutron and proton respectively. The present calculations also predict a deformed bubble structure in $^{100}$Zr isotope.


title: Scalarons mimicking Dark Matter in the Hu-Sawicki model of f(R) gravity

abstract: In this paper, we conduct a study on the scalar field obtained from $\mathit{f(R)}$ gravity via Weyl transformation of the spacetime metric $g_{\mu\nu}$ from the Jordan frame to the Einstein frame. The scalar field is obtained as a result of the modification in the geometrical part of Einstein's field equation of General Relativity. For the Hu-Sawicki model of $\mathit{f(R)}$ gravity, we find the effective potential of the scalar field and calculate its mass. Our study shows that the scalar field (also named as scalaron) obtained from this model has the chameleonic property, i.e.\ the scalaron becomes light in the low-density region while it becomes heavy in the high-density region of matter. Then it is found that the scalaron can be regarded as a dark matter (DM) candidate since the scalaron mass is found to be quite close to the mass of ultralight axions, a prime DM candidate. Thus the scalaron in the Hu-Sawicki model of $\mathit{f(R)}$ gravity behaves as DM. Further, a study on the evolution of the scalaron mass with the redshift is also carried out, which depicts that scalaron becomes light with expansion of the Universe and with different rates at different stages of the Universe.


title: Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization

abstract: In federated optimization, heterogeneity in the clients' local datasets and computation speeds results in large variations in the number of local updates performed by each client in each communication round. Naive weighted aggregation of such models causes objective inconsistency, that is, the global model converges to a stationary point of a mismatched objective function which can be arbitrarily different from the true objective. This paper provides a general framework to analyze the convergence of federated heterogeneous optimization algorithms. It subsumes previously proposed methods such as FedAvg and FedProx and provides the first principled understanding of the solution bias and the convergence slowdown due to objective inconsistency. Using insights from this analysis, we propose FedNova, a normalized averaging method that eliminates objective inconsistency while preserving fast error convergence.


title: Decoding CNN based Object Classifier Using Visualization

abstract: This paper investigates how working of Convolutional Neural Network (CNN) can be explained through visualization in the context of machine perception of autonomous vehicles. We visualize what type of features are extracted in different convolution layers of CNN that helps to understand how CNN gradually increases spatial information in every layer. Thus, it concentrates on region of interests in every transformation. Visualizing heat map of activation helps us to understand how CNN classifies and localizes different objects in image. This study also helps us to reason behind low accuracy of a model helps to increase trust on object detection module.


title: Time-dependent Andreev reflection

abstract: We extend the basic theory of Andreev reflection (AR) in a normal metal/superconductor junction to the situation with an arbitrary time-dependent bias voltage $V(t)$ across the junction. The central element of the theory is the fact that the Fourier transform of the AR amplitude has a casual structure. As an example, the theory is used to describe the current response to short pulses of the bias voltage, which create coherent superposition of quasiparticle states with different energies. The current oscillates in time, with the gap frequency $\Delta/\hbar$, and also as a function of the pulse area $\int V(t)dt$, with the period of the single-electron flux quantum $e/h$.


title: A General Family of Stochastic Proximal Gradient Methods for Deep Learning

abstract: We study the training of regularized neural networks where the regularizer can be non-smooth and non-convex. We propose a unified framework for stochastic proximal gradient descent, which we term ProxGen, that allows for arbitrary positive preconditioners and lower semi-continuous regularizers. Our framework encompasses standard stochastic proximal gradient methods without preconditioners as special cases, which have been extensively studied in various settings. Not only that, we present two important update rules beyond the well-known standard methods as a byproduct of our approach: (i) the first closed-form proximal mappings of $\ell_q$ regularization ($0 \leq q \leq 1$) for adaptive stochastic gradient methods, and (ii) a revised version of ProxQuant that fixes a caveat of the original approach for quantization-specific regularizers. We analyze the convergence of ProxGen and show that the whole family of ProxGen enjoys the same convergence rate as stochastic proximal gradient descent without preconditioners. We also empirically show the superiority of proximal methods compared to subgradient-based approaches via extensive experiments. Interestingly, our results indicate that proximal methods with non-convex regularizers are more effective than those with convex regularizers.


title: Experimentally correlating thermal hysteresis and phase compatibility in multifunctional Heusler alloys

abstract: Thermal hysteresis is recognized as one of the main drawbacks for cyclical applications of magnetocaloric and ferromagnetic shape memory materials with first order transformations. As such, the challenge is to develop strategies that improve the compatibility between the phases involved in the transitions and study its influence on thermal hysteresis. With this purpose, we explore the thermal, structural and magnetic properties of the Ni2Mn1-xCuxGa0.84Al0.16 Heusler alloys. The alloys present a thermal hysteresis reduction of ~60% when the Cu content in the compound varies from x = 0.10 to x = 0.25, with a minimum hysteresis width of 6 K being achieved. We applied the geometric non-linear theory of martensite to address the phase compatibility, quantified by the parameter lambda2, the middle eigenvalue of the transformation stretch tensor, and found that the minimum of hysteresis is associated with a better crystallographic compatibility (lambda2 closer to 1) between the austenite and martensite phases. In addition, we show that the valley-like properties of hysteresis found in the Ni2Mn1-xCuxGa0.84Al0.16 compounds is present in several other alloys in the literature. These results provide new pathways to understand as well as to masters the phase compatibility and ultimately achieve a low thermal hysteresis in multifunctional Heusler alloys.


title: Content-based Recommendations for Radio Stations with Deep Learned Audio Fingerprints

abstract: The world of linear radio broadcasting is characterized by a wide variety of stations and played content. That is why finding stations playing the preferred content is a tough task for a potential listener, especially due to the overwhelming number of offered choices. Here, recommender systems usually step in but existing content-based approaches rely on metadata and thus are constrained by the available data quality. Other approaches leverage user behavior data and thus do not exploit any domain-specific knowledge and are furthermore disadvantageous regarding privacy concerns. Therefore, we propose a new pipeline for the generation of audio-based radio station fingerprints relying on audio stream crawling and a Deep Autoencoder. We show that the proposed fingerprints are especially useful for characterizing radio stations by their audio content and thus are an excellent representation for meaningful and reliable radio station recommendations. Furthermore, the proposed modules are part of the HRADIO Communication Platform, which enables hybrid radio features to radio stations. It is released with a flexible open source license and enables especially small- and medium-sized businesses, to provide customized and high quality radio services to potential listeners.


title: How does stock market reflect the change in economic demand? A study on the industry-specific volatility spillover networks of China's stock market during the outbreak of COVID-19

abstract: Using the carefully selected industry classification standard, we divide 102 industry securities indices in China's stock market into four demand-oriented sector groups and identify demand-oriented industry-specific volatility spillover networks. The "deman-oriented" is a new idea of reconstructing the structure of the networks considering the relationship between industry sectors and the economic demand their outputs meeting. Networks with the new structure help us improve the understanding of the economic demand change, especially when the macroeconomic is dramatically influenced by exogenous shocks like the outbreak of COVID-19. At the beginning of the outbreak of COVID-19, in China's stock market, spillover effects from industry indices of sectors meeting the investment demand to those meeting the consumption demands rose significantly. However, these spillover effects fell after the outbreak containment in China appeared to be effective. Besides, some services sectors including utility, transportation and information services have played increasingly important roles in the networks of industry-specific volatility spillovers as of the COVID-19 out broke. By implication, firstly, being led by Chinese government, the COVID-19 is successfully contained and the work resumption is organized with a high efficiency in China. The risk of the investment demand therefore was controlled and eliminated relatively fast. Secondly, the intensive using of non-pharmaceutical interventions (NPIs) led to supply restriction in services in China. It will still be a potential threat for the Chinese economic recovery in the next stage.


title: An algorithm for integrating peer-to-peer ridesharing and schedule-based transit system for first mile/last mile access

abstract: Due to limited transit network coverage and infrequent service, suburban commuters often face the transit first mile/last mile (FMLM) problem. To deal with this, they either drive to a park-and-ride location to take transit, use carpooling, or drive directly to their destination to avoid inconvenience. Ridesharing, an emerging mode of transportation, can solve the transit first mile/last mile problem. In this setup, a driver can drive a ride-seeker to a transit station, from where the rider can take transit to her respective destination. The problem requires solving a ridesharing matching problem with the routing of riders in a multimodal transportation network. We develop a transit-based ridesharing matching algorithm to solve this problem. The method leverages the schedule-based transit shortest path to generate feasible matches and then solves a matching optimization program to find an optimal match between riders and drivers. The proposed method not only assigns an optimal driver to the rider but also assigns an optimal transit stop and a transit vehicle trip departing from that stop for the rest of the rider's itinerary. We also introduce the application of space-time prism (STP) (the geographical area which can be reached by a traveler given the time constraints) in the context of ridesharing to reduce the computational time by reducing the network search. An algorithm to solve this problem dynamically using a rolling horizon approach is also presented. We use simulated data obtained from the activity-based travel demand model of Twin Cities, MN to show that the transit-based ridesharing can solve the FMLM problem and save a significant number of vehicle-hours spent in the system.


title: Hybrid plasmonic nano-emitters with controlled single quantum emitter positioning on the local excitation field

abstract: Hybrid plasmonic nanoemitters based on the combination of quantum dot emitters (QD) and plasmonic nanoantennas open up new perspectives in the control of light. However, precise positioning of any active medium at the nanoscale constitutes a challenge. Here, we report on the optimal overlap of antenna's near-field and active medium whose spatial distribution is controlled via a plasmon-triggered 2-photon polymerization of a photosensitive formulation containing QDs. Au nanoparticles of various geometries are considered. The response of these hybrid nano-emitters is shown to be highly sensitive to the light polarization. Different light emission states are evidenced by photoluminescence measurements. These states correspond to polarization-sensitive nanoscale overlap between the exciting local field and the active medium distribution. The decrease of the QD concentration within the monomer formulation allows trapping of a single quantum dot in the vicinity of the Au particle. The latter objects show polarization-dependent switching in the single-photon regime.


title: Detecting conjugacy stability of subgroups in certain classes of groups

abstract: In this paper we consider the {\em conjugacy stability} property of subgroups and provide effective procedures to solve the problem in several classes of groups. In particular, we start with free groups, that is, we give an effective procedure to find out if a finitely generated subgroup of a free group is conjugacy stable. Then we further generalize this result to quasi-convex subgroups of torsion-free hyperbolic groups and finitely generated subgroups of limit groups.


title: Convergence to the Product of the Standard Spheres and Eigenvalues of the Laplacian

abstract: We show a Gromov-Hausdorff approximation to the product of the standard spheres $S^{n-p}\times S^p$ for Riemannian manifolds with positive Ricci curvature under some pinching condition on the eigenvalues of the Laplacian acting on functions and forms.


title: Carleson perturbations of elliptic operators on domains with low dimensional boundaries

abstract: We prove an analogue of a perturbation result for the Dirichlet problem of divergence form elliptic operators by Fefferman, Kenig and Pipher, for the degenerate elliptic operators of David, Feneuil and Mayboroda, which were developed to study geometric and analytic properties of sets with boundaries whose co-dimension is higher than $1$. These operators are of the form $-\text{div} A\nabla$, where $A$ is a weighted elliptic matrix crafted to weigh the distance to the high co-dimension boundary in a way that allows for the nourishment of an elliptic theory. When this boundary is a $d-$Alhfors-David regular set in $\mathbb R^n$ with $d\in[1,n-1)$ and $n\geq3$, we prove that the membership of the harmonic measure in $A_{\infty}$ is preserved under Carleson measure perturbations of the matrix of coefficients, yielding in turn that the $L^p-$solvability of the Dirichlet problem is also stable under these perturbations (with possibly different $p$). If the Carleson measure perturbations are suitably small, we establish solvability of the Dirichlet problem in the same $L^p$ space. One of the corollaries of our results together with a previous result of David, Engelstein and Mayboroda, is that, given any $d$-ADR boundary $\Gamma$ with $d\in[1,n-2)$, $n\geq3$, there is a family of degenerate operators of the form described above whose harmonic measure is absolutely continuous with respect to the $d-$dimensional Hausdorff measure on $\Gamma$.


title: Spin thermometry and spin relaxation of optically detected Cr3+ ions in ruby Al2O3

abstract: Paramagnetic ions in solid state crystals form the basis for many advanced technologies such as lasers, masers, frequency standards, and quantum-enhanced sensors. One of the most-studied examples is the Cr3+ ion in sapphire (Al2O3), also known as ruby, which has been intensely studied in the 1950s and 1960s. However, despite decades of research on ruby, some of its fundamental optical and spin properties have not yet been characterized at ultra low-temperatures. In this paper, we present optical measurements on a ruby crystal in a dilution refrigerator at ultra-low temperatures down to 20 mK. Analyzing the relative populations of its 4A2 ground state spin levels, we extract a lattice temperature of 143(7) mK under continuous laser excitation. We perform spin lattice relaxation T1 measurements in excellent agreement with the direct, one-phonon model. Furthermore, we perform optically detected magnetic resonance measurements showing magnetically driven transitions between the ground state spin levels for various magnetic fields. Our measurements characterize some of ruby's low temperature spin properties, and lay the foundations for more advanced spin control experiments.


title: Inference and mutual information on random factor graphs

abstract: Random factor graphs provide a powerful framework for the study of inference problems such as decoding problems or the stochastic block model. Information-theoretically the key quantity of interest is the mutual information between the observed factor graph and the underlying ground truth around which the factor graph was created; in the stochastic block model, this would be the planted partition. The mutual information gauges whether and how well the ground truth can be inferred from the observable data. For a very general model of random factor graphs we verify a formula for the mutual information predicted by physics techniques. As an application we prove a conjecture about low-density generator matrix codes from [Montanari: IEEE Transactions on Information Theory 2005]. Further applications include phase transitions of the stochastic block model and the mixed $k$-spin model from physics.


title: Experimental Design for Bathymetry Editing

abstract: We describe an application of machine learning to a real-world computer assisted labeling task. Our experimental results expose significant deviations from the IID assumption commonly used in machine learning. These results suggest that the common random split of all data into training and testing can often lead to poor performance.


title: Observations on Symmetric Circuits

abstract: We study symmetric arithmetic circuits and improve on lower bounds given by Dawar and Wilsenach (ArXiv 2020). Their result showed an exponential lower bound of the permanent computed by symmetric circuits. We extend this result to show a simpler proof of the permanent lower bound and show that a large class of polynomials have exponential lower bounds in this model. In fact, we prove that all polynomials that contain at least one monomial of the permanent have exponential size lower bounds in the symmetric computation model. We also show super-polynomial lower bounds for smaller groups. We support our conclusion that the group is much more important than the polynomial by showing that on a random process of choosing polynomials, the probability of not encountering a super-polynomial lower bound is exponentially low.


title: Phase diagram for two-layer ReLU neural networks at infinite-width limit

abstract: How neural network behaves during the training over different choices of hyperparameters is an important question in the study of neural networks. In this work, inspired by the phase diagram in statistical mechanics, we draw the phase diagram for the two-layer ReLU neural network at the infinite-width limit for a complete characterization of its dynamical regimes and their dependence on hyperparameters related to initialization. Through both experimental and theoretical approaches, we identify three regimes in the phase diagram, i.e., linear regime, critical regime and condensed regime, based on the relative change of input weights as the width approaches infinity, which tends to $0$, $O(1)$ and $+\infty$, respectively. In the linear regime, NN training dynamics is approximately linear similar to a random feature model with an exponential loss decay. In the condensed regime, we demonstrate through experiments that active neurons are condensed at several discrete orientations. The critical regime serves as the boundary between above two regimes, which exhibits an intermediate nonlinear behavior with the mean-field model as a typical example. Overall, our phase diagram for the two-layer ReLU NN serves as a map for the future studies and is a first step towards a more systematical investigation of the training behavior and the implicit regularization of NNs of different structures.


title: Measurement error models: from nonparametric methods to deep neural networks

abstract: The success of deep learning has inspired recent interests in applying neural networks in statistical inference. In this paper, we investigate the use of deep neural networks for nonparametric regression with measurement errors. We propose an efficient neural network design for estimating measurement error models, in which we use a fully connected feed-forward neural network (FNN) to approximate the regression function $f(x)$, a normalizing flow to approximate the prior distribution of $X$, and an inference network to approximate the posterior distribution of $X$. Our method utilizes recent advances in variational inference for deep neural networks, such as the importance weight autoencoder, doubly reparametrized gradient estimator, and non-linear independent components estimation. We conduct an extensive numerical study to compare the neural network approach with classical nonparametric methods and observe that the neural network approach is more flexible in accommodating different classes of regression functions and performs superior or comparable to the best available method in nearly all settings.