title: Resonance Searches with Machine Learned Likelihood Ratios

abstract: We demonstrate the power of machine-learned likelihood ratios for resonance searches in a benchmark model featuring a heavy Z' boson. The likelihood ratio is expressed as a function of multivariate detector level observables, but rather than being calculated explicitly as in matrix-element-based approaches, it is learned from a joint likelihood ratio which depends on latent information from simulated samples. We show that bounds drawn using the machine learned likelihood ratio are tighter than those drawn using a likelihood ratio calculated from histograms.


title: A Single RGB Camera Based Gait Analysis with a Mobile Tele-Robot for Healthcare

abstract: With the increasing awareness of high-quality life, there is a growing need for health monitoring devices running robust algorithms in home environment. Health monitoring technologies enable real-time analysis of users' health status, offering long-term healthcare support and reducing hospitalization time. The purpose of this work is twofold, the software focuses on the analysis of gait, which is widely adopted for joint correction and assessing any lower limb or spinal problem. On the hardware side, we design a novel marker-less gait analysis device using a low-cost RGB camera mounted on a mobile tele-robot. As gait analysis with a single camera is much more challenging compared to previous works utilizing multi-cameras, a RGB-D camera or wearable sensors, we propose using vision-based human pose estimation approaches. More specifically, based on the output of two state-of-the-art human pose estimation models (Openpose and VNect), we devise measurements for four bespoke gait parameters: inversion/eversion, dorsiflexion/plantarflexion, ankle and foot progression angles. We thereby classify walking patterns into normal, supination, pronation and limp. We also illustrate how to run the purposed machine learning models in low-resource environments such as a single entry-level CPU. Experiments show that our single RGB camera method achieves competitive performance compared to state-of-the-art methods based on depth cameras or multi-camera motion capture system, at smaller hardware costs.


title: Aschenbach effect for spinning particles in Kerr spacetime

abstract: The orbital velocity profile of circular timelike geodesics in the equatorial plane of a Kerr black hole has a non-monotonic radial behavior, provided that the spin parameter $a$ of the black hole is bigger than a certain critical value $a_c \approx 0.9953 M$. Here the orbital velocity is measured with respect to the Locally Non-Rotating Frame (LNRF), and the non-monotonic behavior, which is known as the Aschenbach effect, occurs only for co-rotating orbits. Using the Mathisson-Papapetrou-Dixon equations for a massive spinning particle, we investigate the Aschenbach effect for test particles with spin. In addition to the black-hole spin, the absolute value of the particle's spin and its orientation (parallel or anti-parallel to the black-hole spin) also play an important role for the Aschenbach effect. We determine the critical value $a_c$ of the spin parameter of the Kerr black hole where the Aschenbach effect sets in as a function of the spin of the probe. We consider not only black holes ($a^2 \le M^2$) but also naked singularities ($a^2>M^2$). Whereas for spinless (geodesic) particles the orbital velocity is always monotonically decreasing if the motion is counter-rotating, we find that for spinning particles in counter-rotating motion with anti-parallel spin around a naked singularity the orbital velocity is increasing on a certain radius interval.


title: A Catlin-type Theorem for Graph Partitioning Avoiding Prescribed Subgraphs

abstract: As an extension of the Brooks theorem, Catlin in 1979 showed that if $H$ is neither an odd cycle nor a complete graph with maximum degree $\Delta(H)$, then $H$ has a vertex $\Delta(H)$-coloring such that one of the color classes is a maximum independent set. Let $G$ be a connected graph of order at least $2$. A $G$-free $k$-coloring of a graph $H$ is a partition of the vertex set of $H$ into $V_1,\ldots,V_k$ such that $H[V_i]$, the subgraph induced on $V_i$, does not contain any subgraph isomorphic to $G$. As a generalization of Catlin's theorem we show that a graph $H$ has a $G$-free $\lceil{\Delta(H)\over \delta(G)}\rceil$-coloring for which one of the color classes is a maximum $G$-free subset of $V(H)$ if $H$ satisfies the following conditions; (1) $H$ is not isomorphic to $G$ if $G$ is regular, (2) $H$ is not isomorphic to $K_{k\delta(G)+1}$ if $G \simeq K_{\delta(G)+1}$, and (3) $H$ is not an odd cycle if $G$ is isomorphic to $K_2$. Indeed, we show even more, by proving that if $G_1,\ldots,G_k$ are connected graphs with minimum degrees $d_1,\ldots,d_k$, respectively, and $\Delta(H)=\sum_{i=1}^{k}d_k$, then there is a partition of vertices of $H$ to $V_1,\ldots,V_k$ such that each $H[V_i]$ is $G_i$-free and moreover one of $V_i$s can be chosen in a way that $H[V_i]$ is a maximum $G_i$-free subset of $V(H)$ except either $k=1$ and $H$ is isomorphic to $G_1$, each $G_i$ is isomorphic to $K_{d_i+1}$ and $H$ is not isomorphic to $K_{\Delta(H)+1}$, or each $G_i$ is isomorphic to $K_{2}$ and $H$ is not an odd cycle.


title: Nonlocality of Observables in Quasi-Hermitian Quantum Theory

abstract: Explicit construction of local observable algebras in quasi-Hermitian quantum theories is derived in both the tensor product model of locality and in models of free fermions. The latter construction is applied to several cases of a $\mathcal{PT}$-symmetric toy model of particle-conserving free fermions on a 1-dimensional lattice, with nearest neighbour interactions and open boundary conditions. Despite the locality of the Hamiltonian, local observables do not exist in generic collections of sites in the lattice. The collections of sites which do contain nontrivial observables strongly depends on the complex potential.


title: Large Scale Tensor Regression using Kernels and Variational Inference

abstract: We outline an inherent weakness of tensor factorization models when latent factors are expressed as a function of side information and propose a novel method to mitigate this weakness. We coin our method \textit{Kernel Fried Tensor}(KFT) and present it as a large scale forecasting tool for high dimensional data. Our results show superior performance against \textit{LightGBM} and \textit{Field Aware Factorization Machines}(FFM), two algorithms with proven track records widely used in industrial forecasting. We also develop a variational inference framework for KFT and associate our forecasts with calibrated uncertainty estimates on three large scale datasets. Furthermore, KFT is empirically shown to be robust against uninformative side information in terms of constants and Gaussian noise.


title: Smart Cameras

abstract: We review camera architecture in the age of artificial intelligence. Modern cameras use physical components and software to capture, compress and display image data. Over the past 5 years, deep learning solutions have become superior to traditional algorithms for each of these functions. Deep learning enables 10-100x reduction in electrical sensor power per pixel, 10x improvement in depth of field and dynamic range and 10-100x improvement in image pixel count. Deep learning enables multiframe and multiaperture solutions that fundamentally shift the goals of physical camera design. Here we review the state of the art of deep learning in camera operations and consider the impact of AI on the physical design of cameras.


title: Bayesian Nonparametric Cost-Effectiveness Analyses: Causal Estimation and Adaptive Subgroup Discovery

abstract: Cost-effectiveness analyses (CEAs) are at the center of health economic decision making. While these analyses help policy analysts and economists determine coverage, inform policy, and guide resource allocation, they are statistically challenging for several reasons. Cost and effectiveness are correlated and follow complex joint distributions which are difficult to capture parametrically. Effectiveness (often measured as increased survival time) and accumulated cost tends to be right-censored in many applications. Moreover, CEAs are often conducted using observational data with non-random treatment assignment. Policy-relevant causal estimation therefore requires robust confounding control. Finally, current CEA methods do not address cost-effectiveness heterogeneity in a principled way - often presenting population-averaged estimates even though significant effect heterogeneity may exist. Motivated by these challenges, we develop a nonparametric Bayesian model for joint cost-survival distributions in the presence of censoring. Our approach utilizes a joint Enriched Dirichlet Process prior on the covariate effects of cost and survival time, while using a Gamma Process prior on the baseline survival time hazard. Causal CEA estimands, with policy-relevant interpretations, are identified and estimated via a Bayesian nonparametric g-computation procedure. Finally, we outline how the induced clustering of the Enriched Dirichlet Process can be used to adaptively detect presence of subgroups with different cost-effectiveness profiles. We outline an MCMC procedure for full posterior inference and evaluate frequentist properties via simulations. We use our model to assess the cost-efficacy of chemotherapy versus radiation adjuvant therapy for treating endometrial cancer in the SEER-Medicare database.


title: Smooth Points on Semi-algebraic Sets

abstract: Many algorithms for determining properties of real algebraic or semi-algebraic sets rely upon the ability to compute smooth points. Existing methods to compute smooth points on semi-algebraic sets use symbolic quantifier elimination tools. In this paper, we present a simple algorithm based on computing the critical points of some well-chosen function that guarantees the computation of smooth points in each connected compact component of a real (semi)-algebraic set. Our technique is intuitive in principal, performs well on previously difficult examples, and is straightforward to implement using existing numerical algebraic geometry software. The practical efficiency of our approach is demonstrated by solving a conjecture on the number of equilibria of the Kuramoto model for the $n=4$ case. We also apply our method to design an efficient algorithm to compute the real dimension of (semi)-algebraic sets, the original motivation for this research.


title: Radial expansion preserves hyperbolic convexity and radial contraction preserves spherical convexity

abstract: On a flat plane, convexity of a set is preserved by both radial expansion and contraction of the set about any point inside it. Using the Poincar\'e disk model of hyperbolic geometry, we prove that radial expansion of a hyperbolic convex set about a point inside it always preserves hyperbolic convexity. Using stereographic projection of a sphere, we prove that radial contraction of a spherical convex set about a point inside it, such that the initial set is contained in the closed hemisphere centred at that point, always preserves spherical convexity.


title: Task-Aware Variational Adversarial Active Learning

abstract: Often, labeling large amount of data is challenging due to high labeling cost limiting the application domain of deep learning techniques. Active learning (AL) tackles this by querying the most informative samples to be annotated among unlabeled pool. Two promising directions for AL that have been recently explored are task-agnostic approach to select data points that are far from the current labeled pool and task-aware approach that relies on the perspective of task model. Unfortunately, the former does not exploit structures from tasks and the latter does not seem to well-utilize overall data distribution. Here, we propose task-aware variational adversarial AL (TA-VAAL) that modifies task-agnostic VAAL, that considered data distribution of both label and unlabeled pools, by relaxing task learning loss prediction to ranking loss prediction and by using ranking conditional generative adversarial network to embed normalized ranking loss information on VAAL. Our proposed TA-VAAL outperforms state-of-the-arts on various benchmark datasets for classifications with balanced / imbalanced labels as well as semantic segmentation and its task-aware and task-agnostic AL properties were confirmed with our in-depth analyses.


title: Unique Properties of Flat Minima in Deep Networks

abstract: It is well known that (stochastic) gradient descent has an implicit bias towards flat minima. In deep neural network training, this mechanism serves to screen out minima. However, the precise effect that this has on the trained network is not yet fully understood. In this paper, we characterize the flat minima in linear neural networks trained with a quadratic loss. First, we show that linear ResNets with zero initialization necessarily converge to the flattest of all minima. We then prove that these minima correspond to nearly balanced networks whereby the gain from the input to any intermediate representation does not change drastically from one layer to the next. Finally, we show that consecutive layers in flat minima solutions are coupled. That is, one of the left singular vectors of each weight matrix, equals one of the right singular vectors of the next matrix. This forms a distinct path from input to output, that, as we show, is dedicated to the signal that experiences the largest gain end-to-end. Experiments indicate that these properties are characteristic of both linear and nonlinear models trained in practice.


title: Bi-objective Optimization of Biclustering with Binary Data

abstract: Clustering consists of partitioning data objects into subsets called clusters according to some similarity criteria. This paper addresses a generalization called quasi-clustering that allows overlapping of clusters, and which we link to biclustering. Biclustering simultaneously groups the objects and features so that a specific group of objects has a special group of features. In recent years, biclustering has received a lot of attention in several practical applications. In this paper we consider a bi-objective optimization of biclustering problem with binary data. First we present an integer programing formulations for the bi-objective optimization biclustering. Next we propose a constructive heuristic based on the set intersection operation and its efficient implementation for solving a series of mono-objective problems used inside the Epsilon-constraint method (obtained by keeping only one objective function and the other objective function is integrated into constraints). Finally, our experimental results show that using CPLEX solver as an exact algorithm for finding an optimal solution drastically increases the computational cost for large instances, while our proposed heuristic provides very good results and significantly reduces the computational expense.


title: Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning

abstract: The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In this paper, we propose to incorporate medical and imaging prior knowledge with deep learning to address these two problems. We propose a biomarker infused global-to-local network for the choroid segmentation. It leverages the choroidal thickness, a primary biomarker in clinic, as a constraint to improve the segmentation accuracy. We also design a global-to-local strategy in the choroid segmentation: a global module is used to segment all the retinal and choroidal layers simultaneously for suppressing overfitting and providing global structure information, then a local module is used to refine the segmentation with the biomarker infusion. To eliminate the retinal vessel shadows, we propose a pipeline that firstly use anatomical and OCT imaging knowledge to locate the shadows using their projection on the retinal pigment epithelium layer, then the contents of the choroidal vasculature at the shadow locations are predicted with an edge-to-texture generative adversarial inpainting network. The experiments show our method outperforms the existing methods on both the segmentation and shadow elimination tasks. We further apply the proposed method in a clinical prospective study for understanding the pathology of glaucoma by detecting the structure and vascular changes of the choroid related to the elevation of intra-ocular pressure.


title: On a Conjecture on the Variety of Lines on a Fano Complete Intersection

abstract: The Debarre-de Jong conjecture predicts that the Fano variety of lines on a smooth Fano hypersurface in $\mathbb{P}^n$ is always of the expected dimension. We generalize this conjecture to the case of Fano complete intersections and prove that for a Fano complete intersection $X\subset \mathbb{P}^n$ of hypersurfaces whose degrees sum to at most 7, the Fano variety of lines on $X$ has the expected dimension.


title: Asymmetric expansion preserves hyperbolic convexity

abstract: In an earlier paper we showed that the radial expansion of a hyperbolic convex set in the Poincar\'e disk about any point inside it results in a hyperbolic convex set. In this work, we generalize this result by showing that the asymmetric expansion of a hyperbolic convex set about any point inside it also results in a hyperbolic convex set.


title: Pair approximation for the noisy threshold $q$-voter model

abstract: In the standard $q$-voter model, a given agent can change its opinion only if there is a full consensus of the opposite opinion within a group of influence of size $q$. A more realistic extension is the threshold $q$-voter, where a minimal agreement (at least $0<q_0\le q$ opposite opinions) is sufficient to flip the central agent's opinion, including also the possibility of independent (non conformist) choices. Variants of this model including non-conformist behavior have been previously studied in fully connected networks (mean-field limit). Here we investigate its dynamics in random networks. Particularly, while in the mean-field case it is irrelevant whether repetitions in the influence group are allowed, we show that this is not the case in networks, and we study the impact of both cases, with or without repetition. Furthermore, the results of computer simulations are compared with the predictions of the pair approximation derived for uncorrelated networks of arbitrary degree distributions.


title: Robust multi-scale multi-feature deep learning for atomic and defect identification in Scanning Tunneling Microscopy on H-Si(100) 2x1 surface

abstract: The nature of the atomic defects on the hydrogen passivated Si (100) surface is analyzed using deep learning and scanning tunneling microscopy (STM). A robust deep learning framework capable of identifying atomic species, defects, in the presence of non-resolved contaminates, step edges, and noise is developed. The automated workflow, based on the combination of several networks for image assessment, atom-finding and defect finding, is developed to perform the analysis at different levels of description and is deployed on an operational STM platform. This is further extended to unsupervised classification of the extracted defects using the mean-shift clustering algorithm, which utilizes features automatically engineered from the combined output of neural networks. This combined approach allows the identification of localized and extended defects on the topographically non-uniform surfaces or real materials. Our approach is universal in nature and can be applied to other surfaces for building comprehensive libraries of atomic defects in quantum materials.


title: Computing classical modular forms

abstract: We discuss practical and some theoretical aspects of computing a database of classical modular forms in the L-functions and Modular Forms Database (LMFDB).


title: Harnack inequality and Liouville-type theorems for Ornstein-Uhlenbeck and Kolmogorov operators

abstract: We prove, with a purely analytic technique, a one-side Liouville theorem for a class of Ornstein--Uhlenbeck operators ${\mathcal L_0}$ in $\mathbb{R}^N$, as a consequence of a Liouville theorem at "$t=- \infty$" for the corresponding Kolmogorov operators ${\mathcal L_0} - \partial_t$ in $\mathbb{R}^{N+1}$. In turn, this last result is proved as a corollary of a global Harnack inequality for non-negative solutions to $({\mathcal L_0} - \partial_t) u = 0$ which seems to have an independent interest in its own right. We stress that our Liouville theorem for ${\mathcal L_0}$ cannot be obtained by a probabilistic approach based on recurrence if $N>2$. We provide a self-contained proof of a Liouville theorem involving recurrent Ornstein--Uhlenbeck stochastic processes in the Appendix.


title: Conformal Bjorken flow in the general frame and its attractor: Similarities and discrepancies with the M\"uller-Israel-Stewart formalism

abstract: We investigate the implications of the general frame approach for conformal Bjorken flow beyond the earlier studies. We show that the power series solution at late times is not unique and is accompanied by an exact solution of the form $1/\tau$, which becomes unphysical if taken on shell. In contrast to the M\"uller-Israel-Stewart formalism, a matching between $\NFSYM$ results and the hydro expansion is only possible up to the first order, which gives rise to $\eta/s=1/4\pi$. Matching the results to the next order gives rise to causality/stability-violating values. Furthermore, we show that the pressure anisotropy in the general frame cannot capture the hydrodynamization, and we introduce an alternative measure to find the attractor. Using slow-roll expansion, we find an analytical approximation form for the attractor. We also show that the early-time behavior of attractors is related to stability and causality conditions. The attractor solutions outside the stable and causal regime give rise to reheating and negative longitudinal pressures in early times, in contrast to the stable and causal ones. We also comment on the violation of the second law of thermodynamics by the off-shell parameters. We show that for the stable and causal choice of parameters, the off-shell canonical entropy of the attractors, which is not a physical quantity, has a negative divergence in early times before tending to its on-shell limit. On the other hand, the unstable and acausal attractors have non-negative entropy divergence. We speculate that the violation of the second law by stable and causal off-shell parameters is required for stability of the first-order hydrodynamics. We investigate the analytical structure of the Borel-transformed series and find the proper relation between the poles and nonhydro modes.


title: Improving Molecular Design by Stochastic Iterative Target Augmentation

abstract: Generative models in molecular design tend to be richly parameterized, data-hungry neural models, as they must create complex structured objects as outputs. Estimating such models from data may be challenging due to the lack of sufficient training data. In this paper, we propose a surprisingly effective self-training approach for iteratively creating additional molecular targets. We first pre-train the generative model together with a simple property predictor. The property predictor is then used as a likelihood model for filtering candidate structures from the generative model. Additional targets are iteratively produced and used in the course of stochastic EM iterations to maximize the log-likelihood that the candidate structures are accepted. A simple rejection (re-weighting) sampler suffices to draw posterior samples since the generative model is already reasonable after pre-training. We demonstrate significant gains over strong baselines for both unconditional and conditional molecular design. In particular, our approach outperforms the previous state-of-the-art in conditional molecular design by over 10% in absolute gain. Finally, we show that our approach is useful in other domains as well, such as program synthesis.


title: A Method Expanding 2 by 2 Contingency Table by Obtaining Tendencies of Boolean Operators: Boolean Monte Carlo Method

abstract: Accuracy of medical test and diagnosis are often discussed by 2 by 2 contingency tables. However, it is difficult to apply a 2 by 2 contingency table to multivariate cases because the number of possible categories increases exponentially. The aims of this study is introducing a method by which we can obtain trends of boolean operators and construct a 2 by 2 contingency tables to multivariate cases. In this method, we randomly assigned boolean operators between binary variables and focused on frequencies of boolean operators which could explain outcomes correctly. We determined trends of boolean operators by chi-square test. As an application, we performed this method for a dataset which included patient's age, body mass index (BMI), mean arterial pressure (MAP) and the quantitative measure of diabetes progression ($Y$). We set cutoff to each variable and considered these as binary variables. Interactions of age, BMI and MAP were determined as age $and$ BMI $and$ MAP ($p<0.0001$ for both operators) in estimating $Y$ and sensitivity, specificity, positive and negative predicting value were 0.50, 0.85. 0.59, 0.80 respectively. We may be able to detemine trends of boolean operators and construct a 2 by 2 contingency table in multivariate situation by this method.


title: Threshold for Blowup and Stability for Nonlinear Schr\"odinger Equation with Rotation

abstract: We consider the focusing NLS with an angular momentum and a harmonic potential, which models Bose-Einstein condensate under a rotating magnetic trap. We give a sharp condition on the global existence and blowup in the mass-critical case. We further consider the stability of such systems via variational method. We determine that at the critical exponent $p=1+4/n$, the mass of $Q$, the ground state for the NLS with zero potential, is the threshold for both finite time blowup and orbital instability. Moreover, we prove a sharp threshold theorem for the rotational NLS with an inhomogeneous nonlinearity. The analysis relies on the existence of ground state as well as a virial identity for the associated kinetic-magnetic operator.


title: Superbloom: Bloom filter meets Transformer

abstract: We extend the idea of word pieces in natural language models to machine learning tasks on opaque ids. This is achieved by applying hash functions to map each id to multiple hash tokens in a much smaller space, similarly to a Bloom filter. We show that by applying a multi-layer Transformer to these Bloom filter digests, we are able to obtain models with high accuracy. They outperform models of a similar size without hashing and, to a large degree, models of a much larger size trained using sampled softmax with the same computational budget. Our key observation is that it is important to use a multi-layer Transformer for Bloom filter digests to remove ambiguity in the hashed input. We believe this provides an alternative method to solving problems with large vocabulary size.


title: Improved Consistency Regularization for GANs

abstract: Recent work has increased the performance of Generative Adversarial Networks (GANs) by enforcing a consistency cost on the discriminator. We improve on this technique in several ways. We first show that consistency regularization can introduce artifacts into the GAN samples and explain how to fix this issue. We then propose several modifications to the consistency regularization procedure designed to improve its performance. We carry out extensive experiments quantifying the benefit of our improvements. For unconditional image synthesis on CIFAR-10 and CelebA, our modifications yield the best known FID scores on various GAN architectures. For conditional image synthesis on CIFAR-10, we improve the state-of-the-art FID score from 11.48 to 9.21. Finally, on ImageNet-2012, we apply our technique to the original BigGAN model and improve the FID from 6.66 to 5.38, which is the best score at that model size.


title: More Data Can Expand the Generalization Gap Between Adversarially Robust and Standard Models

abstract: Despite remarkable success in practice, modern machine learning models have been found to be susceptible to adversarial attacks that make human-imperceptible perturbations to the data, but result in serious and potentially dangerous prediction errors. To address this issue, practitioners often use adversarial training to learn models that are robust against such attacks at the cost of higher generalization error on unperturbed test sets. The conventional wisdom is that more training data should shrink the gap between the generalization error of adversarially-trained models and standard models. However, we study the training of robust classifiers for both Gaussian and Bernoulli models under $\ell_\infty$ attacks, and we prove that more data may actually increase this gap. Furthermore, our theoretical results identify if and when additional data will finally begin to shrink the gap. Lastly, we experimentally demonstrate that our results also hold for linear regression models, which may indicate that this phenomenon occurs more broadly.


title: Online Learning with Imperfect Hints

abstract: We consider a variant of the classical online linear optimization problem in which at every step, the online player receives a "hint" vector before choosing the action for that round. Rather surprisingly, it was shown that if the hint vector is guaranteed to have a positive correlation with the cost vector, then the online player can achieve a regret of $O(\log T)$, thus significantly improving over the $O(\sqrt{T})$ regret in the general setting. However, the result and analysis require the correlation property at \emph{all} time steps, thus raising the natural question: can we design online learning algorithms that are resilient to bad hints? In this paper we develop algorithms and nearly matching lower bounds for online learning with imperfect directional hints. Our algorithms are oblivious to the quality of the hints, and the regret bounds interpolate between the always-correlated hints case and the no-hints case. Our results also generalize, simplify, and improve upon previous results on optimistic regret bounds, which can be viewed as an additive version of hints.


title: A simple certifying algorithm for 3-edge-connectivity

abstract: A linear-time certifying algorithm for 3-edge-connectivity is presented. Given an undirected graph G, if G is 3-edge-connected, the algorithm generates a construction sequence as a positive certificate for G. Otherwise, the algorithm decomposes G into its 3-edge-connected components and at the same time generates a construction sequence for each connected component as well as the bridges and a cactus representation of the cut-pairs in G. All of these are done by making only one pass over G using an innovative graph contraction technique. Moreover, the graph need not be 2-edge-connected.


title: Dynamically Reconfigurable Discrete Distributed Stiffness for Inflated Beam Robots

abstract: Inflated continuum robots are promising for a variety of navigation tasks, but controlling their motion with a small number of actuators is challenging. These inflated beam robots tend to buckle under compressive loads, producing extremely tight local curvature at difficult-to-control buckle point locations. In this paper, we present an inflated beam robot that uses distributed stiffness changing sections enabled by positive pressure layer jamming to control or prevent buckling. Passive valves are actuated by an electromagnet carried by an electromechanical device that travels inside the main inflated beam robot body. The valves themselves require no external connections or wiring, allowing the distributed stiffness control to be scaled to long beam lengths. Multiple layer jamming elements are stiffened simultaneously to achieve global stiffening, allowing the robot to support greater cantilevered loads and longer unsupported lengths. Local stiffening, achieved by leaving certain layer jamming elements unstiffened, allows the robot to produce "virtual joints" that dynamically change the robot kinematics. Implementing these stiffening strategies is compatible with growth through tip eversion and tendon-steering, and enables a number of new capabilities for inflated beam robots and tip-everting robots.


title: The Freund-Rubin Coset, Textures and Group Theory

abstract: Contribution to the Peter Freund Memorial volume: a glossary of group-theoretic facts that may relate the seven-dimensional Freund-Rubin coset to Yukawa textures.


title: Spectral multipliers for Schr\"odinger operators

abstract: We prove a sharp H\"ormander multiplier theorem for Schr\"odinger operators $H=-\Delta+V$ on $\mathbb{R}^n$. The result is obtained under certain condition on a weighted $L^\infty$ estimate, coupled with a weighted $L^2$ estimate for $H$, which is a weaker condition than that for nonnegative operators via the heat kernel approach. Our approach is elaborated in one dimension with potential $V$ belonging to certain critical weighted $L^1$ class. Namely, we assume that $\int (1+|x|) |V(x)|dx$ is finite and $H$ has no resonance at zero. In the resonance case we assume $\int (1+|x|^2) |V(x)| dx$ is finite.


title: ZipPhone: Protecting user location privacy from cellular service providers

abstract: Wireless service providers track the time and location of all user connections. Location inference attacks have been effective in revealing the identity of anonymous users of wireless services. In this paper, we propose ZipPhone, a solution that leverages existing cellular infrastructure to improve user privacy. Spartacus allows a community of users to strategically time their connections to remain anonymous while incurring a minimal loss of utility. We evaluate ZipPhone from the perspective of a cell service provider and a community of privacy-seeking users, and quantify the privacy/utility trade-off of ZipPhone using two datasets containing cell tower logs of hundreds of users. We present and assess a deanonymization algorithm that uses both location profiling and trajectory linking. We find that by renewing identifiers every ten minutes and remaining offline for 30 seconds, users can reduce their identifiability by up to 45%.


title: Generalized Bayesian Cram\'{e}r-Rao Inequality via Information Geometry of Relative $\alpha$-Entropy

abstract: The relative $\alpha$-entropy is the R\'enyi analog of relative entropy and arises prominently in information-theoretic problems. Recent information geometric investigations on this quantity have enabled the generalization of the Cram\'{e}r-Rao inequality, which provides a lower bound for the variance of an estimator of an escort of the underlying parametric probability distribution. However, this framework remains unexamined in the Bayesian framework. In this paper, we propose a general Riemannian metric based on relative $\alpha$-entropy to obtain a generalized Bayesian Cram\'{e}r-Rao inequality. This establishes a lower bound for the variance of an unbiased estimator for the $\alpha$-escort distribution starting from an unbiased estimator for the underlying distribution. We show that in the limiting case when the entropy order approaches unity, this framework reduces to the conventional Bayesian Cram\'{e}r-Rao inequality. Further, in the absence of priors, the same framework yields the deterministic Cram\'{e}r-Rao inequality.

categories: cs.IT eess.SP math.IT math.ST stat.ML stat.TH


title: Mech-Elites: Illuminating the Mechanic Space of GVGAI

abstract: This paper introduces a fully automatic method of mechanic illumination for general video game level generation. Using the Constrained MAP-Elites algorithm and the GVG-AI framework, this system generates the simplest tile based levels that contain specific sets of game mechanics and also satisfy playability constraints. We apply this method to illuminate mechanic space for $4$ different games in GVG-AI: Zelda, Solarfox, Plants, and RealPortals.


title: Fast Complete Algorithm for Multiplayer Nash Equilibrium

abstract: We describe a new complete algorithm for computing Nash equilibrium in multiplayer general-sum games, based on a quadratically-constrained feasibility program formulation. We demonstrate that the algorithm runs significantly faster than the prior fastest complete algorithm on several game classes previously studied and that its runtimes even outperform the best incomplete algorithms.


title: Inducing of exotic smooth two fixed point actions on spheres

abstract: This paper is concerned with the Smith question which reads as follows. Is it true that for a finite group acting smoothly on a sphere with exactly two fixed points, the tangent spaces at the fixed points have always isomorphic group module structures defined by differentiation of the action? We show that one can answer this question negatively by using the technique of induction of group representations. We apply our results to indicate new dimensions of spheres admitting actions of specific Oliver groups, which give the negative answer to the Smith question. In particular, for the first time, we indicate some solvable non-nilpotent Oliver groups which yield negative answers to the Smith question.


title: Numerical solution of a class of third-kind Volterra integral equations using Jacobi wavelets

abstract: We propose a spectral collocation method, based on the generalized Jacobi wavelets along with the Gauss-Jacobi quadrature formula, for solving a class of third-kind Volterra integral equations. To do this, the interval of integration is first transformed into the interval [-1,1], by considering a suitable change of variable. Then, by introducing special Jacobi parameters, the integral part is approximated using the Gauss-Jacobi quadrature rule. An approximation of the unknown function is considered in terms of Jacobi wavelets functions with unknown coefficients, which must be determined. By substituting this approximation into the equation, and collocating the resulting equation at a set of collocation points, a system of linear algebraic equations is obtained. Then, we suggest a method to determine the number of basis functions necessary to attain a certain precision. Finally, some examples are included to illustrate the applicability, efficiency, and accuracy of the new scheme.


title: Smooth rational projective varieties with non-finitely generated discrete automorphism group and infinitely many real forms

abstract: We show, among other things, that for each integer $n \ge 3$, there is a smooth complex projective rational variety of dimension $n$, with discrete non-finitely generated automorphism group and with infinitely many mutually non-isomorphic real forms. Our result is inspired by the work of Lesieutre and the work of Dinh and Oguiso.


title: Plasmonic Nanoslit Arrays Fabricated by Serial Bideposition: Optical and Surface-Enhanced Raman Scattering Study

abstract: Recently, studies have been carried out on attempts to combine surface-enhanced Surface-enhanced Raman spectroscopy (SERS) substrates that can be based on either localized surface plasmon (LSP) or surface plasmon polaritons (SPP) structures. By combining these two systems, the drawbacks of each other can be solved. However, the manufacturing methods involved so far are sophisticated, labor-intensive, expensive, and also technically demanding. We propose a facile method for the fabrication of a flexible plasmonic nanoslit SERS sensor. We utilized the pattern on periodic optical disks (DVD-R) as a cheap substitute for printing the periodic pattern on PDMS with soft imprint lithography. Ag nanoslit (AgNS) was fabricated by serial bideposition using a dynamic oblique angle deposition (DOD) technique. The nanoslit structures were physically and optically characterized, and the experimental results were compared to the numerical simulation studies; Monte Carlo and the finite-difference time-domain (FDTD) simulation. The Ag nanoslit structure showed an excellent SERS enhancement, and its biosensing capability was demonstrated by the sensing of bilirubin.


title: Forecast of the evolution of the contagious disease caused by novel coronavirus (2019-nCoV) in China

abstract: The outbreak of novel coronavirus (2019-nCoV) in China has caused a viral epidemic affecting tens of thousands of persons. Though the danger of this epidemic is evident, the statistical analysis of data offered in this paper indicates that the increase in new cases in China will stabilize in the coming days or weeks. Our forecast could serve to evaluate risks and control the evolution of this disease.


title: The role of gravitational recoil in the assembly of massive black hole seeds

abstract: When two black holes merge, the asymmetric emission of gravitational waves provides an impulse to the merged system; this gravitational wave recoil velocity can be up to 4000 km s$^{-1}$, easily fast enough for the black hole to escape its host galaxy. We combine semi-analytic modeling with cosmological zoom-in simulations of a Milky Way-type galaxy to investigate the role of black hole spin and gravitational recoil in the epoch of massive black hole seeding. We sample four different spin distributions (random, aligned, anti-aligned, and zero spin), and compare the resulting merger rates, occupation fractions, and MBH-host relations with what is expected by excluding the effect of recoil. The inclusion of gravitational recoil and MBH spin in the assembly of MBH seeds can reduce the final $z=5$ MBH mass by up to an order of magnitude. The MBH occupation fraction, however, remains effectively unaltered due to episodes of black hole formation following a recoil event. While electromagnetic detections of these events are unlikely, LISA is ideally suited to detect gravitational wave signals from such events.


title: Progressive Object Transfer Detection

abstract: Recent development of object detection mainly depends on deep learning with large-scale benchmarks. However, collecting such fully-annotated data is often difficult or expensive for real-world applications, which restricts the power of deep neural networks in practice. Alternatively, humans can detect new objects with little annotation burden, since humans often use the prior knowledge to identify new objects with few elaborately-annotated examples, and subsequently generalize this capacity by exploiting objects from wild images. Inspired by this procedure of learning to detect, we propose a novel Progressive Object Transfer Detection (POTD) framework. Specifically, we make three main contributions in this paper. First, POTD can leverage various object supervision of different domains effectively into a progressive detection procedure. Via such human-like learning, one can boost a target detection task with few annotations. Second, POTD consists of two delicate transfer stages, i.e., Low-Shot Transfer Detection (LSTD), and Weakly-Supervised Transfer Detection (WSTD). In LSTD, we distill the implicit object knowledge of source detector to enhance target detector with few annotations. It can effectively warm up WSTD later on. In WSTD, we design a recurrent object labelling mechanism for learning to annotate weakly-labeled images. More importantly, we exploit the reliable object supervision from LSTD, which can further enhance the robustness of target detector in the WSTD stage. Finally, we perform extensive experiments on a number of challenging detection benchmarks with different settings. The results demonstrate that, our POTD outperforms the recent state-of-the-art approaches.


title: Fast Geometric Projections for Local Robustness Certification

abstract: Local robustness ensures that a model classifies all inputs within an $\ell_2$-ball consistently, which precludes various forms of adversarial inputs. In this paper, we present a fast procedure for checking local robustness in feed-forward neural networks with piecewise-linear activation functions. Such networks partition the input space into a set of convex polyhedral regions in which the network's behavior is linear; hence, a systematic search for decision boundaries within the regions around a given input is sufficient for assessing robustness. Crucially, we show how the regions around a point can be analyzed using simple geometric projections, thus admitting an efficient, highly-parallel GPU implementation that excels particularly for the $\ell_2$ norm, where previous work has been less effective. Empirically we find this approach to be far more precise than many approximate verification approaches, while at the same time performing multiple orders of magnitude faster than complete verifiers, and scaling to much deeper networks.


title: Fluid-gravity correspondence in the scalar-tensor theory of gravity: (in)equivalence of Einstein and Jordan frames

abstract: The duality of gravitational dynamics (projected on a null hypersurface) and of fluid dynamics is investigated for the scalar tensor (ST) theory of gravity. The description of ST gravity, in both Einstein and Jordan frames, is analyzed from fluid-gravity viewpoint. In the Einstein frame the dynamical equation for the metric leads to the Damour-Navier-Stokes (DNS) equation with an external forcing term, coming from the scalar field in ST gravity. In the Jordan frame the situation is more subtle. We observe that finding the DNS equation in this frame can lead to two pictures. In one picture, the usual DNS equation is modified by a Coriolis-like force term, which originates completely from the presence of a non-minimally coupled scalar field ($\phi$) on the gravity side. Moreover, the identified fluid variables are no longer conformally equivalent with those in the Einstein frame. However, this picture is consistent with the saturation of Kovtun-Son-Starinets (KSS) bound. In the other picture, we find the standard DNS equation (i.e. without the Coriolis-like force), with the fluid variables conformally equivalent with those in Einstein frame. But, the second picture, may not agree with the KSS bound for some values of $\phi$. We conclude by rewriting the Raychaudhuri equation and the tidal force equation in terms of the relevant parameters to demonstrate how the expansion scalar and the shear-tensor evolve in the spacetime. Although, the area law of entropy is broken in ST gravity, we show that the rewritten form of Raychaudhuri's equation correctly results in the generalized second law of black hole thermodynamics.


title: Detection of Ship Wakes in SAR Imagery Using Cauchy Regularisation

abstract: Ship wake detection is of great importance in the characterisation of synthetic aperture radar (SAR) images of the ocean surface since wakes usually carry essential information about vessels. Most detection methods exploit the linear characteristics of the ship wakes and transform the lines in the spatial domain into bright or dark points in a transform domain, such as the Radon or Hough transforms. This paper proposes an innovative ship wake detection method based on sparse regularisation to obtain the Radon transform of the SAR image, in which the linear features are enhanced. The corresponding cost function utilizes the Cauchy prior, and on this basis, the Cauchy proximal operator is proposed. A Bayesian method, the Moreau-Yoshida unadjusted Langevin algorithm (MYULA), which is computationally efficient and robust is used to estimate the image in the transform domain by minimizing the negative log-posterior distribution. The detection accuracy of the Cauchy prior based approach is 86.7%, which is demonstrated by experiments over six COSMO-SkyMed images.


title: On Layer Normalization in the Transformer Architecture

abstract: The Transformer is widely used in natural language processing tasks. To train a Transformer however, one usually needs a carefully designed learning rate warm-up stage, which is shown to be crucial to the final performance but will slow down the optimization and bring more hyper-parameter tunings. In this paper, we first study theoretically why the learning rate warm-up stage is essential and show that the location of layer normalization matters. Specifically, we prove with mean field theory that at initialization, for the original-designed Post-LN Transformer, which places the layer normalization between the residual blocks, the expected gradients of the parameters near the output layer are large. Therefore, using a large learning rate on those gradients makes the training unstable. The warm-up stage is practically helpful for avoiding this problem. On the other hand, our theory also shows that if the layer normalization is put inside the residual blocks (recently proposed as Pre-LN Transformer), the gradients are well-behaved at initialization. This motivates us to remove the warm-up stage for the training of Pre-LN Transformers. We show in our experiments that Pre-LN Transformers without the warm-up stage can reach comparable results with baselines while requiring significantly less training time and hyper-parameter tuning on a wide range of applications.


title: Verification of finite bath fluctuation theorem for a non-ergodic system

abstract: The analysis of fluctuations generated by a thermal reservoir has produced many results throughout the history of science, ranging from the verification of the atomic hypothesis, running through critical phenomena to the most recent advances in the description of non-equilibrium thermodynamic processes. Motivated by recent theoretical and experimental works, we analyze the non-equilibrium and equilibrium fluctuations caused by a finite and chaotic heat bath in a simple system of interest. Finite bath and system of interest give rise to a non-ergodic composite system when interacting with each other. We have characterized the equilibrium distribution induced by the finite bath and numerically verified the finite-bath fluctuation theorem. We have also verified the convergence of our results to Crooks' fluctuation theorem as the number of degrees of freedom of the finite bath increases while the non-ergodic character remains.


title: On the Value of Target Data in Transfer Learning

abstract: We aim to understand the value of additional labeled or unlabeled target data in transfer learning, for any given amount of source data; this is motivated by practical questions around minimizing sampling costs, whereby, target data is usually harder or costlier to acquire than source data, but can yield better accuracy. To this aim, we establish the first minimax-rates in terms of both source and target sample sizes, and show that performance limits are captured by new notions of discrepancy between source and target, which we refer to as transfer exponents.


title: A Systematic Study of the dust of Galactic Supernova Remnants I. The Distance and the Extinction

abstract: By combining the photometric, spectroscopic, and astrometric information of the stars in the sightline of SNRs, the distances to and the extinctions of 32 Galactic supernova remnants (SNRs) are investigated. The stellar atmospheric parameters are from the SDSS$-$DR14$/$APOGEE and LAMOST$-$DR5$/$LEGUE spectroscopic surveys. The multi-band photometry, from optical to infrared, are collected from the {\it Gaia}, APASS, Pan--STARRS1, 2MASS, and {\it WISE} surveys. With the calibrated {\it Gaia} distances of individual stars, the distances to 15 of 32 SNRs are well determined from their produced extinction and association with molecular clouds. The upper limits of distance are derived for 3 SNRs. The color excess ratios $E(g_{\rm P1}-\lambda) / E(g_{\rm P1}-r_{\rm P1})$ of 32 SNRs are calculated, and their variation with wavebands is fitted by a simple dust model. The inferred dust grain size distribution bifurcates: while the graphite grains have comparable size to the average ISM dust, the silicate grains are generally larger. Along the way, the average extinction law from optical to near-infrared of the Milky Way is derived from the 1.3 million star sample and found to agree with the CCM89 law with $R_{\rm V}=3.15$.


title: Production of Lithium in Primordial Supernovae

abstract: The first generation of stars is quite unique. The absence of metals likely affects their formation, with current models suggesting a much more top-heavy initial mass fraction than what we observe today, and some of their other properties, such as rotation rates and binarity, are largely unknown or constrained by direct observations. But even non-rotation single stars of a given mass will evolve quite differently due to the absence of the metals: the stars will mostly remain much more compact until their death, with the hydrogen-rich later reaching down ten teems deeper in radius then in modern stars. When they explode as supernovae, the exposure to the supernova neutrino flux is much enhanced, allowing for copious production of lithium. This production will not be constant for all stars but largely vary across the mass range. Such production even more challenges the presence of the Spite Plateau.


title: On the cohomology of Kobayashi's plus/minus norm groups and applications

abstract: The plus and minus norm groups are constructed by Kobayashi as subgroups of the formal group of an elliptic curve with supersingular reduction, and they play an important role in Kobayashi's definition of the signed Selmer groups. In this paper, we study the cohomology of these plus and minus norm groups. In particular, we show that these norm groups are cohomologically trivial. As an application of our analysis, we establish certain (quasi-)projectivity properties of the non-primitive mixed signed Selmer groups of an elliptic curve with good reduction at all primes above $p$. We then build on these latter projectivity results to derive a Kida formula for the signed Selmer groups, and study the integrality property of the characteristic element attached to the signed Selmer groups.


title: Asteroid belt survival through stellar evolution: dependence on the stellar mass

abstract: Polluted white dwarfs are generally accreting terrestrial-like material that may originate from a debris belt like the asteroid belt in the solar system. The fraction of white dwarfs that are polluted drops off significantly for white dwarfs with masses $M_{\rm WD}\gtrsim 0.8\,\rm M_\odot$. This implies that asteroid belts and planetary systems around main-sequence stars with mass $M_{\rm MS}\gtrsim 3\,\rm M_\odot$ may not form because of the intense radiation from the star. This is in agreement with current debris disc and exoplanet observations. The fraction of white dwarfs that show pollution also drops off significantly for low mass white dwarfs $(M_{\rm WD}\lesssim 0.55\,\rm M_\odot)$. However, the low-mass white dwarfs that do show pollution are not currently accreting but have accreted in the past. We suggest that asteroid belts around main sequence stars with masses $M_{\rm MS}\lesssim 2\,\rm M_\odot$ are not likely to survive the stellar evolution process. The destruction likely occurs during the AGB phase and could be the result of interactions of the asteroids with the stellar wind, the high radiation or, for the lowest mass stars that have an unusually close-in asteroid belt, scattering during the tidal orbital decay of the inner planetary system.


title: Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumes

abstract: Machine learning models for radiology benefit from large-scale data sets with high quality labels for abnormalities. We curated and analyzed a chest computed tomography (CT) data set of 36,316 volumes from 19,993 unique patients. This is the largest multiply-annotated volumetric medical imaging data set reported. To annotate this data set, we developed a rule-based method for automatically extracting abnormality labels from free-text radiology reports with an average F-score of 0.976 (min 0.941, max 1.0). We also developed a model for multi-organ, multi-disease classification of chest CT volumes that uses a deep convolutional neural network (CNN). This model reached a classification performance of AUROC greater than 0.90 for 18 abnormalities, with an average AUROC of 0.773 for all 83 abnormalities, demonstrating the feasibility of learning from unfiltered whole volume CT data. We show that training on more labels improves performance significantly: for a subset of 9 labels - nodule, opacity, atelectasis, pleural effusion, consolidation, mass, pericardial effusion, cardiomegaly, and pneumothorax - the model's average AUROC increased by 10% when the number of training labels was increased from 9 to all 83. All code for volume preprocessing, automated label extraction, and the volume abnormality prediction model will be made publicly available. The 36,316 CT volumes and labels will also be made publicly available pending institutional approval.


title: RFN: A Random-Feature Based Newton Method for Empirical Risk Minimization in Reproducing Kernel Hilbert Spaces

abstract: In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method, where the Hessian is approximated via sub-samples of data. In RKHS, however, the dependence of the penalty function to kernel makes standard sub-sampling approaches inapplicable, since the gram matrix is not readily available in a low-rank form. In this paper, we observe that for this class of problems, one can naturally use kernel approximation to speed up the Newton method. Focusing on randomized features for kernel approximation, we provide a novel second-order algorithm that enjoys local superlinear convergence and global linear convergence (with high probability). We derive the theoretical lower bound for the number of random features required for the approximated Hessian to be close to the true Hessian in the norm sense. Our numerical experiments on real-world data verify the efficiency of our method compared to several benchmarks.


title: Integrated Nonreciprocal Photonic Devices with Dynamic Modulation

abstract: Nonreciprocal components, such as isolators and circulators, are crucial components for photonic systems. In this article we review theoretical and experimental progress towards developing nonreciprocal photonic devices based on dynamic modulation. In particular, we focus on approaches that operate at optical wavelengths and device architectures that have the potential for chip-scale integration. We first discuss the requirements for constructing an isolator or circulator using dynamic modulation. We review a number of different isolator and circulator architectures, including waveguide and resonant devices, and describe their underlying operating principles. We then compare these device architectures from a system-level performance perspective, considering how their figures of merit, such as footprint, bandwidth, isolation, and insertion loss scale with respect to device parameters.


title: Leptonic decays of $B_{(s)}$ and $D_{(s)}$ using the OK action

abstract: We present recent progress in the lattice calculation of leptonic decay constants for $B_{(s)}$ and $D_{(s)}$ mesons using the Oktay-Kronfeld (OK) action for charm and bottom valence quarks, whose masses are tuned non-perturbatively. The calculations are done on 6 HISQ ensembles generated by the MILC collaboration with $N_f=2+1+1$ flavors. We also use the HISQ action for the light spectator quarks. Results are presented for the ratios $f_{B_s}/f_B$ and $f_{D_s}/f_D$, which reflect $SU(3)$ flavor symmetry breaking, and are independent of the renormalization constants of the axial currents.


title: Average-case Acceleration Through Spectral Density Estimation

abstract: We develop a framework for the average-case analysis of random quadratic problems and derive algorithms that are optimal under this analysis. This yields a new class of methods that achieve acceleration given a model of the Hessian's eigenvalue distribution. We develop explicit algorithms for the uniform, Marchenko-Pastur, and exponential distributions. These methods are momentum-based algorithms, whose hyper-parameters can be estimated without knowledge of the Hessian's smallest singular value, in contrast with classical accelerated methods like Nesterov acceleration and Polyak momentum. Through empirical benchmarks on quadratic and logistic regression problems, we identify regimes in which the the proposed methods improve over classical (worst-case) accelerated methods.


title: Lasing from complete set of topological states in two dimensional photonic crystal structure

abstract: Recently, topologically engineered photonic structures have garnered significant attention as their eigenstates may offer a new insight on photon manipulation and an unconventional route for nanophotonic devices with unprecedented functionalities and robustness. Herein, we present lasing actions at all hierarchical eigenstates that can exist in a topologically designed single two-dimensional (2D) photonic crystal (PhC) platform: 2D bulk, one-dimensional edge, and zero-dimensional corner states. In particular, multiple topological eigenstates are generated in a hierarchical manner with no bulk multipole moment. The unit cell of the topological PhC structure is a tetramer composed of four identical air holes perforated into an InGaAsP multiple-quantum-well epilayer slab. A square area of a topologically nontrivial PhC structure is surrounded by a topologically trivial counterpart, resulting in multidimensional eigenstates of one bulk, four side edges, and four corners within and at the boundaries. Spatially resolved optical excitation spontaneously results in lasing actions at all nine hierarchical topological states. Our experimental findings may provide insight into the development of sophisticated next-generation nanophotonic devices and robust integration platforms.


title: Salvaging Federated Learning by Local Adaptation

abstract: Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the participants. To ensure privacy and integrity of the fedeated model, latest FL approaches use differential privacy or robust aggregation. We look at FL from the \emph{local} viewpoint of an individual participant and ask: (1) do participants have an incentive to participate in FL? (2) how can participants \emph{individually} improve the quality of their local models, without re-designing the FL framework and/or involving other participants? First, we show that on standard tasks such as next-word prediction, many participants gain no benefit from FL because the federated model is less accurate on their data than the models they can train locally on their own. Second, we show that differential privacy and robust aggregation make this problem worse by further destroying the accuracy of the federated model for many participants. Then, we evaluate three techniques for local adaptation of federated models: fine-tuning, multi-task learning, and knowledge distillation. We analyze where each is applicable and demonstrate that all participants benefit from local adaptation. Participants whose local models are poor obtain big accuracy improvements over conventional FL. Participants whose local models are better than the federated model\textemdash and who have no incentive to participate in FL today\textemdash improve less, but sufficiently to make the adapted federated model better than their local models.


title: Collaborative Inference for Efficient Remote Monitoring

abstract: While current machine learning models have impressive performance over a wide range of applications, their large size and complexity render them unsuitable for tasks such as remote monitoring on edge devices with limited storage and computational power. A naive approach to resolve this on the model level is to use simpler architectures, but this sacrifices prediction accuracy and is unsuitable for monitoring applications requiring accurate detection of the onset of adverse events. In this paper, we propose an alternative solution to this problem by decomposing the predictive model as the sum of a simple function which serves as a local monitoring tool, and a complex correction term to be evaluated on the server. A sign requirement is imposed on the latter to ensure that the local monitoring function is safe, in the sense that it can effectively serve as an early warning system. Our analysis quantifies the trade-offs between model complexity and performance, and serves as a guidance for architecture design. We validate our proposed framework on a series of monitoring experiments, where we succeed at learning monitoring models with significantly reduced complexity that minimally violate the safety requirement. More broadly, our framework is useful for learning classifiers in applications where false negatives are significantly more costly compared to false positives.


title: DeepMutation: A Neural Mutation Tool

abstract: Mutation testing can be used to assess the fault-detection capabilities of a given test suite. To this aim, two characteristics of mutation testing frameworks are of paramount importance: (i) they should generate mutants that are representative of real faults; and (ii) they should provide a complete tool chain able to automatically generate, inject, and test the mutants. To address the first point, we recently proposed an approach using a Recurrent Neural Network Encoder-Decoder architecture to learn mutants from ~787k faults mined from real programs. The empirical evaluation of this approach confirmed its ability to generate mutants representative of real faults. In this paper, we address the second point, presenting DeepMutation, a tool wrapping our deep learning model into a fully automated tool chain able to generate, inject, and test mutants learned from real faults. Video: https://sites.google.com/view/learning-mutation/deepmutation


title: Simultaneous Input and State Interval Observers for Nonlinear Systems with Full-Rank Direct Feedthrough

abstract: A simultaneous input and state interval observer is presented for Lipschitz continuous nonlinear systems with unknown inputs and bounded noise signals for the case when the direct feedthrough matrix has full column rank. The observer leverages the existence of bounding decomposition functions for mixed monotone mappings to recursively compute the maximal and minimal elements of the estimate intervals that are compatible with output/measurement signals, and are proven to contain the true state and unknown input. Furthermore, we derive a Lipschitz-like property for decomposition functions, which provides several sufficient conditions for stability of the designed observer and boundedness of the sequence of estimate interval widths. Finally, the effectiveness of our approach is demonstrated using an illustrative example.


title: {\sc precision}: A fast python pipeline for high-contrast imaging -- application to SPHERE observations of the red supergiant VX Sagitariae

abstract: The search for extrasolar planets has driven rapid advances in instrumentation, resulting in cameras such as SPHERE at the VLT, GPI at Gemini South and SCExAO at Subaru, capable of achieving very high contrast ($\sim10^{6}$) around bright stars with small inner working angles ($\sim 0\farcs{1}$). The optimal exploitation of data from these instruments depends on the availability of easy-to-use software to process and analyse their data products. We present a pure-python pipeline, {\sc precision}, which provides fast, memory-efficient reduction of data from the SPHERE/IRDIS near-infrared imager, and can be readily extended to other instruments. We apply {\sc precision} to observations of the extreme red supergiant VX~Sgr, the inner outflow of which is revealed to host complex, asymmetric structure in the near-IR. In addition, optical polarimetric imaging reveals clear extended polarised emission on $\sim0.5^{\prime\prime}$ scales which varies significantly with azimuth, confirming the asymmetry. While not conclusive, this could suggest that the ejecta are confined to a disc or torus, which we are viewing nearly face on, although other non-spherical or clumpy configurations remain possible. VX~Sgr has no known companions, making such a geometry difficult to explain, as there is no obvious source of angular momentum in the system.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Understanding Global Loss Landscape of One-hidden-layer ReLU Networks, Part 1: Theory

abstract: For one-hidden-layer ReLU networks, we prove that all differentiable local minima are global inside differentiable regions. We give the locations and losses of differentiable local minima, and show that these local minima can be isolated points or continuous hyperplanes, depending on an interplay between data, activation pattern of hidden neurons and network size. Furthermore, we give necessary and sufficient conditions for the existence of saddle points as well as non-differentiable local minima, and their locations if they exist.


title: Capsules with Inverted Dot-Product Attention Routing

abstract: We introduce a new routing algorithm for capsule networks, in which a child capsule is routed to a parent based only on agreement between the parent's state and the child's vote. The new mechanism 1) designs routing via inverted dot-product attention; 2) imposes Layer Normalization as normalization; and 3) replaces sequential iterative routing with concurrent iterative routing. When compared to previously proposed routing algorithms, our method improves performance on benchmark datasets such as CIFAR-10 and CIFAR-100, and it performs at-par with a powerful CNN (ResNet-18) with 4x fewer parameters. On a different task of recognizing digits from overlayed digit images, the proposed capsule model performs favorably against CNNs given the same number of layers and neurons per layer. We believe that our work raises the possibility of applying capsule networks to complex real-world tasks. Our code is publicly available at: https://github.com/apple/ml-capsules-inverted-attention-routing An alternative implementation is available at: https://github.com/yaohungt/Capsules-Inverted-Attention-Routing/blob/master/README.md


title: Potential molecular semiconductor devices: cyclo-Cn (n = 10 and 14) with higher stabilities and aromaticities than acknowledged cyclo-C18

abstract: The successful isolation of cyclo-C18 in the experiment means the ground-breaking epoch of carbon rings. Herein, we studied the thermodynamic stabilities of cyclo-Cn (4 $\leq$ n $\leq$ 34) with density functional theory. When n = 4N + 2 (N is integer), cyclo-Cn (10 $\leq$ n $\leq$ 34) were thermodynamically stable. Especially, cyclo-C10 and cyclo-C14 were thermodynamically, kinetically, dynamically, and optically preferred to cyclo-C18, and were the candidates of zero-dimension carbon rings. The carbon atoms were sp hybridization in cyclo-C10, cyclo-C14 and cyclo-C18. Cyclo-C14 and cyclo-C18 had alternating abnormal single and triple bonds, but cyclo-C10 had equal bonds. Cyclo-C10, cyclo-C14, and cyclo-C18 with large aromaticities had out-plane and in-plane pi systems, which were perpendicular to each other. The number of pi electrons in out-plane and in-plane pi systems followed the Huckel rule. Simulated UV-vis-NIR spectra indicated the similar electronic structures of cyclo-C14 and cyclo-C18.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.chem-ph physics.comp-ph


title: Task-Robust Model-Agnostic Meta-Learning

abstract: Meta-learning methods have shown an impressive ability to train models that rapidly learn new tasks. However, these methods only aim to perform well in expectation over tasks coming from some particular distribution that is typically equivalent across meta-training and meta-testing, rather than considering worst-case task performance. In this work we introduce the notion of "task-robustness" by reformulating the popular Model-Agnostic Meta-Learning (MAML) objective [Finn et al. 2017] such that the goal is to minimize the maximum loss over the observed meta-training tasks. The solution to this novel formulation is task-robust in the sense that it places equal importance on even the most difficult and/or rare tasks. This also means that it performs well over all distributions of the observed tasks, making it robust to shifts in the task distribution between meta-training and meta-testing. We present an algorithm to solve the proposed min-max problem, and show that it converges to an $\epsilon$-accurate point at the optimal rate of $\mathcal{O}(1/\epsilon^2)$ in the convex setting and to an $(\epsilon, \delta)$-stationary point at the rate of $\mathcal{O}(\max\{1/\epsilon^5, 1/\delta^5\})$ in nonconvex settings. We also provide an upper bound on the new task generalization error that captures the advantage of minimizing the worst-case task loss, and demonstrate this advantage in sinusoid regression and image classification experiments.


title: Supersingular main conjectures, Sylvester's conjecture and Goldfeld's conjecture

abstract: We prove a $p$-converse theorem for elliptic curves $E/\mathbb{Q}$ with complex multiplication by the ring of integers $\mathcal{O}_K$ of an imaginary quadratic field $K$ in which $p$ is ramified. Namely, letting $r_p = \mathrm{corank}_{\mathbb{Z}_p}\mathrm{Sel}_{p^{\infty}}(E/\mathbb{Q})$, we show that $r_p \le 1 \implies \mathrm{rank}_{\mathbb{Z}}E(\mathbb{Q}) = \mathrm{ord}_{s = 1}L(E/\mathbb{Q},s) = r_p$ and $\#\mathrm{Sha}(E/\mathbb{Q}) < \infty$. In particular, this has applications to two classical Diophantine problems. First, it resolves Sylvester's conjecture on rational sums of cubes, showing that for all primes $\ell \equiv 4,7,8 \pmod{9}$, there exists $(x,y) \in \mathbb{Q}^{\oplus 2}$ such that $x^3 + y^3 = \ell$. Second, combined with work of Smith, it resolves the congruent number problem in 100\% of cases and establishes Goldfeld's conjecture on ranks of quadratic twists for the congruent number family. The method for showing the above $p$-converse theorem relies on new interplays between Iwasawa theory for imaginary quadratic fields at nonsplit primes and relative $p$-adic Hodge theory. In particular, we show that a certain de Rham period $q_{\mathrm{dR}}$ can be used to construct anticyclotomic $p$-adic $L$-functions for Hecke characters and newforms, interpolating anticyclotomic twists of positive Hodge-Tate weight in the central critical range. Moreover, one can relate the Iwasawa module of elliptic units to these anticyclotomic $p$-adic $L$-functions via a new "Coleman map", which is, roughly speaking, the $q_{\mathrm{dR}}$-expansion of the Coleman power series map. Using this, we formulate and prove a new Rubin-type main conjecture for elliptic units, which is eventually related to Heegner points in order to prove the $p$-converse theorem.


title: Explicit optimal constants of two critical Rellich inequalities for radially symmetric functions

abstract: We consider two critical Rellich inequalities with singularities at both the origin and the boundary in the higher order critical radial Sobolev spaces $W_{0, {\rm rad}}^{k, p}$, where $1< p = \frac{N}{k}$. We give the explicit values of the optimal constants of two critical Rellich inequalities for radially symmetric functions in $W_{0, {\rm rad}}^{k, \frac{N}{k}}$. Furthermore the (non-)attainability of the optimal constants are also discussed.


title: Finite intersection property for bifunctions and existence for quasi-equilibrium problems

abstract: The "finite intersection property" for bifunctions is introduced and its relationship with generalized monotonicity properties is studied. Some results concerning existence of solution for (quasi-)equilibrium problems are established and several results well-known in the literature are recovered. Furthermore, two applications are considered.


title: Forecasting adverse surgical events using self-supervised transfer learning for physiological signals

abstract: Hundreds of millions of surgical procedures take place annually across the world, which generate a prevalent type of electronic health record (EHR) data comprising time series physiological signals. Here, we present a transferable embedding method (i.e., a method to transform time series signals into input features for predictive machine learning models) named PHASE (PHysiologicAl Signal Embeddings) that enables us to more accurately forecast adverse surgical outcomes based on physiological signals. We evaluate PHASE on minute-by-minute EHR data of more than 50,000 surgeries from two operating room (OR) datasets and patient stays in an intensive care unit (ICU) dataset. PHASE outperforms other state-of-the-art approaches, such as long-short term memory networks trained on raw data and gradient boosted trees trained on handcrafted features, in predicting five distinct outcomes: hypoxemia, hypocapnia, hypotension, hypertension, and phenylephrine administration. In a transfer learning setting where we train embedding models in one dataset then embed signals and predict adverse events in unseen data, PHASE achieves significantly higher prediction accuracy at lower computational cost compared to conventional approaches. Finally, given the importance of understanding models in clinical applications we demonstrate that PHASE is explainable and validate our predictive models using local feature attribution methods.


title: The poset of copies for automorphism groups of countable relational structures

abstract: Let $\mathrm{G}$ be a subgroup of the symmetric group $\mathfrak S(U)$ of all permutations of a countable set $U$. Let $\overline{\mathrm{G}}$ be the topological closure of $\mathrm{G}$ in the function topology on $U^U$. We initiate the study of the poset $\overline{\mathrm{G}}[U]:=\{f[U]\mid f\in \overline{\mathrm{G}}\}$ of images of the functions in $\overline{\mathrm{G}}$, being ordered under inclusion. This set $\overline{\mathrm{G}}[U]$ of subsets of the set $U$ will be called the \emph{poset of copies for} the group $\mathrm{G}$. A denomination being justified by the fact that for every subgroup $\mathrm{G}$ of the symmetric group $\mathfrak S(U)$ there exists a homogeneous relational structure $R$ on $U$ such that $\overline G$ is the set of embeddings of the homogeneous structure $R$ into itself and $\overline{\mathrm{G}}[U]$ is the set of copies of $R$ in $R$ and that the set of bijections $\overline G\cap \mathfrak S(U)$ of $U$ to $U$ forms the group of automorphisms of $\mathrm{R}$.


title: Crystalline Electric-Field Excitations in Quantum Spin Liquids Candidate $NaYbSe_{2}$

abstract: Very recently we revealed a large family of triangular lattice quantum spin liquid candidates named rare-earth chalcogenides, which features a high-symmetry structure without structural/charge disorders and spin impurities, and may serve as an ideal platform exploring spin liquid physics. The knowledge of crystalline electric-field (CEF) excitations is an essential step to explore the fundamental magnetism of rare-earth spin systems. Here we employed inelastic neutron scattering (INS) and Raman scattering (RS) to carry out a comprehensive CFE investigation on $NaYbSe_{2}$, a promising representative of the family. By comparison with its nonmagnetic compound $NaLuSe_{2}$, we are able to identify the CEF excitations at 15.8, 24.3 and 30.5 meV at 5K. The selected cuts of the INS spectra are well re-produced with a large anisotropy of $g$ factors ($g_{ab}:g_{c}\sim3:1$). Further, the CEF excitations are explained well by our calculations based on the point charge model. Interestingly, $NaYbSe_{2}$ exhibits an unusual CEF shift to higher energies with increasing temperatures, and the Raman mode close to the first CEF excitation shows an anomalously large softening with decreasing temperatures. The absence of the anomalies in $NaLuSe_{2}$ clearly demonstrates a CEF-phonon coupling not reported in the family. It can be understood in term of the weaker electronegativity of Se. The fact that the smallest first CEF excitation in the sub-family of $NaYbCh_{2}$ is $\sim$ 180K (Ch=O, S, Se), guarantees that the sub-family can be strictly described with an effective S=1/2 picture at sufficiently low temperatures. Interestingly the CEF-phonon coupling revealed here may present alternative possibilities to manipulate the spin systems.


title: Concept of the half-valley-metal and quantum anomalous valley Hall effect

abstract: Valley, the energy extrema in the electronic band structure at momentum space, is regarded as a new degree of freedom of electrons, in addition to charge and spin. The studies focused on valley degree of freedom now form an emerging field of condensed matter physics, i.e. valleytronics, whose development is exactly following that of spintronics which focuses on the spin degree of freedom. Here, in analogy to half-metals in spintronics with one spin channel is conducting whereas the other is insulating, we propose the concept of half-valley-metal, in which conduction electrons are intrinsically 100% valley polarized, as well as 100% spin-polarized even when spin-orbit interactions are considered. Combining first-principles calculations with two-band kp model, the physical mechanism to form the half-valley-metal is illuminated. Taking the ferrovalley H-FeCl2 monolayer with strong exchange interaction as an example, we find that the strong electron correlation effect can induce the ferrovalley to half-valley-metal transition. Due to the valley-dependent optical selection rules, such system could be transparent to, e.g., left-circularly polarized light, yet the right-circularly polarized light will be reflected, which can in turn be used as a crucial method to detect half-valley-metal state. In addition, we find that in the so obtained half-valley-metal state, the conduction valley demonstrates Dirac cone-like linear energy dispersion. Interestingly, with the increase of the correlation effect, the system becomes insulating again with all valleys follow same optical selection rule. We confirm that in this specific case, the valence bands, which consist of single spin, possess non-zero Chern number and consequently intrinsic quantum anomalous valley Hall effect emerges. Our findings open an appealing route toward functional 2D materials design of valleytronics.


title: Separable and entangled states in the high-spin XX central spin model

abstract: It is shown in a recent preprint [arXiv:2001.10008] that the central spin model with XX-type qubit-bath coupling is integrable for a central spin $s_0=1/2$. Two types of eigenstates, separable states (dark states) and entangled states (bright states) between the central spin and the bath spins, are manifested. In this work, we show by using an operator product state approach that the XX central spin model with central spin $s_0>1/2$ and inhomogeneous coupling is partially solvable. That is, a subset of the eigenstates are obtained by the operator product state ansatz. These are the separable states and those entangled states in the single-spin-excitation subspace with respect to the fully polarized reference state. Due to the high degeneracy of the separable states, the resulting Bethe ansatz equations are found to be non-unique. In the case of $s_0=1/2$ we show that all the separable and entangled states can be written in terms of the operator product states, recovering the results in [arXiv:2001.10008]. Moreover, we also apply our method to the case of homogeneous coupling and derive the corresponding Bethe ansatz equations.


title: A regression-based method for detecting publication bias in multivariate meta-analysis

abstract: Publication bias occurs when the publication of research results depends not only on the quality of the research but also on its nature and direction. The consequence is that published studies may not be truly representative of all valid studies undertaken, and this bias may threaten the validity of systematic reviews and meta-analyses - on which evidence-based medicine increasingly relies. Multivariate meta-analysis has recently received increasing attention for its ability reducing potential bias and improving statistical efficiency by borrowing information across outcomes. However, detecting and accounting for publication bias are more challenging in multivariate meta-analysis setting because some studies may be completely unpublished whereas some studies may selectively report part of multiple outcomes. In this paper, we propose a score test for jointly testing publication bias for multiple outcomes, which is novel to the multivariate setting. The proposed test is a natural multivariate extension of the univariate Egger's test, and can handle the above mentioned scenarios simultaneously, It accounts for correlations among multivariate outcomes, while allowing different types of outcomes, and can borrow information across outcomes. The proposed test is shown to be more powerful than the Egger's test, Begg's test and Trim and Fill method through simulation studies. Two data analyses are given to illustrate the performance of the proposed test in practice.


title: Efficient Training of Deep Convolutional Neural Networks by Augmentation in Embedding Space

abstract: Recent advances in the field of artificial intelligence have been made possible by deep neural networks. In applications where data are scarce, transfer learning and data augmentation techniques are commonly used to improve the generalization of deep learning models. However, fine-tuning a transfer model with data augmentation in the raw input space has a high computational cost to run the full network for every augmented input. This is particularly critical when large models are implemented on embedded devices with limited computational and energy resources. In this work, we propose a method that replaces the augmentation in the raw input space with an approximate one that acts purely in the embedding space. Our experimental results show that the proposed method drastically reduces the computation, while the accuracy of models is negligibly compromised.


title: Emerging nuclear collectivity in $^{124-130}$Te

abstract: The emergence of nuclear collectivity near doubly-magic $^{132}$Sn was explored along the stable, even-even $^{124-130}$Te isotopes. Preliminary measurements of the $B(E2;4^{+}_{1}\rightarrow2^{+}_{1})$ transition strengths are reported from Coulomb excitation experiments primarily aimed at measuring the $g$ factors of the $4^{+}_{1}$ states. Isotopically enriched Te targets were excited by 198-205 MeV $^{58}$Ni beams. A comparison of transition strengths obtained is made to large-scale shell-model calculations with successes and limitations discussed.


title: Genomic Problems Involving Copy Number Profiles: Complexity and Algorithms

abstract: Recently, due to the genomic sequence analysis in several types of cancer, the genomic data based on {\em copy number profiles} ({\em CNP} for short) are getting more and more popular. A CNP is a vector where each component is a non-negative integer representing the number of copies of a specific gene or segment of interest. In this paper, we present two streams of results. The first is the negative results on two open problems regarding the computational complexity of the Minimum Copy Number Generation (MCNG) problem posed by Qingge et al. in 2018. It was shown by Qingge et al. that the problem is NP-hard if the duplications are tandem and they left the open question of whether the problem remains NP-hard if arbitrary duplications are used. We answer this question affirmatively in this paper; in fact, we prove that it is NP-hard to even obtain a constant factor approximation. We also prove that the parameterized version is W[1]-hard, answering another open question by Qingge et al. The other result is positive and is based on a new (and more general) problem regarding CNP's. The \emph{Copy Number Profile Conforming (CNPC)} problem is formally defined as follows: given two CNP's $C_1$ and $C_2$, compute two strings $S_1$ and $S_2$ with $cnp(S_1)=C_1$ and $cnp(S_2)=C_2$ such that the distance between $S_1$ and $S_2$, $d(S_1,S_2)$, is minimized. Here, $d(S_1,S_2)$ is a very general term, which means it could be any genome rearrangement distance (like reversal, transposition, and tandem duplication, etc). We make the first step by showing that if $d(S_1,S_2)$ is measured by the breakpoint distance then the problem is polynomially solvable.


title: Current-induced atomic motion, structural instabilities, and negative temperatures on molecule-electrode interfaces in electronic junctions

abstract: Molecule-electrode interfaces in molecular electronic junctions are prone to chemical reactions, structural changes, and localized heating effects caused by electric current. These can be exploited for device functionality or may be degrading processes that limit performance and device lifetime. We develop a nonequilibrium Green's function based transport theory in which the central region atoms and, more importantly, atoms on molecule-electrode interfaces are allowed to move. The separation of time-scales of slow nuclear motion and fast electronic dynamics enables the algebraic solution of the Kadanoff-Baym equations in the Wigner space. As a result, analytical expressions for dynamical corrections to the adiabatically computed Green's functions are produced. These dynamical corrections depend not only on the instantaneous molecular geometry but also on the nuclear velocities. To make the theoretical approach fully self-consistent, the same time-separation approach is used to develop expressions for the adiabatic, dissipative, and stochastic components of current-induced forces in terms of adiabatic Green's functions. Using these current induced forces, the equation of motion for the nuclear degrees of freedom is cast in the form of a Langevin equation. The theory is applied to model molecular electronic junctions. We observe that the interplay between the value of the spring constant for the molecule-electrode chemical bond and electronic coupling strength to the corresponding electrode is critical for the appearance of structural instabilities and, consequently, telegraphic switching in the electric current. The range of model parameters is identified to observe structurally stable molecular junctions as well as various different kinds of current-induced telegraphic switching. The interfacial structural instabilities are also quantified based on current noise calculations.


title: MFFW: A new dataset for multi-focus image fusion

abstract: Multi-focus image fusion (MFF) is a fundamental task in the field of computational photography. Current methods have achieved significant performance improvement. It is found that current methods are evaluated on simulated image sets or Lytro dataset. Recently, a growing number of researchers pay attention to defocus spread effect, a phenomenon of real-world multi-focus images. Nonetheless, defocus spread effect is not obvious in simulated or Lytro datasets, where popular methods perform very similar. To compare their performance on images with defocus spread effect, this paper constructs a new dataset called MFF in the wild (MFFW). It contains 19 pairs of multi-focus images collected on the Internet. We register all pairs of source images, and provide focus maps and reference images for part of pairs. Compared with Lytro dataset, images in MFFW significantly suffer from defocus spread effect. In addition, the scenes of MFFW are more complex. The experiments demonstrate that most state-of-the-art methods on MFFW dataset cannot robustly generate satisfactory fusion images. MFFW can be a new baseline dataset to test whether an MMF algorithm is able to deal with defocus spread effect.


title: Groups that are the union of two semigroups have left-orderable quotients

abstract: In this article, we show that a group $G$ is the union of two proper subsemigroups if and only if $G$ has a nontrivial left-orderable quotient. Furthermore, if $G$ is the union of two proper semigroups, then there exists a minimum normal subgroup $N\unlhd G$ for which $G/N$ is left-orderable and nontrivial.


title: An $\omega$-rule for the logic of provability and its models

abstract: In this paper, we discuss a proof system $\mathsf{NGL}$ for the logic $\mathbf{GL}$ of provability, which is equipped with an $\omega$-rule. We show the three classes of transitive Kripke frames, the class which strongly validates the $\omega$-rule, the class which weakly validates the $\omega$-rule, and the class which is defined by the L\"{o}b formula, are mutually different, while all of them characterize $\mathbf{GL}$. This gives an example of a proof system $P$ and a class $C$ of Kripke frames such that $P$ is sound with respect to $C$ but the soundness cannot be proved by simple induction on the height of the derivations in $P$. We also show Kripke completeness of $\mathsf{NGL}$ in an algebraic manner. As a corollary, we show that the class of modal algebras which is defined by equations $\Box x\leq\Box\Box x$ and $\bigwedge_{n\in\omega}\Diamond^{n}1=0$ is not a variety.


title: Fixed-Support Wasserstein Barycenters: Computational Hardness and Fast Algorithm

abstract: We study the fixed-support Wasserstein barycenter problem (FS-WBP), which consists in computing the Wasserstein barycenter of $m$ discrete probability measures supported on a finite metric space of size $n$. We show first that the constraint matrix arising from the standard linear programming (LP) representation of the FS-WBP is \textit{not totally unimodular} when $m \geq 3$ and $n \geq 3$. This result resolves an open question pertaining to the relationship between the FS-WBP and the minimum-cost flow (MCF) problem since it proves that the FS-WBP in the standard LP form is not an MCF problem when $m \geq 3$ and $n \geq 3$. We also develop a provably fast \textit{deterministic} variant of the celebrated iterative Bregman projection (IBP) algorithm, named \textsc{FastIBP}, with a complexity bound of $\tilde{O}(mn^{7/3}\varepsilon^{-4/3})$, where $\varepsilon \in (0, 1)$ is the desired tolerance. This complexity bound is better than the best known complexity bound of $\tilde{O}(mn^2\varepsilon^{-2})$ for the IBP algorithm in terms of $\varepsilon$, and that of $\tilde{O}(mn^{5/2}\varepsilon^{-1})$ from accelerated alternating minimization algorithm or accelerated primal-dual adaptive gradient algorithm in terms of $n$. Finally, we conduct extensive experiments with both synthetic data and real images and demonstrate the favorable performance of the \textsc{FastIBP} algorithm in practice.


title: Graph Universal Adversarial Attacks: A Few Bad Actors Ruin Graph Learning Models

abstract: Deep neural networks, while generalize well, are known to be sensitive to small adversarial perturbations. This phenomenon poses severe security threat and calls for in-depth investigation of the robustness of deep learning models. With the emergence of neural networks for graph structured data, similar investigations are urged to understand their robustness. It has been found that adversarially perturbing the graph structure and/or node features may result in a significant degradation of the model performance. In this work, we show from a different angle that such fragility similarly occurs if the graph contains a few bad-actor nodes, which compromise a trained graph neural network through flipping the connections to any targeted victim. Worse, the bad actors found for one graph model severely compromise other models as well. We call the bad actors ``anchor nodes'' and propose an algorithm, named GUA, to identify them. Thorough empirical investigations suggest an interesting finding that the anchor nodes often belong to the same class; and they also corroborate the intuitive trade-off between the number of anchor nodes and the attack success rate. For the dataset Cora which contains 2708 nodes, as few as six anchor nodes will result in an attack success rate higher than 80\% for GCN and other three models.


title: Competition between magnetic order and charge localization in Na$_2$IrO$_3$ thin crystal devices

abstract: Spin orbit assisted Mott insulators such as sodium iridate (Na$_2$IrO$_3$) have been an important subject of study in the recent years. In these materials, the interplay of electronic correlations, spin-orbit coupling, crystal field effects and a honeycomb arrangement of ions bring exciting ground states, predicted in the frame of the Kitaev model. The insulating character of Na$_2$IrO$_3$ has hampered its integration to an electronic device, desirable for applications, such as the manipulation of quasiparticles interesting for topological quantum computing. Here we show through electronic transport measurements supported by Angle Resolved Photoemission Spectroscopy (ARPES) experiments, that electronic transport in Na$_2$IrO$_3$ is ruled by variable range hopping and it is strongly dependent on the magnetic ordering transition known for bulk Na$_2$IrO$_3$, as well as on external electric fields. Electronic transport measurements allow us to deduce a value for the localization length and the density of states in our Na$_2$IrO$_3$ thin crystals devices, offering an alternative approach to study insulating layered materials.