title: Avoiding Kernel Fixed Points: Computing with ELU and GELU Infinite Networks

abstract: Analysing and computing with Gaussian processes arising from infinitely wide neural networks has recently seen a resurgence in popularity. Despite this, many explicit covariance functions of networks with activation functions used in modern networks remain unknown. Furthermore, while the kernels of deep networks can be computed iteratively, theoretical understanding of deep kernels is lacking, particularly with respect to fixed-point dynamics. Firstly, we derive the covariance functions of multi-layer perceptrons (MLPs) with exponential linear units (ELU) and Gaussian error linear units (GELU) and evaluate the performance of the limiting Gaussian processes on some benchmarks. Secondly, and more generally, we analyse the fixed-point dynamics of iterated kernels corresponding to a broad range of activation functions. We find that unlike some previously studied neural network kernels, these new kernels exhibit non-trivial fixed-point dynamics which are mirrored in finite-width neural networks. The fixed point behaviour present in some networks explains a mechanism for implicit regularisation in overparameterised deep models. Our results relate to both the static iid parameter conjugate kernel and the dynamic neural tangent kernel constructions. Software at github.com/RussellTsuchida/ELU_GELU_kernels.


title: Evolution of the Earth's Magnetosheath Turbulence: A statistical study based on MMS observations

abstract: Composed of shocked solar wind, the Earth's magnetosheath serves as a natural laboratory to study the transition of turbulence from low Alfv{\'e}n Mach number, $M_\mathrm{A}$, to high $M_\mathrm{A}$. The simultaneous observations of magnetic field and plasma moments with unprecedented high temporal resolution provided by NASA's \textit{Magnetospheric Multiscale} Mission enable us to study the magnetosheath turbulence at both magnetohydrodynamics (MHD) and sub-ion scales. Based on 1841 burst-mode segments of MMS-1 from 2015/09 to 2019/06, comprehensive patterns of the spatial evolution of magnetosheath turbulences are obtained: (1) from the sub-solar region to the flanks, $M_\mathrm{A}$ increases from $<$ 1 to $>$ 5. At MHD scales, the spectral indices of the magnetic-field and velocity spectra present a positive and negative correlation with $M_\mathrm{A}$. However, no obvious correlations between the spectral indices and $M_\mathrm{A}$ are found at sub-ion scales. (2) from the bow shock to the magnetopause, the turbulent sonic Mach number, $M_{\mathrm{turb}}$, generally decreases from $>$ 0.4 to $<$ 0.1. All spectra steepen at MHD scales and flatten at sub-ion scales, representing a positive/negative correlations with $M_\mathrm{turb}$. The break frequency increases by 0.1 Hz when approaching the magnetopause for the magnetic-field and velocity spectra, while it remains at 0.3 Hz for the density spectra. (3) In spite of some differences, similar results are found for the quasi-parallel and quasi-perpendicular magnetosheath. In addition, the spatial evolution of magnetosheath turbulence is found to be independent of the upstream solar wind conditions, e.g., the Z-component of the interplanetary magnetic field and the solar wind speed.


title: Pulsars Detection by Machine Learning with Very Few Features

abstract: It is an active topic to investigate the schemes based on machine learning (ML) methods for detecting pulsars as the data volume growing exponentially in modern surveys. To improve the detection performance, input features into an ML model should be investigated specifically. In the existing pulsar detection researches based on ML methods, there are mainly two kinds of feature designs: the empirical features and statistical features. Due to the combinational effects from multiple features, however, there exist some redundancies and even irrelevant components in the available features, which can reduce the accuracy of a pulsar detection model. Therefore, it is essential to select a subset of relevant features from a set of available candidate features and known as {\itshape feature selection.} In this work, two feature selection algorithms ----\textit{Grid Search} (GS) and \textit{Recursive Feature Elimination} (RFE)---- are proposed to improve the detection performance by removing the redundant and irrelevant features. The algorithms were evaluated on the Southern High Time Resolution University survey (HTRU-S) with five pulsar detection models. The experimental results verify the effectiveness and efficiency of our proposed feature selection algorithms. By the GS, a model with only two features reach a recall rate as high as 99\% and a false positive rate (FPR) as low as 0.65\%; By the RFE, another model with only three features achieves a recall rate 99\% and an FPR of 0.16\% in pulsar candidates classification. Furthermore, this work investigated the number of features required as well as the misclassified pulsars by our models.


title: The pyramidal growth

abstract: Can one build an arbitrary polytope from any polytope inside by iteratively stacking pyramids onto facets, without losing the convexity throughout the process? We prove that this is indeed possible for (i) 3-polytopes, (ii) 4-polytopes under a certain infinitesimal quasi-pyramidal relaxation, and (iii) all dimensions asymptotically. The motivation partly comes from our study of K-theory of monoid rings and of certain posets of discrete-convex objects.


title: Group Network Hawkes Process

abstract: In this work, we study the event occurrences of individuals interacting in a network. To characterize the dynamic interactions among the individuals, we propose a group network Hawkes process (GNHP) model whose network structure is observed and fixed. In particular, we introduce a latent group structure among individuals to account for the heterogeneous user-specific characteristics. A maximum likelihood approach is proposed to simultaneously cluster individuals in the network and estimate model parameters. A fast EM algorithm is subsequently developed by utilizing the branching representation of the proposed GNHP model. Theoretical properties of the resulting estimators of group memberships and model parameters are investigated under both settings when the number of latent groups $G$ is over-specified or correctly specified. A data-driven criterion that can consistently identify the true $G$ under mild conditions is derived. Extensive simulation studies and an application to a data set collected from Sina Weibo are used to illustrate the effectiveness of the proposed methodology.


title: Rapid Evolution of Volatile CO from the Protostellar Disk Stage to the Protoplanetary Disk Stage

abstract: Recent observations show that the CO gas abundance, relative to H$_2$, in many 1-10 Myr old protoplanetary disks may be heavily depleted, by a factor of 10-100 compared to the canonical interstellar medium value of 10$^{-4}$. When and how this depletion happens can significantly affect compositions of planetesimals and atmospheres of giant planets. It is therefore important to constrain if the depletion occurs already at the earliest protostellar disk stage. Here we present spatially resolved observations of C$^{18}$O, C$^{17}$O, and $^{13}$C$^{18}$O $J$=2-1 lines in three protostellar disks. We show that the C$^{18}$O line emits from both the disk and the inner envelope, while C$^{17}$O and $^{13}$C$^{18}$O lines are consistent with a disk origin. The line ratios indicate that both C$^{18}$O and C$^{17}$O lines are optically thick in the disk region, and only $^{13}$C$^{18}$O line is optically thin. The line profiles of the $^{13}$C$^{18}$O emissions are best reproduced by Keplerian gaseous disks at similar sizes as their mm-continuum emissions, suggesting small radial separations between the gas and mm-sized grains in these disks, in contrast to the large separation commonly seen in protoplanetary disks. Assuming a gas-to-dust ratio of 100, we find that the CO gas abundances in these protostellar disks are consistent with the ISM abundance within a factor of 2, nearly one order of magnitude higher than the average value of 1-10 Myr old disks. These results suggest that there is a fast, $\sim$1 Myr, evolution of the abundance of CO gas from the protostellar disk stage to the protoplanetary disk stage.


title: Constructive Game Logic

abstract: Game Logic is an excellent setting to study proofs-about-programs via the interpretation of those proofs as programs, because constructive proofs for games correspond to effective winning strategies to follow in response to the opponent's actions. We thus develop Constructive Game Logic which extends Parikh's Game Logic (GL) with constructivity and with first-order programs a la Pratt's first-order dynamic logic (DL). Our major contributions include: 1) a novel realizability semantics capturing the adversarial dynamics of games, 2) a natural deduction calculus and operational semantics describing the computational meaning of strategies via proof-terms, and 3) theoretical results including soundness of the proof calculus w.r.t. realizability semantics, progress and preservation of the operational semantics of proofs, and Existence Properties on support of the extraction of computational artifacts from game proofs. Together, these results provide the most general account of a Curry-Howard interpretation for any program logic to date, and the first at all for Game Logic.


title: The Open Crepant Transformation Conjecture for Toric Calabi-Yau 3-Orbifolds

abstract: We prove an open version of Ruan's Crepant Transformation Conjecture for toric Calabi-Yau 3-orbifolds, which is an identification of disk invariants of K-equivalent semi-projective toric Calabi-Yau 3-orbifolds relative to corresponding Lagrangian suborbifolds of Aganagic-Vafa type. Our main tool is a mirror theorem of Fang-Liu-Tseng that relates these disk invariants to local coordinates on the B-model mirror curves. Treating toric crepant transformations as wall-crossings in the GKZ secondary fan, we establish the identification of disk invariants through constructing a global family of mirror curves over charts of the secondary variety and understanding analytic continuation on local coordinates. Our work generalizes previous results of Brini-Cavalieri-Ross on disk invariants of threefold type-A singularities and of Ke-Zhou on crepant resolutions with effective outer branes.


title: Towards Physically-consistent, Data-driven Models of Convection

abstract: Data-driven algorithms, in particular neural networks, can emulate the effect of sub-grid scale processes in coarse-resolution climate models if trained on high-resolution climate simulations. However, they may violate key physical constraints and lack the ability to generalize outside of their training set. Here, we show that physical constraints can be enforced in neural networks, either approximately by adapting the loss function or to within machine precision by adapting the architecture. As these physical constraints are insufficient to guarantee generalizability, we additionally propose to physically rescale the training and validation data to improve the ability of neural networks to generalize to unseen climates.


title: Scalable Constrained Bayesian Optimization

abstract: The global optimization of a high-dimensional black-box function under black-box constraints is a pervasive task in machine learning, control, and engineering. These problems are challenging since the feasible set is typically non-convex and hard to find, in addition to the curses of dimensionality and the heterogeneity of the underlying functions. In particular, these characteristics dramatically impact the performance of Bayesian optimization methods, that otherwise have become the de facto standard for sample-efficient optimization in unconstrained settings, leaving practitioners with evolutionary strategies or heuristics. We propose the scalable constrained Bayesian optimization (SCBO) algorithm that overcomes the above challenges and pushes the applicability of Bayesian optimization far beyond the state-of-the-art. A comprehensive experimental evaluation demonstrates that SCBO achieves excellent results on a variety of benchmarks. To this end, we propose two new control problems that we expect to be of independent value for the scientific community.


title: NAttack! Adversarial Attacks to bypass a GAN based classifier trained to detect Network intrusion

abstract: With the recent developments in artificial intelligence and machine learning, anomalies in network traffic can be detected using machine learning approaches. Before the rise of machine learning, network anomalies which could imply an attack, were detected using well-crafted rules. An attacker who has knowledge in the field of cyber-defence could make educated guesses to sometimes accurately predict which particular features of network traffic data the cyber-defence mechanism is looking at. With this information, the attacker can circumvent a rule-based cyber-defense system. However, after the advancements of machine learning for network anomaly, it is not easy for a human to understand how to bypass a cyber-defence system. Recently, adversarial attacks have become increasingly common to defeat machine learning algorithms. In this paper, we show that even if we build a classifier and train it with adversarial examples for network data, we can use adversarial attacks and successfully break the system. We propose a Generative Adversarial Network(GAN)based algorithm to generate data to train an efficient neural network based classifier, and we subsequently break the system using adversarial attacks.


title: Adaptive Sampling Distributed Stochastic Variance Reduced Gradient for Heterogeneous Distributed Datasets

abstract: We study distributed optimization algorithms for minimizing the average of \emph{heterogeneous} functions distributed across several machines with a focus on communication efficiency. In such settings, naively using the classical stochastic gradient descent (SGD) or its variants (e.g., SVRG) with a uniform sampling of machines typically yields poor performance. It often leads to the dependence of convergence rate on maximum Lipschitz constant of gradients across the devices. In this paper, we propose a novel \emph{adaptive} sampling of machines specially catered to these settings. Our method relies on an adaptive estimate of local Lipschitz constants base on the information of past gradients. We show that the new way improves the dependence of convergence rate from maximum Lipschitz constant to \emph{average} Lipschitz constant across machines, thereby, significantly accelerating the convergence. Our experiments demonstrate that our method indeed speeds up the convergence of the standard SVRG algorithm in heterogeneous environments.


title: Excess C/H in Protoplanetary Disk Gas from Icy Pebble Drift across the CO Snowline

abstract: The atmospheric composition of giant planets carries the information of their formation history. Superstellar C/H ratios are seen in atmospheres of Jupiter, Saturn, and various giant exoplanets. Also, giant exoplanets show a wide range of C/O ratio. To explain these ratios, one hypothesis is that protoplanets accrete carbon-enriched gas when a large number of icy pebbles drift across the CO snowline. Here we report the first direct evidence of an elevated C/H ratio in disk gas. We use two thermo-chemical codes to model the $^{13}$C$^{18}$O, C$^{17}$O, and C$^{18}$O (2-1) line spectra of the HD 163296 disk. We show that the gas inside the CO snowline ($\sim$70 au) has a C/H ratio of 1-2 times higher than the stellar value. This ratio exceeds the expected value substantially, as only 25-60% of the carbon should be in gas at these radii. Although we cannot rule out the case of a normal C/H ratio inside 70 au, the most probable solution is an elevated C/H ratio of 2-8 times higher than the expectation. Our model also shows that the gas outside 70 au has a C/H ratio of 0.1$\times$ the stellar value. This picture of enriched C/H gas at the inner region and depleted gas at the outer region is consistent with numerical simulations of icy pebble growth and drift in protoplanetary disks. Our results demonstrate that the large-scale drift of icy pebble can occur in disks and may significantly change the disk gas composition for planet formation.


title: Learning Multi-granular Quantized Embeddings for Large-Vocab Categorical Features in Recommender Systems

abstract: Recommender system models often represent various sparse features like users, items, and categorical features via embeddings. A standard approach is to map each unique feature value to an embedding vector. The size of the produced embedding table grows linearly with the size of the vocabulary. Therefore, a large vocabulary inevitably leads to a gigantic embedding table, creating two severe problems: (i) making model serving intractable in resource-constrained environments; (ii) causing overfitting problems. In this paper, we seek to learn highly compact embeddings for large-vocab sparse features in recommender systems (recsys). First, we show that the novel Differentiable Product Quantization (DPQ) approach can generalize to recsys problems. In addition, to better handle the power-law data distribution commonly seen in recsys, we propose a Multi-Granular Quantized Embeddings (MGQE) technique which learns more compact embeddings for infrequent items. We seek to provide a new angle to improve recommendation performance with compact model sizes. Extensive experiments on three recommendation tasks and two datasets show that we can achieve on par or better performance, with only ~20% of the original model size.


title: The Fair Basis: Funding and capital in the reduced form framework

abstract: A negative basis trade enters a long bond position and buys protection on the issuer of the bond through credit default swap (CDS), aiming at arbitrage profit due to the bond-CDS basis. To classic reduced form model theorists, the existence of the basis is an abnormality or merely liquidity noise. Such a view, however, fails to explain large basis trading losses incurred during the financial crisis. Employing a bond continuously hedged by CDS under a dynamic spread model with bond repo financing, we find that there is unhedged and unhedgeable residual jump to default risk that can't be diversified because of credit correlation. An economic capital approach has to apply and a charge on the use of capital follows. Together with the hedge funding cost, it allows us to better understand the basis's economics and to predict its fair level.


title: Derivatives Discounting Explained

abstract: Derivative pricing is about cash flow discounting at the riskfree rate. This teaching has lost its meaning post the financial crisis, due to the addition of extra value adjustments (XVA), which also made derivatives pricing and valuation a very difficult task for investors. This article recovers a properly defined discount rate that corresponds to different collateral and margin schemes. A binomial tree model is developed, enabling end-users to price in counterparty default and funding risk. Coherent XVAs, if needed, naturally result from decomposing the discount rate, and can be computed on the same tree.


title: Algorithms and Lower Bounds for de Morgan Formulas of Low-Communication Leaf Gates

abstract: The class $FORMULA[s] \circ \mathcal{G}$ consists of Boolean functions computable by size-$s$ de Morgan formulas whose leaves are any Boolean functions from a class $\mathcal{G}$. We give lower bounds and (SAT, Learning, and PRG) algorithms for $FORMULA[n^{1.99}]\circ \mathcal{G}$, for classes $\mathcal{G}$ of functions with low communication complexity. Let $R^{(k)}(\mathcal{G})$ be the maximum $k$-party NOF randomized communication complexity of $\mathcal{G}$. We show: (1) The Generalized Inner Product function $GIP^k_n$ cannot be computed in $FORMULA[s]\circ \mathcal{G}$ on more than $1/2+\varepsilon$ fraction of inputs for $$ s = o \! \left ( \frac{n^2}{ \left(k \cdot 4^k \cdot {R}^{(k)}(\mathcal{G}) \cdot \log (n/\varepsilon) \cdot \log(1/\varepsilon) \right)^{2}} \right).$$ As a corollary, we get an average-case lower bound for $GIP^k_n$ against $FORMULA[n^{1.99}]\circ PTF^{k-1}$. (2) There is a PRG of seed length $n/2 + O\left(\sqrt{s} \cdot R^{(2)}(\mathcal{G}) \cdot\log(s/\varepsilon) \cdot \log (1/\varepsilon) \right)$ that $\varepsilon$-fools $FORMULA[s] \circ \mathcal{G}$. For $FORMULA[s] \circ LTF$, we get the better seed length $O\left(n^{1/2}\cdot s^{1/4}\cdot \log(n)\cdot \log(n/\varepsilon)\right)$. This gives the first non-trivial PRG (with seed length $o(n)$) for intersections of $n$ half-spaces in the regime where $\varepsilon \leq 1/n$. (3) There is a randomized $2^{n-t}$-time $\#$SAT algorithm for $FORMULA[s] \circ \mathcal{G}$, where $$t=\Omega\left(\frac{n}{\sqrt{s}\cdot\log^2(s)\cdot R^{(2)}(\mathcal{G})}\right)^{1/2}.$$ In particular, this implies a nontrivial #SAT algorithm for $FORMULA[n^{1.99}]\circ LTF$. (4) The Minimum Circuit Size Problem is not in $FORMULA[n^{1.99}]\circ XOR$. On the algorithmic side, we show that $FORMULA[n^{1.99}] \circ XOR$ can be PAC-learned in time $2^{O(n/\log n)}$.


title: Report on the finiteness of silting objects

abstract: We discuss the finiteness of (two-term) silting objects. First, we investigate new triangulated categories without silting object. Second, one studies two classes of $\tau$-tilting-finite algebras and give the numbers of their two-term silting objects. Finally, we explore when $\tau$-tilting-finiteness implies representatoin-finiteness, and obtain several classes of algebras in which a $\tau$-tilting-finite algebra is representation-finite.


title: The fraction of an $S_n$-orbit on a hyperplane

abstract: Huang, McKinnon, and Satriano conjectured that if $v \in \mathbb{R}^n$ has distinct coordinates and $n \geq 3$, then a hyperplane through the origin other than $\sum_i x_i = 0$ contains at most $2\lfloor n/2 \rfloor (n-2)!$ of the vectors obtained by permuting the coordinates of $v$. We prove this conjecture.


title: Debiased Off-Policy Evaluation for Recommendation Systems

abstract: Efficient methods to evaluate new algorithms are critical for improving interactive bandit and reinforcement learning systems such as recommendation systems. A/B tests are reliable, but are time- and money-consuming, and entail a risk of failure. In this paper, we develop an alternative method, which predicts the performance of algorithms given historical data that may have been generated by a different algorithm. Our estimator has the property that its prediction converges in probability to the true performance of a counterfactual algorithm at a rate of $\sqrt{N}$, as the sample size $N$ increases. We also show a correct way to estimate the variance of our prediction, thus allowing the analyst to quantify the uncertainty in the prediction. These properties hold even when the analyst does not know which among a large number of potentially important state variables are actually important. We validate our method by a simulation experiment about reinforcement learning. We finally apply it to improve advertisement design by a major advertisement company. We find that our method produces smaller mean squared errors than state-of-the-art methods.


title: Adaptive Temporal Difference Learning with Linear Function Approximation

abstract: This paper revisits the temporal difference (TD) learning algorithm for the policy evaluation tasks in reinforcement learning. Typically, the performance of TD(0) and TD($\lambda$) is very sensitive to the choice of stepsizes. Oftentimes, TD(0) suffers from slow convergence. Motivated by the tight link between the TD(0) learning algorithm and the stochastic gradient methods, we develop a provably convergent adaptive projected variant of the TD(0) learning algorithm with linear function approximation that we term AdaTD(0). In contrast to the TD(0), AdaTD(0) is robust or less sensitive to the choice of stepsizes. Analytically, we establish that to reach an $\epsilon$ accuracy, the number of iterations needed is $\tilde{O}(\epsilon^{-2}\ln^4\frac{1}{\epsilon}/\ln^4\frac{1}{\rho})$ in the general case, where $\rho$ represents the speed of the underlying Markov chain converges to the stationary distribution. This implies that the iteration complexity of AdaTD(0) is no worse than that of TD(0) in the worst case. When the stochastic semi-gradients are sparse, we provide theoretical acceleration of AdaTD(0). Going beyond TD(0), we develop an adaptive variant of TD($\lambda$), which is referred to as AdaTD($\lambda$). Empirically, we evaluate the performance of AdaTD(0) and AdaTD($\lambda$) on several standard reinforcement learning tasks, which demonstrate the effectiveness of our new approaches.


title: Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems

abstract: We consider the problem of learning stabilizable systems governed by nonlinear state equation $h_{t+1}=\phi(h_t,u_t;\theta)+w_t$. Here $\theta$ is the unknown system dynamics, $h_t $ is the state, $u_t$ is the input and $w_t$ is the additive noise vector. We study gradient based algorithms to learn the system dynamics $\theta$ from samples obtained from a single finite trajectory. If the system is run by a stabilizing input policy, we show that temporally-dependent samples can be approximated by i.i.d. samples via a truncation argument by using mixing-time arguments. We then develop new guarantees for the uniform convergence of the gradients of empirical loss. Unlike existing work, our bounds are noise sensitive which allows for learning ground-truth dynamics with high accuracy and small sample complexity. Together, our results facilitate efficient learning of the general nonlinear system under stabilizing policy. We specialize our guarantees to entry-wise nonlinear activations and verify our theory in various numerical experiments

categories: cs.LG cs.SY eess.SY math.OC stat.AP stat.ML


title: Learn to Design the Heuristics for Vehicle Routing Problem

abstract: This paper presents an approach to learn the local-search heuristics that iteratively improves the solution of Vehicle Routing Problem (VRP). A local-search heuristics is composed of a destroy operator that destructs a candidate solution, and a following repair operator that rebuilds the destructed one into a new one. The proposed neural network, as trained through actor-critic framework, consists of an encoder in form of a modified version of Graph Attention Network where node embeddings and edge embeddings are integrated, and a GRU-based decoder rendering a pair of destroy and repair operators. Experiment results show that it outperforms both the traditional heuristics algorithms and the existing neural combinatorial optimization for VRP on medium-scale data set, and is able to tackle the large-scale data set (e.g., over 400 nodes) which is a considerable challenge in this area. Moreover, the need for expertise and handcrafted heuristics design is eliminated due to the fact that the proposed network learns to design the heuristics with a better performance. Our implementation is available online.


title: Subgroups of Lacunary Hyperbolic Groups and Free Products

abstract: A finitely generated group is lacunary hyperbolic if one of its asymptotic cones is an $\mathbb{R}$-tree. In this article we give a necessary and sufficient condition on lacunary hyperbolic groups in order to be stable under free product by giving a dynamical characterization of lacunary hyperbolic groups. Also we studied limits of elementary subgroups as subgroups of lacunary hperbolic groups and characterized them. Given any countable collection of increasing union of elementary groups we show that there exists a lacunary hyperbolic group whose set of all maximal subgroups is the given collection. As a consequence we construct a finitely generated divisible group. First such example was constructed by V. Guba in \cite{Gu86}. In section 5 we show that given any finitely generated group $Q$ and a non elementary hyperbolic group $H$, there exists a short exact sequence $1\rightarrow N\rightarrow G\rightarrow Q\rightarrow 1$, where $G$ is a lacunary hyperbolic group and $N$ is a non elementary quotient of $H$. Our method allows to recover \cite[Theorem 3]{AS14}. In section 6, we extend the class of groups $\mathcal{R}ip_{\mathcal{T}}(Q)$ considered in \cite{CDK19} and hence give more new examples of property $(T)$ von Neumann algebras which have maximal von Neumann subalgebras without property $(T)$.


title: Simple and Scalable Sparse k-means Clustering via Feature Ranking

abstract: Clustering, a fundamental activity in unsupervised learning, is notoriously difficult when the feature space is high-dimensional. Fortunately, in many realistic scenarios, only a handful of features are relevant in distinguishing clusters. This has motivated the development of sparse clustering techniques that typically rely on k-means within outer algorithms of high computational complexity. Current techniques also require careful tuning of shrinkage parameters, further limiting their scalability. In this paper, we propose a novel framework for sparse k-means clustering that is intuitive, simple to implement, and competitive with state-of-the-art algorithms. We show that our algorithm enjoys consistency and convergence guarantees. Our core method readily generalizes to several task-specific algorithms such as clustering on subsets of attributes and in partially observed data settings. We showcase these contributions thoroughly via simulated experiments and real data benchmarks, including a case study on protein expression in trisomic mice.


title: False Discovery Rate Control via Data Splitting

abstract: Selecting relevant features associated with a given response variable is an important issue in many scientific fields. Quantifying quality and uncertainty of a selection result via false discovery rate (FDR) control has been of recent interest. This paper introduces a way of using data-splitting strategies to asymptotically control the FDR while maintaining a high power. For each feature, the method constructs a test statistic by estimating two independent regression coefficients via data splitting. FDR control is achieved by taking advantage of the statistic's property that, for any null feature, its sampling distribution is symmetric about zero. Furthermore, we propose Multiple Data Splitting (MDS) to stabilize the selection result and boost the power. Interestingly and surprisingly, with the FDR still under control, MDS not only helps overcome the power loss caused by sample splitting, but also results in a lower variance of the false discovery proportion (FDP) compared with all other methods in consideration. We prove that the proposed data-splitting methods can asymptotically control the FDR at any designated level for linear and Gaussian graphical models in both low and high dimensions. Through intensive simulation studies and a real-data application, we show that the proposed methods are robust to the unknown distribution of features, easy to implement and computationally efficient, and are often the most powerful ones amongst competitors especially when the signals are weak and the correlations or partial correlations are high among features.


title: Derivation of Analytic Formulas for the Sample Moments of the Sample Correlation over Permutations of Data

abstract: Pearson's correlation is among the mostly widely reported measures of association. The strength of the statistical evidence for linear association is determined by the p-value of a hypothesis test. If the true distribution of a dataset is bivariate normal, then under specific data transformations a t-statistic returns the exact p-value, otherwise it is an approximation. Alternatively, the p-value can be estimated by analyzing the distribution of the sample correlation under permutations of the data. Moment approximations of this distribution are not as widely used since estimation of the moments themselves are numerically intensive with greater uncertainties. In this paper we derive an inductive formula allowing for the analytic expression of the sample moments of the sample correlation under permutations of the data in terms of the central moments of the data. These formulas placed in a proper statistical framework could open up the possibility of new estimation methods for computing the p-value.


title: Edge Temperature Ring Oscillation Modulated by Turbulence Transition for Sustaining Stationary Improved Energy Confinement Plasmas

abstract: A reproducible stationary improved confinement mode (I-mode) has been achieved recently in the Experimental Advanced Superconducting Tokamak, featuring good confinement without particle transport barrier, which could be beneficial to solving the heat flux problem caused by edge localized modes (ELM) and the helium ash problem for future fusion reactors. The microscopic mechanism of sustaining stationary I-mode, based on the coupling between turbulence transition and the edge temperature oscillation, has been discovered for the first time. A radially localized edge temperature ring oscillation (ETRO) with azimuthally symmetric structure ($n=0$,$m=0$) has been identified and it is caused by alternative turbulence transitions between ion temperature gradient modes (ITG) and trapped electron modes (TEM). The ITG-TEM transition is controlled by local electron temperature gradient and consistent with the gyrokinetic simulations. The self-organizing system consisting with ETRO, turbulence and transport transitions plays the key role in sustaining the I-mode confinement. These results provide a novel physics basis for accessing, maintaining and controlling stationary I-mode in the future.


title: Familywise Error Rate Control by Interactive Unmasking

abstract: We propose a method for multiple hypothesis testing with familywise error rate (FWER) control, called the i-FWER test. Most testing methods are predefined algorithms that do not allow modifications after observing the data. However, in practice, analysts tend to choose a promising algorithm after observing the data; unfortunately, this violates the validity of the conclusion. The i-FWER test allows much flexibility: a human (or a computer program acting on the human's behalf) may adaptively guide the algorithm in a data-dependent manner. We prove that our test controls FWER if the analysts adhere to a particular protocol of "masking" and "unmasking". We demonstrate via numerical experiments the power of our test under structured non-nulls, and then explore new forms of masking.


title: Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation (UDA) aims to leverage the knowledge learned from a labeled source dataset to solve similar tasks in a new unlabeled domain. Prior UDA methods typically require to access the source data when learning to adapt the model, making them risky and inefficient for decentralized private data. This work tackles a practical setting where only a trained source model is available and investigates how we can effectively utilize such a model without source data to solve UDA problems. We propose a simple yet generic representation learning framework, named \emph{Source HypOthesis Transfer} (SHOT). SHOT freezes the classifier module (hypothesis) of the source model and learns the target-specific feature extraction module by exploiting both information maximization and self-supervised pseudo-labeling to implicitly align representations from the target domains to the source hypothesis. To verify its versatility, we evaluate SHOT in a variety of adaptation cases including closed-set, partial-set, and open-set domain adaptation. Experiments indicate that SHOT yields state-of-the-art results among multiple domain adaptation benchmarks.


title: Deep Fusion of Local and Non-Local Features for Precision Landslide Recognition

abstract: Precision mapping of landslide inventory is crucial for hazard mitigation. Most landslides generally co-exist with other confusing geological features, and the presence of such areas can only be inferred unambiguously at a large scale. In addition, local information is also important for the preservation of object boundaries. Aiming to solve this problem, this paper proposes an effective approach to fuse both local and non-local features to surmount the contextual problem. Built upon the U-Net architecture that is widely adopted in the remote sensing community, we utilize two additional modules. The first one uses dilated convolution and the corresponding atrous spatial pyramid pooling, which enlarged the receptive field without sacrificing spatial resolution or increasing memory usage. The second uses a scale attention mechanism to guide the up-sampling of features from the coarse level by a learned weight map. In implementation, the computational overhead against the original U-Net was only a few convolutional layers. Experimental evaluations revealed that the proposed method outperformed state-of-the-art general-purpose semantic segmentation approaches. Furthermore, ablation studies have shown that the two models afforded extensive enhancements in landslide-recognition performance.


title: Homogeneous Darboux polynomials and generalising integrable ODE systems

abstract: We show that any system of ODEs can be modified whilst preserving its homogeneous Darboux polynomials. We employ the result to generalise a hierarchy of integrable Lotka-Volterra systems.


title: Fast and Regularized Reconstruction of Building Fa\c{c}ades from Street-View Images using Binary Integer Programming

abstract: Regularized arrangement of primitives on building fa\c{c}ades to aligned locations and consistent sizes is important towards structured reconstruction of urban environment. Mixed integer linear programing was used to solve the problem, however, it is extreamly time consuming even for state-of-the-art commercial solvers. Aiming to alleviate this issue, we cast the problem into binary integer programming, which omits the requirements for real value parameters and is more efficient to be solved . Firstly, the bounding boxes of the primitives are detected using the YOLOv3 architecture in real-time. Secondly, the coordinates of the upper left corners and the sizes of the bounding boxes are automatically clustered in a binary integer programming optimization, which jointly considers the geometric fitness, regularity and additional constraints; this step does not require \emph{a priori} knowledge, such as the number of clusters or pre-defined grammars. Finally, the regularized bounding boxes can be directly used to guide the fa\c{c}ade reconstruction in an interactive envinronment. Experimental evaluations have revealed that the accuracies for the extraction of primitives are above 0.82, which is sufficient for the following 3D reconstruction. The proposed approach only takes about $ 10\% $ to $ 20\% $ of the runtime than previous approach and reduces the diversity of the bounding boxes to about $20\%$ to $50\%$.


title: Learning to Walk in the Real World with Minimal Human Effort

abstract: Reliable and stable locomotion has been one of the most fundamental challenges for legged robots. Deep reinforcement learning (deep RL) has emerged as a promising method for developing such control policies autonomously. In this paper, we develop a system for learning legged locomotion policies with deep RL in the real world with minimal human effort. The key difficulties for on-robot learning systems are automatic data collection and safety. We overcome these two challenges by developing a multi-task learning procedure and a safety-constrained RL framework. We tested our system on the task of learning to walk on three different terrains: flat ground, a soft mattress, and a doormat with crevices. Our system can automatically and efficiently learn locomotion skills on a Minitaur robot with little human intervention. The supplemental video can be found at: \url{https://youtu.be/cwyiq6dCgOc}.


title: Periods and $(\chi,b)$-factors of Cuspidal Automorphic Forms of Metaplectic Groups

abstract: We give constraints on the existence of $(\chi,b)$-factors in the global $A$-parameter of a genuine cuspidal automorphic representation $\sigma$ of a metaplectic group in terms of the invariant, lowest occurrence index, of theta lifts to odd orthogonal groups. We also give a refined result that relates the invariant, first occurrence index, to non-vanishing of period integrals of residues of Eisenstein series associated to the cuspidal datum $\chi\otimes\sigma$. This complements our previous results for symplectic groups.


title: Predictive Crystal Plasticity Modeling of Single Crystal Nickel Based on First-Principles Calculations

abstract: To reduce reliance on experimental fitting data within the crystal plasticity finite element method (CPFEM), an approached is proposed that integrates first-principles calculations based on density functional theory (DFT) to predict the strain hardening behavior of pure Ni single crystals. Flow resistance was evaluated through the Peierls-Nabarro equation using the ideal shear strength and elastic properties calculated by DFT-based methods, with hardening behavior modeled by imposing strains on supercells in first-principles calculations. Considered alone, elastic interactions of pure edge dislocations capture hardening behavior for small strains on single slip systems. For larger strains, hardening is captured through a strain-weighted linear combination of edge and screw flow resistance components. The rate of combination is not predicted in the present framework, but agreement with experiments through large strains (~0.4) for multiple loading orientations demonstrates a possible route for more predictive crystal plasticity modeling through incorporation of analytical models of mesoscale physics.


title: Weyl points and topological surface states in a three-dimensional elastic lattice

abstract: Following the realization of Weyl semimetals in quantum electronic materials, classical wave analogues of Weyl materials have also been theorized and experimentally demonstrated in photonics and acoustics. Weyl points in elastic systems, however, have been a much more recent discovery. In this study, we report on the design of an elastic fully-continuum three-dimensional material that, while offering structural and load-bearing functionalities, is also capable of Weyl degeneracies and surface topologically-protected modes in a way completely analogous to the quantum mechanical counterpart. The topological characteristics of the lattice are obtained by \textit{ab initio} numerical calculations without employing any further simplifications. The results clearly characterize the topological structure of the Weyl points and are in full agreement with the expectations of surface topological modes. Finally, full field numerical simulations are used to confirm the existence of surface states and to illustrate their extreme robustness towards lattice disorder and defects.


title: Continuous Influence-based Community Partition for Social Networks

abstract: Community partition is of great importance in social networks because of the rapid increasing network scale, data and applications. We consider the community partition problem under LT model in social networks, which is a combinatorial optimization problem that divides the social network to disjoint $m$ communities. Our goal is to maximize the sum of influence propagation through maximizing it within each community. As the influence propagation function of community partition problem is supermodular under LT model, we use the method of Lov{$\acute{a}$}sz Extension to relax the target influence function and transfer our goal to maximize the relaxed function over a matroid polytope. Next, we propose a continuous greedy algorithm using the properties of the relaxed function to solve our problem, which needs to be discretized in concrete implementation. Then, random rounding technique is used to convert the fractional solution to integer solution. We present a theoretical analysis with $1-1/e$ approximation ratio for the proposed algorithms. Extensive experiments are conducted to evaluate the performance of the proposed continuous greedy algorithms on real-world online social networks datasets and the results demonstrate that continuous community partition method can improve influence spread and accuracy of the community partition effectively.


title: Learning Object Scale With Click Supervision for Object Detection

abstract: Weakly-supervised object detection has recently attracted increasing attention since it only requires image-levelannotations. However, the performance obtained by existingmethods is still far from being satisfactory compared with fully-supervised object detection methods. To achieve a good trade-off between annotation cost and object detection performance,we propose a simple yet effective method which incorporatesCNN visualization with click supervision to generate the pseudoground-truths (i.e., bounding boxes). These pseudo ground-truthscan be used to train a fully-supervised detector. To estimatethe object scale, we firstly adopt a proposal selection algorithmto preserve high-quality proposals, and then generate ClassActivation Maps (CAMs) for these preserved proposals by theproposed CNN visualization algorithm called Spatial AttentionCAM. Finally, we fuse these CAMs together to generate pseudoground-truths and train a fully-supervised object detector withthese ground-truths. Experimental results on the PASCAL VOC2007 and VOC 2012 datasets show that the proposed methodcan obtain much higher accuracy for estimating the object scale,compared with the state-of-the-art image-level based methodsand the center-click based method


title: Diffusing-Horizon Model Predictive Control

abstract: We analyze a time-coarsening strategy for model predictive control (MPC) that we call diffusing-horizon MPC. This strategy seeks to overcome the computational challenges associated with optimal control problems that span multiple timescales. The coarsening approach uses a time discretization grid that becomes exponentially more sparse as one moves forward in time. This design is motivated by a recently established property of optimal control problems that is known as exponential decay of sensitivity. This property states that the impact of a parametric perturbation at a future time decays exponentially as one moves backward in time. We establish conditions under which this property holds for a constrained MPC formulation with linear dynamics and costs. Moreover, we show that the proposed coarsening scheme can be cast as a parametric perturbation of the MPC problem and thus the exponential decay condition holds. We use a heating, ventilation, and air conditioning plant case study with real data to demonstrate the proposed approach. Specifically, we show that computational times can be reduced by two orders of magnitude while increasing the closed-loop cost by only 3%.


title: Consequences of neutrino self interactions for weak decoupling and big bang nucleosynthesis

abstract: We calculate and discuss the implications of neutrino self-interactions for the physics of weak decoupling and big bang nucleosynthesis (BBN) in the early universe. In such neutrino-sector extensions of the standard model, neutrinos may not free-stream, yet can stay thermally coupled to one another. Nevertheless, the neutrinos exchange energy and entropy with the photon, electron-positron, and baryon component of the early universe only through the ordinary weak interaction. We examine the effects of neutrino self-interaction for the primordial helium and deuterium abundances and $N_{\rm eff}$, a measure of relativistic energy density at photon decoupling. These quantities are determined in, or may be influenced by, the physics in the weak decoupling epoch. Self interacting neutrinos have been invoked to address a number of anomalies, including as a possible means of ameliorating tension in the Hubble parameter. Our calculations show that surprisingly subtle changes in BBN accompany some of these neutrino self-interaction schemes. Such minute signals require high-precision measurements, making deuterium the best abundance for BBN constraints in the models explored here.


title: Perceptually inspired weighted MSE optimization using irregularity-aware graph Fourier transform

abstract: In image and video coding applications, distortion has been traditionally measured using mean square error (MSE), which suggests the use of orthogonal transforms, such as the discrete cosine transform (DCT). Perceptual metrics such as Structural Similarity (SSIM) are typically used after encoding, but not tied to the encoding process. In this paper, we consider an alternative framework where the goal is to optimize a weighted MSE metric, where different weights can be assigned to each pixel so as to reflect their relative importance in terms of perceptual image quality. For this purpose, we propose a novel transform coding scheme based on irregularity-aware graph Fourier transform (IAGFT), where the induced IAGFT is orthogonal, but the orthogonality is defined with respect to an inner product corresponding to the weighted MSE. We propose to use weights derived from local variances of the input image, such that the weighted MSE aligns with SSIM. In this way, the associated IAGFT can achieve a coding efficiency improvement in SSIM with respect to conventional transform coding based on DCT. Our experimental results show a compression gain in terms of multi-scale SSIM on test images.


title: Probing string-inspired gravity with the inspiral-merger-ringdown consistency tests of gravitational waves

abstract: The extreme-gravity collisions between black holes allow us to probe the underlying theory of gravity. We apply the theory-agnostic inspiral-merger-ringdown consistency test to an example theory beyond general relativity for the first time. Here we focus on the string-inspired Einstein-dilaton Gauss-Bonnet gravity and modify the inspiral, ringdown, and remnant black hole properties of the gravitational waveform. We found that future multiband observations allow us to constrain the theory stronger than current observations by an order of magnitude. The formalism developed here can easily be applied to other theories.


title: Robust Inference for Partially Observed Functional Response Data

abstract: Irregular functional data in which densely sampled curves are observed over different ranges pose a challenge for modeling and inference, and sensitivity to outlier curves is a concern in applications. Motivated by applications in quantitative ultrasound signal analysis, this paper investigates a class of robust M-estimators for partially observed functional data including functional location and quantile estimators. Consistency of the estimators is established under general conditions on the partial observation process. Under smoothness conditions on the class of M-estimators, asymptotic Gaussian process approximations are established and used for large sample inference. The large sample approximations justify a bootstrap approximation for robust inferences about the functional response process. The performance is demonstrated in simulations and in the analysis of irregular functional data from quantitative ultrasound analysis.


title: Column Partition based Distributed Algorithms for Coupled Convex Sparse Optimization: Dual and Exact Regularization Approaches

abstract: This paper develops column partition based distributed schemes for a class of large-scale convex sparse optimization problems, e.g., basis pursuit (BP), LASSO, basis pursuit denosing (BPDN), and their extensions, e.g., fused LASSO. We are particularly interested in the cases where the number of (scalar) decision variables is much larger than the number of (scalar) measurements, and each agent has limited memory or computing capacity such that it only knows a small number of columns of a measurement matrix. These problems in consideration are densely coupled and cannot be formulated as separable convex programs using column partition. To overcome this difficulty, we consider their dual problems which are separable or locally coupled. Once a dual solution is attained, it is shown that a primal solution can be found from the dual of corresponding regularized BP-like problems under suitable exact regularization conditions. A wide range of existing distributed schemes can be exploited to solve the obtained dual problems. This yields two-stage column partition based distributed schemes for LASSO-like and BPDN-like problems; the overall convergence of these schemes is established using sensitivity analysis techniques. Numerical results illustrate the effectiveness of the proposed schemes.


title: Federated pretraining and fine tuning of BERT using clinical notes from multiple silos

abstract: Large scale contextual representation models, such as BERT, have significantly advanced natural language processing (NLP) in recently years. However, in certain area like healthcare, accessing diverse large scale text data from multiple institutions is extremely challenging due to privacy and regulatory reasons. In this article, we show that it is possible to both pretrain and fine tune BERT models in a federated manner using clinical texts from different silos without moving the data.


title: The continuous categorical: a novel simplex-valued exponential family

abstract: Simplex-valued data appear throughout statistics and machine learning, for example in the context of transfer learning and compression of deep networks. Existing models for this class of data rely on the Dirichlet distribution or other related loss functions; here we show these standard choices suffer systematically from a number of limitations, including bias and numerical issues that frustrate the use of flexible network models upstream of these distributions. We resolve these limitations by introducing a novel exponential family of distributions for modeling simplex-valued data - the continuous categorical, which arises as a nontrivial multivariate generalization of the recently discovered continuous Bernoulli. Unlike the Dirichlet and other typical choices, the continuous categorical results in a well-behaved probabilistic loss function that produces unbiased estimators, while preserving the mathematical simplicity of the Dirichlet. As well as exploring its theoretical properties, we introduce sampling methods for this distribution that are amenable to the reparameterization trick, and evaluate their performance. Lastly, we demonstrate that the continuous categorical outperforms standard choices empirically, across a simulation study, an applied example on multi-party elections, and a neural network compression task.


title: Corona-Heated Accretion-disk Reprocessing (CHAR): A Physical Model to Decipher the Melody of AGN UV/optical Twinkling

abstract: Active galactic nuclei (AGNs) have long been observed to "twinkle" (i.e., their brightness varies with time) on timescales from days to years in the UV/optical bands. Such AGN UV/optical variability is essential for probing the physics of supermassive black holes (SMBHs), the accretion disk, and the broad-line region. Here we show that the temperature fluctuations of an AGN accretion disk, which is magnetically coupled with the corona, can account for observed high-quality AGN optical light curves. We calculate the temperature fluctuations by considering the gas physics of the accreted matter near the SMBH. We find that the resulting simulated AGN UV/optical light curves share the same statistical properties as the observed ones as long as the dimensionless viscosity parameter $\alpha$, which is widely believed to be controlled by magnetohydrodynamic (MHD) turbulence in the accretion disk, is about $0.01$---$0.2$. Moreover, our model can simultaneously explain the larger-than-expected accretion disk sizes and the dependence of UV/optical variability upon wavelength for NGC 5548. Our model also has the potential to explain some other observational facts of AGN UV/optical variability, including the timescale-dependent bluer-when-brighter color variability and the dependence of UV/optical variability on AGN luminosity and black hole mass. Our results also demonstrate a promising way to infer the black-hole mass, the accretion rate, and the radiative efficiency, thereby facilitating understanding of the gas physics and MHD turbulence near the SMBH and its cosmic mass growth history by fitting the AGN UV/optical light curves in the era of time-domain astronomy.


title: Captioning Images Taken by People Who Are Blind

abstract: While an important problem in the vision community is to design algorithms that can automatically caption images, few publicly-available datasets for algorithm development directly address the interests of real users. Observing that people who are blind have relied on (human-based) image captioning services to learn about images they take for nearly a decade, we introduce the first image captioning dataset to represent this real use case. This new dataset, which we call VizWiz-Captions, consists of over 39,000 images originating from people who are blind that are each paired with five captions. We analyze this dataset to (1) characterize the typical captions, (2) characterize the diversity of content found in the images, and (3) compare its content to that found in eight popular vision datasets. We also analyze modern image captioning algorithms to identify what makes this new dataset challenging for the vision community. We publicly-share the dataset with captioning challenge instructions at https://vizwiz.org


title: Atmospheric neutrinos in a next-generation xenon dark matter experiment

abstract: We study the sensitivity of future xenon- and argon-based dark matter and neutrino detection experiments to low-energy atmospheric neutrinos. Not accounting for experimental backgrounds, the primary obstacle for identifying nuclear recoils induced by atmospheric neutrinos is the tail of the electron recoil distribution due to $pp$ solar neutrinos. We use the NEST code to model the solar and atmospheric neutrino signals in a xenon detector and find that an exposure of 700 tonne-years will produce a $5\sigma$ detection of atmospheric neutrinos. We explore the effect of different detector properties and find that a sufficiently long electron lifetime is essential to the success of such a measurement.


title: Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems

abstract: The stringent requirements of mobile edge computing (MEC) applications and functions fathom the high capacity and dense deployment of MEC hosts to the upcoming wireless networks. However, operating such high capacity MEC hosts can significantly increase energy consumption. Thus, a base station (BS) unit can act as a self-powered BS. In this paper, an effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. First, a two-stage linear stochastic programming problem is formulated with the goal of minimizing the total energy consumption cost of the system while fulfilling the energy demand. Second, a semi-distributed data-driven solution is proposed by developing a novel multi-agent meta-reinforcement learning (MAMRL) framework to solve the formulated problem. In particular, each BS plays the role of a local agent that explores a Markovian behavior for both energy consumption and generation while each BS transfers time-varying features to a meta-agent. Sequentially, the meta-agent optimizes (i.e., exploits) the energy dispatch decision by accepting only the observations from each local agent with its own state information. Meanwhile, each BS agent estimates its own energy dispatch policy by applying the learned parameters from meta-agent. Finally, the proposed MAMRL framework is benchmarked by analyzing deterministic, asymmetric, and stochastic environments in terms of non-renewable energy usages, energy cost, and accuracy. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost (with 95.8% prediction accuracy), compared to other baseline methods.


title: MEUZZ: Smart Seed Scheduling for Hybrid Fuzzing

abstract: Seed scheduling is a prominent factor in determining the yields of hybrid fuzzing. Existing hybrid fuzzers schedule seeds based on fixed heuristics that aim to predict input utilities. However, such heuristics are not generalizable as there exists no one-size-fits-all rule applicable to different programs. They may work well on the programs from which they were derived, but not others. To overcome this problem, we design a Machine learning-Enhanced hybrid fUZZing system (MEUZZ), which employs supervised machine learning for adaptive and generalizable seed scheduling. MEUZZ determines which new seeds are expected to produce better fuzzing yields based on the knowledge learned from past seed scheduling decisions made on the same or similar programs. MEUZZ's learning is based on a series of features extracted via code reachability and dynamic analysis, which incurs negligible runtime overhead (in microseconds). Moreover, MEUZZ automatically infers the data labels by evaluating the fuzzing performance of each selected seed. As a result, MEUZZ is generally applicable to, and performs well on, various kinds of programs. Our evaluation shows MEUZZ significantly outperforms the state-of-the-art grey-box and hybrid fuzzers, achieving 27.1% more code coverage than QSYM. The learned models are reusable and transferable, which boosts fuzzing performance by 7.1% on average and improves 68% of the 56 cross-program fuzzing campaigns. MEUZZ discovered 47 deeply hidden and previously unknown bugs--with 21 confirmed and fixed by the developers--when fuzzing 8 well-tested programs with the same configurations as used in previous work.


title: Byzantine-resilient Decentralized Stochastic Gradient Descent

abstract: Decentralized learning has gained great popularity to improve learning efficiency and preserve data privacy. Each computing node makes equal contribution to collaboratively learn a Deep Learning model. The elimination of centralized Parameter Servers (PS) can effectively address many issues such as privacy, performance bottleneck and single-point-failure. However, how to achieve Byzantine Fault Tolerance in decentralized learning systems is rarely explored, although this problem has been extensively studied in centralized systems. In this paper, we present an in-depth study towards the Byzantine resilience of decentralized learning systems with two contributions. First, from the adversarial perspective, we theoretically illustrate that Byzantine attacks are more dangerous and feasible in decentralized learning systems: even one malicious participant can arbitrarily alter the models of other participants by sending carefully crafted updates to its neighbors. Second, from the defense perspective, we propose UBAR, a novel algorithm to enhance decentralized learning with Byzantine Fault Tolerance. Specifically, UBAR provides a Uniform Byzantine-resilient Aggregation Rule for benign nodes to select the useful parameter updates and filter out the malicious ones in each training iteration. It guarantees that each benign node in a decentralized system can train a correct model under very strong Byzantine attacks with an arbitrary number of faulty nodes. We conduct extensive experiments on standard image classification tasks and the results indicate that UBAR can effectively defeat both simple and sophisticated Byzantine attacks with higher performance efficiency than existing solutions.


title: Input Perturbation: A New Paradigm between Central and Local Differential Privacy

abstract: Traditionally, there are two models on differential privacy: the central model and the local model. The central model focuses on the machine learning model and the local model focuses on the training data. In this paper, we study the \textit{input perturbation} method in differentially private empirical risk minimization (DP-ERM), preserving privacy of the central model. By adding noise to the original training data and training with the `perturbed data', we achieve ($\epsilon$,$\delta$)-differential privacy on the final model, along with some kind of privacy on the original data. We observe that there is an interesting connection between the local model and the central model: the perturbation on the original data causes the perturbation on the gradient, and finally the model parameters. This observation means that our method builds a bridge between local and central model, protecting the data, the gradient and the model simultaneously, which is more superior than previous central methods. Detailed theoretical analysis and experiments show that our method achieves almost the same (or even better) performance as some of the best previous central methods with more protections on privacy, which is an attractive result. Moreover, we extend our method to a more general case: the loss function satisfies the Polyak-Lojasiewicz condition, which is more general than strong convexity, the constraint on the loss function in most previous work.


title: Factorization Homology and 4D TQFT

abstract: In [BK], it is shown that the Turaev-Viro invariants defined for a spherical fusion category $\mathcal{A}$ extends to invariants of 3-manifolds with corners. In [Kir], an equivalent formulation for the 2-1 part of the theory (2-manifolds with boundary) is described using the space of "stringnets with boundary conditions" as the vector spaces associated to 2-manifolds with boundary. Here we construct a similar theory for the 3-2 part of the 4-3-2 theory in [CY1993].


title: Contact (+1)-surgeries on rational homology 3-spheres

abstract: In this paper, sufficient conditions for contact $(+1)$-surgeries along Legendrian knots in contact rational homology 3-spheres to have vanishing contact invariants or to be overtwisted are given. They can be applied to study contact $(\pm1)$-surgeries along Legendrian links in the standard contact 3-sphere. We also obtain a sufficient condition for contact $(+1)$-surgeries along Legendrian two-component links in the standard contact 3-sphere to be overtwisted via their front projections.


title: Convergence analysis of a variational quasi-reversibility approach for an inverse hyperbolic heat conduction problem

abstract: We study a time-reversed hyperbolic heat conduction problem based upon the Maxwell--Cattaneo model of non-Fourier heat law. This heat and mass diffusion problem is a hyperbolic type equation for thermodynamics systems with thermal memory or with finite time-delayed heat flux, where the Fourier or Fick law is proven to be unsuccessful with experimental data. In this work, we show that our recent variational quasi-reversibility method for the classical time-reversed heat conduction problem, which obeys the Fourier or Fick law, can be adapted to cope with this hyperbolic scenario. We establish a generic regularization scheme in the sense that we perturb both spatial operators involved in the PDE. Driven by a Carleman weight function, we exploit the natural energy method to prove the well-posedness of this regularized scheme. Moreover, we prove the H\"older rate of convergence in the mixed $L^2$--$H^1$ spaces.


title: Elliptic flow splitting between protons and antiprotons from hadronic potentials

abstract: The difference in elliptic flow $v_{2}$ between protons and antiprotons, produced in $^{197}\text{Au}+^{197}\text{Au}$ collisions at center-of-mass energies $\sqrt{s_{NN}}=5-12~\text{GeV}$, is studied within a modified version of the ultrarelativistic quantum molecular dynamics (UrQMD) model. Two different model scenarios are compared: the cascade mode and the mean field mode which includes potential interactions for both formed and pre-formed hadrons. The model results for the elliptic flow of protons and the relative $v_{2}$ difference between protons and antiprotons obtained from the mean field mode agree with the available experimental data, while the $v_{2}$ difference is near zero for the cascade mode. Our results show that the elliptic flow splitting, observed for particles and antiparticles, can be explained by the inclusion of proper hadronic interactions. In addition, the difference in $v_{2}$ between protons and antiprotons depends on the centrality and the rapidity window. With smaller centrality and/or rapidity acceptance, the observed elliptic flow splitting is more sensitive to the beam energy, indicating a strong net baryon density dependence of the effect. We propose to confirm this splitting at the upcoming experiments from Beam Energy Scan (BES) Phase-\Rmnum{2} at Relativistic Heavy Ion Collider (RHIC), the Compressed Baryonic Matter (CBM) at Facility for Antiproton and Ion Research (FAIR), High Intensity heavy ion Accelerator Facility (HIAF) and Nuclotron-based Ion Collider fAcility (NICA).


title: Syndrome-aware Herb Recommendation with Multi-Graph Convolution Network

abstract: Herb recommendation plays a crucial role in the therapeutic process of Traditional Chinese Medicine(TCM), which aims to recommend a set of herbs to treat the symptoms of a patient. While several machine learning methods have been developed for herb recommendation, they are limited in modeling only the interactions between herbs and symptoms, and ignoring the intermediate process of syndrome induction. When performing TCM diagnostics, an experienced doctor typically induces syndromes from the patient's symptoms and then suggests herbs based on the induced syndromes. As such, we believe the induction of syndromes, an overall description of the symptoms, is important for herb recommendation and should be properly handled. However, due to the ambiguity and complexity of syndrome induction, most prescriptions lack the explicit ground truth of syndromes. In this paper, we propose a new method that takes the implicit syndrome induction process into account for herb recommendation. Given a set of symptoms to treat, we aim to generate an overall syndrome representation by effectively fusing the embeddings of all the symptoms in the set, to mimic how a doctor induces the syndromes. Towards symptom embedding learning, we additionally construct a symptom-symptom graph from the input prescriptions for capturing the relations between symptoms; we then build graph convolution networks(GCNs) on both symptom-symptom and symptom-herb graphs to learn symptom embedding. Similarly, we construct a herb-herb graph and build GCNs on both herb-herb and symptom-herb graphs to learn herb embedding, which is finally interacted with the syndrome representation to predict the scores of herbs. In this way, more comprehensive representations can be obtained. We conduct extensive experiments on a public TCM dataset, showing significant improvements over state-of-the-art herb recommendation methods.


title: A characterization of the family of secant lines to a hyperbolic quadric in PG(3,q), q odd

abstract: We give a combinatorial characterization of the family of lines of P G(3, q) which meet a hyperbolic quadric in two points (the so called secant lines) using their intersection properties with the points and planes of PG(3,q).


title: Towards a Soft Faceted Browsing Scheme for Information Access

abstract: Faceted browsing is a commonly supported feature of user interfaces for access to information. Existing interfaces generally treat facet values selected by a user as hard filters and respond to the user by only displaying information items strictly satisfying the filters and in their original ranking order. We propose a novel alternative strategy for faceted browsing, called soft faceted browsing, where the system also includes some possibly relevant items outside the selected filter in a non-intrusive way and re-ranks the items to better satisfy the user's information need. Such a soft faceted browsing strategy can be beneficial when the user does not have a very confident and strict preference for the selected facet values, and is especially appropriate for applications such as e-commerce search where the user would like to explore a larger space before finalizing a purchasing decision. We propose a probabilistic framework for modeling and solving the soft faceted browsing problem, and apply the framework to study the case of facet filter selection in e-commerce search engines. Preliminary experiment results demonstrate the soft faceted browsing scheme is better than the traditional faceted browsing scheme in terms of its efficiency in helping users navigate in the information space.


title: Data Heterogeneity Differential Privacy: From Theory to Algorithm

abstract: Traditionally, the random noise is equally injected when training with different data instances in the field of differential privacy (DP). In this paper, we first give sharper excess risk bounds of DP stochastic gradient descent (SGD) method. Considering most of the previous methods are under convex conditions, we use Polyak-{\L}ojasiewicz condition to relax it in this paper. Then, after observing that different training data instances affect the machine learning model to different extent, we consider the heterogeneity of training data and attempt to improve the performance of DP-SGD from a new perspective. Specifically, by introducing the influence function (IF), we quantitatively measure the contributions of various training data on the final machine learning model. If the contribution made by a single data instance is so little that attackers cannot infer anything from the model, we do not add noise when training with it. Based on this observation, we design a `Performance Improving' DP-SGD algorithm: PIDP-SGD. Theoretical and experimental results show that our proposed PIDP-SGD improves the performance significantly.


title: Linear-time Erasure List-decoding of Expander Codes

abstract: We give a linear-time erasure list-decoding algorithm for expander codes. More precisely, let $r > 0$ be any integer. Given an inner code $C_0$ of length $d$, and a $d$-regular bipartite expander graph $G$ with $n$ vertices on each side, we give an algorithm to list-decode the expander code $C = C(G, C_0)$ of length $nd$ from approximately $\delta \delta_r nd$ erasures in time $n \cdot \mathrm{poly}(d2^r / \delta)$, where $\delta$ and $\delta_r$ are the relative distance and the $r$'th generalized relative distance of $C_0$, respectively. To the best of our knowledge, this is the first linear-time algorithm that can list-decode expander codes from erasures beyond their (designed) distance of approximately $\delta^2 nd$. To obtain our results, we show that an approach similar to that of (Hemenway and Wootters, Information and Computation, 2018) can be used to obtain such an erasure-list-decoding algorithm with an exponentially worse dependence of the running time on $r$ and $\delta$; then we show how to improve the dependence of the running time on these parameters.


title: The (Generalized) Orthogonality Dimension of (Generalized) Kneser Graphs: Bounds and Applications

abstract: The orthogonality dimension of a graph $G=(V,E)$ over a field $\mathbb{F}$ is the smallest integer $t$ for which there exists an assignment of a vector $u_v \in \mathbb{F}^t$ with $\langle u_v,u_v \rangle \neq 0$ to every vertex $v \in V$, such that $\langle u_v, u_{v'} \rangle = 0$ whenever $v$ and $v'$ are adjacent vertices in $G$. The study of the orthogonality dimension of graphs is motivated by various applications in information theory and in theoretical computer science. The contribution of the present work is two-fold. First, we prove that there exists a constant $c$ such that for every sufficiently large integer $t$, it is $\mathsf{NP}$-hard to decide whether the orthogonality dimension of an input graph over $\mathbb{R}$ is at most $t$ or at least $3t/2-c$. At the heart of the proof lies a geometric result, which might be of independent interest, on a generalization of the orthogonality dimension parameter for the family of Kneser graphs, analogously to a long-standing conjecture of Stahl (J. Comb. Theo. Ser. B, 1976). Second, we study the smallest possible orthogonality dimension over finite fields of the complement of graphs that do not contain certain fixed subgraphs. In particular, we provide an explicit construction of triangle-free $n$-vertex graphs whose complement has orthogonality dimension over the binary field at most $n^{1-\delta}$ for some constant $\delta >0$. Our results involve constructions from the family of generalized Kneser graphs and they are motivated by the rigidity approach to circuit lower bounds. We use them to answer a couple of questions raised by Codenotti, Pudl\'{a}k, and Resta (Theor. Comput. Sci., 2000), and in particular, to disprove their Odd Alternating Cycle Conjecture over every finite field.


title: Understanding long-range near-side ridge correlations in p$-$p collisions using rope hadronization at LHC energies

abstract: The observation of long range ridge-like structure in the near-side region of the two particle $\Delta\eta-\Delta\phi$ correlations as measured by LHC experiments in high multiplicity p$-$p collisions indicated towards the presence of collective effects which are similar to that observed in p$-$A(nucleon-nucleus) and A$-$A (nucleus-nucleus) collisions. The two particle correlation between the charged particles in $\Delta\eta-\Delta\phi$ for p$-$p collisions at $\sqrt{s}$ = 7 TeV and 13 TeV is studied using Pythia 8 event generator within the framework of final-state partonic color reconnection effects as well as the microscopic rope hadronization model. The rope hadronization relies on the formation of ropes due to overlapping of strings in high multiplicity events followed by string shoving. A near side ridge-like structure which is qualitatively similar to the observed ridge in data was observed for high-multiplicity events when the mechanism of rope hadronization (with shoving) was enabled.


title: Convergence-guaranteed Independent Positive Semidefinite Tensor Analysis Based on Student's t Distribution

abstract: In this paper, we address a blind source separation (BSS) problem and propose a new extended framework of independent positive semidefinite tensor analysis (IPSDTA). IPSDTA is a state-of-the-art BSS method that enables us to take interfrequency correlations into account, but the generative model is limited within the multivariate Gaussian distribution and its parameter optimization algorithm does not guarantee stable convergence. To resolve these problems, first, we propose to extend the generative model to a parametric multivariate Student's t distribution that can deal with various types of signal. Secondly, we derive a new parameter optimization algorithm that guarantees the monotonic nonincrease in the cost function, providing stable convergence. Experimental results reveal that the cost function in the conventional IPSDTA does not display monotonically nonincreasing properties. On the other hand, the proposed method guarantees the monotonic nonincrease in the cost function and outperforms the conventional ILRMA and IPSDTA in the source-separation performance.


title: Regret Minimization in Stochastic Contextual Dueling Bandits

abstract: We consider the problem of stochastic $K$-armed dueling bandit in the contextual setting, where at each round the learner is presented with a context set of $K$ items, each represented by a $d$-dimensional feature vector, and the goal of the learner is to identify the best arm of each context sets. However, unlike the classical contextual bandit setup, our framework only allows the learner to receive item feedback in terms of their (noisy) pariwise preferences--famously studied as dueling bandits which is practical interests in various online decision making scenarios, e.g. recommender systems, information retrieval, tournament ranking, where it is easier to elicit the relative strength of the items instead of their absolute scores. However, to the best of our knowledge this work is the first to consider the problem of regret minimization of contextual dueling bandits for potentially infinite decision spaces and gives provably optimal algorithms along with a matching lower bound analysis. We present two algorithms for the setup with respective regret guarantees $\tilde O(d\sqrt{T})$ and $\tilde O(\sqrt{dT \log K})$. Subsequently we also show that $\Omega(\sqrt {dT})$ is actually the fundamental performance limit for this problem, implying the optimality of our second algorithm. However the analysis of our first algorithm is comparatively simpler, and it is often shown to outperform the former empirically. Finally, we corroborate all the theoretical results with suitable experiments.


title: Dynamic SLAM: The Need For Speed

abstract: The static world assumption is standard in most simultaneous localisation and mapping (SLAM) algorithms. Increased deployment of autonomous systems to unstructured dynamic environments is driving a need to identify moving objects and estimate their velocity in real-time. Most existing SLAM based approaches rely on a database of 3D models of objects or impose significant motion constraints. In this paper, we propose a new feature-based, model-free, object-aware dynamic SLAM algorithm that exploits semantic segmentation to allow estimation of motion of rigid objects in a scene without the need to estimate the object poses or have any prior knowledge of their 3D models. The algorithm generates a map of dynamic and static structure and has the ability to extract velocities of rigid moving objects in the scene. Its performance is demonstrated on simulated, synthetic and real-world datasets.


title: Multiple scales analysis of out-of-plane and in-plane vibrations of a wind turbine blade

abstract: Steady-state response of an isolated horizontal axis wind turbine blade undergoing out-of-plane and in-plane vibrations are studied considering the two cases separately. Equations of motion for both cases are sought by modeling the blade as cantilevered Euler-Bernoulli beam and applying the Lagrangian formulation. Taking into account the effects of blade rotation on gravitational and aerodynamic forces and allowing the blade to undergo large deformations, various nonlinearities arise in the system resulting in superharmonic resonances. Taking practically relevant numerical values of parameters, we suitably order the parameters for their smallness. We then obtain the frequency responses corresponding to primary and superharmonic resonances by applying the method of multiple scales up to fourth and third orders for out-of-plane and in-plane cases respectively. Comparisons are drawn with the results obtained using the method of harmonic balance.


title: Distributed Computation of Graph Matching in Multi-Agent Networks

abstract: This work considers the distributed computation of the one-to-one vertex correspondences between two undirected and connected graphs, which is called \textit{graph matching}, over multi-agent networks. Given two \textit{isomorphic} and \textit{asymmetric} graphs, there is a unique permutation matrix that maps the vertices in one graph to the vertices in the other. Based on a convex relaxation of graph matching in Aflalo et al. (2015), we propose a distributed computation of graph matching as a distributed convex optimization problem subject to equality constraints and a global set constraint, using a network of multiple agents whose interaction graph is connected. Each agent in the network only knows one column of each of the adjacency matrices of the two graphs, and all agents collaboratively learn the graph matching by exchanging information with their neighbors. The proposed algorithm employs a projected primal-dual gradient method to handle equality constraints and a set constraint. Under the proposed algorithm, the agents' estimates of the permutation matrix converge to the optimal permutation globally and exponentially fast. Finally, simulation results are given to illustrate the effectiveness of the method.


title: Cross-stained Segmentation from Renal Biopsy Images Using Multi-level Adversarial Learning

abstract: Segmentation from renal pathological images is a key step in automatic analyzing the renal histological characteristics. However, the performance of models varies significantly in different types of stained datasets due to the appearance variations. In this paper, we design a robust and flexible model for cross-stained segmentation. It is a novel multi-level deep adversarial network architecture that consists of three sub-networks: (i) a segmentation network; (ii) a pair of multi-level mirrored discriminators for guiding the segmentation network to extract domain-invariant features; (iii) a shape discriminator that is utilized to further identify the output of the segmentation network and the ground truth. Experimental results on glomeruli segmentation from renal biopsy images indicate that our network is able to improve segmentation performance on target type of stained images and use unlabeled data to achieve similar accuracy to labeled data. In addition, this method can be easily applied to other tasks.


title: An AGB Star with a Thick Circumstellar Shell

abstract: The Asymptotic Giant Branch (AGB) is the terminal phase of red giant evolution with timescales of millions of years and a total mass lost from the star that is a significant fraction of the initial mass. Investigation of one of these stars, WISEA J173046.10-344455.5, a kpc in the direction of the center of the Galaxy, reveals a cool oxygen rich star with a dust shell of black-body temperature 1305 K.


title: Intense Dark Exciton Emission from Strongly Quantum Confined CsPbBr$_3$ Nanocrystals

abstract: Dark ground state exciton in semiconductor nanocrystals has been a subject of much interest due to its long lifetime attractive for applications requiring long-lived electronic or spin states. Significant effort has been made recently to explore and access the dark exciton level in metal halide perovskite nanocrystals, which are emerging as a superior source of photons and charges compared to other existing semiconductor nanocrystals. However, the direct observation of long-lived photoluminescence from dark exciton has remained elusive in metal halide perovskite nanocrystals. Here, we report the observation of the intense emission from dark ground state exciton with 1-10 us lifetime in strongly quantum confined CsPbBr3 nanocrystals, which contrasts the behavior of weakly confined system explored so far. The study in CsPbBr3 nanocrystals with varying degree of confinement has revealed the crucial role of quantum confinement in enhancing the bright-dark exciton level splitting which is important for accessing the dark exciton. Our work demonstrates the future potential of strongly quantum-confined perovskite nanocrystals as a new platform to utilize dark excitons.


title: Drop freezing: fine detection of contaminants by measuring the tip angle

abstract: In this Letter, we show that the shape of a freezing drop of water can be sensitive to the presence of impurities. We measure the tip angle of water drops frozen on a cold plate. The fine changes in tip angle are robustly captured by our image analysis method, which shows a deviation from that of pure water in solutions with salt (NaCl), polymer (PEG) and surfactant (TTAB) starting at concentrations of $10^{-6}$, $10^{-4}$ and $10^{-6}$ M respectively. The method could be adapted into a portable water purity tester, but the work also highlights the complexity of water freezing as it is influenced by trace concentrations of impurities.


title: Multidimensional synthetic chiral-tube lattices via nonlinear frequency conversion

abstract: Geometrical dimensionality plays a fundamentally important role in the topological effects arising in discrete lattices. While direct experiments are limited by three spatial dimensions, the research topic of synthetic dimensions implemented by the frequency degree of freedom in photonics is rapidly advancing. The manipulation of light in such artificial lattices is typically realized through electro-optic modulation, yet their operating bandwidth imposes practical constraints on the range of interactions between different frequency components. Here we propose and experimentally realize all-optical synthetic dimensions involving specially tailored simultaneous short- and long-range interactions between discrete spectral lines mediated by frequency conversion in a nonlinear waveguide. We realize triangular chiral-tube lattices in three-dimensional space and explore their four-dimensional generalization. We implement a synthetic gauge field with nonzero magnetic flux and observe the associated multidimensional dynamics of frequency combs, all within one physical spatial port. We anticipate that our method will provide a new means for the fundamental study of high-dimensional physics and act as an important step towards using topological effects in optical devices operating in the time and frequency domains.


title: Partition of enstrophy between zonal and turbulent components

abstract: The partition of enstrophy between zonal (ordered) and wavy (turbulent) components of vorticity has been studied for the beta-plane model of two-dimensional barotropic flow. An analytic estimate of the minimum value for the zonal component has been derived. The energy, angular momentum, circulation, as well as the total enstrophy are invoked as constraints for the minimization of the zonal enstrophy. The corresponding variational principle has an unusual mathematical structure (primarily because the target functional is not a coercive form), by which the constraints work out in an interesting way. A discrete set of zonal enstrophy levels is generated by the energy constraint; each level is specified by an eigenvalue that represents the lamination period of zonal flow. However, the value itself of the zonal enstrophy level is a function of only angular momentum and circulation, being independent of the energy (and total enstrophy). Instead, the energy works in selecting the "level" (eigenvalue) of the relaxed state. The relaxation occurs by emitting small-scale wavy enstrophy, and continues as far as the nonlinear effect, scaled by the energy, can create wavy enstrophy. Comparison with numerical simulations shows that the theory gives a proper estimate of the zonal enstrophy in the relaxed state.

categories: physics.flu-dyn math.AP physics.geo-ph physics.plasm-ph


title: Heating of the Real Polar Cap of Radio Pulsars

abstract: The heating of the real polar cap surface of radio pulsars by the bombardment of ultra-relativistic charges is studied. The real polar cap is a significantly smaller area within or close by the conventional polar cap which is encircled by the last open field lines of the dipolar field $\vec{B}_d$. It is surrounded by those field lines of the small scale local surface field $\vec{B}_s$ that join the last open field lines of $\vec{B}_d$ in a height of $\sim 10^5$ cm above the cap. As the ratio of radii of the conventional and real polar cap $R_{dip}/R_{pc}\sim 10$, flux conservation requires $B_s/B_d\sim 100$. For rotational periods $P\sim 0.5$ s, $B_s\sim 10^{14}$ G creates a strong electric potential gap that forms the inner accelerating region (IAR) in which charges gain kinetic energies $\sim 3\times 10^{14}$ eV. This sets an upper limit for the energy that back flowing charges can release as heat in the surface layers of the real polar cap. Within the IAR, which is flown through with a dense stream of extremely energetic charges, no stable atmosphere of hydrogen can survive. Therefore, we consider the polar cap as a solidified "naked" surface consisting of fully ionized iron ions. We discuss the physical situation at the real polar cap, calculate its surface temperatures $T_s$ as functions of $B_s$ and $P$, and compare the results with X-ray observations of radio pulsars.


title: Role of the triangle mechanism in the $\Lambda_b\rightarrow \Lambda_c\pi^-f_0(980)$ reaction

abstract: We investigate the $\Lambda_b\to\Lambda_c\pi^-f_0(980)$ production with a $f_0(980)$ decay into $\pi^+\pi^-$ via the $K^{*0}K^-K^+$ and $K^{*-}K^0\bar{K}^0$ triangle loops. These loops produce a peak around 1.42 GeV in the $\pi^-f_0(980)$ invariant mass distribution, which is the same mechanism as the one considered to explain the $a_1(1420)$ peak. In the $\pi^+\pi^-$ distribution obtained by fixing the $\pi^-f_0(980)$ invariant mass to some values, a clear peak of $f_0(980)$ is seen, and the $\pi^-f_0(980)$ distribution has a peak around $M_{\pi^-f_0}=1.42$ GeV, which is caused by the triangle mechanism of the $K^*\bar KK$ loop. The branching ratio of $\Lambda_b\rightarrow\Lambda_c\pi^-f_0(980)$ with $f_0(980)\rightarrow\pi^+\pi^-$ by the triangle mechanism, obtained by integrating the $\pi^-f_0(980)$ distribution from 1 to 1.6 GeV, is estimated to be the order $10^{-4}$. Future measurements of the $\Lambda_b\to\Lambda_c\pi^-f_0(980)$ branching ratio and the $\pi^-f_0(980)$ invariant mass distribution predicted in this work would give further clues to clarify the nature of the $a_1(1420)$ peak.


title: KaoKore: A Pre-modern Japanese Art Facial Expression Dataset

abstract: From classifying handwritten digits to generating strings of text, the datasets which have received long-time focus from the machine learning community vary greatly in their subject matter. This has motivated a renewed interest in building datasets which are socially and culturally relevant, so that algorithmic research may have a more direct and immediate impact on society. One such area is in history and the humanities, where better and relevant machine learning models can accelerate research across various fields. To this end, newly released benchmarks and models have been proposed for transcribing historical Japanese cursive writing, yet for the field as a whole using machine learning for historical Japanese artworks still remains largely uncharted. To bridge this gap, in this work we propose a new dataset KaoKore which consists of faces extracted from pre-modern Japanese artwork. We demonstrate its value as both a dataset for image classification as well as a creative and artistic dataset, which we explore using generative models. Dataset available at https://github.com/rois-codh/kaokore


title: Interpretability of machine learning based prediction models in healthcare

abstract: There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models allow healthcare experts to make reasonable and data-driven decisions to provide personalized decisions that can ultimately lead to higher quality of service in healthcare. Generally, we can classify interpretability approaches in two groups where the first focuses on personalized interpretation (local interpretability) while the second summarizes prediction models on a population level (global interpretability). Alternatively, we can group interpretability methods into model-specific techniques, which are designed to interpret predictions generated by a specific model, such as a neural network, and model-agnostic approaches, which provide easy-to-understand explanations of predictions made by any machine learning model. Here, we give an overview of interpretability approaches and provide examples of practical interpretability of machine learning in different areas of healthcare, including prediction of health-related outcomes, optimizing treatments or improving the efficiency of screening for specific conditions. Further, we outline future directions for interpretable machine learning and highlight the importance of developing algorithmic solutions that can enable machine-learning driven decision making in high-stakes healthcare problems.


title: Kalman Filtering With Censored Measurements

abstract: This paper concerns Kalman filtering when the measurements of the process are censored. The censored measurements are addressed by the Tobit model of Type I and are one-dimensional with two censoring limits, while the (hidden) state vectors are multidimensional. For this model, Bayesian estimates for the state vectors are provided through a recursive algorithm of Kalman filtering type. Experiments are presented to illustrate the effectiveness and applicability of the algorithm. The experiments show that the proposed method outperforms other filtering methodologies in minimizing the computational cost as well as the overall Root Mean Square Error (RMSE) for synthetic and real data sets.


title: Microscopic insights into the failure of elastic double networks

abstract: The toughness of a polymer material can increase significantly if two networks are combined into one material. This toughening effect is a consequence of a transition from a brittle to a ductile failure response. Although this transition and the accompanying toughening effect have been demonstrated in hydrogels first, the concept has been proven effective in elastomers and in macroscopic composites as well. This suggests that the transition is not caused by a specific molecular architecture, but rather by a general physical principle related to the mechanical interplay between two interpenetrating networks. Here we employ theory and computer simulations, inspired by this general principle, to investigate how disorder controls the brittle-to-ductile transition both at the macroscopic and the microscopic level. A random spring network model featuring two different spring types, enables us to study the joined effect of initial disorder and network-induced stress heterogeneity on this transition. We reveal that a mechanical force balance gives a good description of the brittle-to-ductile transition. In addition, the inclusion of disorder in the spring model predicts four different failure regimes along the brittle-to-ductile response in agreement with experimental findings. Finally, we show that the network structure can result in stress concentration, diffuse damage and loss of percolation depending on the failure regime. This work thus provides a framework for the design and optimization of double network materials and underlines the importance of network structure in the toughness of polymer materials.