title: Breathing K-Means

abstract: The k-means++ algorithm is the de-facto standard for finding approximate solutions to the k-means problem. A widely used implementation is provided by the scikit-learn Python package for machine learning. We propose the breathing k-means algorithm, which on average significantly outperforms scikit-learn's k-means++ w.r.t. both solution quality and execution speed. The initialization step in the new method is done by k-means++ but without the usual (and costly) repetitions (ten in scikit-learn). The core of the new method is a sequence of "breathing cycles," each consisting of a "breathe in" step where the number of centroids is increased by m and a "breathe out" step where m centroids are removed. Each step is ended by a run of Lloyd's algorithm. The parameter m is decreased until zero, at which point the algorithm terminates. With the default (m = 5), breathing k-means dominates scikit-learn's k-means++. This is demonstrated via experiments on various data sets, including all those from the original k-means++ publication. By setting m to smaller or larger values, one can optionally produce faster or better solutions, respectively. For larger values of m, e.g., m = 20, breathing k-means likely is the new SOTA for the k-means problem.


title: Weak Signal Inclusion Under Sparsity and Dependence

abstract: We consider the scenario where important signals are not strong enough to be separable from a large amount of noise. Such weak signals commonly exist in large-scale data analysis and play vital roles in many biomedical applications. Existing methods however are mostly underpowered for such weak signals. We address the challenge from the perspective of false negative control and develop a new method to efficiently regulate false negative proportion at a user-specified level. The new method is developed in a realistic setting with arbitrary covariance dependence between variables. We calibrate the overall dependence through a parameter whose scale is compatible with the existing phase diagram in high-dimensional sparse inference. Utilizing the new calibration, we asymptotically explicate the joint effect of covariance dependence, signal sparsity, and signal intensity on the proposed method. We interpret the results using a new phase diagram, which shows that the proposed method can efficiently retain a high proportion of signals even when they cannot be well-separated from noise. Finite sample performance of the proposed method is compared to those of several existing methods in simulation studies. The proposed method outperforms the others in adapting to a user-specified false negative control level. We apply the new method to analyze an fMRI dataset to locate voxels that are functionally relevant to saccadic eye movements. The new method exhibits a nice balance in identifying functional relevant regions and avoiding excessive noise voxels.


title: Effective Reduction of Oxygen Debris in Graphene Oxide

abstract: Graphene oxide (GO) raised substantial interest in the last two decades thanks to its unique properties beyond those of pristine graphene, including electronic energy band-gap, hydrophilic behavior and numerous anchoring sites required for functionalization. In addition, GO was found to be a cheap mass-production source for the formation of the pristine graphene. However, the presence of numerous clusters containing oxygen functional groups (called debris) on the GO surface hinders the GO integration in electronic devices. Here, we present a simple method aimed to reduce the density of oxygen debris weakly bonded to the surface. The method consists of minimal treatments, like sonication and/or water rinsing processes. Whereas this simple method removed epoxy and hydroxyl oxygen groups weakly attached to the graphene matrix, the double C=O bonds are almost not affected by the applied treatment, as demonstrated by X-ray photoelectron spectroscopy and Fourier transform infrared spectroscopy. Scanning tunneling microscopy and high-resolution transmission electron microscopy measures designated non-uniform distribution of the oxidation sites, appearing as clusters concentrated preferentially on GO defected regions, albeit separated by pristine graphene areas. The results should have an impact in the implementation of GO in electronic devices deposited on different substrates.


title: Geometry-Inspired Top-k Adversarial Perturbations

abstract: The brittleness of deep image classifiers to small adversarial input perturbations has been extensively studied in the last several years. However, the main objective of existing perturbations is primarily limited to change the correctly predicted Top-1 class by an incorrect one, which does not intend to change the Top-k prediction. In many digital real-world scenarios Top-k prediction is more relevant. In this work, we propose a fast and accurate method of computing Top-k adversarial examples as a simple multi-objective optimization. We demonstrate its efficacy and performance by comparing it to other adversarial example crafting techniques. Moreover, based on this method, we propose Top-k Universal Adversarial Perturbations, image-agnostic tiny perturbations that cause the true class to be absent among the Top-k prediction for the majority of natural images. We experimentally show that our approach outperforms baseline methods and even improves existing techniques of finding Universal Adversarial Perturbations.


title: Simplest random walk for approximating Robin boundary value problems and ergodic limits of reflected diffusions

abstract: A simple-to-implement weak-sense numerical method to approximate reflected stochastic differential equations (RSDEs) is proposed and analysed. It is proved that the method has the first order of weak convergence. Together with the Monte Carlo technique, it can be used to numerically solve linear parabolic and elliptic PDEs with Robin boundary condition. One of the key results of this paper is the use of the proposed method for computing ergodic limits, i.e. expectations with respect to the invariant law of RSDEs, both inside a domain in $\mathbb{R}^{d}$ and on its boundary. This allows to efficiently sample from distributions with compact support. Both time-averaging and ensemble-averaging estimators are considered and analysed. A number of extensions are considered including a second-order weak approximation, the case of arbitrary oblique direction of reflection, and a new adaptive weak scheme to solve a Poisson PDE with Neumann boundary condition. The presented theoretical results are supported by several numerical experiments.


title: A refined well-posedness result for the modified KdV equation in the Fourier-Lebesgue spaces

abstract: We study the well-posedness of the complex-valued modified Korteweg-de Vries equation (mKdV) on the circle at low regularity. In our previous work (2019), we introduced the second renormalized mKdV equation, based on the conservation of momentum, which we proposed as the correct model to study the complex-valued mKdV outside of $H^\frac12(\mathbb{T})$. Here, we employ the method introduced by Deng-Nahmod-Yue (2019) to prove local well-posedness of the second renormalized mKdV equation in the Fourier-Lebesgue spaces $\mathcal{F}L^{s,p}(\mathbb{T})$ for $s\geq \frac12$ and $1\leq p <\infty$. As a byproduct of this well-posedness result, we show ill-posedness of the complex-valued mKdV without the second renormalization for initial data in these Fourier-Lebesgue spaces with infinite momentum.


title: Direct detection of freeze-in inelastic dark matter

abstract: We show that the current sensitivities of direct detection experiments have already reached the interesting parameter space of freeze-in dark matter models if the dark sector is in the inelastic dark matter framework and the excited dark matter state is cosmologically stable. Using results recently presented by the XENON1T experiment, we present constraints on these models. We also show that these models can explain the reported excess in the electron recoil signals if the mass gap between the ground state and the excited state is at keV scale.


title: Differential Privacy of Hierarchical Census Data: An Optimization Approach

abstract: This paper is motivated by applications of a Census Bureau interested in releasing aggregate socio-economic data about a large population without revealing sensitive information about any individual. The released information can be the number of individuals living alone, the number of cars they own, or their salary brackets. Recent events have identified some of the privacy challenges faced by these organizations. To address them, this paper presents a novel differential-privacy mechanism for releasing hierarchical counts of individuals. The counts are reported at multiple granularities (e.g., the national, state, and county levels) and must be consistent across all levels. The core of the mechanism is an optimization model that redistributes the noise introduced to achieve differential privacy in order to meet the consistency constraints between the hierarchical levels. The key technical contribution of the paper shows that this optimization problem can be solved in polynomial time by exploiting the structure of its cost functions. Experimental results on very large, real datasets show that the proposed mechanism provides improvements of up to two orders of magnitude in terms of computational efficiency and accuracy with respect to other state-of-the-art techniques.


title: Photoemission from the gas phase using soft x-ray fs pulses: An investigation of the space-charge effects

abstract: An experimental and computational investigation of the space-charge effects occurring in ultrafast photoelectron spectroscopy from the gas phase is presented. The target sample CF$_3$I is excited by ultrashort (100 fs) far-ultraviolet radiation pulses produced by a free-electron laser. The modification of the energy distribution of the photoelectrons, i.e. the shift and broadening of the spectral structures, is monitored as a function of the pulse intensity. The experimental results are compared with computational simulations which employ a Barnes-Hut algorithm to calculate the effect of individual Coulomb forces acting among the particles. In the presented model, a survey spectrum acquired at low radiation fluence is used to determine the initial energy distribution of the electrons after the photoemission event. The spectrum modified by the space-charge effects is then reproduced by $N$-body calculations that simulate the dynamics of the photoelectrons subject to the individual mutual Coulomb repulsion and to the attractive force of the positive ions. The employed numerical method accounts for the space-charge effects on the energy distribution and allows to reproduce the complete photoelectron spectrum and not just a specific photoemission structure. The simulations also provide information on the time evolution of the space-charge effects on the picosecond scale. Differences with the case of photoemission from solid samples are highlighted and discussed. The presented simulation procedure, although it omits the analysis of angular distribution, constitutes an effective simplified model that allows to predict and account for space-charge effects on the photoelectron energy spectrum in time-resolved photoemission experiments with high-intensity pulsed sources.


title: Could the 2.6 $M_\odot$ object in GW190814 be a primordial black hole?

abstract: On June 20, 2020, the LIGO-Virgo collaboration announced the discovery of GW190814, a gravitational wave event originating from a binary system merger between a black hole of mass $M_1 = 23.2^{+1.1} _ {-1.0}M_\odot$ and an unidentified object with a mass of $M_2 = 2.59^{+0.08} _ {-0.09}M_\odot$. This second object would be either the heaviest neutron star or lightest black hole observed to date. Here we investigate the possibility of the $\sim 2.6M_\odot$ object being a primordial black hole (PBH). We find that a primordial black hole explanation to GW190814 is unlikely as it is limited by the formation rate of the primary stellar progenitor and the observed merger rates of $\mathcal{O}(20)M_\odot$ massive black hole pairs.


title: The $\Pi$-operator on Some Conformally Flat Manifolds and the Upper Half Space

abstract: The $\Pi$-operator, also known as Ahlfors-Beurling transform, plays an important role in solving the existence of locally quasiconformal solutions of Beltrami equations. In this paper, we first construct the $\Pi$-operator on a general Clifford-Hilbert module. This $\Pi$-operator is also an $L^2$ isometry. Further, it can also be used for solving certain Beltrami equations when the Hilbert space is the $L^2$ space of a measure space. Then, we show that this technique can be applied to construct the classical $\Pi$-operator in the complex plane and some other examples on some conformally flat manifolds, which are constructed by $U/\Gamma$, where $U$ is a simply connected subdomain of either $\mathbb{R}^{n}$ or $\mathbb{S}^{n}$, and $\Gamma$ is a Kleinian group acting discontinuously on $U$. The $\Pi$-operators on those manifolds also preserve the isometry property in certain $L^2$ spaces, and their $L^p$ norms are bounded by the $L^p$ norms of the $\Pi$-operators on $\mathbb{R}^{n}$ or $\mathbb{S}^{n}$, depending on where $U$ lies. The applications of the $\Pi$-operator to solutions of the Beltrami equations on those conformally flat manifolds are also discussed. At the end, we investigate the $\Pi$-operator theory in the upper-half space with the hyperbolic metric.


title: A new way to classify 2D higher order quantum superintegrable systems

abstract: We revise a method by Kalnins, Kress and Miller (2010) for constructing a canonical form for symmetry operators of arbitrary order for the Schr\"odinger eigenvalue equation $H\Psi \equiv (\Delta_2 +V)\Psi=E\Psi$ on any 2D Riemannian manifold, real or complex, that admits a separation of variables in some orthogonal coordinate system. We apply the method, as an example, to revisit the Tremblay and Winternitz (2010) derivation of the Painlev\'e VI potential for a 3rd order superintegrable flat space system that separates in polar coordinates and, as new results, we give a listing of the possible potentials on the 2-sphere that separate in spherical coordinates and 2-hyperbolic (two-sheet) potentials separating in horocyclic coordinates. In particular, we show that the Painlev\'e VI potential also appears for a 3rd order superintegrable system on the 2-sphere that separates in spherical coordinates, as well as a 3rd order superintegrable system on the 2-hyperboloid that separates in spherical coordinates and one that separates in horocyclic coordinates. Our aim is to develop tools for analysis and classification of higher order superintegrable systems on any 2D Riemannian space, not just Euclidean space.


title: Heat flow on time-dependent manifolds

abstract: We establish effective existence and uniqueness for the heat flow on time-dependent Riemannian manifolds, under minimal assumptions tailored towards the study of Ricci flow through singularities. The main point is that our estimates only depend on an upper bound for the logarithmic derivative of the volume measure. In particular, our estimates hold for any Ricci flow with scalar curvature bounded below, and such a lower bound of course depends only on the initial data.


title: Kernel Density Estimation based Factored Relevance Model for Multi-Contextual Point-of-Interest Recommendation

abstract: An automated contextual suggestion algorithm is likely to recommend contextually appropriate and personalized 'points-of-interest' (POIs) to a user, if it can extract information from the user's preference history (exploitation) and effectively blend it with the user's current contextual information (exploration) to predict a POI's 'appropriateness' in the current context. To balance this trade-off between exploitation and exploration, we propose an unsupervised, generic framework involving a factored relevance model (FRLM), constituting two distinct components, one pertaining to historical contexts, and the other corresponding to the current context. We further generalize the proposed FRLM by incorporating the semantic relationships between terms in POI descriptors using kernel density estimation (KDE) on embedded word vectors. Additionally, we show that trip-qualifiers, (e.g. 'trip-type', 'accompanied-by') are potentially useful information sources that could be used to improve the recommendation effectiveness. Using such information is not straight forward since users' texts/reviews of visited POIs typically do not explicitly contain such annotations. We undertake a weakly supervised approach to predict the associations between the review-texts in a user profile and the likely trip contexts. Our experiments, conducted on the TREC contextual suggestion 2016 dataset, demonstrate that factorization, KDE-based generalizations, and trip-qualifier enriched contexts of the relevance model improve POI recommendation.


title: Modeling Generalization in Machine Learning: A Methodological and Computational Study

abstract: As machine learning becomes more and more available to the general public, theoretical questions are turning into pressing practical issues. Possibly, one of the most relevant concerns is the assessment of our confidence in trusting machine learning predictions. In many real-world cases, it is of utmost importance to estimate the capabilities of a machine learning algorithm to generalize, i.e., to provide accurate predictions on unseen data, depending on the characteristics of the target problem. In this work, we perform a meta-analysis of 109 publicly-available classification data sets, modeling machine learning generalization as a function of a variety of data set characteristics, ranging from number of samples to intrinsic dimensionality, from class-wise feature skewness to $F1$ evaluated on test samples falling outside the convex hull of the training set. Experimental results demonstrate the relevance of using the concept of the convex hull of the training data in assessing machine learning generalization, by emphasizing the difference between interpolated and extrapolated predictions. Besides several predictable correlations, we observe unexpectedly weak associations between the generalization ability of machine learning models and all metrics related to dimensionality, thus challenging the common assumption that the \textit{curse of dimensionality} might impair generalization in machine learning.


title: Conditional separable effects

abstract: Researchers are often interested in treatment effects on outcomes that are only defined conditional on a post-treatment event status. For example, in a study of the effect of different cancer treatments on quality of life at end of follow-up, the quality of life of individuals who die during the study is undefined. In these settings, a naive contrast of outcomes conditional on the post-treatment variable is not an average causal effect, even in a randomized experiment. Therefore the effect in the principal stratum of those who would have the same value of the post-treatment variable regardless of treatment, such as the always survivors in a truncation by death setting, is often advocated for causal inference. While this principal stratum effect is a well defined causal contrast, it is often hard to justify that it is relevant to scientists, patients or policy makers, and it cannot be identified without relying on unfalsifiable assumptions. Here we formulate alternative estimands, the conditional separable effects, that have a natural causal interpretation under assumptions that can be falsified in a randomized experiment. We provide identification results and introduce different estimators, including a doubly robust estimator derived from the nonparametric influence function. As an illustration, we estimate a conditional separable effect of chemotherapies on quality of life in patients with prostate cancer, using data from a randomized clinical trial.


title: A Survey on the Evaluation of Clone Detection Performance and Benchmarking

abstract: There are a great many clone detection tools proposed in the literature. In this paper, we investigate the state of clone detection tool evaluation. We begin by surveying the clone detection benchmarks, and performing a multi-faceted evaluation and comparison of their features and capabilities. We then survey the existing clone detection tool and technique publications, and evaluate how the authors of these works evaluate their own tools/techniques. We rank the individual works by how well they measure recall, precision, execution time and scalability. We select the works the best evaluate all four metrics as exemplars that should be considered by future researchers publishing clone detection tools/techniques when designing the empirical evaluation of their tool/technique. We measure statistics on tool evaluation by the authors, and find that evaluation is poor amongst the authors. We finish our investigation into clone detection evaluation by surveying the existing tool comparison studies, including both the qualitative and quantitative studies.


title: Finite Planes, Zigzag Sequences, Fibonacci Numbers, Artin's Conjecture and Trinomials

abstract: We begin by considering faithful matrix representations of elementary abelian groups in prime characteristic. The representations considered are seen to be determined up to change of bases by a single number. Studying this number leads to a new family of polynomials which exhibit a number of special properties. These polynomials satisfy a three term recursion and are closely related to zigzag zero-one sequences. Interpreting the polynomials for the "prime" 1 yields the classical Morgan-Voyce polynomials, which form twoorthogonal families of polynomials and which have applications in the study of electrical resistance. Study of the general polynomials reveals deep connections with the Fibonacci series, the order of appearance of prime numbers in the Fibonacci sequence, the order of elements in cyclic groups, Artin's conjecture on primitive roots and the factorization of trinomials over finite fields.


title: A deformation theorem for Poincar\'e duality pairs in dimension 3

abstract: We prove the analogue of Johannson's Deformation Theorem for PD3 pairs.


title: Recursive Analytic Solution of Nonlinear Optimal Regulators

abstract: The paper develops an optimal regulator for a general class of multi-input affine nonlinear systems minimizing a nonlinear cost functional with infinite horizon. The cost functional is general enough to enforce saturation limits on the control input if desired. An efficient algorithm utilizing tensor algebra is employed to compute the tensor coefficients of the Taylor series expansion of the value function (i.e., optimal cost-to-go). The tensor coefficients are found by solving a set of nonlinear matrix equations recursively generalizing the well-known linear quadratic solution. The resulting solution generates the optimal controller as a nonlinear function of the state vector up to a prescribed truncation order. Moreover, a complete convergence of the computed solution together with an estimation of its applicability domain are provided to further guide the user. The algorithm's computational complexity is shown to grow only polynomially with respect to the series order. Finally, several nonlinear examples including some with input saturation are presented to demonstrate the efficacy of the algorithm to generate high order Taylor series solution of the optimal controller.


title: Quaternion Feedback Based Autonomous Control of a Quadcopter UAV with Thrust Vectoring Rotors

abstract: In this paper, we present an autonomous flight controller for a quadcopter with thrust vectoring capabilities. This UAV falls in the category of multirotors with tilt-motion enabled rotors. Since the vehicle considered is over-actuated in nature, the dynamics and control allocation have to be analysed carefully. Moreover, the possibility of hovering at large attitude maneuvers of this novel vehicle requires singularity-free attitude control. Hence, quaternion state feedback is utilized to compute the control commands for the UAV motors while avoiding the gimbal lock condition experienced by Euler angle based controllers. The quaternion implementation also reduces the overall complexity of state estimation due to absence of trigonometric parameters. The quadcopter dynamic model and state space is utilized to design the attitude controller and control allocation for the UAV. The control allocation, in particular, is derived by linearizing the system about hover condition. This mathematical method renders the control allocation more accurate than existing approaches. Lyapunov stability analysis of the attitude controller is shown to prove global stability. The quaternion feedback attitude controller is commanded by an outer position controller loop which generates rotor-tilt and desired quaternions commands for the system. The performance of the UAV is evaluated by numerical simulations for tracking attitude step commands and for following a way-point navigation mission.


title: A Dual Representation in Spectral Algebraic Geometry

abstract: Given a spectral Deligne-Mumford stack $X$, we define a perception of $X$ to be a collection of a certain class of morphisms $Y \rightarrow X$. For the class of affine morphisms in SpDM, we show that from QCoh($X$) on can extract the affine perception $\text{Aff}_X$ of $X$ on the one hand, and a subcategory of an $\infty$-category of representations $\text{Rep}_{\mathfrak{g}_*}$ of a dg Lie algebra $\mathfrak{g}_*$ associated with $X$ on the other. For the class of local morphisms $\text{Sp\'et } R \rightarrow X$, the local perception of $X$ is given by the functor $\mathbf{X} = \text{Hom}(\text{Sp\'et}(-), X)$ it represents. If $\mathbf{X}$ is a geometric stack, Tannaka duality allows us to recover $\mathbf{X}$ from $\text{QCoh}(\mathbf{X})$, from which we can also get, after base change, a subcategory of $\text{Rep}_{\mathfrak{g}_*}$. We generalize those results by considering functors $\mathbf{X}: \text{CAlg}^{\text{cn}} \rightarrow \mathcal{S}$ that are representable in accordance with the spectral Artin representability theorem of Lurie.


title: Quadratic Klein-Gordon equations with a potential in one dimension

abstract: This paper proposes a fairly general new point of view on the question of asymptotic stability of (topological) solitons. Our approach is based on the use of the distorted Fourier transform at the nonlinear level; it does not rely on Strichartz or virial estimates and is therefore able to treat low power nonlinearities (hence also non-localized solitons) and capture the global (in space and time) behavior of solutions. More specifically, we consider quadratic nonlinear Klein-Gordon equations with a potential in one space dimension. The potential is assumed to be regular, decaying, and either generic or exceptional (with some additional parity assumptions). Assuming that the associated Schr\"odinger operator has no negative eigenvalues, we obtain global-in-time bounds, including sharp pointwise decay and modified asymptotics, for small solutions. These results have implications for the asymptotic stability of solitons, or topological solitons, for a variety of problems. For instance, we obtain full asymptotic stability of kinks with respect to odd perturbations for the double Sine-Gordon problem (in an appropriate range of the deformation parameter). For the $\phi^4$ problem, we obtain asymptotic stability of the kink (with respect to odd perturbations) when the coupling to the internal mode appearing in the linearization around it is neglected. Our results also go beyond these examples since our approach allows for the presence of a fully coherent phenomenon at the level of quadratic interactions, which creates a degeneracy in distorted Fourier space. We devise a suitable framework that incorporates this, and use multilinear harmonic analysis in the distorted setting to control all nonlinear interactions.


title: A Distributionally Robust Optimization Approach to the NASA Langley Uncertainty Quantification Challenge

abstract: We study a methodology to tackle the NASA Langley Uncertainty Quantification Challenge problem, based on an integration of robust optimization, more specifically a recent line of research known as distributionally robust optimization, and importance sampling in Monte Carlo simulation. The main computation machinery in this integrated methodology boils down to solving sampled linear programs. We will illustrate both our numerical performances and theoretical statistical guarantees obtained via connections to nonparametric hypothesis testing.


title: Lookahead-Bounded Q-Learning

abstract: We introduce the lookahead-bounded Q-learning (LBQL) algorithm, a new, provably convergent variant of Q-learning that seeks to improve the performance of standard Q-learning in stochastic environments through the use of ``lookahead'' upper and lower bounds. To do this, LBQL employs previously collected experience and each iteration's state-action values as dual feasible penalties to construct a sequence of sampled information relaxation problems. The solutions to these problems provide estimated upper and lower bounds on the optimal value, which we track via stochastic approximation. These quantities are then used to constrain the iterates to stay within the bounds at every iteration. Numerical experiments on benchmark problems show that LBQL exhibits faster convergence and more robustness to hyperparameters when compared to standard Q-learning and several related techniques. Our approach is particularly appealing in problems that require expensive simulations or real-world interactions.


title: Harvesting, Detecting, and Characterizing Liver Lesions from Large-scale Multi-phase CT Data via Deep Dynamic Texture Learning

abstract: Non-invasive radiological-based lesion characterization and identification, e.g., to differentiate cancer subtypes, has long been a major aim to enhance oncological diagnosis and treatment procedures. Here we study a specific population of human subjects, with the hope of reducing the need for invasive surgical biopsies of liver cancer patients, which can cause many harmful side-effects. To this end, we propose a fully-automated and multi-stage liver tumor characterization framework designed for dynamic contrast computed tomography (CT). Our system comprises four sequential processes of tumor proposal detection, tumor harvesting, primary tumor site selection, and deep texture-based tumor characterization. Our main contributions are that, (1) we propose a 3D non-isotropic anchor-free detection method for liver lesions; (2) we present and validate spatially adaptivedeep texture (SaDT) learning, which allows for more precise characterization of liver lesions; (3) using a semi-automatic process, we bootstrap off of 200 gold standard annotations to curate another 1001 patients. Experimental evaluations demonstrate that our new data curation strategy, combined with the SaDT deep dynamic texture analysis, can effectively improve the mean F1 scores by >8.6% compared with baselines, in differentiating four major liver lesion types. Our F1 score of (hepatocellular carcinoma versus remaining subclasses) is 0.763, which is higher than reported human observer performance using dynamic CT and comparable to an advanced magnetic resonance imagery protocol. Apart from demonstrating the benefits of our data curation approach and physician-inspired workflow, these results also indicate that analyzing texture features, instead of standard object-based analysis, is a promising strategy for lesion differentiation.


title: Quantum retrodiction made fully symmetric

abstract: Quantum retrodiction is a time-symmetric approach to quantum mechanics with applications in a number of important problems. One of the major challenges to its more widespread applicability is the restriction of its symmetric formalism to unbiased sources. The main result of this paper is to develop a general theory yielding a symmetric formalism for arbitrary sources. We then highlight on a specific example, by presenting the optimal solution to the retrodiction problem that is dual to unambiguous state discrimination, how the generalized approach works. We also show how this formalism leads to a symmetric formulation of the communication channel between Alice and Bob and point to the intrinsic connection between retrodiction and the no-signaling principle.


title: Simulation of Brain Resection for Cavity Segmentation Using Self-Supervised and Semi-Supervised Learning

abstract: Resective surgery may be curative for drug-resistant focal epilepsy, but only 40% to 70% of patients achieve seizure freedom after surgery. Retrospective quantitative analysis could elucidate patterns in resected structures and patient outcomes to improve resective surgery. However, the resection cavity must first be segmented on the postoperative MR image. Convolutional neural networks (CNNs) are the state-of-the-art image segmentation technique, but require large amounts of annotated data for training. Annotation of medical images is a time-consuming process requiring highly-trained raters, and often suffering from high inter-rater variability. Self-supervised learning can be used to generate training instances from unlabeled data. We developed an algorithm to simulate resections on preoperative MR images. We curated a new dataset, EPISURG, comprising 431 postoperative and 269 preoperative MR images from 431 patients who underwent resective surgery. In addition to EPISURG, we used three public datasets comprising 1813 preoperative MR images for training. We trained a 3D CNN on artificially resected images created on the fly during training, using images from 1) EPISURG, 2) public datasets and 3) both. To evaluate trained models, we calculate Dice score (DSC) between model segmentations and 200 manual annotations performed by three human raters. The model trained on data with manual annotations obtained a median (interquartile range) DSC of 65.3 (30.6). The DSC of our best-performing model, trained with no manual annotations, is 81.7 (14.2). For comparison, inter-rater agreement between human annotators was 84.0 (9.9). We demonstrate a training method for CNNs using simulated resection cavities that can accurately segment real resection cavities, without manual annotations.


title: A global decomposition theorem for excluding immersions in graphs with no edge-cut of order three

abstract: A graph $G$ contains another graph $H$ as an immersion if $H$ can be obtained from a subgraph of $G$ by splitting off edges and removing isolated vertices. There is an obvious necessary degree condition for the immersion containment: if $G$ contains $H$ as an immersion, then for every integer $k$, the number of vertices of degree at least $k$ in $G$ is at least the number of vertices of degree at least $k$ in $H$. In this paper, we prove that this obvious necessary condition is "nearly" sufficient for graphs with no edge-cut of order 3: for every graph $H$, every $H$-immersion free graph with no edge-cut of order 3 can be obtained by an edge-sum of graphs, where each of the summands is obtained from a graph violating the obvious degree condition by adding a bounded number of edges. The condition for having no edge-cut of order 3 is necessary. A simple application of this theorem shows that for every graph $H$ of maximum degree $d \geq 4$, there exists an integer $c$ such that for every positive integer $m$, there are at most $c^m$ unlabelled $d$-edge-connected $H$-immersion free $m$-edge graphs with no isolated vertex, while there are superexponentially many unlabelled $(d-1)$-edge-connected $H$-immersion free $m$-edge graphs with no isolated vertex. Our structure theorem will be applied in a forthcoming paper about determining the clustered chromatic number of the class of $H$-immersion free graphs.


title: Extending Standard Atomic Kernel Model with New Interpretation of Strong Forces

abstract: This paper gives an extended model of the atomic nucleus - we call it the YY model, which allows a new description for strong forces from the well-known Standard Model. The forces that hold the nucleus together (protons and neutrons) can be expressed in a new way. Based on the YY model, more structural description details for an atomic nucleus will be possible than is the case with the conventional description. The YY model is compatible with the standard model. However, it allows for very delicate considerations when modelling the distribution of protons and neutrons within or around an atomic nucleus. Furthermore, it can explain many subatomic processes in an elegant way. The YY model predicts some subatomic aspects that can be explored in a deeper step. Our approach also includes a native common root for the description of macrophysics (space, dark matter and cosmology). Following a model-driven approach - a methodology widely used in computer science and informatics - the investigations in this paper will completely dispense with mathematical formulations. In addition, energy balances in the transformations are left out. Many different aspects that can be derived from this new mechanism can then be verified. We hope to gain the confidence of many other physicists in the YY model. They could make detailed theoretical and experimental verifications by adding additional descriptive elements and linking the YY model to the known quantum field theories and the widely accepted big bang theories for space and cosmology, especially for research on dark matter.


title: Algebraic Conditions for Conformal Superintegrability in Arbitrary Dimension

abstract: We show that the definition of a second order superintegrable system on a (pseudo-)Riemannian manifold gives rise to a conformally invariant notion of superintegrability. Conformal equivalence is the natural extension of the well-known St\"ackel transform, which in turn originates from the classical Maupertuis-Jacobi principle. We extend our recently developed algebraic geometric approach for the classification of second order superintegrable systems in arbitrarily high dimension to conformally superintegrable systems, which are presented via conformal scale choices of second order superintegrable systems defined within a conformal geometry. For superintegrable systems on constant curvature spaces, we find that the conformal scales of St\"ackel equivalent systems arise from eigenfunctions of the Laplacian and that their equivalence is characterised by a conformal density of weight two. Our approach yields an algebraic equation that governs the classification under conformal equivalence for a prolific class of second order conformally superintegrable systems. This class contains all non-degenerate examples known to date, and is given by a simple algebraic constraint of degree two on a general harmonic cubic form. In this way the yet unsolved classification problem is put into the reach of algebraic geometry and geometric invariant theory. In particular, no obstruction exists in dimension three, and thus the known classification of conformally superintegrable systems is reobtained in the guise of an unrestricted univariate sextic. In higher dimensions, the obstruction is new and has never been revealed by traditional approaches.


title: Spatially Resolved Thermoelectric Effects in Operando Semiconductor-Metal Nanowire Heterostructures

abstract: The thermoelectric properties of a nanoscale germanium segment connected by aluminium nanowires are studied using scanning thermal microscopy. The germanium segment of 168\,nm length features atomically sharp interfaces to the aluminium wires and is surrounded by an Al$_2$O$_3$ shell. The temperature distribution along the self-heated nanowire is measured as a function of the applied electrical current, for both Joule and Peltier effects. An analysis is developed that is able to extract the thermal and thermoelectric properties including thermal conductivity, the thermal boundary resistance to the substrate and the Peltier coefficient from a single measurement. Our investigations demonstrate the potential of quantitative measurements of temperature around self-heated devices and structures down to the scattering length of heat carriers.


title: GPU-Accelerated Discontinuous Galerkin Methods: 30x Speedup on 345 Billion Unknowns

abstract: A discontinuous Galerkin method for the discretization of the compressible Euler equations, the governing equations of inviscid fluid dynamics, on Cartesian meshes is developed for use of Graphical Processing Units via OCCA, a unified approach to performance portability on multi-threaded hardware architectures. A 30x time-to-solution speedup over CPU-only implementations using non-CUDA-Aware MPI communications is demonstrated up to 1,536 NVIDIA V100 GPUs and parallel strong scalability is shown up to 6,144 NVIDIA V100 GPUs for a problem containing 345 billion unknowns. A comparison of CUDA-Aware MPI communication to non-GPUDirect communication is performed demonstrating an additional 24% speedup on eight nodes composed of 32 NVIDIA V100 GPUs.

categories: physics.comp-ph cs.DC cs.NA cs.PF math.NA physics.flu-dyn


title: MIMC-VINS: A Versatile and Resilient Multi-IMU Multi-Camera Visual-Inertial Navigation System

abstract: As cameras and inertial sensors are becoming ubiquitous in mobile devices and robots, it holds great potential to design visual-inertial navigation systems (VINS) for efficient versatile 3D motion tracking which utilize any (multiple) available cameras and inertial measurement units (IMUs) and are resilient to sensor failures or measurement depletion. To this end, rather than the standard VINS paradigm using a minimal sensing suite of a single camera and IMU, in this paper we design a real-time consistent multi-IMU multi-camera (MIMC)-VINS estimator that is able to seamlessly fuse multi-modal information from an arbitrary number of uncalibrated cameras and IMUs. Within an efficient multi-state constraint Kalman filter (MSCKF) framework, the proposed MIMC-VINS algorithm optimally fuses asynchronous measurements from all sensors, while providing smooth, uninterrupted, and accurate 3D motion tracking even if some sensors fail. The key idea of the proposed MIMC-VINS is to perform high-order on-manifold state interpolation to efficiently process all available visual measurements without increasing the computational burden due to estimating additional sensors' poses at asynchronous imaging times. In order to fuse the information from multiple IMUs, we propagate a joint system consisting of all IMU states while enforcing rigid-body constraints between the IMUs during the filter update stage. Lastly, we estimate online both spatiotemporal extrinsic and visual intrinsic parameters to make our system robust to errors in prior sensor calibration. The proposed system is extensively validated in both Monte-Carlo simulations and real-world experiments.


title: Monolithic Multigrid for Magnetohydrodynamics

abstract: The magnetohydrodynamics (MHD) equations model a wide range of plasma physics applications and are characterized by a nonlinear system of partial differential equations that strongly couples a charged fluid with the evolution of electromagnetic fields. After discretization and linearization, the resulting system of equations is generally difficult to solve due to the coupling between variables, and the heterogeneous coefficients induced by the linearization process. In this paper, we investigate multigrid preconditioners for this system based on specialized relaxation schemes that properly address the system structure and coupling. Three extensions of Vanka relaxation are proposed and applied to problems with up to 170 million degrees of freedom and fluid and magnetic Reynolds numbers up to 400 for stationary problems and up to 20,000 for time-dependent problems.


title: On polynomials counting essentially irreducible maps

abstract: We consider maps on genus-$g$ surfaces with $n$ (labeled) faces of prescribed even degrees. It is known since work of Norbury that, if one disallows vertices of degree one, the enumeration of such maps is related to the counting of lattice point in the moduli space of genus-$g$ curves with $n$ labeled points and is given by a symmetric polynomial $N_{g,n}(\ell_1,\ldots,\ell_n)$ in the face degrees $2\ell_1, \ldots, 2\ell_n$. We generalize this by restricting to genus-$g$ maps that are essentially $2b$-irreducible for $b\geq 0$, which loosely speaking means that they are not allowed to possess contractible cycles of length less than $2b$ and each such cycle of length $2b$ is required to bound a face of degree $2b$. The enumeration of such maps is shown to be again given by a symmetric polynomial $\hat{N}_{g,n}^{(b)}(\ell_1,\ldots,\ell_n)$ in the face degrees with a polynomial dependence on $b$. These polynomials satisfy (generalized) string and dilaton equations, which for $g\leq 1$ uniquely determine them. The proofs rely heavily on a substitution approach by Bouttier and Guitter and the enumeration of planar maps on genus-$g$ surfaces.


title: Equimeasurable symmetric spaces of measurable function

abstract: In this paper we consider equimeasurable symmetric(rearrangement invariant) spaces $\mathbf{E}_1 = \mathbf{E}_1(\Omega_1,\mathcal{F}_1,\mu_1)$ and $\mathbf{E}_2 = \mathbf{E}_2(\Omega_2,\mathcal{F}_2,\mu_2)$ on a measure spaces $(\Omega_1, \mathcal{F}_1,\mu_1)$ and $(\Omega_2,\mathcal{F}_2,\mu_2)$ with finite or infinite $\sigma$-finite non-atomic measures $\mu_1$ and $\mu_2$. If $\mathbf{E}_1(\Omega_1,\mathcal{F}_1,\mu_1)$ be a symmetric space on a measure spaces $(\Omega_1, \mathcal{F}_1,\mu_1)$ and $(\Omega_2,\mathcal{F}_2,\mu_2)$ be a measure space such that $\mu_1 (\Omega_1)=\mu_2(\Omega_2)$, then there exists a unique symmetric space $\mathbf{E}_2(\Omega_2,\mathcal{F}_2,\mu_2)$ on $(\Omega_2,\mathcal{F}_2,\mu_2)$, which is equimeasurable to $ \mathbf{E}_1(\Omega_1,\mathcal{F}_1,\mu_1)$.


title: A Fast Distributed Algorithm for $(\Delta + 1)$-Edge-Coloring

abstract: We present a deterministic distributed algorithm in the LOCAL model that finds a proper $(\Delta + 1)$-edge-coloring of an $n$-vertex graph of maximum degree $\Delta$ in $\mathrm{poly}(\Delta, \log n)$ rounds. This is the first nontrivial distributed edge-coloring algorithm that uses only $\Delta+1$ colors (matching the bound given by Vizing's theorem). Our approach is inspired by the recent proof of the measurable version of Vizing's theorem due to Greb\'ik and Pikhurko.


title: PyTorch Distributed: Experiences on Accelerating Data Parallel Training

abstract: This paper presents the design, implementation, and evaluation of the PyTorch distributed data parallel module. PyTorch is a widely-adopted scientific computing package used in deep learning research and applications. Recent advances in deep learning argue for the value of large datasets and large models, which necessitates the ability to scale out model training to more computational resources. Data parallelism has emerged as a popular solution for distributed training thanks to its straightforward principle and broad applicability. In general, the technique of distributed data parallelism replicates the model on every computational resource to generate gradients independently and then communicates those gradients at each iteration to keep model replicas consistent. Despite the conceptual simplicity of the technique, the subtle dependencies between computation and communication make it non-trivial to optimize the distributed training efficiency. As of v1.5, PyTorch natively provides several techniques to accelerate distributed data parallel, including bucketing gradients, overlapping computation with communication, and skipping gradient synchronization. Evaluations show that, when configured appropriately, the PyTorch distributed data parallel module attains near-linear scalability using 256 GPUs.


title: Random walks on dense subgroups of locally compact groups

abstract: Let $\Gamma$ be a countable discrete group, $H$ a lcsc totally disconnected group and $\rho : \Gamma \rightarrow H$ a homomorphism with dense image. We develop a general and explicit technique which provides, for every compact open subgroup $L < H$ and bi-$L$-invariant probability measure $\theta$ on $H$, a Furstenberg discretization $\tau$ of $\theta$ such that the Poisson boundary of $(H,\theta)$ is a $\tau$-boundary. Among other things, this technique allows us to construct examples of finitely supported random walks on certain lamplighter groups and solvable Baumslag-Solitar groups, whose Poisson boundaries are prime, but not $L^p$-irreducible for any $p \geq 1$, answering a conjecture of Bader-Muchnik in the negative. Furthermore, we give an example of a countable discrete group $\Gamma$ and two spread-out probability measures $\tau_1$ and $\tau_2$ on $\Gamma$ such that the boundary entropy spectrum of $(\Gamma,\tau_1)$ is an interval, while the boundary entropy spectrum of $(\Gamma,\tau_2)$ is a Cantor set.


title: How many can you infect? Simple (and naive) methods of estimating the reproduction number

abstract: This is a pedagogical paper on estimating the number of people that can be infected by one infectious person during an epidemic outbreak, known as the reproduction number. Knowing the number is crucial for developing policy responses. There are generally two types of such a number, i.e., basic and effective (or instantaneous). While basic reproduction number is the average expected number of cases directly generated by one case in a population where all individuals are susceptible, effective reproduction number is the number of cases generated in the current state of a population. In this paper, we exploit the deterministic susceptible-infected-removed (SIR) model to estimate them through three different numerical approximations. We apply the methods to the pandemic COVID-19 in Italy to provide insights into the spread of the disease in the country. We see that the effect of the national lockdown in slowing down the disease exponential growth appeared about two weeks after the implementation date. We also discuss available improvements to the simple (and naive) methods that have been made by researchers in the field. Authors of this paper are members of the SimcovID (Simulasi dan Pemodelan COVID-19 Indonesia) collaboration.


title: Global optimization using mixed integer quadratic programming on non-convex two-way interaction truncated linear multivariate adaptive regression splines

abstract: Multivariate adaptive regression splines (MARS) is a flexible statistical modeling method that has been popular for data mining applications. MARS has also been employed to approxmiate unknown relationships in optimzation for complex systems, including surrogate optimization, dynamic programming, and two-stage stochastic programming. Given the increasing desire to optimize real world systems, this paper presents an approach to globally optimize a MARS model that allows up to two-way interaction terms that are products of truncated linear univariate functions (TITL-MARS). Specifally, such a MARS model consists of linear and quadratic structure. This structure is exploited to formulate a mixed integer quadratic programming problem (TITL-MARS-OPT). To appreciate the contribution of TITL-MARS-OPT, one must recognize that popular heurstic optimization approaches, such as evolutionary algorithms, do not guarantee global optimality and can be computationally slow. The use of MARS maintains the flexibility of modeling within TITL-MARS-OPT while also taking advantage of the linear modeling structure of MARS to enable global optimality. Computational results compare TITL-MARS-OPT with a genetic algorithm for two types of cases. First, a wind farm power distribution case study is described and then other TITL-MARS forms are tested. The results show the superiority of TITL-MARS-OPT over the genetic algorithm in both accuracy and computational time.


title: The Null and Force-Free Electromagnetic Field

abstract: This paper describes the electrodynamics of a null and force-free field in completely geometric terms. As was previously established in \cite{Menon_FF20}, solutions to force-free electrodynamics are governed by the existence of certain special types of foliations of spacetime. Here the nature of the foliations in a coordinate-free formalism in the null case is prescribed. All of the general results are illustrated by constructing a null, force-free electrodynamic field in a Friedmann-Lemaitre-Robertson- Walker (FLRW) spacetime.


title: Geometrical interpretation of the wave-pilot theory and manifestation of the spinor fields

abstract: Using the hydrodynamical formalism of quantum mechanics for a Schrodinger spinning particle, developed by T. Takabayashi, J. P. Vigier and followers, that involves vortical flows, we propose the new geometrical interpretation of the wave-pilot theory. The spinor wave in this interpretation represents an objectively real field and the evolution of a material particle controlled by the wave is a manifestation of the geometry of space. We assume this field to have a geometrical nature, basing on the idea that the intrinsic angular momentum, the spin, modifies the geometry of the space, which becomes a manifold, that is represented as a vector bundle with a base formed by the translational coordinates and time, and the fiber of the bundle, specified at each point by the field of an tetrad $e^a_{\mu}$, forms from the bilinear combinations of spinor wave function. It was shown, that the spin vector rotates following the geodesic of the space with torsion and the particle moves according to the geometrized guidance equation. This fact explains the self-action of the spinning particle. We show that the curvature and torsion of the spin vector line is determined by the space torsion of the absolute parallelism geometry.


title: Motion Pyramid Networks for Accurate and Efficient Cardiac Motion Estimation

abstract: Cardiac motion estimation plays a key role in MRI cardiac feature tracking and function assessment such as myocardium strain. In this paper, we propose Motion Pyramid Networks, a novel deep learning-based approach for accurate and efficient cardiac motion estimation. We predict and fuse a pyramid of motion fields from multiple scales of feature representations to generate a more refined motion field. We then use a novel cyclic teacher-student training strategy to make the inference end-to-end and further improve the tracking performance. Our teacher model provides more accurate motion estimation as supervision through progressive motion compensations. Our student model learns from the teacher model to estimate motion in a single step while maintaining accuracy. The teacher-student knowledge distillation is performed in a cyclic way for a further performance boost. Our proposed method outperforms a strong baseline model on two public available clinical datasets significantly, evaluated by a variety of metrics and the inference time. New evaluation metrics are also proposed to represent errors in a clinically meaningful manner.


title: Using Bluetooth Low Energy (BLE) Signal Strength Estimation to Facilitate Contact Tracing for COVID-19

abstract: The process of contact tracing to reduce the spread of highly infectious and life-threatening diseases has traditionally been a primarily manual process managed by public health entities. This process becomes challenged when faced with a pandemic of the proportions of SARS-CoV2. Digital contact tracing has been proposed as way to augment manual contact tracing and lends itself to widely proliferated devices such as cell phones and wearables. This paper describes a method and analysis of determining whether two cell phones, carried by humans, were in persistent contact of no more than 6 feet over 15 minutes using Bluetooth Low Energy signals. The paper describes the approach to detecting these signals, as well as a data-driven performance analysis showing that larger numbers of samples coupled with privacy preserving auxiliary information improves detection performance.


title: Exponential single server queues in an interactive random environment

abstract: We consider exponential single server queues with state-dependent arrival and service rates which evolve under influences of external environments. The transitions of the queues are influenced by the environment's state and the movements of the environment depend on the status of the queues (bi-directional interaction). The environment is constructed in a way to encompass various models from the recent Operations Research literature, where a queue is coupled with an inventory or with reliability issues. With a Markovian joint queueing-environment process we prove separability for a large class of such interactive systems, i.e. the steady state distribution is of product form and explicitly given. The queue and the environment processes decouple asymptotically and in steady state. For non-separable systems we develop ergodicity and exponential ergodicity criteria via Lyapunov functions. By examples we explain principles for bounding departure rates of served customers (throughputs) of non-separable systems by throughputs of related separable systems as upper and lower bound.


title: Generalizable Cone Beam CT Esophagus Segmentation Using Physics-Based Data Augmentation

abstract: Automated segmentation of esophagus is critical in image guided/adaptive radiotherapy of lung cancer to minimize radiation-induced toxicities such as acute esophagitis. We developed a semantic physics-based data augmentation method for segmenting esophagus in both planning CT (pCT) and cone-beam CT (CBCT) using 3D convolutional neural networks. 191 cases with their pCT and CBCTs from four independent datasets were used to train a modified 3D-Unet architecture with a multi-objective loss function specifically designed for soft-tissue organs such as esophagus. Scatter artifacts and noise were extracted from week 1 CBCTs using power law adaptive histogram equalization method and induced to the corresponding pCT followed by reconstruction using CBCT reconstruction parameters. Moreover, we leverage physics-based artifact induced pCTs to drive the esophagus segmentation in real weekly CBCTs. Segmentations were evaluated using geometric Dice and Hausdorff distance as well as dosimetrically using mean esophagus dose and D5cc. Due to the physics-based data augmentation, our model trained just on the synthetic CBCTs was robust and generalizable enough to also produce state-of-the-art results on the pCTs and CBCTs, achieving 0.81 and 0.74 Dice overlap. Our physics-based data augmentation spans the realistic noise/artifact spectrum across patient CBCT/pCT data and can generalize well across modalities with the potential to improve the accuracy of treatment setup and response analysis.


title: Active Finite Reward Automaton Inference and Reinforcement Learning Using Queries and Counterexamples

abstract: Despite the fact that deep reinforcement learning (RL) has surpassed human-level performances in various tasks, it still has several fundamental challenges. First, most RL methods require intensive data from the exploration of the environment to achieve satisfactory performance. Second, the use of neural networks in RL renders it hard to interpret the internals of the system in a way that humans can understand. To address these two challenges, we propose a framework that enables an RL agent to reason over its exploration process and distill high-level knowledge for effectively guiding its future explorations. Specifically, we propose a novel RL algorithm that learns high-level knowledge in the form of a finite reward automaton by using the L* learning algorithm. We prove that in episodic RL, a finite reward automaton can express any non-Markovian bounded reward functions with finitely many reward values and approximate any non-Markovian bounded reward function (with infinitely many reward values) with arbitrary precision. We also provide a lower bound for the episode length such that the proposed RL approach almost surely converges to an optimal policy in the limit. We test this approach on two RL environments with non-Markovian reward functions, choosing a variety of tasks with increasing complexity for each environment. We compare our algorithm with the state-of-the-art RL algorithms for non-Markovian reward functions, such as Joint Inference of Reward machines and Policies for RL (JIRP), Learning Reward Machine (LRM), and Proximal Policy Optimization (PPO2). Our results show that our algorithm converges to an optimal policy faster than other baseline methods.


title: A review of Bayesian perspectives on sample size derivation for confirmatory trials

abstract: Sample size derivation is a crucial element of the planning phase of any confirmatory trial. A sample size is typically derived based on constraints on the maximal acceptable type I error rate and a minimal desired power. Here, power depends on the unknown true effect size. In practice, power is typically calculated either for the smallest relevant effect size or a likely point alternative. The former might be problematic if the minimal relevant effect is close to the null, thus requiring an excessively large sample size. The latter is dubious since it does not account for the a priori uncertainty about the likely alternative effect size. A Bayesian perspective on the sample size derivation for a frequentist trial naturally emerges as a way of reconciling arguments about the relative a priori plausibility of alternative effect sizes with ideas based on the relevance of effect sizes. Many suggestions as to how such `hybrid' approaches could be implemented in practice have been put forward in the literature. However, key quantities such as assurance, probability of success, or expected power are often defined in subtly different ways in the literature. Starting from the traditional and entirely frequentist approach to sample size derivation, we derive consistent definitions for the most commonly used `hybrid' quantities and highlight connections, before discussing and demonstrating their use in the context of sample size derivation for clinical trials.


title: Bilinear Multipliers of Small Lebesgue spaces

abstract: Let $G$ be a locally compact abelian metric group with Haar measure $\lambda $ and $\hat{G}$ its dual with Haar measure $\mu ,$ and $\lambda ( G) $ is finite. Assume that$~1<p_{i}<\infty $, $p_{i}^{\prime }=\frac{ p_{i}}{p_{i}-1}$, $( i=1,2,3) $ and $\theta \geq 0$. Let $ L^{(p_{i}^{\prime },\theta }( G) ,$ $( i=1,2,3) $ be small Lebesgue spaces. A bounded measurable function $m( \xi ,\eta ) $ defined on $\hat{G}\times \hat{G}$ is said to be a bilinear multiplier on $G$ of type $[ (p_{1}^{\prime };(p_{2}^{\prime };(p_{3}^{\prime }] _{\theta }$ if the bilinear operator $B_{m}$ associated with the symbol $m$, \begin{equation} B_{m}(f,g) ( x) =\sum_{s\in \hat{G} }\sum_{t\in \hat{G}}\hat{f}(s) \hat{g}(t) m(s,t) \langle s+t,x\rangle \end{equation} defines a bounded bilinear operator from $L^{(p_{1}^{\prime },\theta }( G) \times L^{(p_{2}^{\prime },\theta }( G) $ into $ L^{(p_{3}^{\prime },\theta }(G) $. We denote by $BM_{\theta } [ (p_{1}^{\prime };(p_{2}^{\prime };(p_{3}^{\prime }] $ the space of all bilinear multipliers of type $[ (p_{1}^{\prime };(p_{2}^{\prime };(p_{3}^{\prime }] _{\theta }$. In this paper, we discuss some basic properties of the space $BM_{\theta }[ (p_{1}^{\prime };(p_{2}^{\prime };(p_{3}^{\prime }] $ and give examples of bilinear multipliers.


title: Calculating Great Britains half-hourly electrical demand from publicly available data

abstract: Here we present a method to combine half-hourly publicly available electrical generation and interconnector operational data for Great Britain to create a timeseries that approximates its electrical demand. We term the calculated electrical demand ESPENI that is an acronym for Elexon Sum Plus Embedded Net Imports. The method adds value to the original data by combining both transmission and distribution generation data into a single dataset and adding ISO 8601 compatible datetimes to increase interoperability with other timeseries data. Data cleansing is undertaken by visually flagging data errors and then using simple linear interpolation to impute values to replace the flagged data. Publishing the method allows it to be further enhanced or adapted and to be considered and critiqued by a wider community. In addition, the published raw and cleaned data is a valuable resource that saves researchers considerable time in repeating the steps presented in the method to prepare the data for further analysis. The data is a public record of the decarbonisation of Great Britains electrical system since late 2008, widely seen as an example of rapid decarbonisation of an electrical system away from fossil fuel generation to lower carbon sources.


title: Steer with Me: A Predictive, Potential Field-Based Control Approach for Semi-Autonomous, Teleoperated Road Vehicles

abstract: Autonomous driving is among the most promising of upcoming traffic safety technologies. Prototypes of autonomous vehicles are already being tested on public streets today. However, while current prototypes prove the feasibility of truly driverless cars, edge cases remain which necessitate falling back on human operators. Teleoperated driving is one solution that would allow a human to remotely control a vehicle via mobile radio networks. Removing in-vehicle drivers would thus allow current autonomous technologies to further progress towards becoming genuinely driverless systems. This paper proposes a new model predictive steering control scheme, specifically designed for semi-autonomous, teleoperated road vehicles. The controller is capable of receiving teleoperator steering commands and, in the case of potential collisions, automatically correcting these commands. Collision avoidance is incorporated into the design using potential fields. A term in the cost function facilitates natural maneuvers, and constraints on the maximum potential keep the vehicle at safe distances from obstacles. This paper also proposes the use of high-order ellipses as a method to accurately model rectangular obstacles in tight driving scenarios. Simulation results support the effectiveness of the proposed approach.


title: Reliability Correction is Key for Robust Kepler Occurrence Rates

abstract: The Kepler DR25 planet candidate catalog was produced using an automated method of planet candidate identification based on various tests. These tests were tuned to obtain a reasonable but arbitrary balance between catalog completeness and reliability. We produce new catalogs with differing balances of completeness and reliability by varying these tests, and study the impact of these alternative catalogs on occurrence rates. We find that if there is no correction for reliability, different catalogs give statistically inconsistent occurrence rates, while if we correct for both completeness and reliability, we get statistically consistent occurrence rates. This is a strong indication that correction for completeness and reliability is critical for the accurate computation of occurrence rates. Additionally, we find that this result is the same whether using Bayesian Poisson likelihood MCMC or Approximate Bayesian Computation methods. We also examine the use of a Robovetter disposition score cut as an alternative to reliability correction, and find that while a score cut does increase the reliability of the catalog, it is not as accurate as performing a full reliability correction. We get the same result when performing a reliability correction with and without a score cut. Therefore removing low-score planets removes data without providing any advantage, and should be avoided when possible. We make our alternative catalogs publicly available, and propose that these should be used as a test of occurrence rate methods, with the requirement that a method should provide statistically consistent occurrence rates for all these catalogs.


title: Progressive Generation of Long Text with Pretrained Language Models

abstract: Large-scale language models (LMs) pretrained on massive corpora of text, such as GPT-2, are powerful open-domain text generators. However, as our systematic examination reveals, it is still challenging for such models to generate coherent long passages of text (e.g., 1000 tokens), especially when the models are fine-tuned to the target domain on a small corpus. Previous planning-then-generation methods also fall short of producing such long text in various domains. To overcome the limitations, we propose a simple but effective method of generating text in a progressive manner, inspired by generating images from low to high resolution. Our method first produces domain-specific content keywords and then progressively refines them into complete passages in multiple stages. The simple design allows our approach to take advantage of pretrained LMs at each stage and effectively adapt to any target domain given only a small set of examples. We conduct a comprehensive empirical study with a broad set of evaluation metrics, and show that our approach significantly improves upon the fine-tuned large LMs and various planning-then-generation methods in terms of quality and sample efficiency. Human evaluation also validates that our model generations are more coherent.


title: Observable signatures of initial state momentum anisotropies in nuclear collisions

abstract: We show that the correlation between the elliptic momentum anisotropy, $v_2$, and the average transverse momentum, $[p_T]$, at fixed multiplicity in small system nuclear collisions carries information on the origin of the observed momentum anisotropy. A calculation using a hybrid IP-Glasma+\textsc{Music}+UrQMD model that includes contributions from final state response to the initial geometry as well as initial state momentum anisotropies of the Color Glass Condensate, predicts a characteristic sign change of the correlator $\hat{\rho}(v_2^2,[p_T])$ as a function of charged particle multiplicity in p+Au and d+Au collisions at $\sqrt{s}=200\,{\rm GeV}$, and p+Pb collisions at $\sqrt{s}=5.02\,{\rm TeV}$. This sign change is absent in calculations without initial state momentum anisotropies. The model further predicts a qualitative difference between the centrality dependence of $\hat{\rho}(v_2^2,[p_T])$ in Au+Au collisions at $\sqrt{s}=200\,{\rm GeV}$ and Pb+Pb collisions at $\sqrt{s}=5.02\,{\rm TeV}$, with only the latter showing a sign change in peripheral events. Predictions for O+O collisions at different collision energy show a similar behavior. Experimental observation of these distinct qualitative features of $\hat{\rho}(v_2^2,[p_T])$ in small and large systems would constitute strong evidence for the presence and importance of initial state momentum anisotropies predicted by the Color Glass Condensate effective theory.


title: Deep Probabilistic Accelerated Evaluation: A Robust Certifiable Rare-Event Simulation Methodology for Black-Box Safety-Critical Systems

abstract: Evaluating the reliability of intelligent physical systems against rare safety-critical events poses a huge testing burden for real-world applications. Simulation provides a useful platform to evaluate the extremal risks of these systems before their deployments. Importance Sampling (IS), while proven to be powerful for rare-event simulation, faces challenges in handling these learning-based systems due to their black-box nature that fundamentally undermines its efficiency guarantee, which can lead to under-estimation without diagnostically detected. We propose a framework called Deep Probabilistic Accelerated Evaluation (Deep-PrAE) to design statistically guaranteed IS, by converting black-box samplers that are versatile but could lack guarantees, into one with what we call a relaxed efficiency certificate that allows accurate estimation of bounds on the safety-critical event probability. We present the theory of Deep-PrAE that combines the dominating point concept with rare-event set learning via deep neural network classifiers, and demonstrate its effectiveness in numerical examples including the safety-testing of an intelligent driving algorithm.


title: Multilinear maximal operators associated to simplices

abstract: We establish $L^{p_1}\times\cdots\times L^{p_k}\to L^r$ and $\ell^{p_1}\times\cdots\times \ell^{p_k}\to \ell^r$ type bounds for multilinear maximal operators associated to averages over isometric copies of a given non-degenerate $k$-simplex in both the continuous and discrete settings. These provide natural extensions of $L^p\to L^p$ and $\ell^p\to \ell^p$ bounds for Stein's spherical maximal operator and the discrete spherical maximal operator, with each of these results serving as a key ingredient of the respective proofs.


title: Heterogeneous impact of a lockdown on inter-municipality mobility

abstract: Without a vaccine, the fight against the spreading of the coronavirus has focused on maintaining physical distance. To study the impact of such measures on inter-municipality traffic, we analyze a mobile dataset with the daily flow of people in Portugal in March and April 2020. We find that the reduction in inter-municipality traffic depends strongly on its initial outflow. In municipalities where the mobility is low, the outflow reduced by $10-20\%$ and this decrease was independent of the population size. Whereas, for municipalities of high mobility, the reduction was a monotonic increasing function of the population size and it even exceeded $60\%$ for the largest municipalities. As a consequence of such heterogeneities, there were significant structural changes on the most probable paths for the spreading of the virus, which must be considered when modeling the impact of control measures.


title: Best-Effort Adversarial Approximation of Black-Box Malware Classifiers

abstract: An adversary who aims to steal a black-box model repeatedly queries the model via a prediction API to learn a function that approximates its decision boundary. Adversarial approximation is non-trivial because of the enormous combinations of model architectures, parameters, and features to explore. In this context, the adversary resorts to a best-effort strategy that yields the closest approximation. This paper explores best-effort adversarial approximation of a black-box malware classifier in the most challenging setting, where the adversary's knowledge is limited to a prediction label for a given input. Beginning with a limited input set for the black-box classifier, we leverage feature representation mapping and cross-domain transferability to approximate a black-box malware classifier by locally training a substitute. Our approach approximates the target model with different feature types for the target and the substitute model while also using non-overlapping data for training the target, training the substitute, and the comparison of the two. We evaluate the effectiveness of our approach against two black-box classifiers trained on Windows Portable Executables (PEs). Against a Convolutional Neural Network (CNN) trained on raw byte sequences of PEs, our approach achieves a 92% accurate substitute (trained on pixel representations of PEs), and nearly 90% prediction agreement between the target and the substitute model. Against a 97.8% accurate gradient boosted decision tree trained on static PE features, our 91% accurate substitute agrees with the black-box on 90% of predictions, suggesting the strength of our purely black-box approximation.


title: On Weil Sums, Conjectures of Helleseth, and Niho Exponents

abstract: Let $F$ be a finite field, $\mu$ be a fixed additive character and $s$ be an integer coprime to $|F^\times|$. For any $a\in F$, the corresponding Weil sum is defined to be $W_{F,s}(a)=\displaystyle\sum_{x \in F} \mu(x^s-ax)$. The Weil spectrum counts distinct values of the Weil sum as $a$ runs through the invertible elements in the finite field. The value of these sums and the size of the Weil spectrum are of particular interest, as they link problems in coding and information theory to other areas of math such as number theory and arithmetic geometry. In the setting of Niho exponents, we examine the Weil sum, its bounds and its spectrum. As a consequence, we give a new proof to the Vanishing Conjecture of Helleseth ($1971$) on the presence of zero in the Weil spectrum in the case of Niho exponents. We also state a conjecture for when the Weil spectrum contains at least five elements and prove it for a certain class of Weil sums.


title: In medium properties of axion within a Polyakov loop enhanced Nambu-Jona-Lasinio model

abstract: We estimate the axion properties i.e. its mass, topological susceptibility and the self-coupling within the framework of Polyakov loop enhanced Nambu-Jona-Lasinio (PNJL) model at finite temperature and quark chemical potential. PNJL model, where quarks couple simultaneously to the chiral condensate and to a background temporal quantum chromodynamics (QCD) gauge field, includes two important features of QCD phase transition, i.e. deconfinement and chiral symmetry restoration. The Polyakov loop in PNJL model plays an important role near the critical temperature. We have shown significant difference in the axion properties calculated in PNJL model compared to the same obtained using Nambu-Jona-Lasinio (NJL) model. We find that both the mass of the axion and its self-coupling are correlated with the chiral transition as well as the confinement-deconfinement transition. We have also estimated the axion properties at finite chemical potential. Across the QCD transition temperature and/or quark chemical potential axion mass and its self-coupling also changes significantly. Since the PNJL model includes both the fermionic sector and the gauge fields, it can give reliable estimates of the axion properties, i.e. it's mass and the self-coupling in a hot and dense QCD medium. We also compare our results with the lattice QCD results whenever available.


title: Energy-Efficient UAV Relaying Robust Resource Allocation in Uncertain Adversarial Networks

abstract: The mobile relaying technique is a critical enhancing technology in wireless communications due to a higher chance of supporting the remote user from the base station (BS) with better quality of service. This paper investigates energy-efficient (EE) mobile relaying networks, mounted on an unmanned aerial vehicle (UAV), while the unknown adversaries try to intercept the legitimate link. We aim to optimize robust transmit power both UAV and BS along, relay hovering path, speed, and acceleration. The BS sends legitimate information, which is forwarded to the user by the relay. This procedure is defined as information-causality-constraint (ICC). We jointly optimize the worst case secrecy rate (WCSR) and UAV propulsion energy consumption (PEC) for a finite time horizon. We construct the BS-UAV, the UAV-user, and the UAV-adversary channel models. We apply the UAV PEC considering UAV speed and acceleration. At last, we derive EE UAV relay-user maximization problem in the adversarial wireless networks. While the problem is non-convex, we propose an iterative and sub-optimal algorithm to optimize EE UAV relay with constraints, such as ICC, trajectory, speed, acceleration, and transmit power. First, we optimize both BS and UAV transmit power, and hovering speed for known UAV path planning and acceleration. Using the optimal transmit power and speed, we obtain the optimal trajectory and acceleration. We compare our algorithm with existing algorithms and demonstrate the improved EE UAV relaying communication for our model.


title: Several Results Concerning Convex Subcategories

abstract: We apply the notion of a full convex subcategory to a wide range of algebras including tilted, quasi-tilted, shod, weakly shod, left and right glued, laura, simply connected, strongly simply connected, left supported, and cluster-tilted. In particular, given an algebra $\Lambda$ from one of the aforementioned classes, we investigate certain factor algebras $\Lambda/I$ where $I$ is an ideal generated by a suitable idempotent.


title: Conditions for a bigraph to be super-cyclic

abstract: A hypergraph $\mathcal H$ is super-pancyclic if for each $A \subseteq V(\mathcal H)$ with $|A| \geq 3$, $\mathcal H$ contains a Berge cycle with base vertex set $A$. We present two natural necessary conditions for a hypergraph to be super-pancyclic, and show that in several classes of hypergraphs these necessary conditions are also sufficient for this. In particular, they are sufficient for every hypergraph $\mathcal H$ with $ \delta(\mathcal H)\geq \max\{|V(\mathcal H)|, \frac{|E(\mathcal H)|+10}{4}\}$. We also consider super-cyclic bipartite graphs: those are $(X,Y)$-bigraphs $G$ such that for each $A \subseteq X$ with $|A| \geq 3$, $G$ has a cycle $C_A$ such that $V(C_A)\cap X=A$. Such graphs are incidence graphs of super-pancyclic hypergraphs, and our proofs use the language of such graphs.


title: Unsupervised Learning of Video Representations via Dense Trajectory Clustering

abstract: This paper addresses the task of unsupervised learning of representations for action recognition in videos. Previous works proposed to utilize future prediction, or other domain-specific objectives to train a network, but achieved only limited success. In contrast, in the relevant field of image representation learning, simpler, discrimination-based methods have recently bridged the gap to fully-supervised performance. We first propose to adapt two top performing objectives in this class - instance recognition and local aggregation, to the video domain. In particular, the latter approach iterates between clustering the videos in the feature space of a network and updating it to respect the cluster with a non-parametric classification loss. We observe promising performance, but qualitative analysis shows that the learned representations fail to capture motion patterns, grouping the videos based on appearance. To mitigate this issue, we turn to the heuristic-based IDT descriptors, that were manually designed to encode motion patterns in videos. We form the clusters in the IDT space, using these descriptors as a an unsupervised prior in the iterative local aggregation algorithm. Our experiments demonstrates that this approach outperform prior work on UCF101 and HMDB51 action recognition benchmarks. We also qualitatively analyze the learned representations and show that they successfully capture video dynamics.


title: Mapping Topic Evolution Across Poetic Traditions

abstract: Poetic traditions across languages evolved differently, but we find that certain semantic topics occur in several of them, albeit sometimes with temporal delay, or with diverging trajectories over time. We apply Latent Dirichlet Allocation (LDA) to poetry corpora of four languages, i.e. German (52k poems), English (85k poems), Russian (18k poems), and Czech (80k poems). We align and interpret salient topics, their trend over time (1600--1925 A.D.), showing similarities and disparities across poetic traditions with a few select topics, and use their trajectories over time to pinpoint specific literary epochs.


title: Two-Layer Neural Networks for Partial Differential Equations: Optimization and Generalization Theory

abstract: The problem of solving partial differential equations (PDEs) can be formulated into a least-squares minimization problem, where neural networks are used to parametrize PDE solutions. A global minimizer corresponds to a neural network that solves the given PDE. In this paper, we show that the gradient descent method can identify a global minimizer of the least-squares optimization for solving second-order linear PDEs with two-layer neural networks under the assumption of over-parametrization. We also analyze the generalization error of the least-squares optimization for second-order linear PDEs and two-layer neural networks, when the right-hand-side function of the PDE is in a Barron-type space and the least-squares optimization is regularized with a Barron-type norm, without the over-parametrization assumption.


title: Pentagonal geometries with block sizes 3, 4 and 5

abstract: A pentagonal geometry PENT($k$, $r$) is a partial linear space, where every line, or block, is incident with $k$ points, every point is incident with $r$ lines, and for each point $x$, there is a line incident with precisely those points that are not collinear with $x$. An opposite line pair in a pentagonal geometry consists of two parallel lines such that each point on one of the lines is not collinear with precisely those points on the other line. We give a direct construction for an infinite sequence of pentagonal geometries with block size 3 and connected deficiency graphs. Also we present 39 new pentagonal geometries with block size 4 and five with block size 5, all with connected deficiency graphs. Consequentially we determine the existence spectrum up to a few possible exceptions for PENT(4, $r$) that do not contain opposite line pairs and for PENT(4, $r$) with one opposite line pair. More generally, given $j$ we show that there exists a PENT(4, $r$) with $j$ opposite line pairs for all sufficiently large admissible $r$. Using some new group divisible designs with block size 5 (including types $2^{35}$, $2^{71}$ and $10^{23}$) we significantly extend the known existence spectrum for PENT(5, $r$).


title: Predicting Customer Churn in World of Warcraft

abstract: World of Warcraft is a massively multiplayer online video game released on November 23, 2004, by Blizzard Entertainment. In contrast with traditional games only having a single upfront fee to play, WoW also has a monthly subscription to play the game. With customer subscriptions in mind, we can apply the use of churn prediction to not only predict whether a customer will unsubscribe from the service but explore the user's playing behavior to obtain more insight into user playing patterns. The churn problem is somewhat complex due to the nature of not having a one size fits all solution, as different services define churn in a variety of ways. In this paper, we explore a dataset that focuses on one year from January 1, 2008, until December 31, 2008, as it highlights the release of a major content update in the game. Machine learning is used in two aspects of this paper: Survival Analysis and Binary Classification. Firstly, we explore the dataset using the Kaplan Meier estimator to predict the duration until a customer churns, and lastly predict whether a person will churn in six months using traditional machine learning algorithms such as Logistic Regression, Support Vector Machine, KNN Classifier, and Random Forests. From the survival analysis results, WoW customers have a relatively long duration until churn, which solidifies the addictiveness of the game. Lastly, the binary classification performed in the best performing algorithm having a 96% ROC AUC score in predicting whether a customer will churn in six months.


title: Roweisposes, Including Eigenposes, Supervised Eigenposes, and Fisherposes, for 3D Action Recognition

abstract: Human action recognition is one of the important fields of computer vision and machine learning. Although various methods have been proposed for 3D action recognition, some of which are basic and some use deep learning, the need of basic methods based on generalized eigenvalue problem is sensed for action recognition. This need is especially sensed because of having similar basic methods in the field of face recognition such as eigenfaces and Fisherfaces. In this paper, we propose Roweisposes which uses Roweis discriminant analysis for generalized subspace learning. This method includes Fisherposes, eigenposes, supervised eigenposes, and double supervised eigenposes as its special cases. Roweisposes is a family of infinite number of action recongition methods which learn a discriminative subspace for embedding the body poses. Experiments on the TST, UTKinect, and UCFKinect datasets verify the effectiveness of the proposed method for action recognition.


title: On p-groups of maximal class

abstract: Recall that a $p$-group of order $p^ {n} >p^ {3} $ is of maximal class, if its nilpotency class is $n-1$. In this paper, we study the $p$-groups of maximal class. Furthermore, we introduce a subgroup of a $p$-group of maximal class called the fundamental subgroup. This group plays a fundamental role in the development of the general theory of $p$-groups of maximal class. As an application, we study some special class of finite $p$-groups of maximal class and exponent $p$.


title: Central limit theorems for local network statistics

abstract: Subgraph counts - in particular the number of occurrences of small shapes such as triangles - characterize properties of random networks, and as a result have seen wide use as network summary statistics. However, subgraphs are typically counted globally, and existing approaches fail to describe vertex-specific characteristics. On the other hand, rooted subgraph counts - counts focusing on any given vertex's neighborhood - are fundamental descriptors of local network properties. We derive the asymptotic joint distribution of rooted subgraph counts in inhomogeneous random graphs, a model which generalizes many popular statistical network models. This result enables a shift in the statistical analysis of large graphs, from estimating network summaries, to estimating models linking local network structure and vertex-specific covariates. As an example, we consider a school friendship network and show that local friendship patterns are significant predictors of gender and race.


title: Causal Explanations of Image Misclassifications

abstract: The causal explanation of image misclassifications is an understudied niche, which can potentially provide valuable insights in model interpretability and increase prediction accuracy. This study trains CIFAR-10 on six modern CNN architectures, including VGG16, ResNet50, GoogLeNet, DenseNet161, MobileNet V2, and Inception V3, and explores the misclassification patterns using conditional confusion matrices and misclassification networks. Two causes are identified and qualitatively distinguished: morphological similarity and non-essential information interference. The former cause is not model dependent, whereas the latter is inconsistent across all six models. To reduce the misclassifications caused by non-essential information interference, this study erases the pixels within the bonding boxes anchored at the top 5% pixels of the saliency map. This method first verifies the cause; then by directly modifying the cause it reduces the misclassification. Future studies will focus on quantitatively differentiating the two causes of misclassifications, generalizing the anchor-box based inference modification method to reduce misclassification, exploring the interactions of the two causes in misclassifications.


title: A Modified Multiple Shooting Algorithm for Parameter Estimation in ODEs Using Adjoint Sensitivity Analysis

abstract: To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous computational cost. The method of multiple shooting, on the other hand, takes its place in between these two extremes. The computational cost of the algorithm is mostly due to the calculation of directional derivatives of objective and constraint functions. Here we modify { the} multiple shooting algorithm to use the adjoint method in calculating these derivatives. In the literature, this method is known to be a more stable and computationally efficient way of computing gradients of scalar functions. A predator-prey system is used to show the performance of the method and supply all necessary information for a successful and efficient implementation.


title: ESPN: Extremely Sparse Pruned Networks

abstract: Deep neural networks are often highly overparameterized, prohibiting their use in compute-limited systems. However, a line of recent works has shown that the size of deep networks can be considerably reduced by identifying a subset of neuron indicators (or mask) that correspond to significant weights prior to training. We demonstrate that an simple iterative mask discovery method can achieve state-of-the-art compression of very deep networks. Our algorithm represents a hybrid approach between single shot network pruning methods (such as SNIP) with Lottery-Ticket type approaches. We validate our approach on several datasets and outperform several existing pruning approaches in both test accuracy and compression ratio.


title: Effect of flow-induced molecular alignment on welding and strength of polymer interfaces

abstract: Structures formed by fused filament fabrication are often substantially weaker than those made with conventional techniques, and fail at the welds between successive layers. One factor that may influence strength is flow-induced alignment of deposited material. Recent work suggests that alignment reduces the entanglement density and thus should accelerate welding by diffusion. Here, coarse-grained molecular simulations are used to test the effect of molecular alignment on diffusion and weld strength. While standard measures show a decrease of the entanglement density with alignment, there is no change in the rate of diffusion normal to the interface or the rate of formation of entanglements across the interface. The time for chain reorientation also remains equal to the equilibrium disentanglement time $\tau_d$. Despite this, simulations of mechanical tests show that welds formed from aligned states are weaker until several $\tau_d$. This is not because the weld itself is weaker, but because aligned material near the weld is weaker than unaligned material. The maximum shear strength and tensile fracture energy of welded systems are the same as bulk systems with the same alignment.


title: Prompt photon production in high-energy $pA$ collisions at forward rapidity

abstract: Prompt photon production in hadronic collisions at the RHIC and the LHC energies is investigated within the QCD color dipole approach. Predictions for the nuclear modification factor in $pA$ collisions are evaluated based on parton saturation framework and the results are compared to the experimental measurements as a function of the photon transverse momentum at different rapidity bins. The reliability of the models is performed with the data from PHENIX, ATLAS, and ALICE Collaborations. Moreover, we show that the observed $x_T$-scaling of prompt photon production in $pp$ and $pA$ collisions can positively be addressed in the QCD color dipole formalism.


title: Fast and Private Submodular and $k$-Submodular Functions Maximization with Matroid Constraints

abstract: The problem of maximizing nonnegative monotone submodular functions under a certain constraint has been intensively studied in the last decade, and a wide range of efficient approximation algorithms have been developed for this problem. Many machine learning problems, including data summarization and influence maximization, can be naturally modeled as the problem of maximizing monotone submodular functions. However, when such applications involve sensitive data about individuals, their privacy concerns should be addressed. In this paper, we study the problem of maximizing monotone submodular functions subject to matroid constraints in the framework of differential privacy. We provide $(1-\frac{1}{\mathrm{e}})$-approximation algorithm which improves upon the previous results in terms of approximation guarantee. This is done with an almost cubic number of function evaluations in our algorithm. Moreover, we study $k$-submodularity, a natural generalization of submodularity. We give the first $\frac{1}{2}$-approximation algorithm that preserves differential privacy for maximizing monotone $k$-submodular functions subject to matroid constraints. The approximation ratio is asymptotically tight and is obtained with an almost linear number of function evaluations.


title: On lattice of congruences on graph inverse semigroups

abstract: Congruences on a graph inverse semigroup were recently described in terms of the underline graph. Based on such descriptions, we show that the lattice of congruences on a graph inverse semigroup is upper semimodular but not lower semimodular.


title: State preparation and measurement in a quantum simulation of the O(3) sigma model

abstract: Recently, Singh and Chandrasekharan showed that fixed points of the non-linear O(3) sigma model can be reproduced near a quantum phase transition of a spin model with just two qubits per lattice site. In a paper by the NuQS collaboration, the proposal is made to simulate such field theories on a quantum computer using the universal properties of a similar model. In this paper, following that direction, we demonstrate how to prepare the ground state of the model from and measure a dynamical quantity of interest, the O(3) Noether charge, on a quantum computer. In particular, we apply Trotter methods to obtain results for the complexity of adiabatic ground state preparation in both the weak-coupling and quantum-critical regimes and use shadow tomography to measure the dynamics of local observables. We then present and analyze a quantum algorithm based on non-unitary randomized simulation methods that may yield an approach suitable for intermediate-term noisy quantum devices.