title: Thermodynamic uncertainty relation for systems with unidirectional transitions

abstract: We derive a thermodynamic uncertainty relation (TUR) for systems with unidirectional transitions. The uncertainty relation involves a mixture of thermodynamic and dynamic terms. Namely, the entropy production from bidirectional transitions, and the net flux of unidirectional transitions. The derivation does not assume a steady-state, and the results apply equally well to transient processes with arbitrary initial conditions. As every bidirectional transition can also be seen as a pair of separate unidirectional ones, our approach is equipped with an inherent degree of freedom. Thus, for any given system, an ensemble of valid TURs can be derived. However, we find that choosing a representation that best matches the systems dynamics over the observation time will yield a TUR with a tighter bound on fluctuations. More precisely, we show a bidirectional representation should be replaced by a unidirectional one when the entropy production associated with the transitions between two states is larger than the sum of the net fluxes between them. Thus, in addition to offering TURs for systems where such relations were previously unavailable, the results presented herein also provide a systematic method to improve TUR bounds via physically motivated replacement of bidirectional transitions with pairs of unidirectional transitions. The power of our approach and its implementation are demonstrated on a model for random walk with stochastic resetting and on the Michaelis-Menten model of enzymatic catalysis.


title: Semi-Analytical Solution for a Multi-Objective TEAM Benchmark Problem

abstract: Benchmarking is essential for testing new numerical analysis codes. Their solution is crucial both for testing the partial differential equation solvers and both for the optimization methods. Especially, nature-inspired optimization algorithm-based solvers, where is an important study is to use benchmark functions to test how the new algorithm may perform, in comparison with other algorithms or fine-tune the optimizer parameters. This paper proposes a novel semi-analytical solution of the multi-objective T.E.A.M benchmark problem. The goal of the benchmark problem is to optimize the layout of a coil and provide a uniform magnetic field in the given region. The proposed methodology was realized in the open-source robust design optimization framework \=Artap, and the precision of the solution is compared with the result of a fully hp-adaptive numerical solver: Agros-suite. The coil layout optimization was performed by derivative-free non-linear methods and the NSGA-II algorithm.


title: Simplicial spanning trees in random Steiner complexes

abstract: A spanning tree $T$ in a graph $G$ is a sub-graph of $G$ with the same vertex set as $G$ which is a tree. In 1981, McKay proved an asymptotic result regarding the number of spanning trees in random $k$-regular graphs. In this paper we prove a high-dimensional generalization of McKay's result for random $d$-dimensional, $k$-regular simplicial complexes on $n$ vertices, showing that the weighted number of simplicial spanning trees is of order $(\xi_{d,k}+o(1))^{\binom{n}{d}}$ as $n\to\infty$, where $\xi_{d,k}$ is an explicit constant, provided $k> 4d^2+d+2$. A key ingredient in our proof is the local convergence of such random complexes to the $d$-dimensional, $k$-regular arboreal complex, which allows us to generalize McKay's result regarding the Kesten-McKay distribution.


title: Geometric Recursion from Polytope Triangulations and Twisted Homology

abstract: A geometric approach to understanding recursion relations for scattering amplitudes is developed. We achieve this by studying intersection numbers of triangulated accordiohedra presented as hyperplane arrangements. The cancellation of spurious divergences is subsequently realized as a topological no-boundary condition.


title: Improving Services Offered by Internet Providers by Analyzing Online Reviews using Text Analytics

abstract: With the proliferation of digital infrastructure, there is a plethora of demand for internet services, which makes the wireless communications industry highly competitive. Thus internet service providers (ISPs) must ensure that their efforts are targeted towards attracting and retaining customers to ensure continued growth. As Web 2.0 has gained traction and more tools have become available, customers in recent times are equipped to make well-informed decisions, specifically due to the colossal information available in online reviews. ISPs can use this information to better understand the views of the customers about their products and services. The goal of this paper is to identify the current strengths, weaknesses, opportunities, and threats (SWOT) of each ISP by exploring consumer reviews using text analytics. The proposed approach consists of four different stages: bigram and trigram analyses, topic identification, SWOT analysis and Root Cause Analysis (RCA). For each ISP, we first categorize online reviews into positive and negative based on customer ratings and then leverage text analytic tools to determine the most frequently used and co-occurring words in each categorization of reviews. Subsequently, looking at the positive and negative topics in each ISP, we conduct the SWOT analysis as well as the RCA to help companies identify the internal and external factors impacting customer satisfaction. We use a case study to illustrate the proposed approach. The proposed managerial insights that are derived from the results can act as a decision support tool for ISPs to offer better products and services for their customers.


title: Stuckelberg SUSY QED and Infrared Problem

abstract: We review gauge invariant $\mathcal N =1$ supersymmetric massive $U(1)$ gauge theory coupled to matter and Stuckelberg superfields. We focus on the leading order self energy and vertex correction to the matter field in the massless limit of both the $U(1)$ vector superfield and the Stuckelberg superfield. We explicitly verify that the theory is infrared divergence free in the massless limit. Hence the Stuckelberg mechanism appears to be the efficient route to handle infrared divergences seen in supersymmetric quantum electrodynamics.Since these additional particles have very small masses they can serve as dark matter candidates through `Ultralight particles' mechanism.


title: Image Stylization for Robust Features

abstract: Local features that are robust to both viewpoint and appearance changes are crucial for many computer vision tasks. In this work we investigate if photorealistic image stylization improves robustness of local features to not only day-night, but also weather and season variations. We show that image stylization in addition to color augmentation is a powerful method of learning robust features. We evaluate learned features on visual localization benchmarks, outperforming state of the art baseline models despite training without ground-truth 3D correspondences using synthetic homographies only. We use trained feature networks to compete in Long-Term Visual Localization and Map-based Localization for Autonomous Driving challenges achieving competitive scores.


title: Selecting "Convenient Observers" to Probe the Atomic Structure of Epitaxial Graphene Grown on Ir(111) via Photoelectron Diffraction

abstract: Epitaxial graphene grown on metallic substrates presents, in several cases, a long-range periodic structure due to a lattice mismatch between the graphene and the substrate. For instance, graphene grown on Ir(111), displays a corrugated supercell with distinct adsorption sites due to a variation of its local electronic structure. This type of surface reconstruction represents a challenging problem for a detailed atomic surface structure determination for experimental and theoretical techniques. In this work, we revisited the surface structure determination of graphene on Ir(111) by using the unique advantage of surface and chemical selectivity of synchrotron-based photoelectron diffraction. We take advantage of the Ir 4f photoemission surface state and use its diffraction signal as a probe to investigate the atomic arrangement of the graphene topping layer. We determine the average height and the overall corrugation of the graphene layer, which are respectively equal to 3.40 $\pm 0.11 \AA$ and 0.45 $\pm 0.03 \AA$. Furthermore, we explore the graphene topography in the vicinity of its high-symmetry adsorption sites and show that the experimental data can be described by three reduced systems simplifying the Moir\'{e} supercell multiple scattering analysis.


title: Harnack inequality and principal eigentheory for general infinity Laplacian operators with gradient in $\mathbb{R}^N$ and applications

abstract: Under the lack of variational structure and nondegeneracy, we investigate three notions of \textit{generalized principal eigenvalue} for a general infinity Laplacian operator with gradient and homogeneous term. A Harnack inequality and boundary Harnack inequality are proved to support our analysis. This is a continuation of our first work [3] and a contribution in the development of the theory of \textit{generalized principal eigenvalue} beside the works [8, 13, 12, 9, 29]. We use these notions to characterize the validity of maximum principle and study the existence, nonexistence and uniqueness of positive solutions of Fisher-KPP type equations in the whole space. The sliding method is intrinsically improved for infinity Laplacian to solve the problem. The results are related to the Liouville type results, which will be meticulously explained.


title: Observation of gapped state in rare-earth monopnictide HoSb

abstract: The rare-earth monopnictide family is attracting an intense current interest driven by its unusual extreme magnetoresistance (XMR) property and the potential presence of topologically non-trivial surface states. The experimental observation of non-trivial surface states in this family of materials are not ubiquitous. Here, using high-resolution angle-resolved photoemission spectroscopy (ARPES), magnetotransport, and parallel first-principles modeling, we examine the nature of electronic states in HoSb. Although we find the presence of bulk band gaps at the G and X-symmetry points of the Brillouin zone (BZ), we do not find these gaps to exhibit band inversion so that HoSb does not host a Dirac semimetal state. Our magnetotransport measurements indicate that HoSb can be characterized as a correlated nearly-complete electron-hole-compensated semimetal. Our analysis reveals that the nearly perfect electron-hole compensation could drive the appearance of non-saturating XMR effect in HoSb.


title: Do Not Disturb Me: Person Re-identification Under the Interference of Other Pedestrians

abstract: In the conventional person Re-ID setting, it is widely assumed that cropped person images are for each individual. However, in a crowded scene, off-shelf-detectors may generate bounding boxes involving multiple people, where the large proportion of background pedestrians or human occlusion exists. The representation extracted from such cropped images, which contain both the target and the interference pedestrians, might include distractive information. This will lead to wrong retrieval results. To address this problem, this paper presents a novel deep network termed Pedestrian-Interference Suppression Network (PISNet). PISNet leverages a Query-Guided Attention Block (QGAB) to enhance the feature of the target in the gallery, under the guidance of the query. Furthermore, the involving Guidance Reversed Attention Module and the Multi-Person Separation Loss promote QGAB to suppress the interference of other pedestrians. Our method is evaluated on two new pedestrian-interference datasets and the results show that the proposed method performs favorably against existing Re-ID methods.


title: Effects of dynamo magnetic fields on observational properties of Accreting Millisecond X-ray Pulsars

abstract: In this paper, we have investigated the accreting millisecond X-ray pulsars, which are rapidly rotating neutron stars in low-mass X-ray binaries. These systems show coherent X-ray pulsations that arise when the accretion flow is magnetically channeled to the stellar surface. Here, we have developed the fundamental equations for an accretion disc around accreting millisecond X-ray pulsars in the presence of a dynamo generated magnetic fields in the inner part of the disc and we have also formulated the numerical method for the structure equations in the inner region of the disc and the highest accretion rate is enough to make the inner region of the disc which is overpowered by radiation pressure and electron scattering. Finally, we have examined our results with the effects of dynamo magnetic fields on accreting millisecond X-ray pulsars.


title: Berry phases of higher spins due to internal geometry of Majorana constellation and relation to quantum entanglement

abstract: Majorana stars, the antipodal directions associated with the coherent states that are orthogonal to a spin state, provide a visualization and a geometric understanding of the structures of general quantum states. For example, the Berry phase of a spin-1/2 is given by half the solid angle enclosed by the close path of its Majorana star. It is conceivable that the Berry phase of higher spins may also be related to the geometry of the Majorana constellation. We find that for a spin-1 state, besides the expected contributions from the solid angles enclosed by the close paths of the two Majorana stars, the Berry phase includes a term related to the twist of the relative position vector around the barycenter vector of the two Majorana stars, i.e., the self-rotation of the constellation. Interestingly, if the spin-1 state is taken as a symmetrized two-qubit state, the extra contribution to the Berry phase is given by the self-rotation of the Majorana constellation weighted by the quantum entanglement of the two qubits. This discovery alludes to the relevance of the Majorana stellar geometry in representing the deep structures of quantum states and of quantum entanglement.


title: Automated Detection of Congenital Heart Disease in Fetal Ultrasound Screening

abstract: Prenatal screening with ultrasound can lower neonatal mortality significantly for selected cardiac abnormalities. However, the need for human expertise, coupled with the high volume of screening cases, limits the practically achievable detection rates. In this paper we discuss the potential for deep learning techniques to aid in the detection of congenital heart disease (CHD) in fetal ultrasound. We propose a pipeline for automated data curation and classification. During both training and inference, we exploit an auxiliary view classification task to bias features toward relevant cardiac structures. This bias helps to improve in F1-scores from 0.72 and 0.77 to 0.87 and 0.85 for healthy and CHD classes respectively.


title: Mesorasi: Architecture Support for Point Cloud Analytics via Delayed-Aggregation

abstract: Point cloud analytics is poised to become a key workload on battery-powered embedded and mobile platforms in a wide range of emerging application domains, such as autonomous driving, robotics, and augmented reality, where efficiency is paramount. This paper proposes Mesorasi, an algorithm-architecture co-designed system that simultaneously improves the performance and energy efficiency of point cloud analytics while retaining its accuracy. Our extensive characterizations of state-of-the-art point cloud algorithms show that, while structurally reminiscent of convolutional neural networks (CNNs), point cloud algorithms exhibit inherent compute and memory inefficiencies due to the unique characteristics of point cloud data. We propose delayed-aggregation, a new algorithmic primitive for building efficient point cloud algorithms. Delayed-aggregation hides the performance bottlenecks and reduces the compute and memory redundancies by exploiting the approximately distributive property of key operations in point cloud algorithms. Delayed-aggregation let point cloud algorithms achieve 1.6x speedup and 51.1% energy reduction on a mobile GPU while retaining the accuracy (-0.9% loss to 1.2% gains). To maximize the algorithmic benefits, we propose minor extensions to contemporary CNN accelerators, which can be integrated into a mobile Systems-on-a-Chip (SoC) without modifying other SoC components. With additional hardware support, Mesorasi achieves up to 3.6x speedup.


title: Blow-ups of caloric measure in time varying domains and applications to two-phase problems

abstract: We develop a method to study the structure of the common part of the boundaries of disjoint and possibly non-complementary time-varying domains in $\mathbb{R}^{n+1}$, $n \geq 2$, at the points of mutual absolute continuity of their respective caloric measures. Our set of techniques, which is based on parabolic tangent measures, allows us to tackle the following problems: 1) Let $\Omega_1$ and $\Omega_2$ be disjoint domains in $\mathbb{R}^{n+1}$, $n \geq 2$, which are quasi-regular for the heat equation and regular for the adjoint heat equation, and their complements satisfy a mild non-degeneracy hypothesis on the set $E$ of mutual absolute continuity of the associated caloric measures $\omega_i$ with poles at $\bar{p}_i=(p_i,t_i)\in\Omega_i$, $i=1,2$. Then, we obtain a parabolic analogue of the results of Kenig, Preiss, and Toro, i.e., we show that the parabolic Hausdorff dimension of $\omega_1|_E$ is $n+1$ and the tangent measures of $\omega_1$ at $\omega_1$-a.e. point of $E$ are equal to a constant multiple of the parabolic $(n+1)$-Hausdorff measure restricted to hyperplanes containing a line parallel to the time-axis. 2) If, additionally, $\omega_1$ and $\omega_2$ are doubling, $\log \frac{d\omega_2|_E}{d\omega_1|_E} \in VMO(\omega_1|_E)$, and $E$ is relatively open in the support of $\omega_1$, then their tangent measures at {\it every} point of $E$ are caloric measures associated with adjoint caloric polynomials. As a corollary we obtain that in complementary $\delta$-Reifenberg flat domains, if $\delta$ is small enough and $\log \frac{d\omega_2}{d\omega_1} \in VMO(\omega_1)$, then $\Omega_1 \cap \{t<t_2\}$ is vanishing Reifenberg flat. This generalizes results of Kenig and Toro for the Laplacian. 3) We establish a parabolic version of a theorem of Tsirelson about triple-points for harmonic measure.


title: Characterizing the Hyperuniformity of Ordered and Disordered Two-Phase Media

abstract: The hyperuniformity concept provides a unified means to classify all perfect crystals, perfect quasicrystals, and exotic amorphous states of matter according to their capacity to suppress large-scale density fluctuations. While the classification of hyperuniform point configurations has received considerable attention, much less is known about the classification of hyperuniform heterogeneous two-phase media, which include composites, porous media, foams, cellular solids, colloidal suspensions and polymer blends. The purpose of this article is to begin such a program for certain two-dimensional models of hyperuniform two-phase media by ascertaining their local volume-fraction variances $\sigma^2_{_V}(R)$ and the associated hyperuniformity order metrics $\overline{B}_V$. This is a highly challenging task because the geometries and topologies of the phases are generally much richer and more complex than point-configuration arrangements and one must ascertain a broadly applicable length scale to make key quantities dimensionless. Therefore, we focus on a certain class of two-dimensional periodic cellular networks, periodic and disordered/irregular packings, some of which maximize their effective transport and elastic properties. Among the cellular networks considered, the honeycomb networks have a minimal value of $\overline{B}_V$ across all volume fractions. On the other hand, among all packings considered, the triangular-lattice packings have the smallest values of $\overline{B}_V$ for the possible range of volume fractions. Among all structures studied here, the triangular-lattice packing has the minimal order metric for almost all volume fractions. Our study provides a theoretical foundation for the establishment of hyperuniformity order metrics for general two-phase media and a basis to discover new hyperuniform two-phase systems by inverse design procedures.


title: Proposed theorems for lifts of the extended almost complex structures on the complex manifold

abstract: The present paper aims to study the higher-order complete and vertical lifts of the extended almost complex structures on an extended complex manifold kM. The proposed theorems on the Nijenhuis tensor of an extended almost complex structure Jk on the extended complex manifold kM are proved. Also, a tensor field J~k of type (1,1) is introduced and shows that it is an extended almost complex structure. Finally, the Lie derivative concerning higher-order lifts is studied and basic results on the almost analytic complex vector concerning an extended almost complex structure on kM are investigated.


title: Physical Action Categorization using Signal Analysis and Machine Learning

abstract: Daily life of thousands of individuals around the globe suffers due to physical or mental disability related to limb movement. The quality of life for such individuals can be made better by use of assistive applications and systems. In such scenario, mapping of physical actions from movement to a computer aided application can lead the way for solution. Surface Electromyography (sEMG) presents a non-invasive mechanism through which we can translate the physical movement to signals for classification and use in applications. In this paper, we propose a machine learning based framework for classification of 4 physical actions. The framework looks into the various features from different modalities which contribution from time domain, frequency domain, higher order statistics and inter channel statistics. Next, we conducted a comparative analysis of k-NN, SVM and ELM classifier using the feature set. Effect of different combinations of feature set has also been recorded. Finally, the classifier accuracy with SVM and 1-NN based classifier for a subset of features gives an accuracy of 95.21 and 95.83 respectively. Additionally, we have also proposed that dimensionality reduction by use of PCA leads to only a minor drop of less than 5.55% in accuracy while using only 9.22% of the original feature set. These finding are useful for algorithm designer to choose the best approach keeping in mind the resources available for execution of algorithm.


title: Real-Time Spatio-Temporal LiDAR Point Cloud Compression

abstract: Compressing massive LiDAR point clouds in real-time is critical to autonomous machines such as drones and self-driving cars. While most of the recent prior work has focused on compressing individual point cloud frames, this paper proposes a novel system that effectively compresses a sequence of point clouds. The idea to exploit both the spatial and temporal redundancies in a sequence of point cloud frames. We first identify a key frame in a point cloud sequence and spatially encode the key frame by iterative plane fitting. We then exploit the fact that consecutive point clouds have large overlaps in the physical space, and thus spatially encoded data can be (re-)used to encode the temporal stream. Temporal encoding by reusing spatial encoding data not only improves the compression rate, but also avoids redundant computations, which significantly improves the compression speed. Experiments show that our compression system achieves 40x to 90x compression rate, significantly higher than the MPEG's LiDAR point cloud compression standard, while retaining high end-to-end application accuracies. Meanwhile, our compression system has a compression speed that matches the point cloud generation rate by today LiDARs and out-performs existing compression systems, enabling real-time point cloud transmission.


title: An adaptive synchronization approach for weights of deep reinforcement learning

abstract: Deep Q-Networks (DQN) is one of the most well-known methods of deep reinforcement learning, which uses deep learning to approximate the action-value function. Solving numerous Deep reinforcement learning challenges such as moving targets problem and the correlation between samples are the main advantages of this model. Although there have been various extensions of DQN in recent years, they all use a similar method to DQN to overcome the problem of moving targets. Despite the advantages mentioned, synchronizing the network weight in a fixed step size, independent of the agent's behavior, may in some cases cause the loss of some properly learned networks. These lost networks may lead to states with more rewards, hence better samples stored in the replay memory for future training. In this paper, we address this problem from the DQN family and provide an adaptive approach for the synchronization of the neural weights used in DQN. In this method, the synchronization of weights is done based on the recent behavior of the agent, which is measured by a criterion at the end of the intervals. To test this method, we adjusted the DQN and rainbow methods with the proposed adaptive synchronization method. We compared these adjusted methods with their standard form on well-known games, which results confirm the quality of our synchronization methods.


title: OpenFraming: We brought the ML; you bring the data. Interact with your data and discover its frames

abstract: When journalists cover a news story, they can cover the story from multiple angles or perspectives. A news article written about COVID-19 for example, might focus on personal preventative actions such as mask-wearing, while another might focus on COVID-19's impact on the economy. These perspectives are called "frames," which when used may influence public perception and opinion of the issue. We introduce a Web-based system for analyzing and classifying frames in text documents. Our goal is to make effective tools for automatic frame discovery and labeling based on topic modeling and deep learning widely accessible to researchers from a diverse array of disciplines. To this end, we provide both state-of-the-art pre-trained frame classification models on various issues as well as a user-friendly pipeline for training novel classification models on user-provided corpora. Researchers can submit their documents and obtain frames of the documents. The degree of user involvement is flexible: they can run models that have been pre-trained on select issues; submit labeled documents and train a new model for frame classification; or submit unlabeled documents and obtain potential frames of the documents. The code making up our system is also open-sourced and well-documented, making the system transparent and expandable. The system is available on-line at http://www.openframing.org and via our GitHub page https://github.com/davidatbu/openFraming .


title: Deep Learning Enables Robust and Precise Light Focusing on Treatment Needs

abstract: If light passes through the body tissues, focusing only on areas where treatment needs, such as tumors, will revolutionize many biomedical imaging and therapy technologies. So how to focus light through deep inhomogeneous tissues overcoming scattering is Holy Grail in biomedical areas. In this paper, we use deep learning to learn and accelerate the process of phase pre-compensation using wavefront shaping. We present an approach (LoftGAN, light only focuses on treatment needs) for learning the relationship between phase domain X and speckle domain Y . Our goal is not just to learn an inverse mapping F:Y->X such that we can know the corresponding X needed for imaging Y like most work, but also to make focusing that is susceptible to disturbances more robust and precise by ensuring that the phase obtained can be forward mapped back to speckle. So we introduce different constraints to enforce F(Y)=X and H(F(Y))=Y with the transmission mapping H:X->Y. Both simulation and physical experiments are performed to investigate the effects of light focusing to demonstrate the effectiveness of our method and comparative experiments prove the crucial improvement of robustness and precision. Codes are available at https://github.com/ChangchunYang/LoftGAN.


title: Applications of Robots for COVID-19 Response

abstract: This paper reviews 262 reports appearing between March 27 and July 4, 2020, in the press, social media, and scientific literature describing 203 instances of actual use of 104 different models of ground and aerial robots for the COVID19 response. The reports are organized by stakeholders and work domain into a novel taxonomy of six application categories, reflecting major differences in work envelope, adoption strategy, and human-robot interaction constraints. Each application category is further divided into a total of 30 subcategories based on differences in mission. The largest number of reported instances were for public safety (74 out of 203) and clinical care (46), though robots for quality of life (27), continuity of work and education (22), laboratory and supply chain automation (21), and non-clinical care (13) were notable. Ground robots were used more frequently (119) than aerial systems (84), but unlike ground robots, aerial applications appeared to take advantage of existing general purpose platforms that were used for multiple applications and missions. Of the 104 models of robots, 82 were determined to be commercially available or already existed as a prototype, 11 were modifications to existing robots, 11 were built from scratch. Teleoperation dominated the control style (105 instances), with the majority of those applications intentionally providing remote presence and thus not amenable to full autonomy in the future. Automation accounted for 74 instances and taskable agency forms of autonomy, 24. The data suggests areas for further research in autonomy, human-robot interaction, and adaptability.


title: Uniform approximation by multivariate quasi-projection operators

abstract: Approximation properties of quasi-projection operators $Q_j(f,\varphi, \widetilde{\varphi})$ are studied. Such an operator is associated with a function $\varphi$ satisfying the Strang-Fix conditions and a tempered distribution $\widetilde{\varphi}$ such that compatibility conditions with $\varphi$ hold. Error estimates in the uniform norm are obtained for a wide class of quasi-projection operators defined on the space of uniformly continuous functions and on the anisotropic Besov spaces. Under additional assumptions on $\varphi$ and $\widetilde{\varphi}$, two-sided estimates in terms of realizations of the $K$-functional are also obtained.


title: Modification of T/E models and their multi-field versions

abstract: We propose a modification on the super-potential of (arXiv: 1901.09046) which discusses the simplest construction of inflationary $\alpha$ attractor models (also called T/E models) in supergravity without the sinflaton. This can make all the components of the first derivative vanish at the minimum point after the specific choice for the modified part. We also extend T/E models into the multi-field versions, motivated by considering the effect of multi orthogonal nilpotent super-fields, whose sgoldstino, sinflatons and inflatinos are very heavy such that we can take the orthogonal nilpotent constraints to obtain physical limits. Finally, we study the inflation dynamics in the double field cases of both T and E models and show their turning rates and the square mass of the entropic perturbation, which can be used for further observational verification.


title: Prediction of Homicides in Urban Centers: A Machine Learning Approach

abstract: Relevant research has been highlighted in the computing community to develop machine learning models capable of predicting the occurrence of crimes, analyzing contexts of crimes, extracting profiles of individuals linked to crime, and analyzing crimes over time. However, models capable of predicting specific crimes, such as homicide, are not commonly found in the current literature. This research presents a machine learning model to predict homicide crimes, using a dataset that uses generic data (without study location dependencies) based on incident report records for 34 different types of crimes, along with time and space data from crime reports. Experimentally, data from the city of Bel\'em - Par\'a, Brazil was used. These data were transformed to make the problem generic, enabling the replication of this model to other locations. In the research, analyses were performed with simple and robust algorithms on the created dataset. With this, statistical tests were performed with 11 different classification methods and the results are related to the prediction's occurrence and non-occurrence of homicide crimes in the month subsequent to the occurrence of other registered crimes, with 76% assertiveness for both classes of the problem, using Random Forest. Results are considered as a baseline for the proposed problem.


title: Electron FLASH Delivery at Treatment Room Isocenter for Efficient Reversible Conversion of a Clinical LINAC

abstract: Purpose: In this study, procedures were developed to achieve efficient reversible conversion of a clinical linear accelerator (LINAC) and deliver electron FLASH (eFLASH) or conventional beams to the treatment room isocenter. Material & Methods: The LINAC was converted to deliver eFLASH beam within 20 minutes by retracting the x-ray target from the beam's path, positioning the carousel on an empty port, and selecting 10 MV photon beam energy in the treatment console. Dose per pulse and average dose rate were measured in a solid water phantom at different depths with Gafchromic film and OSLD. A pulse controller counted the pulses via scattered radiation signal and gated the delivery for preset pulse count. A fast photomultiplier tube-based Cherenkov detector measured per pulse beam output at 2 ns sampling rate. After conversion back to clinical mode, conventional beam output, flatness, symmetry, field size and energy were measured for all clinically commissioned energies. Results: Dose per pulse of 0.86 +/- 0.01 Gy (310 +/- 7 Gy/s average dose rate) were achieved at isocenter. The dose from simultaneous irradiation of film and OSLD were within 1%. The PMT showed the LINAC required about 5 pulses before the output stabilized and its long-term stability was within 3% for measurements performed at 3 minutes intervals. The dose, flatness, symmetry, and photon energy were unchanged from baseline and within tolerance (1%, 3%, 2%, and 0.1% respectively) after reverting to conventional beams. Conclusion: 10 MeV FLASH beams were achieved at the isocenter of the treatment room. The beam output was reproducible but requires further investigation of the ramp up time in the first 5 pulses, equivalent to <100 cGy. The eFLASH beam can irradiate both small and large subjects in minimally modified clinical settings and dose rates can be further increased by reducing the source to surface distance.


title: Bowtie Networks: Generative Modeling for Joint Few-Shot Recognition and Novel-View Synthesis

abstract: We propose a novel task of joint few-shot recognition and novel-view synthesis: given only one or few images of a novel object from arbitrary views with only category annotation, we aim to simultaneously learn an object classifier and generate images of that type of object from new viewpoints. While existing work copes with two or more tasks mainly by multi-task learning of shareable feature representations, we take a different perspective. We focus on the interaction and cooperation between a generative model and a discriminative model, in a way that facilitates knowledge to flow across tasks in complementary directions. To this end, we propose bowtie networks that jointly learn 3D geometric and semantic representations with a feedback loop. Experimental evaluation on challenging fine-grained recognition datasets demonstrates that our synthesized images are realistic from multiple viewpoints and significantly improve recognition performance as ways of data augmentation, especially in the low-data regime. Code and pre-trained models are released at https://github.com/zpbao/bowtie_networks.


title: A Self-supervised GAN for Unsupervised Few-shot Object Recognition

abstract: This paper addresses unsupervised few-shot object recognition, where all training images are unlabeled, and test images are divided into queries and a few labeled support images per object class of interest. The training and test images do not share object classes. We extend the vanilla GAN with two loss functions, both aimed at self-supervised learning. The first is a reconstruction loss that enforces the discriminator to reconstruct the probabilistically sampled latent code which has been used for generating the "fake" image. The second is a triplet loss that enforces the discriminator to output image encodings that are closer for more similar images. Evaluation, comparisons, and detailed ablation studies are done in the context of few-shot classification. Our approach significantly outperforms the state of the art on the Mini-Imagenet and Tiered-Imagenet datasets.


title: A Non-Abelian Generalization of the Alexander Polynomial from Quantum $\mathfrak{sl}_3$

abstract: Murakami and Ohtsuki have shown that the Alexander polynomial is an $R$-matrix invariant associated with representations $V(t)$ of unrolled restricted quantum $\mathfrak{sl}_2$ at a fourth root of unity. In this context, the highest weight $t\in\mathbb{C}^\times$ of the representation determines the polynomial variable. For any semisimple Lie algebra $\mathfrak{g}$ of rank $n$, we extend their construction to a link invariant $\Delta_{\mathfrak{g}}$, which takes values in $n$-variable Laurent polynomials. The focus of this paper is the case $\mathfrak{g}=\mathfrak{sl}_3$. For any knot $K$, evaluating $\Delta_{\mathfrak{sl}_3}$ at ${t_1=1}$, ${t_2=1}$, or ${t_2= it_1^{-1}}$ recovers the Alexander polynomial of $K$. This is not obvious from an examination of the $R$-matrix, as the $R$-matrix evaluated at these parameters does not satisfy the Alexander-Conway skein relation. We tabulate $\Delta_{\mathfrak{sl}_3}$ for all knots up to seven crossings along with various other examples. In particular, it distinguishes the Kinoshita-Terasaka knot and Conway knot mutant pair and is nontrivial on the Whitehead double of the trefoil.


title: Universal Taylor Series in several variables depending on parameters

abstract: We establish generic existence of Universal Taylor Series on products $\Omega = \prod \Omega_i$ of planar simply connected domains $\Omega_i$ where the universal approximation holds on products $K$ of planar compact sets with connected complements provided $K \cap \Omega = \emptyset$. These classes are with respect to one or several centers of expansion and the universal approximation is at the level of functions or at the level of all derivatives. Also, the universal functions can be smooth up to the boundary, provided that $K \cap \overline{\Omega} = \emptyset$ and $\{\infty\} \cup [\mathbb{C} \setminus \overline{\Omega}_i]$ is connected for all $i$. All previous kinds of universal series may depend on some parameters; then the approximable functions may depend on the same parameters, as it is shown in the present paper. These universalities are topologically and algebraically generic.


title: On the Correlation between Energy Spectra and Element Abundances in Solar Energetic Particles

abstract: In solar energetic particle (SEP) events, the physical processes of both shock acceleration and scattering during transport can cause energy-spectral indices to be correlated with enhancement or suppression of element abundances versus mass-to-charge ratios A/Q. We observe correlations for those "gradual" SEP events where shock waves accelerate ions from the ambient coronal plasma, but there are no such correlations for "impulsive" SEP events produced by magnetic reconnection in solar jets, where abundance enhancement in different events vary from (A/Q)^+2 to (A/Q)^+8, nor are there correlations when shock waves reaccelerate these residual impulsive ions. In these latter events the abundances are determined separately, prior to the accelerated spectra. Events with correlated spectra and abundances show a wide variety of interesting behavior that has not been described previously. Small and moderate gradual SEP events, with relative abundances typically depending approximately upon (A/Q)^-1 and the spectra upon energy E^-2.5, vary little with time. Large SEP events show huge temporal variations skirting the correlation line; in one case O spectra vary with time from E^-1 to E^-5 while abundances vary from (A/Q)^+1 to (A/Q)^-2 during the event. In very large events, streaming-limited transport through proton-generated resonant Alfve'n waves flattens the spectra and enhances heavy ion abundances prior to local shock passage, then steepens the spectra and reduces enhancements afterward, recapturing the typical correlation. Systematic correlation of spectra and element abundances provide a new perspective on the "injection problem" of ion selection by shocks and on the physics of SEP acceleration and transport.


title: False Detection (Positives and Negatives) in Object Detection

abstract: Object detection is a very important function of visual perception systems. Since the early days of classical object detection based on HOG to modern deep learning based detectors, object detection has improved in accuracy. Two stage detectors usually have higher accuracy than single stage ones. Both types of detectors use some form of quantization of the search space of rectangular regions of image. There are far more of the quantized elements than true objects. The way these bounding boxes are filtered out possibly results in the false positive and false negatives. This empirical experimental study explores ways of reducing false positives and negatives with labelled data.. In the process also discovered insufficient labelling in Openimage 2019 Object Detection dataset.


title: On minimum Bregman divergence inference

abstract: In this paper a new family of minimum divergence estimators based on the Bregman divergence is proposed. The popular density power divergence (DPD) class of estimators is a sub-class of Bregman divergences. We propose and study a new sub-class of Bregman divergences called the exponentially weighted divergence (EWD). Like the minimum DPD estimator, the minimum EWD estimator is recognised as an M-estimator. This characterisation is useful while discussing the asymptotic behaviour as well as the robustness properties of this class of estimators. Performances of the two classes are compared -- both through simulations as well as through real life examples. We develop an estimation process not only for independent and homogeneous data, but also for non-homogeneous data. General tests of parametric hypotheses based on the Bregman divergences are also considered. We establish the asymptotic null distribution of our proposed test statistic and explore its behaviour when applied to real data. The inference procedures generated by the new EWD divergence appear to be competitive or better that than the DPD based procedures.


title: Power and the Pandemic: Exploring Global Changes in Electricity Demand During COVID-19

abstract: Understanding how efforts to limit exposure to COVID-19 have altered electricity demand provides insights not only into how dramatic restrictions shape electricity demand but also about future electricity use in a post-COVID-19 world. We develop a unified modeling framework to quantify and compare electricity usage changes in 58 countries and regions around the world from January-May 2020. We find that daily electricity demand declined as much as 10% in April 2020 compared to modelled demand, controlling for weather, seasonal and temporal effects, but with significant variation. Clustering techniques show that four impact groups capture systematic differences in timing and depth of electricity usage changes, ranging from a mild decline of 2% to an extreme decline of 26%. These groupings do not align with geography, with almost every continent having at least one country or region that experienced a dramatic reduction in demand and one that did not. Instead, we find that such changes relate to government restrictions and mobility. Government restrictions have a non-linear effect on demand that generally saturates at its most restrictive levels and sustains even as restrictions ease. Mobility offers a sharper focus on electricity demand change with workplace and residential mobility strongly linked to demand changes at the daily level. Steep declines in electricity usage are associated with workday hourly load patterns that resemble pre-COVID weekend usage. Quantifying these impacts is a crucial first step in understanding the impacts of crises like the pandemic and the associated societal response on electricity demand.


title: Is Face Recognition Sexist? No, Gendered Hairstyles and Biology Are

abstract: Recent news articles have accused face recognition of being "biased", "sexist" or "racist". There is consensus in the research literature that face recognition accuracy is lower for females, who often have both a higher false match rate and a higher false non-match rate. However, there is little published research aimed at identifying the cause of lower accuracy for females. For instance, the 2019 Face Recognition Vendor Test that documents lower female accuracy across a broad range of algorithms and datasets also lists "Analyze cause and effect" under the heading "What we did not do". We present the first experimental analysis to identify major causes of lower face recognition accuracy for females on datasets where previous research has observed this result. Controlling for equal amount of visible face in the test images reverses the apparent higher false non-match rate for females. Also, principal component analysis indicates that images of two different females are inherently more similar than of two different males, potentially accounting for a difference in false match rates.


title: Miscellaneous on Commutants mod Normed Ideals and Quasicentral Modulus I

abstract: We define commutants mod normed ideals associated with compact smooth manifolds with boundary. The results about the K-theory of these operator algebras include an exact sequence for the connected sum of manifolds, derived from the Mayer-Vietoris sequence. We also make a few remarks about bicommutants mod normed ideals and about the quasicentral modulus for the quasinormed p-Schatten-von Neumann classes 0 < p < 1.


title: In-situ Workflow Auto-tuning via Combining Performance Models of Component Applications

abstract: In-situ parallel workflows couple multiple component applications, such as simulation and analysis, via streaming data transfer. in order to avoid data exchange via shared file systems. Such workflows are challenging to configure for optimal performance due to the large space of possible configurations. Expert experience is rarely sufficient to identify optimal configurations, and existing empirical auto-tuning approaches are inefficient due to the high cost of obtaining training data for machine learning models. It is also infeasible to optimize individual components independently, due to component interactions. We propose here a new auto-tuning method, Component-based Ensemble Active Learning (CEAL), that combines machine learning techniques with knowledge of in-situ workflow structure to enable automated workflow configuration with a limited number of performance measurements.


title: Elmer FEM-Dakota: A unified open-source computational framework for electromagnetics and data analytics

abstract: Open-source electromagnetic design software, Elmer FEM, was interfaced with data analytics toolkit, Dakota. Furthermore, the coupled software was validated against a benchmark test. The interface developed provides a unified open-source computational framework for electromagnetics and data analytics. Its key features include uncertainty quantification, surrogate modelling and parameter studies. This framework enables a richer understanding of model predictions to better design electric machines in a time sensitive manner.


title: Asymptotic Performance of Box-RLS Decoders under Imperfect CSI with Optimized Resource Allocation

abstract: This paper considers the problem of symbol detection in massive multiple-input multiple-output (MIMO) wireless communication systems. We consider hard-thresholding preceeded by two variants of the regularized least squares (RLS) decoder; namely the unconstrained RLS and the RLS with box constraint. For all schemes, we focus on the evaluation of the mean squared error (MSE) and the symbol error probability (SEP) for M-ary pulse amplitude modulation (M-PAM) symbols transmitted over a massive MIMO system when the channel is estimated using linear minimum mean squared error (LMMSE) estimator. Under such circumstances, the channel estimation error is Gaussian which allows for the use of the convex Gaussian min-max theorem (CGMT) to derive asymptotic approximations for the MSE and SER when the system dimensions and the coherence duration grow large with the same pace. The obtained expressions are then leveraged to derive the optimal power distribution between pilot and data under a total transmit energy constraint. In addition, we derive an asymptotic approximation of the goodput for all schemes which is then used to jointly optimize the number of training symbols and their associated power. Numerical results are presented to support the accuracy of the theoretical results.


title: ADL-MVDR: All deep learning MVDR beamformer for target speech separation

abstract: Speech separation algorithms are often used to separate the target speech from other interfering sources. However, purely neural network based speech separation systems often cause nonlinear distortion that is harmful for automatic speech recognition (ASR) systems. The conventional mask-based minimum variance distortionless response (MVDR) beamformer can be used to minimize the distortion, but comes with high level of residual noise. Furthermore, the matrix operations (e.g., matrix inversion) involved in the conventional MVDR solution are sometimes numerically unstable when jointly trained with neural networks. In this paper, we propose a novel all deep learning MVDR framework, where the matrix inversion and eigenvalue decomposition are replaced by two recurrent neural networks (RNNs), to resolve both issues at the same time. The proposed method can greatly reduce the residual noise while keeping the target speech undistorted by leveraging on the RNN-predicted frame-wise beamforming weights. The system is evaluated on a Mandarin audio-visual corpus and compared against several state-of-the-art (SOTA) speech separation systems. Experimental results demonstrate the superiority of the proposed method across several objective metrics and ASR accuracy.


title: Efficient Knowledge Graph Validation via Cross-Graph Representation Learning

abstract: Recent advances in information extraction have motivated the automatic construction of huge Knowledge Graphs (KGs) by mining from large-scale text corpus. However, noisy facts are unavoidably introduced into KGs that could be caused by automatic extraction. To validate the correctness of facts (i.e., triplets) inside a KG, one possible approach is to map the triplets into vector representations by capturing the semantic meanings of facts. Although many representation learning approaches have been developed for knowledge graphs, these methods are not effective for validation. They usually assume that facts are correct, and thus may overfit noisy facts and fail to detect such facts. Towards effective KG validation, we propose to leverage an external human-curated KG as auxiliary information source to help detect the errors in a target KG. The external KG is built upon human-curated knowledge repositories and tends to have high precision. On the other hand, although the target KG built by information extraction from texts has low precision, it can cover new or domain-specific facts that are not in any human-curated repositories. To tackle this challenging task, we propose a cross-graph representation learning framework, i.e., CrossVal, which can leverage an external KG to validate the facts in the target KG efficiently. This is achieved by embedding triplets based on their semantic meanings, drawing cross-KG negative samples and estimating a confidence score for each triplet based on its degree of correctness. We evaluate the proposed framework on datasets across different domains. Experimental results show that the proposed framework achieves the best performance compared with the state-of-the-art methods on large-scale KGs.


title: Large Associative Memory Problem in Neurobiology and Machine Learning

abstract: Dense Associative Memories or modern Hopfield networks permit storage and reliable retrieval of an exponentially large (in the dimension of feature space) number of memories. At the same time, their naive implementation is non-biological, since it seemingly requires the existence of many-body synaptic junctions between the neurons. We show that these models are effective descriptions of a more microscopic (written in terms of biological degrees of freedom) theory that has additional (hidden) neurons and only requires two-body interactions between them. For this reason our proposed microscopic theory is a valid model of large associative memory with a degree of biological plausibility. The dynamics of our network and its reduced dimensional equivalent both minimize energy (Lyapunov) functions. When certain dynamical variables (hidden neurons) are integrated out from our microscopic theory, one can recover many of the models that were previously discussed in the literature, e.g. the model presented in "Hopfield Networks is All You Need" paper. We also provide an alternative derivation of the energy function and the update rule proposed in the aforementioned paper and clarify the relationships between various models of this class.

categories: q-bio.NC cond-mat.dis-nn cs.CL cs.LG stat.ML


title: Deep Learning Predicts Cardiovascular Disease Risks from Lung Cancer Screening Low Dose Computed Tomography

abstract: Cancer patients have a higher risk of cardiovascular disease (CVD) mortality than the general population. Low dose computed tomography (LDCT) for lung cancer screening offers an opportunity for simultaneous CVD risk estimation in at-risk patients. Our deep learning CVD risk prediction model, trained with 30,286 LDCTs from the National Lung Cancer Screening Trial, achieved an area under the curve (AUC) of 0.871 on a separate test set of 2,085 subjects and identified patients with high CVD mortality risks (AUC of 0.768). We validated our model against ECG-gated cardiac CT based markers, including coronary artery calcification (CAC) score, CAD-RADS score, and MESA 10-year risk score from an independent dataset of 335 subjects. Our work shows that, in high-risk patients, deep learning can convert LDCT for lung cancer screening into a dual-screening quantitative tool for CVD risk estimation.


title: Vector bundles on trees of smooth rational curves

abstract: Given a vector bundle $E$ on a tree of smooth rational curves $C$, we give necessary and sufficient conditions for a vector bundle $E'$ on $\mathbb{P}^1$ to specialize to $E$ on $C$, generalizing the rank 2 case, due to Coskun.


title: RevPHiSeg: A Memory-Efficient Neural Network for Uncertainty Quantification in Medical Image Segmentation

abstract: Quantifying segmentation uncertainty has become an important issue in medical image analysis due to the inherent ambiguity of anatomical structures and its pathologies. Recently, neural network-based uncertainty quantification methods have been successfully applied to various problems. One of the main limitations of the existing techniques is the high memory requirement during training; which limits their application to processing smaller field-of-views (FOVs) and/or using shallower architectures. In this paper, we investigate the effect of using reversible blocks for building memory-efficient neural network architectures for quantification of segmentation uncertainty. The reversible architecture achieves memory saving by exactly computing the activations from the outputs of the subsequent layers during backpropagation instead of storing the activations for each layer. We incorporate the reversible blocks into a recently proposed architecture called PHiSeg that is developed for uncertainty quantification in medical image segmentation. The reversible architecture, RevPHiSeg, allows training neural networks for quantifying segmentation uncertainty on GPUs with limited memory and processing larger FOVs. We perform experiments on the LIDC-IDRI dataset and an in-house prostate dataset, and present comparisons with PHiSeg. The results demonstrate that RevPHiSeg consumes ~30% less memory compared to PHiSeg while achieving very similar segmentation accuracy.


title: Spontaneous preterm birth prediction using convolutional neural networks

abstract: An estimated 15 million babies are born too early every year. Approximately 1 million children die each year due to complications of preterm birth (PTB). Many survivors face a lifetime of disability, including learning disabilities and visual and hearing problems. Although manual analysis of ultrasound images (US) is still prevalent, it is prone to errors due to its subjective component and complex variations in the shape and position of organs across patients. In this work, we introduce a conceptually simple convolutional neural network (CNN) trained for segmenting prenatal ultrasound images and classifying task for the purpose of preterm birth detection. Our method efficiently segments different types of cervixes in transvaginal ultrasound images while simultaneously predicting a preterm birth based on extracted image features without human oversight. We employed three popular network models: U-Net, Fully Convolutional Network, and Deeplabv3 for the cervix segmentation task. Based on the conducted results and model efficiency, we decided to extend U-Net by adding a parallel branch for classification task. The proposed model is trained and evaluated on a dataset consisting of 354 2D transvaginal ultrasound images and achieved a segmentation accuracy with a mean Jaccard coefficient index of 0.923 $\pm$ 0.081 and a classification sensitivity of 0.677 $\pm$ 0.042 with a 3.49\% false positive rate. Our method obtained better results in the prediction of preterm birth based on transvaginal ultrasound images compared to state-of-the-art methods.


title: Learning Disentangled Expression Representations from Facial Images

abstract: Face images are subject to many different factors of variation, especially in unconstrained in-the-wild scenarios. For most tasks involving such images, e.g. expression recognition from video streams, having enough labeled data is prohibitively expensive. One common strategy to tackle such a problem is to learn disentangled representations for the different factors of variation of the observed data using adversarial learning. In this paper, we use a formulation of the adversarial loss to learn disentangled representations for face images. The used model facilitates learning on single-task datasets and improves the state-of-the-art in expression recognition with an accuracy of60.53%on the AffectNetdataset, without using any additional data.


title: New characterization of the duals of Hardy-amalgam spaces

abstract: In this paper, carrying on with our study of the Hardy-amalgam spaces $\mathcal H^{(q,p)}$ and $\mathcal{H}_{\mathrm{loc}}^{(q,p)}$ ($0<q,p<+\infty$), we give a characterization of their duals whenever $0<q\leq 1<p<+\infty$. Moreover, when $0<q\leq p\leq 1$, these characterizations coincide with those obtained in our earlier papers. Thus, we obtain a unified characterization of the dual spaces of Hardy-amalgam spaces, when $0<q\leq1$ and $0<q\leq p<+\infty$.


title: $k$-Forrelation Optimally Separates Quantum and Classical Query Complexity

abstract: Aaronson and Ambainis (SICOMP `18) showed that any partial function on $N$ bits that can be computed with an advantage $\delta$ over a random guess by making $q$ quantum queries, can also be computed classically with an advantage $\delta/2$ by a randomized decision tree making ${O}_q(N^{1-\frac{1}{2q}}\delta^{-2})$ queries. Moreover, they conjectured the $k$-Forrelation problem -- a partial function that can be computed with $q = \lceil k/2 \rceil$ quantum queries -- to be a suitable candidate for exhibiting such an extremal separation. We prove their conjecture by showing a tight lower bound of $\widetilde{\Omega}(N^{1-1/k})$ for the randomized query complexity of $k$-Forrelation, where the advantage $\delta = 2^{-O(k)}$. By standard amplification arguments, this gives an explicit partial function that exhibits an $O_\epsilon(1)$ vs $\Omega(N^{1-\epsilon})$ separation between bounded-error quantum and randomized query complexities, where $\epsilon>0$ can be made arbitrarily small. Our proof also gives the same bound for the closely related but non-explicit $k$-Rorrelation function introduced by Tal (FOCS `20). Our techniques rely on classical Gaussian tools, in particular, Gaussian interpolation and Gaussian integration by parts, and in fact, give a more general statement. We show that to prove lower bounds for $k$-Forrelation against a family of functions, it suffices to bound the $\ell_1$-weight of the Fourier coefficients between levels $k$ and $(k-1)k$. We also prove new interpolation and integration by parts identities that might be of independent interest in the context of rounding high-dimensional Gaussian vectors.


title: Generalized Ricci Flow

abstract: This book gives an introduction to fundamental aspects of generalized Riemannian, complex, and K\"ahler geometry. This leads to an extension of the classical Einstein-Hilbert action, which yields natural extensions of Einstein and Calabi-Yau structures as `canonical metrics' in generalized Riemannian and complex geometry. The generalized Ricci flow is introduced as a tool for constructing such metrics, and extensions of the fundamental Hamilton/Perelman regularity theory of Ricci flow are proved. These results are refined in the setting of generalized complex geometry, where the generalized Ricci flow is shown to preserve various integrability conditions, taking the form of pluriclosed flow and generalized K\"ahler-Ricci flow. This leads to global convergence results, and applications to complex geometry. A purely mathematical introduction to the physical idea of T-duality is given, and a discussion of its relationship to generalized Ricci flow.


title: A Directed Preferential Attachment Model with Poisson Measurement

abstract: When modeling a directed social network, one choice is to use the traditional preferential attachment model, which generates power-law tail distributions. In a traditional directed preferential attachment, every new edge is added sequentially into the network. However, for real datasets, it is common to only have coarse timestamps available, which means several new edges are created at the same timestamp. Previous analyses on the evolution of social networks reveal that after reaching a stable phase, the growth of edge counts in a network follows a non-homogeneous Poisson process with a constant rate across the day but varying rates from day to day. Taking such empirical observations into account, we propose a modified preferential attachment model with Poisson measurement, and study its asymptotic behavior. This modified model is then fitted to real datasets, and we see it provides a better fit than the traditional one.


title: Quiver Yangian and Supersymmetric Quantum Mechanics

abstract: The statistical model of crystal melting represents BPS configurations of D-branes on a toric Calabi-Yau three-fold. Recently it has been noticed that an infinite-dimensional algebra, the quiver Yangian, acts consistently on the crystal-melting configurations. We physically derive the algebra and its action on the BPS states, starting with the effective supersymmetric quiver quantum mechanics on the D-brane worldvolume. This leads to remarkable combinatorial identities involving equivariant integrations on the moduli space of the quantum mechanics, which can be checked by numerical computations.


title: Interpretable Representations in Explainable AI: From Theory to Practice

abstract: Interpretable representations are the backbone of many explainers that target black-box predictive systems based on artificial intelligence and machine learning algorithms. They translate the low-level data representation necessary for good predictive performance into high-level human-intelligible concepts used to convey the explanatory insights. Notably, the explanation type and its cognitive complexity are directly controlled by the interpretable representation, tweaking which allows to target a particular audience and use case. However, many explainers built upon interpretable representations overlook their merit and fall back on default solutions that often carry implicit assumptions, thereby degrading the explanatory power and reliability of such techniques. To address this problem, we study properties of interpretable representations that encode presence and absence of human-comprehensible concepts. We demonstrate how they are operationalised for tabular, image and text data; discuss their assumptions, strengths and weaknesses; identify their core building blocks; and scrutinise their configuration and parameterisation. In particular, this in-depth analysis allows us to pinpoint their explanatory properties, desiderata and scope for (malicious) manipulation in the context of tabular data where a linear model is used to quantify the influence of interpretable concepts on a black-box prediction. Our findings lead to a range of recommendations for designing trustworthy interpretable representations; specifically, the benefits of class-aware (supervised) discretisation of tabular data, e.g., with decision trees, and sensitivity of image interpretable representations to segmentation granularity and occlusion colour.


title: Monocular Instance Motion Segmentation for Autonomous Driving: KITTI InstanceMotSeg Dataset and Multi-task Baseline

abstract: Moving object segmentation is a crucial task for autonomous vehicles as it can be used to segment objects in a class agnostic manner based on their motion cues. It enables the detection of unseen objects during training (e.g., moose or a construction truck) based on their motion and independent of their appearance. Although pixel-wise motion segmentation has been studied in autonomous driving literature, it has been rarely addressed at the instance level, which would help separate connected segments of moving objects leading to better trajectory planning. As the main issue is the lack of large public datasets, we create a new InstanceMotSeg dataset comprising of 12.9K samples improving upon our KITTIMoSeg dataset. In addition to providing instance level annotations, we have added 4 additional classes which is crucial for studying class agnostic motion segmentation. We adapt YOLACT and implement a motion-based class agnostic instance segmentation model which would act as a baseline for the dataset. We also extend it to an efficient multi-task model which additionally provides semantic instance segmentation sharing the encoder. The model then learns separate prototype coefficients within the class agnostic and semantic heads providing two independent paths of object detection for redundant safety. To obtain real-time performance, we study different efficient encoders and obtain 39 fps on a Titan Xp GPU using MobileNetV2 with an improvement of 10% mAP relative to the baseline. Our model improves the previous state of the art motion segmentation method by 3.3%. The dataset and qualitative results video are shared in our website at https://sites.google.com/view/instancemotseg/.


title: Computer-Generated Music for Tabletop Role-Playing Games

abstract: In this paper we present Bardo Composer, a system to generate background music for tabletop role-playing games. Bardo Composer uses a speech recognition system to translate player speech into text, which is classified according to a model of emotion. Bardo Composer then uses Stochastic Bi-Objective Beam Search, a variant of Stochastic Beam Search that we introduce in this paper, with a neural model to generate musical pieces conveying the desired emotion. We performed a user study with 116 participants to evaluate whether people are able to correctly identify the emotion conveyed in the pieces generated by the system. In our study we used pieces generated for Call of the Wild, a Dungeons and Dragons campaign available on YouTube. Our results show that human subjects could correctly identify the emotion of the generated music pieces as accurately as they were able to identify the emotion of pieces written by humans.


title: The first open channel for a yield-stress fluid in complex porous media

abstract: The prediction of the first fluidized path of a yield-stress fluid in complex porous media is a challenging yet an important task to understand the fundamentals of fluid flow in several industrial and biological processes. In most cases, the conditions that open this first path are known either through experiments or expensive computations. Here, we present a simple network model to predict the first open channel for a yield-stress fluid in a complex porous medium. For porous media made of non-overlapping disks, we find that the pressure drop required to open the first channel for given yield stress depends on both the relative disks size to the macroscopic length of the system and the packing fraction. We also report the statistics on the arc-length of the first open path. Finally, we discuss the implication of our results on the design of porous media used in energy storage applications.

categories: physics.flu-dyn cond-mat.soft cond-mat.stat-mech physics.chem-ph physics.geo-ph


title: A Novel Traffic Rate Measurement Algorithm for QoE-Aware Video Admission Control

abstract: With the inevitable dominance of video traffic on the Internet, providing perceptually good video quality is becoming a challenging task. This is partly due to the bursty nature of video traffic, changing network conditions and limitations of network transport protocols. This growth of video traffic has made Quality of Experience (QoE) of the end user the focus of the research community. In contrast, Internet service providers are concerned about maximizing revenue by accepting as many sessions as possible, as long as customers remain satisfied. However, there is still no entirely satisfactory admission algorithm for flows with variable rate. The trade-off between the number of sessions and perceived QoE can be optimized by exploiting the bursty nature of video traffic. This paper proposes a novel algorithm to determine the upper limit of the aggregate video rate that can exceed the available bandwidth without degrading the QoE of accepted video sessions. A parameter $\beta$ that defines the exceedable limit is defined. The proposed algorithm results in accepting more sessions without compromising the QoE of on-going video sessions. Thus it contributes to the optimization of the QoE-Session trade-off in support of the expected growth of video traffic on the Internet.


title: DyStaB: Unsupervised Object Segmentation via Dynamic-Static Bootstrapping

abstract: We describe an unsupervised method to detect and segment portions of images of live scenes that, at some point in time, are seen moving as a coherent whole, which we refer to as objects. Our method first partitions the motion field by minimizing the mutual information between segments. Then, it uses the segments to learn object models that can be used for detection in a static image. Static and dynamic models are represented by deep neural networks trained jointly in a bootstrapping strategy, which enables extrapolation to previously unseen objects. While the training process requires motion, the resulting object segmentation network can be used on either static images or videos at inference time. As the volume of seen videos grows, more and more objects are seen moving, priming their detection, which then serves as a regularizer for new objects, turning our method into unsupervised continual learning to segment objects. Our models are compared to the state of the art in both video object segmentation and salient object detection. In the six benchmark datasets tested, our models compare favorably even to those using pixel-level supervision, despite requiring no manual annotation.


title: Evidence for electroweak production of four charged leptons and two jets in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: Evidence is presented for the electroweak (EW) production of two jets (jj) in association with two Z bosons and constraints on anomalous quartic gauge couplings are set. The analysis is based on a data sample of proton-proton collisions at $\sqrt{s} = $ 13 TeV collected with the CMS detector in 2016-2018, and corresponding to an integrated luminosity of 137 fb$^{-1}$. The search is performed in the fully leptonic final state ZZ $\to$ $\ell\ell\ell'\ell'$, where $\ell,\ell' = $ e, $\mu$. The EW production of two jets in association with two Z bosons is measured with an observed (expected) significance of 4.0 (3.5) standard deviations. The cross sections for the EW production are measured in three fiducial volumes and the result is $\sigma_{\mathrm{EW}}$(pp $\to$ ZZjj $\to$ $\ell\ell\ell'\ell'$jj) = 0.33 $^{+0.11}_{-0.10}$ (stat) $^{+0.04}_{-0.03}$ (syst) fb in the most inclusive volume, in agreement with the standard model prediction of 0.275 $\pm$ 0.021 fb. Measurements of total cross sections for jj production in association with two Z bosons are also reported. Limits on anomalous quartic gauge couplings are derived in terms of the effective field theory operators T0, T1, T2, T8, and T9.


title: Binary Black Hole Mergers from LIGO/Virgo O1 and O2: Population Inference Combining Confident and Marginal Events

abstract: We perform a statistical inference of the astrophysical population of binary black hole (BBH) mergers observed during the first two observing runs of Advanced LIGO and Advanced Virgo, including events reported in the GWTC-1 and IAS catalogs. We derive a novel formalism to fully and consistently account for events of arbitrary significance. We carry out a software injection campaign to obtain a set of mock astrophysical events subject to our selection effects, and use the search background to compute the astrophysical probabilities $p_{\rm astro}$ of candidate events for several phenomenological models of the BBH population. We emphasize that the values of $p_{\rm astro}$ depend on both the astrophysical and background models. Finally, we combine the information from individual events to infer the rate, spin, mass, mass-ratio and redshift distributions of the mergers. The existing population does not discriminate between random spins with a spread in the effective spin parameter, and a small but nonzero fraction of events from tidally-torqued stellar progenitors. The mass distribution is consistent with one having a cutoff at $m_{\rm max} = 41^{+10}_{-5}\,\rm M_\odot$, while the mass ratio favors equal masses; the mean mass ratio $\bar q> 0.67$. The rate shows no significant evolution with redshift. We show that the merger rate restricted to BBHs with a primary mass between 20 and $30\, \rm M_\odot$, and a mass ratio $q > 0.5$, and at $z \sim 0.2$, is 1.5 to $5.3\,{\rm Gpc^{-3} yr^{-1}}$ (90\% c.l.); these bounds are model independent and a factor of $\sim 3$ tighter than that on the local rate of all BBH mergers, and hence are a robust constraint on all progenitor models. Including the events in our catalog increases the Fisher information about the BBH population by $\sim 47\%$, and tightens the constraints on population parameters.


title: Adversarial Concurrent Training: Optimizing Robustness and Accuracy Trade-off of Deep Neural Networks

abstract: Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we propose Adversarial Concurrent Training (ACT), which employs adversarial training in a collaborative learning framework whereby we train a robust model in conjunction with a natural model in a minimax game. ACT encourages the two models to align their feature space by using the task-specific decision boundaries and explore the input space more broadly. Furthermore, the natural model acts as a regularizer, enforcing priors on features that the robust model should learn. Our analyses on the behavior of the models show that ACT leads to a robust model with lower model complexity, higher information compression in the learned representations, and high posterior entropy solutions indicative of convergence to a flatter minima. We demonstrate the effectiveness of the proposed approach across different datasets and network architectures. On ImageNet, ACT achieves 68.20% standard accuracy and 44.29% robustness accuracy under a 100-iteration untargeted attack, improving upon the standard adversarial training method's 65.70% standard accuracy and 42.36% robustness.


title: Contact Map based Crystal Structure Prediction using Global Optimization

abstract: Crystal structure prediction is now playing an increasingly important role in discovery of new materials. Global optimization methods such as genetic algorithms (GA) and particle swarm optimization (PSO) have been combined with first principle free energy calculations to predict crystal structures given composition or only a chemical system. While these approaches can exploit certain crystal patterns such as symmetry and periodicity in their search process, they usually do not exploit the large amount of implicit rules and constraints of atom configurations embodied in the large number of known crystal structures. They currently can only handle crystal structure prediction of relatively small systems. Inspired by the knowledge-rich protein structure prediction approach, herein we explore whether known geometric constraints such as the atomic contact map of a target crystal material can help predict its structure given its space group information. We propose a global optimization based algorithm, CMCrystal, for crystal structure reconstruction based on atomic contact maps. Based on extensive experiments using six global optimization algorithms, we show that it is viable to reconstruct the crystal structure given the atomic contact map for some crystal materials but more constraints are needed for other target materials to achieve successful reconstruction. This implies that atomic interaction information learned from existing materials can be used to improve crystal structure prediction.


title: Avidity and surface mobility in multivalent ligand-receptor binding

abstract: Targeted drug delivery relies on two physical processes: the selective binding of a therapeutic particle to receptors on a specific cell membrane, followed by transport of the particle across the membrane. In this article, we address some of the challenges in controlling the thermodynamics and dynamics of these two processes by combining a simple experimental system with a statistical mechanical model. Specifically, we characterize and model multivalent ligand-receptor binding between colloidal particles and fluid lipid bilayers, as well as the surface mobility of membrane-bound particles. We show that the mobility of the receptors within the fluid membrane is key to both the thermodynamics and dynamics of binding. First, we find that the particle-membrane binding free energy -- or avidity -- is a strongly nonlinear function of the ligand-receptor affinity. We attribute the nonlinearity to a combination of multivalency and recruitment of fluid receptors to the binding site. Our results also suggest that partial wrapping of the bound particles by the membrane enhances avidity further. Second, we demonstrate that the lateral mobility of membrane-bound particles is also strongly influenced by the recruitment of receptors. Specifically, we find that the lateral diffusion coefficient of a membrane-bound particle is dominated by the hydrodynamic drag against the aggregate of receptors within the membrane. These results provide one of the first direct validations of the working theoretical framework for multivalent interactions. They also highlight that the fluidity and elasticity of the membrane are as important as the ligand-receptor affinity in determining the binding and transport of small particles attached to membranes.


title: AutoPose: Searching Multi-Scale Branch Aggregation for Pose Estimation

abstract: We present AutoPose, a novel neural architecture search(NAS) framework that is capable of automatically discovering multiple parallel branches of cross-scale connections towards accurate and high-resolution 2D human pose estimation. Recently, high-performance hand-crafted convolutional networks for pose estimation show growing demands on multi-scale fusion and high-resolution representations. However, current NAS works exhibit limited flexibility on scale searching, they dominantly adopt simplified search spaces of single-branch architectures. Such simplification limits the fusion of information at different scales and fails to maintain high-resolution representations. The presentedAutoPose framework is able to search for multi-branch scales and network depth, in addition to the cell-level microstructure. Motivated by the search space, a novel bi-level optimization method is presented, where the network-level architecture is searched via reinforcement learning, and the cell-level search is conducted by the gradient-based method. Within 2.5 GPU days, AutoPose is able to find very competitive architectures on the MS COCO dataset, that are also transferable to the MPII dataset. Our code is available at https://github.com/VITA-Group/AutoPose.


title: Enforcing Safety at Runtime for Systems with Disturbances

abstract: Safety for control systems is often posed as an invariance constraint; the system is said to be safe if state trajectories avoid some unsafe region of the statespace for all time. An assured controller is one that enforces safety online by filtering a desired control input at runtime, and control barrier functions (CBFs) provide an assured controller that renders a safe subset of the state-space forward invariant. Recent extensions propose CBF-based assured controllers that allow the system to leave a known safe set so long as a given backup control strategy eventually returns to the safe set, however, these methods have yet to be extended to consider systems subjected to unknown disturbance inputs. In this work, we present a problem formulation for CBF-based runtime assurance for systems with disturbances, and controllers which solve this problem must, in some way, incorporate the online computation of reachable sets. In general, computing reachable sets in the presence of disturbances is computationally costly and cannot be directly incorporated in a CBF framework. To that end, we present a particular solution to the problem, whereby reachable sets are approximated via the mixed-monotonicity property. Efficient algorithms exist for overapproximating reachable sets for mixed-monotone systems with hyperrectangles, and we show that such approximations are suitable for incorporating into a CBF-based runtime assurance framework.


title: Construtions and bimodules of BiHom-alternative and BiHom-Jordan algebras

abstract: The aim of this paper is to give some construction results and examples of BiHom-alternative and BiHom-Jordan algebras. Next, we define BiHom-alternative and BiHom-Jordan (bi)modules and we prove that from a given BiHom-alternative and BiHom-Jordan bimodules, a sequence of this kind of bimodules can be constructed. Some relations between Bihom-associative, BiHom-alternative and BiHom-Jordan bimodules are given.


title: Temporally-decoherent and spatially-coherent vibrations in metal halide perovskite

abstract: The long carrier lifetime and defect tolerance in metal halide perovskites (MHPs) are major contributors to the superb performance of MHP optoelectronic devices. Large polarons were reported to be responsible for the long carrier lifetime. Yet microscopic mechanisms of the large polaron formation including the so-called phonon melting, are still under debate. Here, time-of-flight (TOF) inelastic neutron scattering (INS) experiments and first-principles density-functional theory (DFT) calculations were employed to investigate the lattice vibrations (or phonon dynamics) in methylammonium lead iodide ($\rm{MAPbI_3}$), a prototypical example of MHPs. Our findings are that optical phonons lose temporal coherence gradually with increasing temperature which vanishes at the orthorhombic-to-tetragonal structural phase transition. Surprisingly, however, we found that the spatial coherence is still retained throughout the decoherence process. We argue that the temporally decoherent and spatially coherent vibrations contribute to the formation of large polarons in this metal halide perovskite.


title: Radial Cutoffs and Holographic Entanglement

abstract: Tensor networks, $T\bar{T}$, and broader notions of a holographic principle all motivate the idea that some notion of gravitational holography should persist in the presence of a radial cutoff. But in the absence of time-reflection symmetry, the areas of Hubeny-Rangamani-Takayanagi surfaces anchored to the radial cutoff generally violate strong subadditivity, even when the associated boundary regions are spacelike separated as defined by both bulk and boundary notions of causality. We thus propose an alternate definition of cutoff-holographic entropy using a restricted maximin prescription anchored to a codimension 2 cutoff surface. For bulk solutions that respect the null energy condition, we show that the resulting areas satisfy SSA, entanglement wedge nesting, and monogamy of mutual information in parallel with cutoff free results in AdS. These results hold even when the cutoff surface fails to be convex.


title: Selection on $X_1 + X_1 + \cdots X_m$ via Cartesian product tree

abstract: Selection on the Cartesian product is a classic problem in computer science. Recently, an optimal algorithm for selection on $X+Y$, based on soft heaps, was introduced. By combining this approach with layer-ordered heaps (LOHs), an algorithm using a balanced binary tree of $X+Y$ selections was proposed to perform $k$-selection on $X_1+X_2+\cdots+X_m$ in $o(n\cdot m + k\cdot m)$, where $X_i$ have length $n$. Here, that $o(n\cdot m + k\cdot m)$ algorithm is combined with a novel, optimal LOH-based algorithm for selection on $X+Y$ (without a soft heap). Performance of algorithms for selection on $X_1+X_2+\cdots+X_m$ are compared empirically, demonstrating the benefit of the algorithm proposed here.


title: Limiting one-point distribution of periodic TASEP

abstract: The relaxation time limit of the one-point distribution of the spatially periodic totally asymmetric simple exclusion process is expected to be the universal one point distribution for the models in the KPZ universality class in a periodic domain. Unlike the infinite line case, the limiting one point distribution depends non-trivially on the scaled time parameter. We study several properties of this distribution for the case of the periodic step and flat initial conditions. We show that the distribution changes from a Tracy-Widom distribution in the small time limit to the Gaussian distribution in the large time limit, and also obtain right tail estimate for all time. Furthermore, we establish a connection to integrable differential equations such as the KP equation, coupled systems of mKdV and nonlinear heat equations, and the KdV equation.


title: LfEdNet: A Task-based Day-ahead Load Forecasting Model for Stochastic Economic Dispatch

abstract: Load forecasting is one of the most important and studied topics in modern power systems. Most of the existing researches on day-ahead load forecasting try to build a good model to improve the forecasting accuracy. The forecasted load is then used as the input to generation scheduling with the ultimate goal of minimizing the cost of generation schedules. However, existing day-ahead load forecasting models do not consider this ultimate goal at the training/forecasting stage. This paper proposes a task-based day-ahead load forecasting model labeled as LfEdNet that combines two individual layers in one model, including a load forecasting layer based on deep neural network (Lf layer) and a day-ahead stochastic economic dispatch (SED) layer (Ed layer). The training of LfEdNet aims to minimize the cost of the day-ahead SED in the Ed layer by updating the parameters of the Lf layer. Sequential quadratic programming (SQP) is used to solve the day-ahead SED in the Ed layer. The test results demonstrate that the forecasted results produced by LfEdNet can lead to lower cost of day-ahead SED while maintaining a relatively high forecasting accuracy.


title: Affine Orlicz P\'olya-Szeg\"o principles and their equality cases

abstract: The conjecture about the Orlicz P\'olya-Szeg\"o principle posed in [43] is proved. The cases of equality are characterized in the affine Orlicz P\'olya-Szeg\"o principle with respect to Steiner symmetrization and Schwarz spherical symmetrization.


title: Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size

abstract: Fine-tuning a pretrained transformer for a downstream task has become a standard method in NLP in the last few years. While the results from these models are impressive, applying them can be extremely computationally expensive, as is pretraining new models with the latest architectures. We present a novel method for applying pretrained transformer language models which lowers their memory requirement both at training and inference time. An additional benefit is that our method removes the fixed context size constraint that most transformer models have, allowing for more flexible use. When applied to the GPT-2 language model, we find that our method attains better perplexity than an unmodified GPT-2 model on the PG-19 and WikiText-103 corpora, for a given amount of computation or memory.


title: Rigidity results for complete manifolds with nonnegative scalar curvature

abstract: In this paper, we are going to show some rigidity results for complete open Riemannian manifolds with nonnegative scalar curvature. Without using the famous Cheeger-Gromoll splitting theorem we give a new proof to a rigidity result for complete manifolds with nonnegative scalar curvature admitting a proper smooth map to $T^{n-1}\times \mathbf R$ with nonzero degree. Here we introduce a trick to obtain the compactness of limit hypersurface from locally graphical convergence. Based on the same idea we also establish an optimal $2$-systole inequality for several classes of complete Riemannian manifolds with positive scalar curvature and further prove a rigidity result for the equality case.


title: Uncertainty aware Search Framework for Multi-Objective Bayesian Optimization with Constraints

abstract: We consider the problem of constrained multi-objective (MO) blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto set of solutions satisfying a set of constraints while minimizing the number of function evaluations. We propose a novel framework named Uncertainty-aware Search framework for Multi-Objective Optimization with Constraints (USeMOC) to efficiently select the sequence of inputs for evaluation to solve this problem. The selection method of USeMOC consists of solving a cheap constrained MO optimization problem via surrogate models of the true functions to identify the most promising candidates and picking the best candidate based on a measure of uncertainty. We applied this framework to optimize the design of a multi-output switched-capacitor voltage regulator via expensive simulations. Our experimental results show that USeMOC is able to achieve more than 90 % reduction in the number of simulations needed to uncover optimized circuits.


title: Training CNN Classifiers for Semantic Segmentation using Partially Annotated Images: with Application on Human Thigh and Calf MRI

abstract: Objective: Medical image datasets with pixel-level labels tend to have a limited number of organ or tissue label classes annotated, even when the images have wide anatomical coverage. With supervised learning, multiple classifiers are usually needed given these partially annotated datasets. In this work, we propose a set of strategies to train one single classifier in segmenting all label classes that are heterogeneously annotated across multiple datasets without moving into semi-supervised learning. Methods: Masks were first created from each label image through a process we termed presence masking. Three presence masking modes were evaluated, differing mainly in weightage assigned to the annotated and unannotated classes. These masks were then applied to the loss function during training to remove the influence of unannotated classes. Results: Evaluation against publicly available CT datasets shows that presence masking is a viable method for training class-generic classifiers. Our class-generic classifier can perform as well as multiple class-specific classifiers combined, while the training duration is similar to that required for one class-specific classifier. Furthermore, the class-generic classifier can outperform the class-specific classifiers when trained on smaller datasets. Finally, consistent results are observed from evaluations against human thigh and calf MRI datasets collected in-house. Conclusion: The evaluation outcomes show that presence masking is capable of significantly improving both training and inference efficiency across imaging modalities and anatomical regions. Improved performance may even be observed on small datasets. Significance: Presence masking strategies can reduce the computational resources and costs involved in manual medical image annotations. All codes are publicly available at https://github.com/wong-ck/DeepSegment.


title: A new set of efficient SMP-parallel 2D Fourier subroutines

abstract: Extensive set of tests on different platforms indicated that there is a performance drop of current standard de facto software library for the Discrete Fourier Transform (DFT) in case of large 2D array sizes (larger than 16384x16384). Parallel performance for Symmetric Multi Processor (SMP) systems was seriously affected. The remedy for this problem was proposed and implemented as a software library for 2D out of place complex to complex DFTs. Proposed library was thoroughly tested on different available architectures and hardware configurations and demonstrated significant (38-94%) performance boost on vast majority of them. The new library together with the testing suite and results of all tests is published as a project on GitHub.com platform under free software license (GNU GPL v3). Comprehensive description of programming interface as well as provided testing programs is given.


title: Beyond Point Estimate: Inferring Ensemble Prediction Variation from Neuron Activation Strength in Recommender Systems

abstract: Despite deep neural network (DNN)'s impressive prediction performance in various domains, it is well known now that a set of DNN models trained with the same model specification and the same data can produce very different prediction results. Ensemble method is one state-of-the-art benchmark for prediction uncertainty estimation. However, ensembles are expensive to train and serve for web-scale traffic. In this paper, we seek to advance the understanding of prediction variation estimated by the ensemble method. Through empirical experiments on two widely used benchmark datasets MovieLens and Criteo in recommender systems, we observe that prediction variations come from various randomness sources, including training data shuffling, and parameter random initialization. By introducing more randomness into model training, we notice that ensemble's mean predictions tend to be more accurate while the prediction variations tend to be higher. Moreover, we propose to infer prediction variation from neuron activation strength and demonstrate the strong prediction power from activation strength features. Our experiment results show that the average R squared on MovieLens is as high as 0.56 and on Criteo is 0.81. Our method performs especially well when detecting the lowest and highest variation buckets, with 0.92 AUC and 0.89 AUC respectively. Our approach provides a simple way for prediction variation estimation, which opens up new opportunities for future work in many interesting areas (e.g.,model-based reinforcement learning) without relying on serving expensive ensemble models.


title: Comment on "Relevance of Cu-3d multiplet structure in models of high Tc cuprates''

abstract: In a recent work [M. Jiang, M. Moeller, M. Berciu, and G. A. Sawatzky, Phys. Rev. B \textbf{101}, 035151 (2020)], the authors solved a model with a Cu impurity in an O-2p band as an approximation to the local electronic structure of a hole doped cuprate. One of their conclusions is that the ground-state has only $\sim 50$ \% overlap with a Zhang-Rice singlet (ZRS). This claim is based on the definition of the ZRS in a different representation, in which the charge fluctuations at the Cu site have been eliminated by a canonical transformation. The correct interpretation of the results, based on known low-energy reduction procedures for a multiband model including 3d$^8$ and 3d$^{10}$ configurations of Cu, indicates that this overlap is near 94 \%.