title: The Most Informative Order Statistic and its Application to Image Denoising

abstract: We consider the problem of finding the subset of order statistics that contains the most information about a sample of random variables drawn independently from some known parametric distribution. We leverage information-theoretic quantities, such as entropy and mutual information, to quantify the level of informativeness and rigorously characterize the amount of information contained in any subset of the complete collection of order statistics. As an example, we show how these informativeness metrics can be evaluated for a sample of discrete Bernoulli and continuous Uniform random variables. Finally, we unveil how our most informative order statistics framework can be applied to image processing applications. Specifically, we investigate how the proposed measures can be used to choose the coefficients of the L-estimator filter to denoise an image corrupted by random noise. We show that both for discrete (e.g., salt-pepper noise) and continuous (e.g., mixed Gaussian noise) noise distributions, the proposed method is competitive with off-the-shelf filters, such as the median and the total variation filters, as well as with wavelet-based denoising methods.


title: On the Cauchy problems associated to a ZK-KP-type family equations with a transversal fractional dispersion

abstract: In this paper we examine the well-posedness and ill-posedeness of the Cauchy problems associated to a family equations of ZK-KP-type \[ \begin{cases} u_{t}=u_{xxx}-\mathscr{H}D_{x}^{\alpha}u_{yy}+uu_{x}, \cr u(0)=\psi \in Z \end{cases} \] in anisotropic Sobolev spaces, where $1\le \alpha \le 1$, $\mathscr{H}$ is the Hilbert transform and $D_{x}^{\alpha}$ is the fractional derivative, both with respect to $x$.


title: A Zero-Sum Deterministic Impulse Controls Game in Infinite Horizon with a New HJBI QVI

abstract: In the present paper, we study a two-player zero-sum deterministic differential game with both players adopting impulse controls, in infinite time horizon, under rather weak assumptions on the cost functions. We prove by means of the dynamic programming principle (DPP) that the lower and upper value functions are continuous and viscosity solutions to the corresponding Hamilton-Jacobi-Bellman-Isaacs (HJBI) quasi-variational inequality (QVI). We define a new HJBI QVI for which, under a proportional property assumption on the maximizer cost, the value functions are the unique viscosity solution. We then prove that the lower and upper value functions coincide.


title: Bounds on mutual information of mixture data for classification tasks

abstract: The data for many classification problems, such as pattern and speech recognition, follow mixture distributions. To quantify the optimum performance for classification tasks, the Shannon mutual information is a natural information-theoretic metric, as it is directly related to the probability of error. The mutual information between mixture data and the class label does not have an analytical expression, nor any efficient computational algorithms. We introduce a variational upper bound, a lower bound, and three estimators, all employing pair-wise divergences between mixture components. We compare the new bounds and estimators with Monte Carlo stochastic sampling and bounds derived from entropy bounds. To conclude, we evaluate the performance of the bounds and estimators through numerical simulations.


title: Components of Eleven-dimensional Supergravity with Four Off-shell Supersymmetries

abstract: We derive the component structure of 11D, $N=1/8$ supergravity linearized around eleven-dimensional Minkowski space. This theory represents 4 local supersymmetries closing onto 4 of the 11 spacetime translations without the use of equations of motion. It may be interpreted as adding $201$ auxiliary bosons and $56$ auxiliary fermions to the physical supergravity multiplet for a total of $376+376$ components. These components and their transformations are organized into representations of $SL(2;\mathbf C)\times G_2$.


title: On the integrable hierarchy for the resolved conifold

abstract: We provide a direct proof of a conjecture of Brini relating the Gromov-Witten theory of the resolved conifold to the Ablowitz-Ladik integrable hierarchy at the level of primaries. In doing so, we use a functional representation of the Ablowitz-Ladik hierarchy as well as a difference equation for the Gromov-Witten potential. In particular, we express certain distinguished solutions of the difference equation in terms of an analytic function which is a specialization of a Tau function put forward by Bridgeland in the study of wall-crossing phenomena of Donaldson-Thomas invariants.


title: LIGO Detector Characterization in the Second and Third Observing Runs

abstract: The characterization of the Advanced LIGO detectors in the second and third observing runs has increased the sensitivity of the instruments, allowing for a higher number of detectable gravitational-wave signals, and provided confirmation of all observed gravitational-wave events. In this work, we present the methods used to characterize the LIGO detectors and curate the publicly available datasets, including the LIGO strain data and data quality products. We describe the essential role of these datasets in LIGO-Virgo Collaboration analyses of gravitational-waves from both transient and persistent sources and include details on the provenance of these datasets in order to support analyses of LIGO data by the broader community. Finally, we explain anticipated changes in the role of detector characterization and current efforts to prepare for the high rate of gravitational-wave alerts and events in future observing runs.


title: LS-HDIB: A Large Scale Handwritten Document Image Binarization Dataset

abstract: Handwritten document image binarization is challenging due to high variability in the written content and complex background attributes such as page style, paper quality, stains, shadow gradients, and non-uniform illumination. While the traditional thresholding methods do not effectively generalize on such challenging real-world scenarios, deep learning-based methods have performed relatively well when provided with sufficient training data. However, the existing datasets are limited in size and diversity. This work proposes LS-HDIB - a large-scale handwritten document image binarization dataset containing over a million document images that span numerous real-world scenarios. Additionally, we introduce a novel technique that uses a combination of adaptive thresholding and seamless cloning methods to create the dataset with accurate ground truths. Through an extensive quantitative and qualitative evaluation over eight different deep learning based models, we demonstrate the enhancement in the performance of these models when trained on the LS-HDIB dataset and tested on unseen images.


title: Vertical magnetic field on boundary of sunspot umbra

abstract: 12 stable single sunspots were investigated in two aspects. The outer boundaries of the sunspots umbra were determined by an independent mathematical method and the vertical component of the magnetic field at these boundaries was found. We analyzed data from the SDO station using the segments of the continuum and magnetic field. It is shown that in a wide range of sunspot fields, the field average along the contour changes weakly, while the vertical component of the magnetic field itself, in a particular spot, changes significantly along the defined contour which reflects the fibrous structure of the penumbral field.


title: Connecting the formation of stars and planets. II: coupling the angular momentum of stars with the angular momentum of planets

abstract: A sample of 46 stars, host of exoplanets, is used to search for a connection between their formation process and the formation of the planets rotating around them. Separating our sample in two, stars hosting high-mass exoplanets (HMEs) and low-mass exoplanets (LMEs), we found the former to be more massive and to rotate faster than the latter. We also found the HMEs to have higher orbital angular momentum than the LMEs and to have lost more angular momentum through migration. These results are consistent with the view that the more massive the star and higher its rotation, the more massive was its protoplanetarys disk and rotation, and the more efficient the extraction of angular momentum from the planets.


title: Nilpotent varieties in symmetric spaces and twisted affine Schubert varieties

abstract: We relate the geometry of Schubert varieties in twisted affine Grassmannian and the nilpotent varieties in symmetric spaces. This extends some results of Achar-Henderson in the twisted setting. We also get some applications to the geometry of the order 2 nilpotent varieties in certain classical symmetric spaces.


title: Anomalous skin effect study of superconducting film

abstract: The field distribution inside the superconducting radiofrequency (SRF) film with different mean free path is studied using niobium (Nb) as an example. The surface resistance of clean Nb film with different substrate and different film thickness is calculated. We also show the study of a special structured multilayer superconducting film called Superconductor-Insulator-Superconductor (SIS) structure.


title: A reduction methodology for fluctuation driven population dynamics

abstract: Lorentzian distributions have been largely employed in statistical mechanics to obtain exact results for heterogeneous systems. Analytic continuation of these results is impossible even for slightly deformed Lorentzian distributions, due to the divergence of all the moments (cumulants). We have solved this problem by introducing a `pseudo-cumulants' expansion. This allows us to develop a reduction methodology for heterogeneous spiking neural networks subject to extrinsinc and endogenous noise sources, thus generalizing the mean-field formulation introduced in [E. Montbri\'o et al., Phys. Rev. X 5, 021028 (2015)].


title: High Resolution, Deep Imaging Using Confocal Time-of-flight Diffuse Optical Tomography

abstract: Light scattering by tissue severely limits how deep beneath the surface one can image, and the spatial resolution one can obtain from these images. Diffuse optical tomography (DOT) is one of the most powerful techniques for imaging deep within tissue -- well beyond the conventional $\sim$10-15 mean scattering lengths tolerated by ballistic imaging techniques such as confocal and two-photon microscopy. Unfortunately, existing DOT systems are limited, achieving only centimeter-scale resolution. Furthermore, they suffer from slow acquisition times and slow reconstruction speeds making real-time imaging infeasible. We show that time-of-flight diffuse optical tomography (ToF-DOT) and its confocal variant (CToF-DOT), by exploiting the photon travel time information, allow us to achieve millimeter spatial resolution in the highly scattered diffusion regime ($> 50 $ mean free paths). In addition, we demonstrate two additional innovations: focusing on confocal measurements, and multiplexing the illumination sources allow us to significantly reduce the measurement acquisition time. Finally, we rely on a novel convolutional approximation that allows us to develop a fast reconstruction algorithm, achieving a 100$\times$ speedup in reconstruction time compared to traditional DOT reconstruction techniques. Together, we believe that these technical advances serve as the first step towards real-time, millimeter resolution, deep tissue imaging using DOT.


title: Artificial Intelligence Driven UAV-NOMA-MEC in Next Generation Wireless Networks

abstract: Driven by the unprecedented high throughput and low latency requirements in next-generation wireless networks, this paper introduces an artificial intelligence (AI) enabled framework in which unmanned aerial vehicles (UAVs) use non-orthogonal multiple access (NOMA) and mobile edge computing (MEC) techniques to service terrestrial mobile users (MUs). The proposed framework enables the terrestrial MUs to offload their computational tasks simultaneously, intelligently, and flexibly, thus enhancing their connectivity as well as reducing their transmission latency and their energy consumption. To this end, the fundamentals of this framework are first introduced. Then, a number of communication and AI techniques are proposed to improve the quality of experiences of terrestrial MUs. To this end, federated learning and reinforcement learning are introduced for intelligent task offloading and computing resource allocation. For each learning technique, motivations, challenges, and representative results are introduced. Finally, several key technical challenges and open research issues of the proposed framework are summarized.


title: The AL-Gaussian Distribution as the Descriptive Model for the Internal Proactive Inhibition in the Standard Stop Signal Task

abstract: Measurements of response inhibition components of reactive inhibition and proactive inhibition within the stop signal paradigm have been of special interest for researchers since the 1980s. While frequentist nonparametric and Bayesian parametric methods have been proposed to precisely estimate the entire distribution of reactive inhibition, quantified by stop signal reaction times(SSRT), there is no method yet in the stop-signal task literature to precisely estimate the entire distribution of proactive inhibition. We introduce an Asymmetric Laplace Gaussian (ALG) model to describe the distribution of proactive inhibition. The proposed method is based on two assumptions of independent trial type(go/stop) reaction times, and Ex-Gaussian (ExG) models for them. Results indicated that the four parametric, ALG model uniquely describes the proactive inhibition distribution and its key shape features; and, its hazard function is monotonically increasing as are its three parametric ExG components. In conclusion, both response inhibition components can be uniquely modeled via variations of the four parametric ALG model described with their associated similar distributional features.


title: Split-Douglas-Rachford algorithm for composite monotone inclusions and Split-ADMM

abstract: In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed method allows for primal and dual non-standard metrics and activates the linear operator separately from the monotone operators appearing in the inclusion. In the simplest case when the linear operator has full range, it reduces to classical DRS. Moreover, the weak convergence of primal-dual sequences to a Kuhn-Tucker point is guaranteed, generalizing the main result in Svaiter (2011). Inspired by Gabay (1983), we also derive a new Split-ADMM (SADMM) by applying our method to the dual of a convex optimization problem involving a linear operator which can be expressed as the composition of two linear operators. The proposed SADMM activates one linear operator implicitly and the other one explicitly, and we recover ADMM when the latter is set as the identity. Connections and comparisons of our theoretical results with respect to the literature are provided for the main algorithm and SADMM. The flexibility and efficiency of both methods is illustrated via a numerical simulations in total variation image restoration and a sparse minimization problem.


title: A Hybrid 2-stage Neural Optimization for Pareto Front Extraction

abstract: Classification, recommendation, and ranking problems often involve competing goals with additional constraints (e.g., to satisfy fairness or diversity criteria). Such optimization problems are quite challenging, often involving non-convex functions along with considerations of user preferences in balancing trade-offs. Pareto solutions represent optimal frontiers for jointly optimizing multiple competing objectives. A major obstacle for frequently used linear-scalarization strategies is that the resulting optimization problem might not always converge to a global optimum. Furthermore, such methods only return one solution point per run. A Pareto solution set is a subset of all such global optima over multiple runs for different trade-off choices. Therefore, a Pareto front can only be guaranteed with multiple runs of the linear-scalarization problem, where all runs converge to their respective global optima. Consequently, extracting a Pareto front for practical problems is computationally intractable with substantial computational overheads, limited scalability, and reduced accuracy. We propose a robust, low cost, two-stage, hybrid neural Pareto optimization approach that is accurate and scales (compute space and time) with data dimensions, as well as number of functions and constraints. The first stage (neural network) efficiently extracts a weak Pareto front, using Fritz-John conditions as the discriminator, with no assumptions of convexity on the objectives or constraints. The second stage (efficient Pareto filter) extracts the strong Pareto optimal subset given the weak front from stage 1. Fritz-John conditions provide us with theoretical bounds on approximation error between the true and network extracted weak Pareto front. Numerical experiments demonstrates the accuracy and efficiency on a canonical set of benchmark problems and a fairness optimization task from prior works.


title: CNN with large memory layers

abstract: This work is centred around the recently proposed product key memory structure \cite{large_memory}, implemented for a number of computer vision applications. The memory structure can be regarded as a simple computation primitive suitable to be augmented to nearly all neural network architectures. The memory block allows implementing sparse access to memory with square root complexity scaling with respect to the memory capacity. The latter scaling is possible due to the incorporation of Cartesian product space decomposition of the key space for the nearest neighbour search. We have tested the memory layer on the classification, image reconstruction and relocalization problems and found that for some of those, the memory layers can provide significant speed/accuracy improvement with the high utilization of the key-value elements, while others require more careful fine-tuning and suffer from dying keys. To tackle the later problem we have introduced a simple technique of memory re-initialization which helps us to eliminate unused key-value pairs from the memory and engage them in training again. We have conducted various experiments and got improvements in speed and accuracy for classification and PoseNet relocalization models. We showed that the re-initialization has a huge impact on a toy example of randomly labeled data and observed some gains in performance on the image classification task. We have also demonstrated the generalization property perseverance of the large memory layers on the relocalization problem, while observing the spatial correlations between the images and the selected memory cells.


title: Prefix-free quantum Kolmogorov complexity

abstract: We introduce quantum-K ($QK$), a measure of the descriptive complexity of density matrices using classical prefix-free Turing machines and show that the initial segments of weak Solovay random and quantum Schnorr random states are incompressible in the sense of $QK$. Many properties enjoyed by prefix-free Kolmogorov complexity ($K$) have analogous versions for $QK$; notably a counting condition. Several connections between Solovay randomness and $K$, including the Chaitin type characterization of Solovay randomness, carry over to those between weak Solovay randomness and $QK$. We work towards a Levin-Schnorr type characterization of weak Solovay randomness in terms of $QK$. Schnorr randomness has a Levin-Schnorr characterization using $K_C$; a version of $K$ using a computable measure machine, $C$. We similarly define $QK_C$, a version of $QK$. Quantum Schnorr randomness is shown to have a Levin-Schnorr and a Chaitin type characterization using $QK_C$. The latter implies a Chaitin type characterization of classical Schnorr randomness using $K_C$.


title: Strong In-plane Anisotropy in the Electronic Properties of Doped Transition Metal Dichalcogenides exhibited in W1-xNbxS2

abstract: In this work, we study the electronic properties of monolayer transition metal dichalcogenide materials subjected to aliovalent doping, using Nb-doped WS2 as an exemplar. Scanning transmission electron microscopy imaging of the as-grown samples reveals an anisotropic Nb dopant distribution, prompting our investigation of anisotropy in electronic properties. Through electronic structure calculations on supercells representative of observed structures, we confirm that local Nb-atom distributions are consistent with energetic considerations, although kinetic processes occurring during sample growth must be invoked to explain the overall symmetry-breaking. We perform effective bandstructure and conductivity calculations on realistic models of the material that demonstrate that a high level of anisotropy can be expected in electronic properties including conductivity and mobility.


title: Hadamard Extensions and the Identification of Mixtures of Product Distributions

abstract: The Hadamard Extension of a matrix is the matrix consisting of all Hadamard products of subsets of its rows. This construction arises in the context of identifying a mixture of product distributions on binary random variables: full column rank of such extensions is a necessary ingredient of identification algorithms. We provide several results concerning when a Hadamard Extension has full column rank.


title: Target Prioritization and Observing Strategies for the NEID Earth Twin Survey

abstract: NEID is a high-resolution optical spectrograph on the WIYN 3.5-m telescope at Kitt Peak National Observatory and will soon join the new generation of extreme precision radial velocity instruments in operation around the world. We plan to use the instrument to conduct the NEID Earth Twin Survey (NETS) over the course of the next 5 years, collecting hundreds of observations of some of the nearest and brightest stars in an effort to probe the regime of Earth-mass exoplanets. Even if we take advantage of the extreme instrumental precision conferred by NEID, it will remain difficult to disentangle the weak (~10 cm s$^{-1}$) signals induced by such low-mass, long-period exoplanets from stellar noise for all but the quietest host stars. In this work, we present a set of quantitative selection metrics which we use to identify an initial NETS target list consisting of stars conducive to the detection of exoplanets in the regime of interest. We also outline a set of observing strategies with which we aim to mitigate uncertainty contributions from intrinsic stellar variability and other sources of noise.


title: Regularity theory for nonlocal equations with VMO coefficients

abstract: We prove higher regularity for nonlinear nonlocal equations with possibly discontinuous coefficients of VMO-type in fractional Sobolev spaces. While for corresponding local elliptic equations with VMO coefficients it is only possible to obtain higher integrability, in our nonlocal setting we are able to also prove a substantial amount of higher differentiability, so that our result is in some sense of purely nonlocal type. By embedding, we also obtain higher H\"older regularity for such nonlocal equations.


title: Art and Science Interaction Lab -- A highly flexible and modular interaction science research facility

abstract: The Art and Science Interaction Lab (ASIL) is a unique, highly flexible and modular interaction science research facility to effectively bring, analyse and test experiences and interactions in mixed virtual/augmented contexts as well as to conduct research on next-gen immersive technologies. It brings together the expertise and creativity of engineers, performers, designers and scientists creating solutions and experiences shaping the lives of people. The lab is equipped with state-of-the-art visual, auditory and user-tracking equipment, fully synchronized and connected to a central backend. This synchronization allows for highly accurate multi-sensor measurements and analysis.


title: RGE effects on the LFV scale from meson decays

abstract: We consider the lepton-flavor violating (LFV) lepton-quark dimension-6 operators and analyze their contributions to the LFV leptonic decays of vector, pseudoscalar, and scalar neutral mesons $M\to \ell_1 \ell_2$ as well as to $\mu(\tau) \rightarrow \ell ee, \ell \gamma\gamma$ decays. These operators contribute to the purely leptonic processes via quark loop. On the basis of quark-hadron duality, we relate these loops to the appropriate meson-exchange contributions. In this way, we extract lower bounds on the individual scales of the studied LFV operators from the experimental and phenomenological limits on the leptonic decays of mesons and leptons. As a byproduct, we shall obtain new limits on the LFV leptonic decays of flavored mesons from the experimental bounds on the three-body lepton decays. We study the effects of QED and QCD radiative corrections to the LFV lepton-quark operators in question. We derive for them the one-loop matrix of the RGE evolution and examine its effect on the previously derived tree-level limits on these operators. We show that the QED corrections are particularly relevant due to operator mixing. Specifically, for some of them the limits on their individual LFV scales improve by up to 3 orders of magnitude.


title: Dopamine: Differentially Private Federated Learning on Medical Data

abstract: While rich medical datasets are hosted in hospitals distributed across the world, concerns on patients' privacy is a barrier against using such data to train deep neural networks (DNNs) for medical diagnostics. We propose Dopamine, a system to train DNNs on distributed datasets, which employs federated learning (FL) with differentially-private stochastic gradient descent (DPSGD), and, in combination with secure aggregation, can establish a better trade-off between differential privacy (DP) guarantee and DNN's accuracy than other approaches. Results on a diabetic retinopathy~(DR) task show that Dopamine provides a DP guarantee close to the centralized training counterpart, while achieving a better classification accuracy than FL with parallel DP where DPSGD is applied without coordination. Code is available at https://github.com/ipc-lab/private-ml-for-health.


title: Trilinear embedding for divergence-form operators with complex coefficients

abstract: We prove a dimension-free $L^p(\Omega)\times L^q(\Omega)\times L^r(\Omega)\rightarrow L^1(\Omega\times (0,\infty))$ embedding for triples of elliptic operators in divergence form with complex coefficients and subject to mixed boundary conditions on $\Omega$, and for triples of exponents $p,q,r\in(1,\infty)$ mutually related by the identity $1/p+1/q+1/r=1$. Here $\Omega$ is allowed to be an arbitrary open subset of $\mathbb{R}^d$. Our assumptions involving the exponents and coefficient matrices are expressed in terms of a condition known as $p$-ellipticity. The proof utilizes the method of Bellman functions and heat flows. As a corollary, we give applications to (i) paraproducts and (ii) square functions associated with the corresponding operator semigroups, moreover, we prove (iii) inequalities of Kato--Ponce type for elliptic operators with complex coefficients. All the above results are the first of their kind for elliptic divergence-form operators with complex coefficients on arbitrary open sets. Furthermore, the approach to (ii),(iii) through trilinear embeddings seems to be new.


title: Design of Light-Matter Interactions for Quantum Technologies

abstract: In this Thesis we design radiation patterns capable of creating effective light-matter interactions suited to applications in quantum computing, quantum simulation and quantum sensing. On the one hand, we have used dynamical decoupling techniques to design quantum operations that are robust against errors in environmental and control fields, achieving high-fidelity quantum logic in trapped ions and energy-efficient nuclear magnetic resonance at the nanoscale with nitrogen-vacancy centers in diamond. On the other hand, we have studied generalised models of light-matter interaction, leading to the discovery of selective multi-photon interactions in the Rabi-Stark model and a proposal for preparing non-classical quantum states using the nonlinear quantum Rabi model. Finally, we have shown how the appropriate tailoring of interactions among ultracold atoms in optical lattices could lead to solve the boson sampling problem faster than the best supercomputers, thus demonstrating quantum supremacy. In this manner, we believe the results presented here significantly expand our knowledge on the control of light-matter interactions, and provide optimal scenarios for current quantum devices to generate the next-generation of quantum applications.


title: Robust and Efficient Single-Pixel Image Classificationwith Nonlinear Optics

abstract: We present a hybrid image classifier by mode-selective image upconversion, single pixel photodetection, and deep learning, aiming at fast processing a large number of pixels. It utilizes partial Fourier transform to extract the signature features of images in both the original and Fourier domains, thereby significantly increasing the classification accuracy and robustness. Tested on the MNIST handwritten digit images, it boosts the accuracy from 81.25% to 99.23%, and achieves an 83% accuracy for highly contaminated images whose signal-to-noise ratio is only -17 dB. Our approach could prove useful for fast lidar data processing, high resolution image recognition, occluded target identification, atmosphere monitoring, and so on.


title: Quasi-phasematching in a poled Josephson traveling-wave parametric amplifier with three-wave mixing

abstract: We develop the concept of quasi-phasematching (QPM) by implementing it in the recently proposed Josephson traveling-wave parametric amplifier (JTWPA) with three-wave mixing (3WM). The amplifier is based on a ladder transmission line consisting of flux-biased radio-frequency SQUIDs whose nonlinearity is of $\chi^{(2)}$-type. QPM is achieved in the 3WM process, $\omega_p=\omega_s+\omega_i$ (where $\omega_p$, $\omega_s$, and $\omega_i$ are the pump, signal, and idler frequencies, respectively) due to designing the JTWPA to include periodically inverted groups of these SQUIDs that reverse the sign of the nonlinearity. Modeling shows that the JTWPA bandwidth is relatively large (ca. $0.4\omega_p$) and flat, while unwanted modes, including $\omega_{2p}=2\omega_p$, $\omega_+=\omega_p +\omega_s$, $\omega_- = 2\omega_p - \omega_s$, etc., are strongly suppressed with the help of engineered dispersion.


title: Large twisting angles in Bilayer graphene Moire quantum dot structures

abstract: Recent exploration of the commensurate structure in the turbostratic double layer graphene shows that the large angle twisting can be treated by the decrease of the effective velocity within the energy spectra of the single layer graphene. Within our work, we use this result as a starting point, aiming towards understanding the physics of by a large angle twisted double layer graphene (i.e. Moire) quantum dot systems. We show that within this simple approach using the language of the first quantization, yet another so far unrealized (not up to our knowledge), illustrative property of the commutation relation appears in the graphene physics. Intriguingly, large twisting angles show to be a suitable tunning knob of the position symmetry in the graphene systems. Complete overview of the large angle twisting on the considered dot systems is provided.


title: Impartial games with entailing moves

abstract: Combinatorial Game Theory has also been called `additive game theory', whenever the analysis involves sums of independent game components. Such {\em disjunctive sums} invoke comparison between games, which allows abstract values to be assigned to them. However, there are rulesets with {\em entailing moves} that break the alternating play axiom and/or restrict the other player's options within the disjunctive sum components. These situations are exemplified in the literature by a ruleset such as {\sc nimstring}, a normal play variation of the classical children's game {\sc dots \& boxes}, and {\sc top~entails}, an elegant ruleset introduced in the classical work Winning Ways, by Berlekamp Conway and Guy. Such rulesets fall outside the scope of the established normal play theory. Here, we axiomatize normal play via two new terminating games, $\infty$ (Left wins) and $\overline\infty$ (Right wins), and a more general theory is achieved. We define {\em affine impartial}, which extends classical impartial games, and we analyze their algebra by extending the established Sprague-Grundy theory, with an accompanying minimum excluded rule. Solutions of {\sc nimstring} and {\sc top~entails} are given to illustrate the theory.


title: Multi-Modal Aesthetic Assessment for MObile Gaming Image

abstract: With the proliferation of various gaming technology, services, game styles, and platforms, multi-dimensional aesthetic assessment of the gaming contents is becoming more and more important for the gaming industry. Depending on the diverse needs of diversified game players, game designers, graphical developers, etc. in particular conditions, multi-modal aesthetic assessment is required to consider different aesthetic dimensions/perspectives. Since there are different underlying relationships between different aesthetic dimensions, e.g., between the `Colorfulness' and `Color Harmony', it could be advantageous to leverage effective information attached in multiple relevant dimensions. To this end, we solve this problem via multi-task learning. Our inclination is to seek and learn the correlations between different aesthetic relevant dimensions to further boost the generalization performance in predicting all the aesthetic dimensions. Therefore, the `bottleneck' of obtaining good predictions with limited labeled data for one individual dimension could be unplugged by harnessing complementary sources of other dimensions, i.e., augment the training data indirectly by sharing training information across dimensions. According to experimental results, the proposed model outperforms state-of-the-art aesthetic metrics significantly in predicting four gaming aesthetic dimensions.


title: Eigenfunctions of the Perron-Frobenius operator and the finite-time Lyapunov exponents in uniformly hyperbolic area-preserving maps

abstract: The subleading eigenvalues and associated eigenfunctions of the Perron-Frobenius operator for 2-dimensional area-preserving maps are numerically investigated. We closely examine the validity of the so-called Ulam method, a numerical scheme believed to provide eigenvalues and eigenfunctions of the Perron-Frobenius operator, both for linear and nonlinear maps on the torus. For the nonlinear case, the second-largest eigenvalues and the associated eigenfunctions of the Perron-Frobenius operator are investigated by calculating the Fokker-Planck operator with sufficiently small diffusivity. On the basis of numerical schemes thus established, we find that eigenfunctions for the subleading eigenvalues exhibit spatially inhomogeneous patterns, especially showing localization around the region where unstable manifolds are sparsely running. Finally, such spatial patterns of the eigenfunction are shown to be very close to the distribution of the maximal finite-time Lyapunov exponents.


title: Better sampling in explanation methods can prevent dieselgate-like deception

abstract: Machine learning models are used in many sensitive areas where besides predictive accuracy their comprehensibility is also important. Interpretability of prediction models is necessary to determine their biases and causes of errors, and is a necessary prerequisite for users' confidence. For complex state-of-the-art black-box models post-hoc model-independent explanation techniques are an established solution. Popular and effective techniques, such as IME, LIME, and SHAP, use perturbation of instance features to explain individual predictions. Recently, Slack et al. (2020) put their robustness into question by showing that their outcomes can be manipulated due to poor perturbation sampling employed. This weakness would allow dieselgate type cheating of owners of sensitive models who could deceive inspection and hide potentially unethical or illegal biases existing in their predictive models. This could undermine public trust in machine learning models and give rise to legal restrictions on their use. We show that better sampling in these explanation methods prevents malicious manipulations. The proposed sampling uses data generators that learn the training set distribution and generate new perturbation instances much more similar to the training set. We show that the improved sampling increases the robustness of the LIME and SHAP, while previously untested method IME is already the most robust of all.


title: Unified Framework for Feature Extraction based on Contrastive Learning

abstract: Feature extraction is an efficient approach for alleviating the issue of dimensionality in high-dimensional data. As a popular self-supervised learning method, contrastive learning has recently garnered considerable attention. In this study, we proposed a unified framework based on a new perspective of contrastive learning (CL) that is suitable for both unsupervised and supervised feature extraction. The proposed framework first constructed two CL graph for uniquely defining the positive and negative pairs. Subsequently, the projection matrix was determined by minimizing the contrastive loss function. In addition, the proposed framework considered both similar and dissimilar samples to unify unsupervised and supervised feature extraction. Moreover, we propose the three specific methods: unsupervised contrastive learning method, supervised contrastive learning method 1 ,and supervised contrastive learning method 2. Finally, the numerical experiments on five real datasets demonstrated the superior performance of the proposed framework in comparison to the existing methods.


title: A Case Study of Deep Learning Based Multi-Modal Methods for Predicting the Age-Suitability Rating of Movie Trailers

abstract: In this work, we explore different approaches to combine modalities for the problem of automated age-suitability rating of movie trailers. First, we introduce a new dataset containing videos of movie trailers in English downloaded from IMDB and YouTube, along with their corresponding age-suitability rating labels. Secondly, we propose a multi-modal deep learning pipeline addressing the movie trailer age suitability rating problem. This is the first attempt to combine video, audio, and speech information for this problem, and our experimental results show that multi-modal approaches significantly outperform the best mono and bimodal models in this task.


title: Diophantine triples and K3 surfaces

abstract: A Diophantine $m$-tuple with elements in the field $K$ is a set of $m$ non-zero (distinct) elements of $K$ with the property that the product of any two distinct elements is one less than a square in $K$. Let $X: (x^2-1)(y^2-1)(z^2-1)=k^2,$ be a threefold. Its $K$-rational points parametrize Diophantine triples over $K$ such that the product of the elements of the triple that corresponds to the point $(x,y,z,k)\in X(K)$ is equal to $k$. We denote by $\overline{X}$ the projective closure of $X$ and for a fixed $k$ by $X_k$ a variety defined by the same equation as $X$. We prove that the variety $\overline{X}$ is birational to $\mathbb{P}^3$ which leads us to a new rational parametrization of the set of Diophantine triples. Next, specializing to finite fields, we find a correspondence between a K3 surface $X_k$ for a given $k\in\mathbb{F}_{p}^{\times}$ in the prime field $\mathbb{F}_{p}$ of odd characteristic and an abelian surface which is a product of two elliptic curves $E_k\times E_k$ where $E_k: y^2=x(k^2(1 + k^2)^3 + 2(1 + k^2)^2 x + x^2)$. We derive a formula for $N(p,k)$, the number of Diophantine triples over $\mathbb{F}_{p}$ with the product of elements equal to $k$. We show that the variety $\overline{X}$ admits a fibration by rational elliptic surfaces and from it we derive the formula for the number of points on $\overline{X}$ over an arbitrary finite field $\mathbb{F}_{q}$. We reprove the formula for the number of Diophantine triples over $\mathbb{F}_{q}$ from Dujella-Kazalicki(2021). We derive the formula for the second moment of the elliptic surface $E_k$ (and thus confirming Steven J. Miller's Bias conjecture in this particular case) which we describe in terms of Fourier coefficients of a rational newform generating $S_4(\Gamma_{0}(8))$. Finally, in the Appendix, Luka Lasi\'c defines circular Diophantine $m$-tuples, and describes the parametrization of these sets.


title: Ten Simple Rules for Attending Your First Conference

abstract: Conferences are a mainstay of most scientific disciplines, where scientists of all career stages come together to share cutting-edge ideas and approaches. If you do research, chances are you will attend one or more of these meetings in your career. Conferences are a microcosm of their discipline, and while conferences offer different perspectives in different disciplines, they all offer experiences that range from a casual chat waiting in line for coffee to watching someone present their groundbreaking, hot-off-the-press research. The authors of this piece have attended our fair share of conferences and have collectively mentored hundreds of students in understanding the "unwritten rules" and pro-tips of conference attendance. As you head to your first scientific conference, these rules will help you navigate the conference environment and make the most of your experience. We have also developed a web portal which contains far more information about these rules, tables of professional societies and conferences in different disciplines, and other resources that may come in handy for first-time conference attendees and their mentors. We encourage any reader to use, adapt, and contribute to these materials.


title: Knowledge-driven Natural Language Understanding of English Text and its Applications

abstract: Understanding the meaning of a text is a fundamental challenge of natural language understanding (NLU) research. An ideal NLU system should process a language in a way that is not exclusive to a single task or a dataset. Keeping this in mind, we have introduced a novel knowledge driven semantic representation approach for English text. By leveraging the VerbNet lexicon, we are able to map syntax tree of the text to its commonsense meaning represented using basic knowledge primitives. The general purpose knowledge represented from our approach can be used to build any reasoning based NLU system that can also provide justification. We applied this approach to construct two NLU applications that we present here: SQuARE (Semantic-based Question Answering and Reasoning Engine) and StaCACK (Stateful Conversational Agent using Commonsense Knowledge). Both these systems work by "truly understanding" the natural language text they process and both provide natural language explanations for their responses while maintaining high accuracy.


title: A Cable Knot and BPS-Series

abstract: A series invariant of a complement of a knot was introduced recently. The invariant for several prime knots up to ten crossings have been explicitly computed. We present the first example of a satellite knot, namely, a cable of the figure eight knot, which has more than ten crossings. This cable knot result provides nontrivial evidence for the conjectures for the series invariant and demonstrates the robustness of integrality of the quantum invariant under the cabling operation. Furthermore, we observe a relation between the series invariant of the cable knot and the series invariant of the figure eight knot. This relation provides an alternative simple method for finding the former series invariant.


title: A new solution to the curved Ewald sphere problem for 3D image reconstruction in electron microscopy

abstract: We develop an algorithm capable of imaging a three-dimensional object given a collection of two-dimensional images of that object that are significantly influenced by the curvature of the Ewald sphere. These two-dimensional images cannot be approximated as projections of the object. Such an algorithm is useful in cryo-electron microscopy where larger samples, higher resolution, or lower energy electron beams are desired, all of which contribute to the significance of Ewald curvature.


title: Tracking Short-Term Temporal Linguistic Dynamics to Characterize Candidate Therapeutics for COVID-19 in the CORD-19 Corpus

abstract: Scientific literature tends to grow as a function of funding and interest in a given field. Mining such literature can reveal trends that may not be immediately apparent. The CORD-19 corpus represents a growing corpus of scientific literature associated with COVID-19. We examined the intersection of a set of candidate therapeutics identified in a drug-repurposing study with temporal instances of the CORD-19 corpus to determine if it was possible to find and measure changes associated with them over time. We propose that the techniques we used could form the basis of a tool to pre-screen new candidate therapeutics early in the research process.


title: Damage detection in operational wind turbine blades using a new approach based on machine learning

abstract: The application of reliable structural health monitoring (SHM) technologies to operational wind turbine blades is a challenging task, due to the uncertain nature of the environments they operate in. In this paper, a novel SHM methodology, which uses Gaussian Processes (GPs) is proposed. The methodology takes advantage of the fact that the blades on a turbine are nominally identical in structural properties and encounter the same environmental and operational variables (EOVs). The properties of interest are the first edgewise frequencies of the blades. The GPs are used to predict the edge frequencies of one blade given that of another, after these relationships between the pairs of blades have been learned when the blades are in a healthy state. In using this approach, the proposed SHM methodology is able to identify when the blades start behaving differently from one another over time. To validate the concept, the proposed SHM system is applied to real onshore wind turbine blade data, where some form of damage was known to have taken place. X-bar control chart analysis of the residual errors between the GP predictions and actual frequencies show that the system successfully identified early onset of damage as early as six months before it was identified and remedied.


title: Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Data

abstract: Biopolymer gels, such as those made out of fibrin or collagen, are widely used in tissue engineering applications and biomedical research. Moreover, fibrin naturally assembles into gels in vivo during wound healing and thrombus formation. Macroscale biopolymer gel mechanics are dictated by the microscale fiber network. Hence, accurate description of biopolymer gels can be achieved using representative volume elements (RVE) that explicitly model the discrete fiber networks of the microscale. These RVE models, however, cannot be efficiently used to model the macroscale due to the challenges and computational demands of multiscale coupling. Here, we propose the use of an artificial, fully connected neural network (FCNN) to efficiently capture the behavior of the RVE models. The FCNN was trained on 1100 fiber networks subjected to 121 biaxial deformations. The stress data from the RVE, together with the total energy and the condition of incompressibility of the surrounding matrix, were used to determine the derivatives of an unknown strain energy function with respect to the deformation invariants. During training, the loss function was modified to ensure convexity of the strain energy function and symmetry of its Hessian. A general FCNN model was coded into a user material subroutine (UMAT) in the software Abaqus. In this work, the FCNN trained on the discrete fiber network data was used in finite element simulations of fibrin gels using our UMAT. We anticipate that this work will enable further integration of machine learning tools with computational mechanics. It will also improve computational modeling of biological materials characterized by a multiscale structure.


title: Neural networks for Anatomical Therapeutic Chemical (ATC) classification

abstract: Motivation: Automatic Anatomical Therapeutic Chemical (ATC) classification is a critical and highly competitive area of research in bioinformatics because of its potential for expediting drug develop-ment and research. Predicting an unknown compound's therapeutic and chemical characteristics ac-cording to how these characteristics affect multiple organs/systems makes automatic ATC classifica-tion a challenging multi-label problem. Results: In this work, we propose combining multiple multi-label classifiers trained on distinct sets of features, including sets extracted from a Bidirectional Long Short-Term Memory Network (BiLSTM). Experiments demonstrate the power of this approach, which is shown to outperform the best methods reported in the literature, including the state-of-the-art developed by the fast.ai research group. Availability: All source code developed for this study is available at https://github.com/LorisNanni. Contact: loris.nanni@unipd.it


title: TT-Rec: Tensor Train Compression for Deep Learning Recommendation Models

abstract: The memory capacity of embedding tables in deep learning recommendation models (DLRMs) is increasing dramatically from tens of GBs to TBs across the industry. Given the fast growth in DLRMs, novel solutions are urgently needed, in order to enable fast and efficient DLRM innovations. At the same time, this must be done without having to exponentially increase infrastructure capacity demands. In this paper, we demonstrate the promising potential of Tensor Train decomposition for DLRMs (TT-Rec), an important yet under-investigated context. We design and implement optimized kernels (TT-EmbeddingBag) to evaluate the proposed TT-Rec design. TT-EmbeddingBag is 3 times faster than the SOTA TT implementation. The performance of TT-Rec is further optimized with the batched matrix multiplication and caching strategies for embedding vector lookup operations. In addition, we present mathematically and empirically the effect of weight initialization distribution on DLRM accuracy and propose to initialize the tensor cores of TT-Rec following the sampled Gaussian distribution. We evaluate TT-Rec across three important design space dimensions -- memory capacity, accuracy, and timing performance -- by training MLPerf-DLRM with Criteo's Kaggle and Terabyte data sets. TT-Rec achieves 117 times and 112 times model size compression, for Kaggle and Terabyte, respectively. This impressive model size reduction can come with no accuracy nor training time overhead as compared to the uncompressed baseline.


title: Failure Prediction in Production Line Based on Federated Learning: An Empirical Study

abstract: Data protection across organizations is limiting the application of centralized learning (CL) techniques. Federated learning (FL) enables multiple participants to build a learning model without sharing data. Nevertheless, there are very few research works on FL in intelligent manufacturing. This paper presents the results of an empirical study on failure prediction in the production line based on FL. This paper (1) designs Federated Support Vector Machine (FedSVM) and Federated Random Forest (FedRF) algorithms for the horizontal FL and vertical FL scenarios, respectively; (2) proposes an experiment process for evaluating the effectiveness between the FL and CL algorithms; (3) finds that the performance of FL and CL are not significantly different on the global testing data, on the random partial testing data, and on the estimated unknown Bosch data, respectively. The fact that the testing data is heterogeneous enhances our findings. Our study reveals that FL can replace CL for failure prediction.


title: Disambiguating Symbolic Expressions in Informal Documents

abstract: We propose the task of disambiguating symbolic expressions in informal STEM documents in the form of LaTeX files - that is, determining their precise semantics and abstract syntax tree - as a neural machine translation task. We discuss the distinct challenges involved and present a dataset with roughly 33,000 entries. We evaluated several baseline models on this dataset, which failed to yield even syntactically valid LaTeX before overfitting. Consequently, we describe a methodology using a transformer language model pre-trained on sources obtained from arxiv.org, which yields promising results despite the small size of the dataset. We evaluate our model using a plurality of dedicated techniques, taking the syntax and semantics of symbolic expressions into account.


title: Overestimation learning with guarantees

abstract: We describe a complete method that learns a neural network which is guaranteed to overestimate a reference function on a given domain. The neural network can then be used as a surrogate for the reference function. The method involves two steps. In the first step, we construct an adaptive set of Majoring Points. In the second step, we optimize a well-chosen neural network to overestimate the Majoring Points. In order to extend the guarantee on the Majoring Points to the whole domain, we necessarily have to make an assumption on the reference function. In this study, we assume that the reference function is monotonic. We provide experiments on synthetic and real problems. The experiments show that the density of the Majoring Points concentrate where the reference function varies. The learned over-estimations are both guaranteed to overestimate the reference function and are proven empirically to provide good approximations of it. Experiments on real data show that the method makes it possible to use the surrogate function in embedded systems for which an underestimation is critical; when computing the reference function requires too many resources.


title: BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation

abstract: Recent advances in deep learning techniques have enabled machines to generate cohesive open-ended text when prompted with a sequence of words as context. While these models now empower many downstream applications from conversation bots to automatic storytelling, they have been shown to generate texts that exhibit social biases. To systematically study and benchmark social biases in open-ended language generation, we introduce the Bias in Open-Ended Language Generation Dataset (BOLD), a large-scale dataset that consists of 23,679 English text generation prompts for bias benchmarking across five domains: profession, gender, race, religion, and political ideology. We also propose new automated metrics for toxicity, psycholinguistic norms, and text gender polarity to measure social biases in open-ended text generation from multiple angles. An examination of text generated from three popular language models reveals that the majority of these models exhibit a larger social bias than human-written Wikipedia text across all domains. With these results we highlight the need to benchmark biases in open-ended language generation and caution users of language generation models on downstream tasks to be cognizant of these embedded prejudices.


title: Strongly localized wrinkling modes of single- and few-layer graphene sheets in or on a compliant matrix under compression

abstract: We present a study of the wrinkling modes, localized in the plane of single- and few-layer graphene sheets embedded in or placed on a compliant compressively strained matrix. We provide the analytical model based on nonlinear elasticity of the graphene sheet, which shows that the compressive surface stress results in spatial localization of the extended sinusoidal wrinkling mode with soliton-like envelope with localization length, decreasing with the overcritical external strain. The parameters of the extended sinusoidal wrinkling modes are found from the conditions of anomalous softening of flexural surface acoustic wave propagating along the graphene sheet in or on the matrix. For relatively small overcritical external strain, the continuous transition occurs from the sinusoidal wrinkling modes with soliton-like envelope to the strongly localized modes with approximately one-period sinusoidal profiles and amplitude- and external-strain-independent spatial widths. Two types of graphene wrinkling modes with different symmetry are described, when the in-plane antisymmetric or symmetric modes are presumably realized in the graphene sheet embedded in or placed on a compliant strained matrix. Strongly localized wrinkling modes can be realized without delamination of the graphene sheet from the compliant matrix and are not equivalent to the ripplocations in layered solids. Molecular-dynamics modeling confirms the appearance of sinusoidal wrinkling modes in single- and few-layer graphene sheets embedded in polyethylene matrix at T = 300K.


title: MiniV2G: An Electric Vehicle Charging Emulator

abstract: The impact of global warming and the imperative to limit climate change have stimulated the need to develop new solutions based on renewable energy sources. One of the emerging trends in this endeavor are the Electric Vehicles (EVs), which use electricity instead of traditional fossil fuels as a power source, relying on the Vehicle-to-Grid (V2G) paradigm. The novelty of such a paradigm requires careful analysis to avoid malicious attempts. An attacker can exploit several surfaces, such as the remote connection between the Distribution Grid and Charging Supply or the authentication system between the charging Supply Equipment and the Electric Vehicles. However, V2G architecture's high cost and complexity in implementation can restrain this field's research capability. In this paper, we approach this limitation by proposing MiniV2G, an open-source emulator to simulate Electric Vehicle Charging (EVC) built on top of Mininet and RiseV2G. MiniV2G is particularly suitable for security researchers to study and test real V2G charging scenarios. MiniV2G can reproduce with high fidelity a V2G architecture to easily simulate an EV charging process. Finally, we present a MiniV2G application and show how MiniV2G can be used to study V2G communication and develop attacks and countermeasures that can be applied to real systems. Since we believe our tool can be of great help for research in this field, we also made it freely available.


title: Flexible and highly conductive composites by impregnation of polydimethylsiloxane in graphite nanoplates paper

abstract: This paper deals with the preparation and characterization of conductive and flexible sheets based on graphite nanoplates (GNP) and polydimethylsiloxane (PDMS). Highly porous GNP nanopaper were prepared by filtration from a GNP suspension in solvent. Subsequently, the impregnation strategy was pursued to obtain a composite material. By varying the concentration of the solution to be impregnated and the deposition time, PDMS/GNP nanopapers are produced with a range of PDMS content, porosity and density. Thermal diffusivity of the films (both in-plane and cross-plane) were measured and correlated with the structure of the nanopapers. Based on the results found and considering the restraints, three formulations were further investigated for their physical, thermal and mechanical properties. Highly flexible, tough and conductive (up to 25 W/mK) nanopapers were obtained, for possible application in modern electronic devices.


title: Participatory Funding Coordination: Model, Axioms and Rules

abstract: We present a new model of collective decision making that captures important crowd-funding and donor coordination scenarios. In the setting, there is a set of projects (each with its own cost) and a set of agents (that have their budgets as well as preferences over the projects). An outcome is a set of projects that are funded along with the specific contributions made by the agents. For the model, we identify meaningful axioms that capture concerns including fairness, efficiency, and participation incentives. We then propose desirable rules for the model and study, which sets of axioms can be satisfied simultaneously. An experimental study indicates the relative performance of different rules as well as the price of enforcing fairness axioms.


title: Development of a PET/EPRI combined imaging system for assessing tumor hypoxia

abstract: Precise quantitative delineation of tumor hypoxia is essential in radiation therapy treatment planning to improve the treatment efficacy by targeting hypoxic sub-volumes. We developed a combined imaging system of positron emission tomography (PET) and electron para-magnetic resonance imaging (EPRI) of molecular oxygen to investigate the accuracy of PET imaging in assessing tumor hypoxia. The PET/EPRI combined imaging system aims to use EPRI to precisely measure the oxygen partial pressure in tissues. This will evaluate the validity of PET hypoxic tumor imaging by (near) simultaneously acquired EPRI as ground truth. The combined imaging system was constructed by integrating a small animal PET scanner (inner ring diameter 62 mm and axial field of view 25.6 mm) and an EPRI subsystem (field strength 25 mT and resonant frequency 700 MHz). The compatibility between the PET and EPRI subsystems were tested with both phantom and animal imaging. Hypoxic imaging on a tumor mouse model using $^{18}$F-fluoromisonidazole radio-tracer was conducted with the developed PET/EPRI system. We report the development and initial imaging results obtained from the PET/EPRI combined imaging system.


title: Local sequence-structure relationships in proteins

abstract: We seek to understand the interplay between amino acid sequence and local structure in proteins. Are some amino acids unique in their ability to fit harmoniously into certain local structures? What is the role of sequence in sculpting the putative native state folds from myriad possible conformations? In order to address these questions, we represent the local structure of each C-alpha atom of a protein by just two angles, theta and mu, and we analyze a set of more than 4000 protein structures from the PDB. We use a hierarchical clustering scheme to divide the 20 amino acids into six distinct groups based on their similarity to each other in fitting local structural space. We present the results of a detailed analysis of patterns of amino acid specificity in adopting local structural conformations and show that the sequence-structure correlation is not very strong compared to a random assignment of sequence to structure. Yet, our analysis may be useful to determine an effective scoring rubric for quantifying the match of an amino acid to its putative local structure.

categories: q-bio.BM cond-mat.soft cond-mat.stat-mech physics.bio-ph


title: Generalized fractional Dirac type operators

abstract: We introduce a class of fractional Dirac type operators with time variable coefficients by means of a Witt basis, the Djrbashian-Caputo fractional derivative and the fractional Laplacian, both operators defined with respect to some given functions. Direct and inverse fractional Cauchy type problems are studied for the introduced operators. We give explicit solutions of the considered fractional Cauchy type problems. We also use a recent method to recover a variable coefficient solution of some inverse fractional wave and heat type equations. Illustrative examples are provided.


title: Bottom-Up Synthesis of Hexagonal Boron Nitride Nanoparticles with Intensity-Stabilized Quantum Emitters

abstract: Fluorescent nanoparticles are widely utilized in a large range of nanoscale imaging and sensing applications. While ultra-small nanoparticles (size <10 nm) are highly desirable, at this size range their photostability can be compromised due to effects such as intensity fluctuation and spectral diffusion caused by interaction with surface states. In this letter, we demonstrate a facile, bottom-up technique for the fabrication of sub-10-nm hBN nanoparticles hosting photostable bright emitters via a catalyst-free hydrothermal reaction between boric acid and melamine. We also implement a simple stabilization protocol that significantly reduces intensity fluctuation by ~85% and narrows the emission linewidth by ~14% by employing a common sol-gel silica coating process. Our study advances a promising strategy for the scalable, bottom-up synthesis of high-quality quantum emitters in hBN nanoparticles.


title: Characterising Fixed Parameter Tractability of Query Evaluation over Guarded TGDs

abstract: We study the parameterized complexity of evaluating Ontology Mediated Queries (OMQs) based on Guarded TGDs (GTGDs) and Unions of Conjunctive Queries (UCQs), in the case where relational symbols have unrestricted arity and where the parameter is the size of the OMQ. We establish exact criteria for fixed-parameter tractability (fpt) evaluation of recursively enumerable classes of such OMQs (under the widely held Exponential Time Hypothesis). One of the main technical tools introduced in the paper is an fpt-reduction from deciding parameterized uniform CSPs to parameterized OMQ evaluation. The reduction preserves measures which are known to be essential for classifying recursively enumerable classes of parameterized uniform CSPs: submodular width (according to the well known result of Marx for unrestricted-arity schemas) and treewidth (according to the well known result of Grohe for bounded-arity schemas). As such, it can be employed to obtain hardness results for evaluation of recursively enumerable classes of parameterized OMQs both in the unrestricted and in the bounded arity case. Previously, in the case of bounded arity schemas, this has been tackled using a technique requiring full introspection into the construction employed by Grohe.


title: SimBle: Generating privacy preserving real-world BLE traces with ground truth

abstract: Bluetooth has become critical as many IoT devices are arriving in the market. Most of the current literature focusing on Bluetooth simulation concentrates on the network protocols' performances and completely neglects the privacy protection recommendations introduced in the BLE standard. Indeed, privacy protection is one of the main issues handled in the Bluetooth standard. For instance, the current standard forces devices to change the identifier they embed within the public and private packets, known as MAC address randomization. Although randomizing MAC addresses is intended to preserve device privacy, recent literature shows many challenges that are still present. One of them is the correlation between the public packets and the emitters. Unfortunately, existing evaluation tools such as NS-3 are not designed to reproduce this Bluetooth standard's essential functionality. This makes it impossible to test solutions for different device-fingerprinting strategies as there is a lack of ground truth for large-scale scenarios with the majority of current BLE devices implementing MAC address randomization. In this paper, we first introduce a solution of standard-compliant MAC address randomization in the NS-3 framework, capable of emulating any real BLE device in the simulation and generating real-world Bluetooth traces. In addition, since the simulation run-time for trace-collection grows exponentially with the number of devices, we introduce an optimization to linearize public-packet sniffing. This made the large-scale trace-collection practically feasible. Then, we use the generated traces and associated ground truth to do a case study on the evaluation of a generic MAC address association available in the literature. Our case study reveals that close to 90 percent of randomized addresses could be correctly linked even in highly dense and mobile scenarios.


title: Neuromorphic computing with a single qudit

abstract: Accelerating computational tasks with quantum resources is a widely-pursued goal that is presently limited by the challenges associated with high-fidelity control of many-body quantum systems. The paradigm of reservoir computing presents an attractive alternative, especially in the noisy intermediate-scale quantum era, since control over the internal system state and knowledge of its dynamics are not required. Instead, complex, unsupervised internal trajectories through a large state space are leveraged as a computational resource. Quantum systems offer a unique venue for reservoir computing, given the presence of interactions unavailable in analogous classical systems, and the potential for a computational space that grows exponentially with physical system size. Here, we consider a reservoir comprised of a single qudit ($d$-dimensional quantum system). We demonstrate a robust performance advantage compared to an analogous classical system accompanied by a clear improvement with Hilbert space dimension for two benchmark tasks: signal processing and short-term memory capacity. Qudit reservoirs are directly realized by current-era quantum hardware, offering immediate practical implementation, and a promising outlook for increased performance in larger systems.


title: Alignment Completeness for Relational Hoare Logics

abstract: Relational Hoare logics (RHL) provide rules for reasoning about relations between programs. Several RHLs include a rule we call sequential product that infers a relational correctness judgment from judgments of ordinary Hoare logic (HL). Other rules embody sensible patterns of reasoning and have been found useful in practice, but sequential product is relatively complete on its own (with HL). As a more satisfactory way to evaluate RHLs, a notion of alignment completeness is introduced, in terms of the inductive assertion method and product automata. Alignment completeness results are given to account for several different sets of rules. The notion may serve to guide the design of RHLs and relational verifiers for richer programming languages and alignment patterns.


title: A Multi-Scale Conditional Deep Model for Tumor Cell Ratio Counting

abstract: We propose a method to accurately obtain the ratio of tumor cells over an entire histological slide. We use deep fully convolutional neural network models trained to detect and classify cells on images of H&E-stained tissue sections. Pathologists' labels consisting of exhaustive nuclei locations and tumor regions were used to trained the model in a supervised fashion. We show that combining two models, each working at a different magnification allows the system to capture both cell-level details and surrounding context to enable successful detection and classification of cells as either tumor-cell or normal-cell. Indeed, by conditioning the classification of a single cell on a multi-scale context information, our models mimic the process used by pathologists who assess cell neoplasticity and tumor extent at different microscope magnifications. The ratio of tumor cells can then be readily obtained by counting the number of cells in each class. To analyze an entire slide, we split it into multiple tiles that can be processed in parallel. The overall tumor cell ratio can then be aggregated. We perform experiments on a dataset of 100 slides with lung tumor specimens from both resection and tissue micro-array (TMA). We train fully-convolutional models using heavy data augmentation and batch normalization. On an unseen test set, we obtain an average mean absolute error on predicting the tumor cell ratio of less than 6%, which is significantly better than the human average of 20% and is key in properly selecting tissue samples for recent genetic panel tests geared at prescribing targeted cancer drugs. We perform ablation studies to show the importance of training two models at different magnifications and to justify the choice of some parameters, such as the size of the receptive field.


title: $\tau^{9}$ Eri: A bright pulsating magnetic Bp star in a 5.95-day double-lined spectroscopic binary

abstract: $\tau^{9}$ Eri is a Bp star that was previously reported to be a single-lined spectroscopic binary. Using 17 ESPaDOnS spectropolarimetric (Stokes $V$) observations we identified the weak spectral lines of the secondary component and detected a strong magnetic field in the primary. We performed orbital analysis of the radial velocities of both components to find a slightly eccentric orbit ($e= 0.129$) with a period of $5.95382(2)$ days. The longitudinal magnetic field ($B_\ell$) of the primary was measured from each of the Stokes $V$ profiles, with typical error bars smaller than 10 G. Equivalent widths (EWs) of LSD profiles corresponding to only the Fe lines were also measured. We performed frequency analysis of both the $B_\ell$ and EW measurements, as well as of the Hipparcos, SMEI, and TESS photometric data. All sets of photometric observations produce two clear, strong candidates for the rotation period of the Bp star: 1.21 days and 3.82 days. The $B_\ell$ and EW measurements are consistent with only the 3.82-day period. We conclude that HD 25267 consists of a late-type Bp star (M= $3.6_{-0.2}^{+0.1} M_\odot$, T= $12580_{-120}^{+150}$ K) with a rotation period of 3.82262(4) days orbiting with a period of 5.95382(2) days with a late-A/early-F type secondary companion (M= $1.6\pm 0.1 M_\odot$, T= $7530_{-510}^{+580}$ K). The Bp star's magnetic field is approximately dipolar with $i= 41\pm 2^{\circ}$, $\beta= 158\pm 5^{\circ}$ and $B_{\rm d}= 1040\pm 50$ G. All evidence points to the strong $1.209912(3)$ day period detected in photometry, along with several other weaker photometric signals, as arising from $g$-mode pulsations in the primary.


title: Structures of bulk hexagonal post-transition-metal chalcogenides from dispersion-corrected density-functional theory

abstract: We use dispersion-corrected density-functional theory to determine the relative energies of competing polytypes of bulk layered hexagonal post-transition-metal chalcogenides, to search for the most stable structures of these potentially technologically important semiconductors. We show that there is some degree of consensus among dispersion-corrected exchange-correlation functionals regarding the energetic orderings of polytypes, but we find that for each material there are multiple stacking orders with relative energies of less than 1 meV per monolayer unit cell, implying that stacking faults are expected to be abundant in all post-transition-metal chalcogenides. By fitting a simple model to all our energy data, we predict that the most stable hexagonal structure has P$6_3$/mmc space group in each case, but that the stacking order differs between GaS, GaSe, GaTe, and InS on the one hand and InSe and InTe on the other. At zero pressure, the relative energies obtained with different functionals disagree by around 1-5 meV per monolayer unit cell, which is not sufficient to identify the most stable structure unambiguously; however, multi-GPa pressures reduce the number of competing phases significantly. At higher pressures, an AB$'$-stacked structure of the most stable monolayer polytype is found to be the most stable bulk structure; this structure has not been reported in experiments thus far.


title: Overview and status of EXCLAIM, the experiment for cryogenic large-aperture intensity mapping

abstract: The EXperiment for Cryogenic Large-Aperture Intensity Mapping (EXCLAIM) is a balloon-borne far-infrared telescope that will survey star formation history over cosmological time scales to improve our understanding of why the star formation rate declined at redshift z < 2, despite continued clustering of dark matter. Specifically,EXCLAIM will map the emission of redshifted carbon monoxide and singly-ionized carbon lines in windows over a redshift range 0 < z < 3.5, following an innovative approach known as intensity mapping. Intensity mapping measures the statistics of brightness fluctuations of cumulative line emissions instead of detecting individual galaxies, thus enabling a blind, complete census of the emitting gas. To detect this emission unambiguously, EXCLAIM will cross-correlate with a spectroscopic galaxy catalog. The EXCLAIM mission uses a cryogenic design to cool the telescope optics to approximately 1.7 K. The telescope features a 90-cm primary mirror to probe spatial scales on the sky from the linear regime up to shot noise-dominated scales. The telescope optical elements couple to six {\mu}-Spec spectrometer modules, operating over a 420-540 GHz frequency band with a spectral resolution of 512 and featuring microwave kinetic inductance detectors. A Radio Frequency System-on-Chip (RFSoC) reads out the detectors in the baseline design. The cryogenic telescope and the sensitive detectors allow EXCLAIM to reach high sensitivity in spectral windows of low emission in the upper atmosphere. Here, an overview of the mission design and development status since the start of the EXCLAIM project in early 2019 is presented.


title: Wave Dark Matter

abstract: We review the physics and phenomenology of wave dark matter: a bosonic dark matter candidate lighter than about 30 eV. Such particles have a de Broglie wavelength exceeding the average inter-particle separation in a galaxy like the Milky Way, and are well described as classical waves. We outline the particle physics motivations for them, including the QCD axion and ultra-light axion-like-particles such as fuzzy dark matter. The wave nature of the dark matter implies a rich phenomenology: (1) Wave interference leads to order unity density fluctuations on de Broglie scale. A manifestation is vortices where the density vanishes and around which the velocity circulates. There is one vortex ring per de Broglie volume on average. (2) For sufficiently low masses, soliton condensation occurs at centers of halos. The soliton oscillates and random walks, another manifestation of wave interference. The halo/subhalo abundance is suppressed at small masses, but the precise prediction from numerical wave simulations remains to be determined. (3) For ultra-light ~$10^{-22}$ eV dark matter, the wave interference substructures can be probed by tidal streams/gravitational lensing. The signal can be distinguished from that due to subhalos by the dependence on stream orbital radius/image separation. (4) Axion detection experiments are sensitive to interference substructures for moderately light masses. The stochastic nature of the waves affects the interpretation of experiments and motivates the measurement of correlation functions. Current constraints and open questions, covering detection experiments and cosmological/galactic/black-hole observations, are discussed.

categories: astro-ph.CO astro-ph.GA gr-qc hep-ph hep-th


title: The DESI Sky Continuum Monitor System

abstract: The Dark Energy Spectroscopic Instrument (DESI) is an ongoing spectroscopic survey to measure the dark energy equation of state to unprecedented precision. We describe the DESI Sky Continuum Monitor System, which tracks the night sky brightness as part of a system that dynamically adjusts the spectroscopic exposure time to produce more uniform data quality and to maximize observing efficiency. The DESI dynamic exposure time calculator (ETC) will combine sky brightness measurements from the Sky Monitor with data from the guider system to calculate the exposure time to achieve uniform signal-to-noise ratio (SNR) in the spectra under various observing conditions. The DESI design includes 20 sky fibers, and these are split between two identical Sky Monitor units to provide redundancy. Each Sky Monitor unit uses an SBIG STXL-6303e CCD camera and supports an eight-position filter wheel. Both units have been completed and delivered to the Mayall Telescope at the Kitt Peak National Observatory. Commissioning results show that the Sky Monitor delivers the required performance necessary for the ETC.


title: Linearized theory of the fluctuation dynamics in 2D topological lasers

abstract: We theoretically study the collective excitation modes of a topological laser device operating in a single-mode steady-state with monochromatic emission. We consider a model device based on a two-dimensional photonic Harper-Hofstadter lattice including a broadband gain medium localized on the system edge. Different regimes are considered as a function of the value of the optical nonlinearity and of the gain relaxation time. The dispersion of the excitation modes is calculated via a full two-dimensional Bogoliubov approach and physically interpreted in terms of an effective one-dimensional theory. Depending on the system parameters, various possible physical processes leading to dynamical instabilities are identified and characterized. On this basis, strategies to enforce a stable single-mode topological laser operation are finally pointed out.


title: Probabilistic Error Analysis For Sequential Summation of Real Floating Point Numbers

abstract: We derive two probabilistic bounds for the relative forward error in the floating point summation of $n$ real numbers, by representing the roundoffs as independent, zero-mean, bounded random variables. The first probabilistic bound is based on Azuma's concentration inequality, and the second on the Azuma-Hoeffding Martingale. Our numerical experiments illustrate that the probabilistic bounds, with a stringent failure probability of $10^{-16}$, can be 1-2 orders of magnitude tighter than deterministic bounds. We performed the numerical experiments in Julia by summing up to $n=10^7$ single precision (binary32) floating point numbers, and up to $n=10^4$ half precision (binary16) floating point numbers. We simulated exact computation with double precision (binary64). The bounds tend to be tighter when all summands have the same sign.


title: Compositionality Through Language Transmission, using Artificial Neural Networks

abstract: We propose an architecture and process for using the Iterated Learning Model ("ILM") for artificial neural networks. We show that ILM does not lead to the same clear compositionality as observed using DCGs, but does lead to a modest improvement in compositionality, as measured by holdout accuracy and topologic similarity. We show that ILM can lead to an anti-correlation between holdout accuracy and topologic rho. We demonstrate that ILM can increase compositionality when using non-symbolic high-dimensional images as input.


title: Convergence Analysis of Fixed Point Chance Constrained Optimal Power Flow Problems

abstract: For optimal power flow problems with chance constraints, a particularly effective method is based on a fixed point iteration applied to a sequence of deterministic power flow problems. However, a priori, the convergence of such an approach is not necessarily guaranteed. This article analyses the convergence conditions for this fixed point approach, and reports numerical experiments including for large IEEE networks.


title: {\mu}-Spec Spectrometers for the EXCLAIM Instrument

abstract: The EXperiment for Cryogenic Large-Aperture Intensity Mapping (EXCLAIM) is a cryogenic balloon-borne instrument that will map carbon monoxide and singly-ionized carbon emission lines across redshifts from 0 to 3.5, using an intensity mapping approach. EXCLAIM will broaden our understanding of these elemental and molecular gases and the role they play in star formation processes across cosmic time scales. The focal plane of EXCLAIM's cryogenic telescope features six {\mu}-Spec spectrometers. {\mu}-Spec is a compact, integrated grating-analog spectrometer, which uses meandered superconducting niobium microstrip transmission lines on a single-crystal silicon dielectric to synthesize the grating. It features superconducting aluminum microwave kinetic inductance detectors (MKIDs), also in a microstrip architecture. The spectrometers for EXCLAIM couple to the telescope optics via a hybrid planar antenna coupled to a silicon lenslet. The spectrometers operate from 420 to 540 GHz with a resolving power R={\lambda}/{\Delta}{\lambda}=512 and employ an array of 355 MKIDs on each spectrometer. The spectrometer design targets a noise equivalent power (NEP) of 2x10-18W/\sqrt{Hz} (defined at the input to the main lobe of the spectrometer lenslet beam, within a 9-degree half width), enabled by the cryogenic telescope environment, the sensitive MKID detectors, and the low dielectric loss of single-crystal silicon. We report on these spectrometers under development for EXCLAIM, providing an overview of the spectrometer and component designs, the spectrometer fabrication process, fabrication developments since previous prototype demonstrations, and the current status of their development for the EXCLAIM mission.


title: Automated femur segmentation from computed tomography images using a deep neural network

abstract: Osteoporosis is a common bone disease that occurs when the creation of new bone does not keep up with the loss of old bone, resulting in increased fracture risk. Adults over the age of 50 are especially at risk and see their quality of life diminished because of limited mobility, which can lead to isolation and depression. We are developing a robust screening method capable of identifying individuals predisposed to hip fracture to address this clinical challenge. The method uses finite element analysis and relies on segmented computed tomography (CT) images of the hip. Presently, the segmentation of the proximal femur requires manual input, which is a tedious task, prone to human error, and severely limits the practicality of the method in a clinical context. Here we present a novel approach for segmenting the proximal femur that uses a deep convolutional neural network to produce accurate, automated, robust, and fast segmentations of the femur from CT scans. The network architecture is based on the renowned u-net, which consists of a downsampling path to extract increasingly complex features of the input patch and an upsampling path to convert the acquired low resolution image into a high resolution one. Skipped connections allow us to recover critical spatial information lost during downsampling. The model was trained on 30 manually segmented CT images and was evaluated on 200 ground truth manual segmentations. Our method delivers a mean Dice similarity coefficient (DSC) and 95th percentile Hausdorff distance (HD95) of 0.990 and 0.981 mm, respectively.


title: Not Now, Ask Later: Users Weaken Their Behavior Change Regimen Over Time, But Expect To Re-Strengthen It Imminently

abstract: How effectively do we adhere to nudges and interventions that help us control our online browsing habits? If we have a temporary lapse and disable the behavior change system, do we later resume our adherence, or has the dam broken? In this paper, we investigate these questions through log analyses of 8,000+ users on HabitLab, a behavior change platform that helps users reduce their time online. We find that, while users typically begin with high-challenge interventions, over time they allow themselves to slip into easier and easier interventions. Despite this, many still expect to return to the harder interventions imminently: they repeatedly choose to be asked to change difficulty again on the next visit, declining to have the system save their preference for easy interventions.


title: On the mapping between Hopfield networks and Restricted Boltzmann Machines

abstract: Hopfield networks (HNs) and Restricted Boltzmann Machines (RBMs) are two important models at the interface of statistical physics, machine learning, and neuroscience. Recently, there has been interest in the relationship between HNs and RBMs, due to their similarity under the statistical mechanics formalism. An exact mapping between HNs and RBMs has been previously noted for the special case of orthogonal (uncorrelated) encoded patterns. We present here an exact mapping in the case of correlated pattern HNs, which are more broadly applicable to existing datasets. Specifically, we show that any HN with $N$ binary variables and $p<N$ arbitrary binary patterns can be transformed into an RBM with $N$ binary visible variables and $p$ gaussian hidden variables. We outline the conditions under which the reverse mapping exists, and conduct experiments on the MNIST dataset which suggest the mapping provides a useful initialization to the RBM weights. We discuss extensions, the potential importance of this correspondence for the training of RBMs, and for understanding the performance of deep architectures which utilize RBMs.


title: FIRe-GAN: A novel Deep Learning-based infrared-visible fusion method for wildfire imagery

abstract: Early wildfire detection is of paramount importance to avoid as much damage as possible to the environment, properties, and lives. Deep Learning (DL) models that can leverage both visible and infrared information have the potential to display state-of-the-art performance, with lower false-positive rates than existing techniques. However, most DL-based image fusion methods have not been evaluated in the domain of fire imagery. Additionally, to the best of our knowledge, no publicly available dataset contains visible-infrared fused fire images. There is a growing interest in DL-based image fusion techniques due to their reduced complexity. Due to the latter, we select three state-of-the-art, DL-based image fusion techniques and evaluate them for the specific task of fire image fusion. We compare the performance of these methods on selected metrics. Finally, we also present an extension to one of the said methods, that we called FIRe-GAN, that improves the generation of artificial infrared images and fused ones on selected metrics.


title: Exploring Hydrodynamic Instabilities along the Infalling High-Velocity Cloud Complex A

abstract: Complex A is a high-velocity cloud that is traversing through the Galactic halo toward the Milky Way's disk. We combine both new and archival Green Bank Telescope observations to construct a spectroscopically resolved HI~21-cm map of this entire complex at a $17.1\lesssim\log{\left({N_{\rm HI},\,1\sigma}/{\rm cm}^{-2}\right)}\lesssim17.9$ sensitivity for a ${\rm FWHM}=20~{\rm km}\,{\rm s}^{-1}$ line and $\Delta\theta=9.1\,{\rm arcmins}$ or $17\lesssim\Delta d_{\theta}\lesssim30~\rm pc$ spatial resolution. We find that that Complex A is has a Galactic standard of rest frame velocity gradient of $\Delta\rm v_{GSR}/\Delta L=25~{\rm km}\,{\rm s}^{-1}/{\rm kpc}$ along its length, that it is decelerating at a rate of $\langle a\rangle_{\rm GSR}=55~{\rm km}/{\rm yr}^2$, and that it will reach the Galactic plane in $\Delta t\lesssim70~{\rm Myrs}$ if it can survive the journey. We have identify numerous signatures of gas disruption. The elongated and multi-core structure of Complex A indicates that either thermodynamic instabilities or shock-cascade processes have fragmented this stream. We find Rayleigh-Taylor fingers on the low-latitude edge of this HVC; many have been pushed backward by ram-pressure stripping. On the high-latitude side of the complex, Kelvin-Helmholtz instabilities have generated two large wings that extend tangentially off Complex A. The tips of these wings curve slightly forward in the direction of motion and have an elevated \hi\ column density, indicating that these wings are forming Rayleigh-Taylor globules at their tips and that this gas is becoming entangled with unseen vortices in the surrounding coronal gas. These observations provide new insights on the survivability of low-metallicity gas streams that are accreting onto $L_\star$ galaxies.


title: Design and implementation of the AMIGA embedded system for data acquisition

abstract: The Auger Muon Infill Ground Array (AMIGA) is part of the AugerPrime upgrade of the Pierre Auger Observatory. It consists of particle counters buried 2.3 m underground next to the water-Cherenkov stations that form the 23.5 km$^2$ large infilled array. The reduced distance between detectors in this denser area allows the lowering of the energy threshold for primary cosmic ray reconstruction down to about 10$^{17}$ eV. At the depth of 2.3 m the electromagnetic component of cosmic ray showers is almost entirely absorbed so that the buried scintillators provide an independent and direct measurement of the air showers muon content. This work describes the design and implementation of the AMIGA embedded system, which provides centralized control, data acquisition and environment monitoring to its detectors. The presented system was firstly tested in the engineering array phase ended in 2017, and lately selected as the final design to be installed in all new detectors of the production phase. The system was proven to be robust and reliable and has worked in a stable manner since its first deployment.


title: Rethinking Floating Point Overheads for Mixed Precision DNN Accelerators

abstract: In this paper, we propose a mixed-precision convolution unit architecture which supports different integer and floating point (FP) precisions. The proposed architecture is based on low-bit inner product units and realizes higher precision based on temporal decomposition. We illustrate how to integrate FP computations on integer-based architecture and evaluate overheads incurred by FP arithmetic support. We argue that alignment and addition overhead for FP inner product can be significant since the maximum exponent difference could be up to 58 bits, which results into a large alignment logic. To address this issue, we illustrate empirically that no more than 26-bitproduct bits are required and up to 8-bit of alignment is sufficient in most inference cases. We present novel optimizations based on the above observations to reduce the FP arithmetic hardware overheads. Our empirical results, based on simulation and hardware implementation, show significant reduction in FP16 overhead. Over typical mixed precision implementation, the proposed architecture achieves area improvements of up to 25% in TFLOPS/mm2and up to 46% in TOPS/mm2with power efficiency improvements of up to 40% in TFLOPS/Wand up to 63% in TOPS/W.


title: An extensive empirical study of inconsistent labels in multi-version-project defect data sets

abstract: The label quality of defect data sets has a direct influence on the reliability of defect prediction models. In this study, for multi-version-project defect data sets, we propose an approach to automatically detecting instances with inconsistent labels (i.e. the phenomena of instances having the same source code but different labels over multiple versions of a software project) and understand their influence on the evaluation and interpretation of defect prediction models. Based on five multi-version-project defect data sets (either widely used or the most up-to-date in the literature) collected by diverse approaches, we find that: (1) most versions in the investigated defect data sets contain inconsistent labels with varying degrees; (2) the existence of inconsistent labels in a training data set may considerably change the prediction performance of a defect prediction model as well as can lead to the identification of substantially different true defective modules; and (3) the importance ranking of independent variables in a defect prediction model can be substantially shifted due to the existence of inconsistent labels. The above findings reveal that inconsistent labels in defect data sets can profoundly change the prediction ability and interpretation of a defect prediction model. Therefore, we strongly suggest that practitioners should detect and exclude inconsistent labels in defect data sets to avoid their potential negative influence on defect prediction models. What is more, it is necessary for researchers to improve existing defect label collection approaches to reduce inconsistent labels. Furthermore, there is a need to re-examine the experimental conclusions of previous studies using multi-version-project defect data sets with a high ratio of inconsistent labels.


title: Information contraction in noisy binary neural networks and its implications

abstract: Neural networks have gained importance as the machine learning models that achieve state-of-the-art performance on large-scale image classification, object detection and natural language processing tasks. In this paper, we consider noisy binary neural networks, where each neuron has a non-zero probability of producing an incorrect output. These noisy models may arise from biological, physical and electronic contexts and constitute an important class of models that are relevant to the physical world. Intuitively, the number of neurons in such systems has to grow to compensate for the noise while maintaining the same level of expressive power and computation reliability. Our key finding is a lower bound for the required number of neurons in noisy neural networks, which is first of its kind. To prove this lower bound, we take an information theoretic approach and obtain a novel strong data processing inequality (SDPI), which not only generalizes the Evans-Schulman results for binary symmetric channels to general channels, but also improves the tightness drastically when applied to estimate end-to-end information contraction in networks. Our SDPI can be applied to various information processing systems, including neural networks and cellular automata. Applying the SDPI in noisy binary neural networks, we obtain our key lower bound and investigate its implications on network depth-width trade-offs, our results suggest a depth-width trade-off for noisy neural networks that is very different from the established understanding regarding noiseless neural networks. Furthermore, we apply the SDPI to study fault-tolerant cellular automata and obtain bounds on the error correction overheads and the relaxation time. This paper offers new understanding of noisy information processing systems through the lens of information theory.