title: Long-term Orbit Stability of the Apollo 11 Eagle Lunar Module Ascent Stage

abstract: The Apollo 11 Eagle Lunar Module ascent stage was abandoned in lunar orbit after the historic landing in 1969. Its fate is unknown. Numerical analysis described here provides evidence that this object might have remained in lunar orbit to the present day. The simulations show a periodic variation in eccentricity of the orbit, correlated to the selenographic longitude of the apsidal line. The rate of apsidal precession is correlated to eccentricity. These two factors appear to interact to stabilize the orbit over the long term.


title: Latent-space scalability for multi-task collaborative intelligence

abstract: We investigate latent-space scalability for multi-task collaborative intelligence, where one of the tasks is object detection and the other is input reconstruction. In our proposed approach, part of the latent space can be selectively decoded to support object detection while the remainder can be decoded when input reconstruction is needed. Such an approach allows reduced computational resources when only object detection is required, and this can be achieved without reconstructing input pixels. By varying the scaling factors of various terms in the training loss function, the system can be trained to achieve various trade-offs between object detection accuracy and input reconstruction quality. Experiments are conducted to demonstrate the adjustable system performance on the two tasks compared to the relevant benchmarks.


title: Escaping Saddle Points with Compressed SGD

abstract: Stochastic gradient descent (SGD) is a prevalent optimization technique for large-scale distributed machine learning. While SGD computation can be efficiently divided between multiple machines, communication typically becomes a bottleneck in the distributed setting. Gradient compression methods can be used to alleviate this problem, and a recent line of work shows that SGD augmented with gradient compression converges to an $\varepsilon$-first-order stationary point. In this paper we extend these results to convergence to an $\varepsilon$-second-order stationary point ($\varepsilon$-SOSP), which is to the best of our knowledge the first result of this type. In addition, we show that, when the stochastic gradient is not Lipschitz, compressed SGD with RandomK compressor converges to an $\varepsilon$-SOSP with the same number of iterations as uncompressed SGD [Jin et al.,2021] (JACM), while improving the total communication by a factor of $\tilde \Theta(\sqrt{d} \varepsilon^{-3/4})$, where $d$ is the dimension of the optimization problem. We present additional results for the cases when the compressor is arbitrary and when the stochastic gradient is Lipschitz.


title: Connes-Moscovici Residue Cocycle For Some Dirac-Type Operators

abstract: The residue cocycle associated to a suitable spectral triple is the key component of the Connes-Moscovici local index theorem in noncommutative geometry. We review the relationship between the residue cocycle and heat kernel asymptotics. We use a modified version of the Getzler calculus to compute the cocycle for a class of Dirac-type operators introduced by Bismut, obtained by deforming a Dirac operator by a closed 3-form B. We also compute the cocycle in low-dimensions when the 3-form B is not closed.


title: Efficient hypothesis testing for community detection in heterogeneous networks

abstract: Identifying communities in networks is a fundamental and challenging problem of practical importance in many fields of science. Current methods either ignore the heterogeneous distribution of nodal degrees or assume prior knowledge of the number of communities. Here we propose an efficient hypothesis test for community detection based on quantifying dissimilarities between graphs. Given a random graph, the null hypothesis is that it is of degree-corrected Erd\"{o}s-R\'{e}nyi type. We compare the dissimilarity between them by a measure incorporating the vertex distance distribution, the clustering coefficient distribution, and the alpha-centrality distribution, which is used for our hypothesis test. We design a two-stage bipartitioning algorithm to uncover the number of communities and the corresponding structure simultaneously. Experiments on synthetic and real networks show that our method outperforms state-of-the-art ones.


title: Comparative study of superconducting and normal-state anisotropy in Fe$_{1+y}$Te$_{0.6}$Se$_{0.4}$ superconductors with controlled amounts of interstitial excess Fe

abstract: We report a systematic study of the superconducting (SC) and normal-state anisotropy of Fe$_{1+y}$Te$_{0.6}$Se$_{0.4}$ single crystals with controlled amounts of excess Fe ($y$ = 0, 0.07, and 0.14). The SC state anisotropy $\gamma_{H}$ was obtained by measuring the upper critical fields under high magnetic fields over 50 T for both $H\parallel ab$ and $H\parallel c$. On the other hand, the normal state anisotropy $\gamma_{\rho}$ was obtained by measuring the resistivity with current flowing in the $ab$ plane ($\rho_{ab}$) and along the $c$ axis ($\rho_c$). To precisely measure $\rho_{ab}$ and $\rho_c$ in the same part of a specimen avoiding the variation dependent on pieces or parts, we adopt a new method using a micro-fabricated bridge with an additional neck part along $c$ axis. The $\gamma_{H}$ decreases from a value dependent on the amount of excess Fe at $T_{\rm{c}}$ to a common value $\sim$ 1 at 2 K. The different $\gamma_{H}$ at $T_{\rm{c}}$ ($\sim$1.5 for $y$ = 0, and 2.5 for $y$ = 0.14) suggests that the anisotropy of effective mass $m_c^*/m_{ab}^*$ increases from $\sim$ 2.25 ($y$ = 0) to 6.25 ($y$ = 0.14) with the excess Fe. The almost isotropic $\gamma_{H}$ at low temperatures is due to the strong spin paramagnetic effect at $H\parallel ab$. By contrast, the $\gamma_{\rho}$ shows a much larger value of $\sim$ 17 ($y$ = 0) to $\sim$ 50 ($y$ = 0.14) at the temperature just above $T_{\rm{c}}$. Combined the results of $\gamma_{H}$ and $\gamma_{\rho}$ near $T_{\rm{c}}$, we found out that the discrepant anisotropies between the SC and normal states originates from a large anisotropy of scattering time $\tau_{ab}$/$\tau_c$ $\sim$ 7.8. The $\tau_{ab}$/$\tau_c$ is found to be independent of the excess Fe.


title: Finding All Bounded-Length Simple Cycles in a Directed Graph

abstract: A new efficient algorithm is presented for finding all simple cycles that satisfy a length constraint in a directed graph. When the number of vertices is non-trivial, most cycle-finding problems are of practical interest for sparse graphs only. We show that for a class of sparse graphs in which the vertex degrees are almost uniform, our algorithm can find all cycles of length less than or equal to $k$ in $O((c+n)(k-1)d^k)$ steps, where $n$ is the number of vertices, $c$ is the total number of cycles discovered, $d$ is the average degree of the graph's vertices, and $k > 1$. While our analysis for the running time addresses only a class of sparse graphs, we provide empirical and experimental evidence of the efficiency of the algorithm for general sparse graphs. This algorithm is a significant improvement over the only other deterministic algorithm for this problem known to us; it also lends itself to massive parallelism. Experimental results of a serial implementation on some large real-world graphs are presented.


title: Variational Gaussian Topic Model with Invertible Neural Projections

abstract: Neural topic models have triggered a surge of interest in extracting topics from text automatically since they avoid the sophisticated derivations in conventional topic models. However, scarce neural topic models incorporate the word relatedness information captured in word embedding into the modeling process. To address this issue, we propose a novel topic modeling approach, called Variational Gaussian Topic Model (VaGTM). Based on the variational auto-encoder, the proposed VaGTM models each topic with a multivariate Gaussian in decoder to incorporate word relatedness. Furthermore, to address the limitation that pre-trained word embeddings of topic-associated words do not follow a multivariate Gaussian, Variational Gaussian Topic Model with Invertible neural Projections (VaGTM-IP) is extended from VaGTM. Three benchmark text corpora are used in experiments to verify the effectiveness of VaGTM and VaGTM-IP. The experimental results show that VaGTM and VaGTM-IP outperform several competitive baselines and obtain more coherent topics.


title: Three families of $q$-Lommel polynomials

abstract: Three $q$-versions of Lommel polynomials are studied. Included are explicit representations, recurrences, continued fractions, and connections to associated Askey--Wilson polynomials. Combinatorial results are emphasized, including a general theorem when $R_I$ moments coincide with orthogonal polynomial moments. The combinatorial results use weighted Motzkin paths, Schr\"oder paths, and parallelogram polyominoes.


title: Convergence analysis of the extragradient method for vector quasi-equilibrium problems

abstract: We study the extragradient method for solving vector quasi-equilibrium problems in Banach spaces, which generalizes the extragradient method for vector equilibrium problems and scalar quasi-equilibrium problems. We propose a regularization procedure which ensures strong convergence of the generated sequence to a solution of the vector quasi-equilibrium problem, under standard assumptions on the problem without assuming neither any monotonicity assumption on the vector valued bifunction nor any weak continuity assumption of $f$ in its arguments that in the many well-known methods have been used. Also, we show that the boundedness of the generated sequences implies that the solution set of the vector quasi-equilibrium problem is nonempty, and prove the strong convergence of the generated sequences to a solution of the problem. Finally, we give some examples of vector quasi-equilibrium problems in several Banach spaces to which our main theorem can be applied. We also present some numerical experiments.


title: Molecular field theory for biaxial smectic A liquid crystals

abstract: Thermotropic biaxial nematic phases seem to be rare, but biaxial smectic A phases less so. Here we use molecular field theory to study a simple two-parameter model, with one parameter promoting a biaxial phase and the second promoting smecticity. The theory combines the biaxial Maier-Saupe and McMillan models. We use alternatively the Sonnet-Virga-Durand (SVD) and geometric mean approximations (GMA) to characterize molecular biaxiality by a single parameter. For non-zero smecticity and biaxiality, the model always predicts a ground state biaxial smectic A phase. For a low degree of smectic order, the phase diagram is very rich, predicting uniaxial and biaxial nematic and smectic phases, with in addition a variety of tricritical and tetracritical points. For higher degrees of smecticity, the region of stability of the biaxial nematic phase is restricted and eventually disappears, yielding to the biaxial smectic phase. Phase diagrams from the two alternative approximations for molecular biaxiality are similar, except inasmuch that SVD allows for a first order isotropic-nematic biaxial transition, whereas GMA predicts a Landau point separating isotropic and biaxial nematic phases. We speculate that the rarity of thermotropic biaxial nematic phases is partly a consequence of the presence of stabler analogous smectic phases.


title: Learning from zero: how to make consumption-saving decisions in a stochastic environment with an AI algorithm

abstract: This exercise proposes a learning mechanism to model economic agent's decision-making process using an actor-critic structure in the literature of artificial intelligence. It is motivated by the psychology literature of learning through reinforcing good or bad decisions. In a model of an environment, to learn to make decisions, this AI agent needs to interact with its environment and make explorative actions. Each action in a given state brings a reward signal to the agent. These interactive experience is saved in the agent's memory, which is then used to update its subjective belief of the world. The agent's decision-making strategy is formed and adjusted based on this evolving subjective belief. This agent does not only take an action that it knows would bring a high reward, it also explores other possibilities. This is the process of taking explorative actions, and it ensures that the agent notices changes in its environment and adapt its subjective belief and decisions accordingly. Through a model of stochastic optimal growth, I illustrate that the economic agent under this proposed learning structure is adaptive to changes in an underlying stochastic process of the economy. AI agents can differ in their levels of exploration, which leads to different experience in the same environment. This reflects on to their different learning behaviours and welfare obtained. The chosen economic structure possesses the fundamental decision making problems of macroeconomic models, i.e., how to make consumption-saving decisions in a lifetime, and it can be generalised to other decision-making processes and economic models.


title: Deep Learning-based Implicit CSI Feedback in Massive MIMO

abstract: Massive multiple-input multiple-output can obtain more performance gain by exploiting the downlink channel state information (CSI) at the base station (BS). Therefore, studying CSI feedback with limited communication resources in frequency-division duplexing systems is of great importance. Recently, deep learning (DL)-based CSI feedback has shown considerable potential. However, the existing DL-based explicit feedback schemes are difficult to deploy because current fifth-generation mobile communication protocols and systems are designed based on an implicit feedback mechanism. In this paper, we propose a DL-based implicit feedback architecture to inherit the low-overhead characteristic, which uses neural networks (NNs) to replace the precoding matrix indicator (PMI) encoding and decoding modules. By using environment information, the NNs can achieve a more refined mapping between the precoding matrix and the PMI compared with codebooks. The correlation between subbands is also used to further improve the feedback performance. Simulation results show that, for a single resource block (RB), the proposed architecture can save 25.0% and 40.0% of overhead compared with Type I codebook under two antenna configurations, respectively. For a wideband system with 52 RBs, overhead can be saved by 30.7% and 48.0% compared with Type II codebook when ignoring and considering extracting subband correlation, respectively.


title: Anomaly Detection of Adversarial Examples using Class-conditional Generative Adversarial Networks

abstract: Deep Neural Networks (DNNs) have been shown vulnerable to Test-Time Evasion attacks (TTEs, or adversarial examples), which, by making small changes to the input, alter the DNN's decision. We propose an unsupervised attack detector on DNN classifiers based on class-conditional Generative Adversarial Networks (GANs). We model the distribution of clean data conditioned on the predicted class label by an Auxiliary Classifier GAN (AC-GAN). Given a test sample and its predicted class, three detection statistics are calculated based on the AC-GAN Generator and Discriminator. Experiments on image classification datasets under various TTE attacks show that our method outperforms previous detection methods. We also investigate the effectiveness of anomaly detection using different DNN layers (input features or internal-layer features) and demonstrate, as one might expect, that anomalies are harder to detect using features closer to the DNN's output layer.


title: Error Bounds of the Invariant Statistics in Machine Learning of Ergodic It\^o Diffusions

abstract: This paper studies the theoretical underpinnings of machine learning of ergodic It\^o diffusions. The objective is to understand the convergence properties of the invariant statistics when the underlying system of stochastic differential equations (SDEs) is empirically estimated with a supervised regression framework. Using the perturbation theory of ergodic Markov chains and the linear response theory, we deduce a linear dependence of the errors of one-point and two-point invariant statistics on the error in the learning of the drift and diffusion coefficients. More importantly, our study shows that the usual $L^2$-norm characterization of the learning generalization error is insufficient for achieving this linear dependence result. We find that sufficient conditions for such a linear dependence result are through learning algorithms that produce a uniformly Lipschitz and consistent estimator in the hypothesis space that retains certain characteristics of the drift coefficients, such as the usual linear growth condition that guarantees the existence of solutions of the underlying SDEs. We examine these conditions on two well-understood learning algorithms: the kernel-based spectral regression method and the shallow random neural networks with the ReLU activation function.


title: Design and Prototype Implementation of a Blockchain-Enabled LoRa System With Edge Computing

abstract: Efficiency and security have become critical issues during the development of the long-range (LoRa) system for Internet-of-Things (IoT) applications. The centralized work method in the LoRa system, where all packages are processed and kept in the central cloud, cannot well exploit the resources in LoRa gateways and also makes it vulnerable to security risks, such as data falsification or data loss. On the other hand, the blockchain has the potential to provide a decentralized and secure infrastructure for the LoRa system. However, there are significant challenges in deploying blockchain at LoRa gateways with limited edge computing abilities. This article proposes a design and implementation of the blockchain-enabled LoRa system with edge computing by using the open-source Hyperledger Fabric, which is called as HyperLoRa. According to different features of LoRa data, a blockchain network with multiple ledgers is designed, each of which stores a specific kind of LoRa data. LoRa gateways can participate in the operations of the blockchain and share the ledger that keep the time-critical network data with small size. Then, the edge computing abilities of LoRa gateways are utilized to handle the join procedure and application packages processing. Furthermore, a HyperLoRa prototype is implemented on embedded hardware, which demonstrates the feasibility of deploying the blockchain into LoRa gateways with limited computing and storage resources. Finally, various experiments are conducted to evaluate the performances of the proposed LoRa system.


title: EMface: Detecting Hard Faces by Exploring Receptive Field Pyraminds

abstract: Scale variation is one of the most challenging problems in face detection. Modern face detectors employ feature pyramids to deal with scale variation. However, it might break the feature consistency across different scales of faces. In this paper, we propose a simple yet effective method named the receptive field pyramids (RFP) method to enhance the representation ability of feature pyramids. It can learn different receptive fields in each feature map adaptively based on the varying scales of detected faces. Empirical results on two face detection benchmark datasets, i.e., WIDER FACE and UFDD, demonstrate that our proposed method can accelerate the inference rate significantly while achieving state-of-the-art performance. The source code of our method is available at \url{https://github.com/emdata-ailab/EMface}.


title: On the formation of terrestrial planets between two massive planets: The case of 55 Cancri

abstract: Considering the huge computational resources required by smoothed particle hydrodynamics (SPH) simulations and the overestimation of post-collision materials from perfect merging, we develop a statistical method to deal with collisions during the formation of planetary systems by introducing random material loss. In this method the mass and water content lost by the sole outcome from every merger vary randomly within a range dependent on the total mass and water content of colliding bodies. The application of the random loss method to the planet formation in the solar system shows a good consistency with existing SPH results. We also apply this method to the extrasolar planetary system 55 Cancri which hosts (at least) five planets and study the formation of terrestrial planets between the outermost two planets. A disk with 500 Mars mass embryos in dynamically cold orbits before the late-stage accretion phase is assumed. Scenarios with different amounts of planetary embryos and different loss parameters are adopted in our simulations. The statistical result from hundreds of simulations shows that an Earth-like planet with water inventory of roughly 6 Earth ocean could form between 55 Cnc f and d. It may reside between 1.0 and 2.6 AU but the most likely region extends from 1.5 to 2.1 AU. Thus the probability of this planet being in the potentially habitable zone (0.59--1.43 AU) is relatively low, only around 10\%. Planets 55 Cnc f and d could also be shaped and gain some water from giant impacts and consequently the orbits of them may also change accordingly.


title: A rotated characteristic decomposition technique for high-order reconstructions in multi-dimensions

abstract: When constructing high-order schemes for solving hyperbolic conservation laws, the corresponding high-order reconstructions are commonly performed in characteristic spaces to eliminate spurious oscillations as much as possible. For multi-dimensional finite volume (FV) schemes, we need to perform the characteristic decomposition several times in different normal directions of the target cell, which is very time-consuming. In this paper, we propose a rotated characteristic decomposition technique which requires only one-time decomposition for multi-dimensional reconstructions. The rotated direction depends only on the gradient of a specific physical quantity which is cheap to calculate. This technique not only reduces the computational cost remarkably, but also controls spurious oscillations effectively. We take a third-order weighted essentially non-oscillatory finite volume (WENO-FV) scheme for solving the Euler equations as an example to demonstrate the efficiency of the proposed technique.


title: An Intelligent Transaction Migration Scheme for RAFT-based Private Blockchain in Internet of Things Applications

abstract: The integration of multi-access edge computing (MEC) and RAFT consensus makes it feasible to deploy blockchain on trustful base stations and gateways to provide efficient and tamper-proof edge data services for Internet of Things (IoT) applications. However, reducing the latency of storing data on blockchain remains a challenge, especially when an anomalytriggered data flow in a certain area exceeds the block generation speed. This letter proposes an intelligent transaction migration scheme for RAFT-based private blockchain in IoT applications to migrate transactions in busy areas to idle regions intelligently. Simulation results show that the proposed scheme can apparently reduce the latency in high data flow circumstances.


title: CDF-S XT1: The off-axis afterglow of a neutron star merger at $z=2.23$

abstract: CDF-S XT1 is a fast-rising non-thermal X-ray transient detected by \textit{Chandra} in the Deep-Field South Survey. Although various hypotheses have been suggested, the origin of this transient remains unclear. Here, we show that the observations of CDF-S XT1 are well explained as the X-ray afterglow produced by a relativistic structured jet viewed off-axis. We measure properties of the jet, showing that they are similar to those of GRB170817A, albeit at cosmological distances. We measure the observers viewing angle to be $\theta_{\textrm{obs}} = 10^{\circ}\pm3^{\circ}$ and the core of the ultra-relativistic jet to be $\theta_{\textrm{core}} = 4.4^{\circ}\pm0.9^{\circ}$, where the uncertainties are the $68\%$ credible interval. The inferred properties and host galaxy combined with Hubble, radio, and optical non detections favour the hypothesis that CDF-S XT1 is the off-axis afterglow of a binary neutron star merger. We find that other previously suggested hypotheses are unable to explain all properties of CDF-S XT1. At a redshift of $z=2.23$, this is potentially the most distant observed neutron star merger to date and the first orphan afterglow of a short gamma-ray burst. We discuss the implications of a binary neutron star merger at such a high redshift for the star-formation rate in the early Universe, the nucleosynthesis of heavy elements, and the prospect of identifying other off-axis afterglows.


title: Correlation-invariant synaptic plasticity

abstract: Cortical populations of neurons develop sparse representations adapted to the statistics of the environment. While existing synaptic plasticity models reproduce some of the observed receptive-field properties, a major obstacle is the sensitivity of Hebbian learning to omnipresent spurious correlations in cortical networks which can overshadow relevant latent input features. Here we develop a theory for synaptic plasticity that is invariant to second-order correlations in the input. Going beyond classical Hebbian learning, we show how Hebbian long-term depression (LTD) cancels the sensitivity to second-order correlations, so that receptive fields become aligned with features hidden in higher-order statistics. Our simulations demonstrate how correlation-invariance enables biologically realistic models to develop sparse population codes, despite diverse levels of variability and heterogeneity. The theory advances our understanding of local unsupervised learning in cortical circuits and assigns a specific functional role to synaptic LTD mechanisms in pyramidal neurons.


title: Guidance and Teaching Network for Video Salient Object Detection

abstract: Owing to the difficulties of mining spatial-temporal cues, the existing approaches for video salient object detection (VSOD) are limited in understanding complex and noisy scenarios, and often fail in inferring prominent objects. To alleviate such shortcomings, we propose a simple yet efficient architecture, termed Guidance and Teaching Network (GTNet), to independently distil effective spatial and temporal cues with implicit guidance and explicit teaching at feature- and decision-level, respectively. To be specific, we (a) introduce a temporal modulator to implicitly bridge features from motion into the appearance branch, which is capable of fusing cross-modal features collaboratively, and (b) utilise motion-guided mask to propagate the explicit cues during the feature aggregation. This novel learning strategy achieves satisfactory results via decoupling the complex spatial-temporal cues and mapping informative cues across different modalities. Extensive experiments on three challenging benchmarks show that the proposed method can run at ~28 fps on a single TITAN Xp GPU and perform competitively against 14 cutting-edge baselines.


title: Simultaneous Robust State Estimation, Topology Error Processing, and Outage Detection for Unbalanced Distribution Systems

abstract: This paper proposes an efficient algorithmic approach that overcomes the critical challenges in the real-time unbalanced distribution system state estimation, topology error processing, and outage identification simultaneously: (1) Limited locations of measurement devices and unsynchronized measurement data as well as missing and bad data, (2) Complicated mixed-phase switch actions and mutual impedances, and (3) the nonlinear nature of unbalanced distribution system power flow and measurement data . A single snap-shot mixed-integer quadratic programming (MIQP) optimization framework is proposed to cope with these challenges. This MIQP framework presents a more accurate unbalanced distribution system model, linearizes the nonlinear relationship between bus voltage and current injections, formulates the complicated mixed-phase switch operations, and executes the outage detection function via analytic constraints. The proposed model can be effectively solved by a general commercial MIP solver. The effectiveness of the proposed approach is verified on an actual distribution feeder in Arizona.


title: IDEAL: Independent Domain Embedding Augmentation Learning

abstract: Many efforts have been devoted to designing sampling, mining, and weighting strategies in high-level deep metric learning (DML) loss objectives. However, little attention has been paid to low-level but essential data transformation. In this paper, we develop a novel mechanism, the independent domain embedding augmentation learning ({IDEAL}) method. It can simultaneously learn multiple independent embedding spaces for multiple domains generated by predefined data transformations. Our IDEAL is orthogonal to existing DML techniques and can be seamlessly combined with prior DML approaches for enhanced performance. Empirical results on visual retrieval tasks demonstrate the superiority of the proposed method. For example, the IDEAL improves the performance of MS loss by a large margin, 84.5\% $\rightarrow$ 87.1\% on Cars-196, and 65.8\% $\rightarrow$ 69.5\% on CUB-200 at Recall$@1$. Our IDEAL with MS loss also achieves the new state-of-the-art performance on three image retrieval benchmarks, \ie, \emph{Cars-196}, \emph{CUB-200}, and \emph{SOP}. It outperforms the most recent DML approaches, such as Circle loss and XBM, significantly. The source code and pre-trained models of our method will be available at\emph{\url{https://github.com/emdata-ailab/IDEAL}}.


title: TestRank: Bringing Order into Unlabeled Test Instances for Deep Learning Tasks

abstract: Deep learning (DL) has achieved unprecedented success in a variety of tasks. However, DL systems are notoriously difficult to test and debug due to the lack of explainability of DL models and the huge test input space to cover. Generally speaking, it is relatively easy to collect a massive amount of test data, but the labeling cost can be quite high. Consequently, it is essential to conduct test selection and label only those selected "high quality" bug-revealing test inputs for test cost reduction. In this paper, we propose a novel test prioritization technique that brings order into the unlabeled test instances according to their bug-revealing capabilities, namely TestRank. Different from existing solutions, TestRank leverages both intrinsic attributes and contextual attributes of test instances when prioritizing them. To be specific, we first build a similarity graph on test instances and training samples, and we conduct graph-based semi-supervised learning to extract contextual features. Then, for a particular test instance, the contextual features extracted from the graph neural network (GNN) and the intrinsic features obtained with the DL model itself are combined to predict its bug-revealing probability. Finally, TestRank prioritizes unlabeled test instances in descending order of the above probability value. We evaluate the performance of TestRank on a variety of image classification datasets. Experimental results show that the debugging efficiency of our method significantly outperforms existing test prioritization techniques.


title: Ferroelectricity in Polar ScAlN/GaN Epitaxial Semiconductor Heterostructures

abstract: Room temperature ferroelectricity is observed in lattice-matched ~18% ScAlN/GaN heterostructures grown by molecular beam epitaxy on single-crystal GaN substrates. The epitaxial films have smooth surface morphologies and high crystallinity. Pulsed current-voltage measurements confirm stable and repeatable polarization switching in such ferroelectric/semiconductor structures at several measurement conditions, and in multiple samples. The measured coercive field values are Ec~0.7 MV/cm at room temperature, with remnant polarization Pr~10 {\mu}C/cm2 for ~100 nm thick ScAlN layers. These values are substantially lower than comparable ScAlN control layers deposited by sputtering. Importantly, the coercive field of MBE ScAlN is smaller than the critical breakdown field of GaN, offering the potential for low voltage ferroelectric switching. The low coercive field ferroelectricity of ScAlN on GaN heralds the possibility of new forms of electronic and photonic devices with epitaxially integrated ferroelectric/semiconductor heterostructures that take advantage of the GaN electronic and photonic semiconductor platform, where the underlying semiconductors themselves exhibit spontaneous and piezoelectric polarization.


title: Kinematic Vortices induced by defects in Gapless Superconductors

abstract: The generalized time-dependent Ginzburg-Landau (GTDGL) theory was first proposed to describe better gap superconductors and the phenomenon of thermal phase-slips (PSs) in defect-free systems. However, there is a lack of information about studies involving PSs in mesoscopic superconductors with surface defects. Thus, in this work, we simulated samples with two co-linear surface defects consisting of a lower $T_c$ superconductor narrowing the sample in its central part. The non-linear GTDGL equations were solved self-consistently under variable applied currents and by considering both gapless and gap-like superconductors. In such systems, the currents passing by the constriction induce the appearance of kinematic vortices even in the gapless sample. The dynamics always occur with a pair forming at opposite edges of the sample and annihilating in the center. It is noticed that the resistive state appears at distinct values of the applied current density for different samples, and the critical current presents a tiny difference between gapless and gap-like samples. It is worth mentioning that parameters such as the size of electrical contacts and constriction affect the critical current and the average velocity of the kinematic vortices.


title: Approximate analytical solution for transient heat and mass transfer across an irregular interface

abstract: Motivated by practical applications in heat conduction and contaminant transport, we consider heat and mass diffusion across a perturbed interface separating two finite regions of distinct diffusivity. Under the assumption of continuity of the solution and diffusive flux at the interface, we use perturbation theory to develop an asymptotic expansion of the solution valid for small perturbations. Each term in the asymptotic expansion satisfies an initial-boundary value problem on the unperturbed domain subject to interface conditions depending on the previously determined terms in the asymptotic expansion. Demonstration of the perturbation solution is carried out for a specific, practically-relevant set of initial and boundary conditions with semi-analytical solutions of the initial-boundary value problems developed using standard Laplace transform and eigenfunction expansion techniques. Results for several choices of the perturbed interface confirm the perturbation solution is in good agreement with a standard numerical solution.


title: Towards Automatic Comparison of Data Privacy Documents: A Preliminary Experiment on GDPR-like Laws

abstract: General Data Protection Regulation (GDPR) becomes a standard law for data protection in many countries. Currently, twelve countries adopt the regulation and establish their GDPR-like regulation. However, to evaluate the differences and similarities of these GDPR-like regulations is time-consuming and needs a lot of manual effort from legal experts. Moreover, GDPR-like regulations from different countries are written in their languages leading to a more difficult task since legal experts who know both languages are essential. In this paper, we investigate a simple natural language processing (NLP) approach to tackle the problem. We first extract chunks of information from GDPR-like documents and form structured data from natural language. Next, we use NLP methods to compare documents to measure their similarity. Finally, we manually label a small set of data to evaluate our approach. The empirical result shows that the BERT model with cosine similarity outperforms other baselines. Our data and code are publicly available.


title: Probabilistic Sufficient Explanations

abstract: Understanding the behavior of learned classifiers is an important task, and various black-box explanations, logical reasoning approaches, and model-specific methods have been proposed. In this paper, we introduce probabilistic sufficient explanations, which formulate explaining an instance of classification as choosing the "simplest" subset of features such that only observing those features is "sufficient" to explain the classification. That is, sufficient to give us strong probabilistic guarantees that the model will behave similarly when all features are observed under the data distribution. In addition, we leverage tractable probabilistic reasoning tools such as probabilistic circuits and expected predictions to design a scalable algorithm for finding the desired explanations while keeping the guarantees intact. Our experiments demonstrate the effectiveness of our algorithm in finding sufficient explanations, and showcase its advantages compared to Anchors and logical explanations.


title: Isotropic Riemannian Maps and Helices along Riemannian Maps

abstract: This work has two main purposes. The first aim is to study isotropic Riemannian maps as a generalization of isotropic immersions. For this purpose, the concept of isotropic Riemannian map is presented, an example is given and a characterization is obtained. The second aim is to study the helices along Riemannian map. For this purpose, by using the notion of isotropic Riemannian map and the notion of helix on the manifold, a characterization is obtained for the transportation of a helix on the total manifold to the target manifold along a Riemannian map.


title: Improving the Regularity of Vector Fields

abstract: Let $\alpha>0$, $\beta>\alpha$, and let $X_1,\ldots, X_q$ be $\mathscr{C}^{\alpha}_{\mathrm{loc}}$ vector fields on a $\mathscr{C}^{\alpha+1}$ manifold which span the tangent space at every point, where $\mathscr{C}^{s}$ denotes the Zygmund-H\"older space of order $s$. We give necessary and sufficient conditions for when there is a $\mathscr{C}^{\beta+1}$ structure on the manifold, compatible with its $\mathscr{C}^{\alpha+1}$ structure, with respect to which $X_1,\ldots, X_q$ are $\mathscr{C}^{\beta}_{\mathrm{loc}}$. This strengthens previous results of the first author which dealt with the setting $\alpha>1$, $\beta>\max\{ \alpha, 2\}$.


title: Conformational analysis of tannic acid: environment effects in electronic and reactivity properties

abstract: Polyphenols are natural molecules of crucial importance in many applications, of which tannic acid (TA) is one of the most abundant and established. Most high-value applications require precise control of TA interactions with the system of interest. However, the molecular structure of TA is still not comprehended at the atomic level, of which all electronic and reactivity properties depend. Here, we combine an enhanced sampling global optimization method with density functional theory (DFT)-based calculations to explore the conformational space of TA assisted by unsupervised machine learning visualization, and then investigate its lowest energy conformers. We study the external environment's effect on the TA structure and properties. We find that vacuum favors compact structures by stabilizing peripheral atoms' weak interactions, while in water, the molecule adopts more open conformations. The frontier molecular orbitals of the conformers with lowest harmonic vibrational free energy have a HOMO-LUMO energy gap of 2.21 (3.27) eV, increasing to 2.82 (3.88) eV in water, at the DFT generalized gradient approximation (and hybrid) level of theory. Structural differences also change the distribution of potential reactive sites. We establish the fundamental importance of accurate structural consideration in determining TA and related polyphenols interactions in relevant technological applications.


title: Permutation actions on Quiver Grassmannians for the equioriented cycle via GKM-Theory

abstract: In previous work we equipped quiver Grassmannians for nilpotent representations of the equioriented cycle with an action of an algebraic torus. We show here that the equivariant cohomology ring is acted upon by a product of symmetric groups and we investigate this permutation action via GKM techniques. In the case of (type A) flag varieties, or Schubert varieties therein, we recover Tymoczko's results on permutation representations.


title: Backdoor Attacks on Self-Supervised Learning

abstract: Large-scale unlabeled data has spurred recent progress in self-supervised learning methods that learn rich visual representations. State-of-the-art self-supervised methods for learning representations from images (e.g., MoCo, BYOL, MSF) use an inductive bias that random augmentations (e.g., random crops) of an image should produce similar embeddings. We show that such methods are vulnerable to backdoor attacks - where an attacker poisons a small part of the unlabeled data by adding a trigger (image patch chosen by the attacker) to the images. The model performance is good on clean test images, but the attacker can manipulate the decision of the model by showing the trigger at test time. Backdoor attacks have been studied extensively in supervised learning and to the best of our knowledge, we are the first to study them for self-supervised learning. Backdoor attacks are more practical in self-supervised learning, since the use of large unlabeled data makes data inspection to remove poisons prohibitive. We show that in our targeted attack, the attacker can produce many false positives for the target category by using the trigger at test time. We also propose a defense method based on knowledge distillation that succeeds in neutralizing the attack. Our code is available here: https://github.com/UMBCvision/SSL-Backdoor .


title: RLIRank: Learning to Rank with Reinforcement Learning for Dynamic Search

abstract: To support complex search tasks, where the initial information requirements are complex or may change during the search, a search engine must adapt the information delivery as the user's information requirements evolve. To support this dynamic ranking paradigm effectively, search result ranking must incorporate both the user feedback received, and the information displayed so far. To address this problem, we introduce a novel reinforcement learning-based approach, RLIrank. We first build an adapted reinforcement learning framework to integrate the key components of the dynamic search. Then, we implement a new Learning to Rank (LTR) model for each iteration of the dynamic search, using a recurrent Long Short Term Memory neural network (LSTM), which estimates the gain for each next result, learning from each previously ranked document. To incorporate the user's feedback, we develop a word-embedding variation of the classic Rocchio Algorithm, to help guide the ranking towards the high-value documents. Those innovations enable RLIrank to outperform the previously reported methods from the TREC Dynamic Domain Tracks 2017 and exceed all the methods in 2016 TREC Dynamic Domain after multiple search iterations, advancing the state of the art for dynamic search.


title: Generic Stability Implication from Full Information Estimation to Moving-Horizon Estimation

abstract: Optimization-based state estimation is useful for handling of constrained linear or nonlinear dynamical systems. It has an ideal form, known as full information estimation (FIE) which uses all past measurements to perform state estimation, and also a practical counterpart, known as moving-horizon estimation (MHE) which uses most recent measurements of a limited length to perform the estimation. Due to the theoretical ideal, conditions for robust stability of FIE are relatively easier to establish than those for MHE, and various sufficient conditions have been developed in literature. This work reveals a generic link from robust stability of FIE to that of MHE, showing that the former implies at least a weaker robust stability of MHE which implements a long enough horizon. The implication strengthens to strict robust stability of MHE if the corresponding FIE satisfies a mild Lipschitz continuity condition. The revealed implications are then applied to derive new sufficient conditions for robust stability of MHE, which further reveal an intrinsic relation between the existence of a robustly stable FIE/MHE and the system being incrementally input/output-to-state stable.


title: Deep-Learned Event Variables for Collider Phenomenology

abstract: The choice of optimal event variables is crucial for achieving the maximal sensitivity of experimental analyses. Over time, physicists have derived suitable kinematic variables for many typical event topologies in collider physics. Here we introduce a deep learning technique to design good event variables, which are sensitive over a wide range of values for the unknown model parameters. We demonstrate that the neural networks trained with our technique on some simple event topologies are able to reproduce standard event variables like invariant mass, transverse mass, and stransverse mass. The method is automatable, completely general, and can be used to derive sensitive, previously unknown, event variables for other, more complex event topologies.


title: A Need-finding Study for Understanding Text Entry in Smartphone App Usage

abstract: Text entry makes up about one-fourth of the smartphone interaction events, and is known to be challenging and difficult. However, there has been little study about the characteristics of text entry in the context of smartphone app usage. In this paper, we present a mixed-method in-situ study conducted in 2016 with 17 active smartphone users to better understand text entry in smartphone app usage. Our results show 80% of text was entered into communication apps, with different apps exhibiting distinct usage patterns. We found that structured data such as URLs and email addresses are rarely typed but instead are auto-completed or replaced with search, copy-and-paste is rarely used, and sessions of smartphone usage with text entry involve more apps and last longer. We conclude with a discussion about the implications on the development of systems to better support mobile interaction.


title: Mapping the material distribution of a complex structure in an electron beam

abstract: The simulation and analysis of High Energy Physics experiments require a realistic simulation of the detector material and its distribution. The challenge is to describe all active and passive parts of large scale detectors like ATLAS in terms of their size, position and material composition. The common method for estimating the radiation length by weighing individual components, adding up their contributions and averaging the resulting material distribution over extended structures provides a good general estimate, but can deviate significantly from the material actually present. A method has been developed to assess its material distribution with high spatial resolution using the reconstructed scattering angles and hit positions of high energy electron tracks traversing an object under investigation. The study presented here shows measurements for an extended structure with a highly inhomogeneous material distribution. The structure under investigation is an End-of-Substructure-card prototype designed for the ATLAS Inner Tracker strip tracker -- a PCB populated with components of a large range of material budgets and sizes. The measurements presented here summarise requirements for data samples and reconstructed electron tracks for reliable image reconstruction of large scale, inhomogeneous samples, choices of pixel sizes compared to the size of features under investigation as well as a bremsstrahlung correction for high material densities and thicknesses.


title: A Novel 3D-UNet Deep Learning Framework Based on High-Dimensional Bilateral Grid for Edge Consistent Single Image Depth Estimation

abstract: The task of predicting smooth and edge-consistent depth maps is notoriously difficult for single image depth estimation. This paper proposes a novel Bilateral Grid based 3D convolutional neural network, dubbed as 3DBG-UNet, that parameterizes high dimensional feature space by encoding compact 3D bilateral grids with UNets and infers sharp geometric layout of the scene. Further, another novel 3DBGES-UNet model is introduced that integrate 3DBG-UNet for inferring an accurate depth map given a single color view. The 3DBGES-UNet concatenates 3DBG-UNet geometry map with the inception network edge accentuation map and a spatial object's boundary map obtained by leveraging semantic segmentation and train the UNet model with ResNet backbone. Both models are designed with a particular attention to explicitly account for edges or minute details. Preserving sharp discontinuities at depth edges is critical for many applications such as realistic integration of virtual objects in AR video or occlusion-aware view synthesis for 3D display applications.The proposed depth prediction network achieves state-of-the-art performance in both qualitative and quantitative evaluations on the challenging NYUv2-Depth data. The code and corresponding pre-trained weights will be made publicly available.


title: Convergence of a spatial semi-discretization for a backward semilinear stochastic parabolic equation

abstract: This paper studies the convergence of a spatial semi-discretization for a backward semilinear stochastic parabolic equation. The filtration is general, and the spatial semi-discretization uses the standard continuous piecewise linear element method. Firstly, higher regularity of the solution to the continuous equation is derived. Secondly, the first-order spatial accuracy is derived for the spatial semi-discretization. Thirdly, an application of the theoretical result to a stochastic linear quadratic control problem is presented.


title: Visual representation of negation: Real world data analysis on comic image design

abstract: There has been a widely held view that visual representations (e.g., photographs and illustrations) do not depict negation, for example, one that can be expressed by a sentence "the train is not coming". This view is empirically challenged by analyzing the real-world visual representations of comic (manga) illustrations. In the experiment using image captioning tasks, we gave people comic illustrations and asked them to explain what they could read from them. The collected data showed that some comic illustrations could depict negation without any aid of sequences (multiple panels) or conventional devices (special symbols). This type of comic illustrations was subjected to further experiments, classifying images into those containing negation and those not containing negation. While this image classification was easy for humans, it was difficult for data-driven machines, i.e., deep learning models (CNN), to achieve the same high performance. Given the findings, we argue that some comic illustrations evoke background knowledge and thus can depict negation with purely visual elements.


title: Li--Yau Inequalities for Dunkl Heat Equations

abstract: Motivated by recent works due to Yu--Zhao [J. Geom. Anal. 2020] and Weber--Zacher [arXiv:2012.12974], we study Li--Yau inequalities for the heat equation corresponding to the Dunkl Laplacian, which is a non-local operator parameterized by reflection groups and multiplicity functions. The results are sharp in the particular case when the reflection group is isometric to $\mathbb{Z}_2^d$.


title: Waiting Tables as a Robot Planning Problem

abstract: We present how we formalize the waiting tables task in a restaurant as a robot planning problem. This formalization was used to test our recently developed algorithms that allow for optimal planning for achieving multiple independent tasks that are partially observable and evolve over time [1], [2].


title: Certification of Iterative Predictions in Bayesian Neural Networks

abstract: We consider the problem of computing reach-avoid probabilities for iterative predictions made with Bayesian neural network (BNN) models. Specifically, we leverage bound propagation techniques and backward recursion to compute lower bounds for the probability that trajectories of the BNN model reach a given set of states while avoiding a set of unsafe states. We use the lower bounds in the context of control and reinforcement learning to provide safety certification for given control policies, as well as to synthesize control policies that improve the certification bounds. On a set of benchmarks, we demonstrate that our framework can be employed to certify policies over BNNs predictions for problems of more than $10$ dimensions, and to effectively synthesize policies that significantly increase the lower bound on the satisfaction probability.


title: Unified Expression of Utility-Privacy Trade-off in Privacy-Constrained Source Coding

abstract: Privacy-constrained source coding problems have become increasingly important recently, and the utility-privacy trade-off has been investigated for various systems. As pioneering work, Yamamoto (1983) found theoretical limits of the coding rate, privacy and utility in two cases; (i) both public and private information is encoded and (ii) only public information is encoded. However, the theoretical limit has not been characterized in a more general case; (iii) encoded messages consist of public information and a part of private information. Then in this paper, we characterize the trade-off relation in case (iii) using rate-distortion theory. The obtained expression of the achievable region is a "unified expression" because it includes the ones in cases (i) and (ii) as special cases. The numerical results also demonstrate that neither case (i) nor (ii) are the best cases, and it is important to select the encoded information adequately in case (iii).


title: Quasi-elastic electron scattering with KIDS nuclear energy density functional

abstract: Isoscalar and isovector effective masses of the nucleon in nuclear medium are explored in the quasi-elastic electron scattering of nuclei with KIDS (Korea-IBS-Daegu-SKKU) density functional model. Effective masses are varied in the range (0.7 ~ 1.0)$M$ where $M$ is the mass of the nucleon in free space. Parameters in the KIDS functional are adjusted to nuclear matter equation of state, energy and radius of selected nuclei, and effective mass of nucleons. Hartree-Fock equation is solved to obtain the wave functions of the nucleon in target nuclei, and they are plugged in the calculation of electron-nucleus scattering cross sections at the energies of incident electrons 300 MeV ~ 2.5 GeV. Theoretical prediction agrees well with measurement. Dependence on the effective mass is evident: cross section tends to increase with small isoscalar effective masses. However, effect of isovector effective mass is negligible. Spectroscopic factors are estimated for the protons in the outermost shells of $^{16}$O, $^{40}$Ca, and $^{208}$Pb. Results are consistent with the values in the literature.


title: Bijections for Ranked Tree-Child Networks

abstract: The class of ranked tree-child networks, tree-child networks arising from an evolution process with a fixed embedding into the plane, has recently been introduced by Bienvenu, Lambert, and Steel. These authors derived counting results for this class. In this note, we will give bijective proofs of three of their results. Two of our bijections answer questions raised in their paper.


title: Relativistic massive particle with spin-1/2, a vector bundle point of view

abstract: Recently, in the context of Relativistic Quantum Information Theory (RQI) of massive spin-1/2 particles, it has been suggested that it is impossible to perform a momentum-independent spin measurement, showing the inadequacy of the spin reduced density matrix as a legitimate information resource. This is because there is an unavoidable ambiguity in the definition of the spin of a moving particle. In this paper, by introducing a vector bundle theoretic way to view the single-particle state space, we try to rule out this ambiguity. The discrete degree of freedom of the resulting representation space contains information about the Pauli-Lubansky four-vector of the particle instead of the ambiguous spin. Comparing this representation with the standard one used in the RQI literature, we show that the discrete degree of freedom of the standard representation space attains the meaning of the Newton-Wigner spin. Also using this viewpoint, we give a mathematical proof of why the spin reduced density matrix is meaningless, which is stronger than the previous claims in that it asserts that the matrix is void of any meaning at all, not just in terms of the impossibility of measurement or Lorentz non-covariance. We give a way (which turns out to be the only way) to modify it to obtain the Pauli-Lubansky reduced density matrix, which is covariant under Lorentz transformations.


title: Revisiting G-Dedekind domains

abstract: Let $R$ be an integral domain with $qf(R)=K$ and let $F(R)$ be the set of nonzero fractional ideals of $R.$ Call $R$ a dually compact domain (DCD) if for each $I\in F(R)$ the ideal $I_{v}=(I^{-1})^{-1}$ is a finite intersection of principal fractional ideals. We characterize DCDs and show that the class of DCDs properly contains various classes of integral domains, such as Noetherian, Mori and Krull domains. In addition we show that a Schreier DCD is a GCD domain with the property that for each $A\in F(R)$ the ideal $A_{v}$ is principal. We show that a domain $R$ is G-Dedekind domain (i.e. has the property that $A_{v}$ is invertible for each $A\in F(R)$) if and only if $R$ is a DCD satisfying the property $\ast :$ for all pairs of subsets $\{a_{1},...,a_{m}\},\{b_{1},...b_{n}\}\subseteq K\backslash \{0\},$ $(\cap _{i=1}^{m}(a_{i})(\cap _{j=1}^{n}(b_{j}))=\cap _{i,j=1}^{m,n}a_{i}b_{j}$. We discuss what the appropriate name for G-Dedekind domains and related notions should be. We also make some observations about how the DCDs behave under localizations and polynomial ring extensions.


title: Ultimate plasma wakefield acceleration with 400 GeV proton driver

abstract: A new regime of proton-driven plasma wakefield acceleration is discovered, in which the plasma nonlinearity increases the phase velocity of the excited wave compared to that of the protons. If the beam charge is much larger than minimally necessary to excite a nonlinear wave, there is sufficient freedom in choosing the longitudinal plasma density profile to make the wave speed close to the speed of light. This allows electrons or positrons to be accelerated to about 200 GeV with a 400 GeV proton driver.


title: Tropical contractions to integral affine manifolds with singularities

abstract: We consider a toric degeneration of Calabi--Yau complete intersections of Batyrev--Borisov in the Gross--Siebert program. One can associate two types of tropical spaces with it. One is a tropical variety obtained by tropicalization. The other one is an integral affine manifold with singularities, which arises as the dual intersection complex of the toric degeneration. In this article, we show that the latter is contained in the former as a subset, and construct an integral affine contraction map from the former to the latter. We also show that the contraction preserves tropical cohomology groups, and sends the eigenwave to the radiance obstruction.


title: Safety Metrics for Semantic Segmentation in Autonomous Driving

abstract: Within the context of autonomous driving, safety-related metrics for deep neural networks have been widely studied for image classification and object detection. In this paper, we further consider safety-aware correctness and robustness metrics specialized for semantic segmentation. The novelty of our proposal is to move beyond pixel-level metrics: Given two images with each having N pixels being class-flipped, the designed metrics should, depending on the clustering of pixels being class-flipped or the location of occurrence, reflect a different level of safety criticality. The result evaluated on an autonomous driving dataset demonstrates the validity and practicality of our proposed methodology.


title: An Essential Local Geometric Morphism which is not Locally Connected though its Inverse Image Part defines an Exponential Ideal

abstract: We describe an essential local geometric morphism which is not locally connected, though its inverse image part defines an exponential ideal


title: Azimuthal correlations in diffractive scattering at the Electron-Ion Collider

abstract: We calculate azimuthal correlations between the exclusively produced vector meson and the scattered electron in Deep Inelastic Scattering processes at the future Electron-Ion Collider (EIC). We identify "kinematical" and "intrinsic" contributions to these correlations, and show that the correlations are sensitive to the non-trivial correlations in the gluon distribution of the target. Realistic predictions at the EIC kinematics are provided using two different approaches to describe the dipole-proton interaction at relatively small $x$.


title: Distance-based regression analysis for measuring associations

abstract: Distance-based regression model, as a nonparametric multivariate method, has been widely used to detect the association between variations in a distance or dissimilarity matrix for outcomes and predictor variables of interest in genetic association studies, genomic analyses, and many other research areas. Based on it, a pseudo-$F$ statistic which partitions the variation in distance matrices is often constructed to achieve the aim. To the best of our knowledge, the statistical properties of the pseudo-$F$ statistic has not yet been well established in the literature. To fill this gap, we study the asymptotic null distribution of the pseudo-$F$ statistic and show that it is asymptotically equivalent to a mixture of chi-squared random variables. Given that the pseudo-$F$ test statistic has unsatisfactory power when the correlations of the response variables are large, we propose a square-root $F$-type test statistic which replaces the similarity matrix with its square root. The asymptotic null distribution of the new test statistic and power of both tests are also investigated. Simulation studies are conducted to validate the asymptotic distributions of the tests and demonstrate that the proposed test has more robust power than the pseudo-$F$ test. Both test statistics are exemplified with a gene expression dataset for a prostate cancer pathway. Keywords: Asymptotic distribution, Chi-squared-type mixture, Nonparametric test, Pseudo-$F$ test, Similarity matrix.


title: Training Bi-Encoders for Word Sense Disambiguation

abstract: Modern transformer-based neural architectures yield impressive results in nearly every NLP task and Word Sense Disambiguation, the problem of discerning the correct sense of a word in a given context, is no exception. State-of-the-art approaches in WSD today leverage lexical information along with pre-trained embeddings from these models to achieve results comparable to human inter-annotator agreement on standard evaluation benchmarks. In the same vein, we experiment with several strategies to optimize bi-encoders for this specific task and propose alternative methods of presenting lexical information to our model. Through our multi-stage pre-training and fine-tuning pipeline we further the state of the art in Word Sense Disambiguation.


title: New Construction of Z-Complementary Code Sets and Mutually Orthogonal Complementary Sequence Sets

abstract: Due to the zero nontrivial aperiodic correlation of complete complementary code (CCCs), it is used in asynchronous multi carrier code division multiple access (MC-CDMA) communication to provide zero interference performance. However, there is no CCC for some lengths. In this case, if the system pays more attention to the correlation, it can use mutually orthogonal complementary sequence sets (MOCSSs), and if the system pays more attention to the set size, it can use Z-complementary code sets (ZCCSs). In this paper, we propose a direct construction of $q$-ary $(q^{v+1},q,q^m,q^{m-v})$-ZCCS. In addition, based on the known CCCs, we propose a new construction of MOCSSs and CCCs respectively.


title: On Instrumental Variable Regression for Deep Offline Policy Evaluation

abstract: We show that the popular reinforcement learning (RL) strategy of estimating the state-action value (Q-function) by minimizing the mean squared Bellman error leads to a regression problem with confounding, the inputs and output noise being correlated. Hence, direct minimization of the Bellman error can result in significantly biased Q-function estimates. We explain why fixing the target Q-network in Deep Q-Networks and Fitted Q Evaluation provides a way of overcoming this confounding, thus shedding new light on this popular but not well understood trick in the deep RL literature. An alternative approach to address confounding is to leverage techniques developed in the causality literature, notably instrumental variables (IV). We bring together here the literature on IV and RL by investigating whether IV approaches can lead to improved Q-function estimates. This paper analyzes and compares a wide range of recent IV methods in the context of offline policy evaluation (OPE), where the goal is to estimate the value of a policy using logged data only. By applying different IV techniques to OPE, we are not only able to recover previously proposed OPE methods such as model-based techniques but also to obtain competitive new techniques. We find empirically that state-of-the-art OPE methods are closely matched in performance by some IV methods such as AGMM, which were not developed for OPE. We open-source all our code and datasets at https://github.com/liyuan9988/IVOPEwithACME.


title: Remembering Louis Nirenberg and his mathematics

abstract: The article is dedicated to recalling the life and mathematics of Louis Nirenberg, a distinguished Canadian mathematician who recently died in New York, where he lived. An emblematic figure of Analysis and Partial Differential Equations in the last century, he was awarded the Abel Prize in 2015. From his watchtower at the Courant Institute in New York, he was for many years a global teacher and master. He was a good friend of Spain.


title: Free energy diminishing discretization of Darcy-Forchheimer flow in poroelastic media

abstract: In this paper, we develop a discretization for the non-linear coupled model of classical Darcy-Forchheimer flow in deformable porous media, an extension of the quasi-static Biot equations. The continuous model exhibits a generalized gradient flow structure, identifying the dissipative character of the physical system. The considered mixed finite element discretization is compatible with this structure, which gives access to a simple proof for the existence, uniqueness, and stability of discrete approximations. Moreover, still within the framework, the discretization allows for the development of finite volume type discretizations by lumping or numerical quadrature, reducing the computational cost of the numerical solution.


title: The relative importance of structure and dynamics on node influence in reversible spreading processes

abstract: The reversible spreading processes with repeated infection widely exist in nature and human society, such as gonorrhea propagation and meme spreading. Identifying influential spreaders is an important issue in the reversible spreading dynamics on complex networks, which has been given much attention. Except for structural centrality, the nodes' dynamical states play a significant role in their spreading influence in the reversible spreading processes. By integrating the number of outgoing edges and infection risks of node's neighbors into structural centrality, a new measure for identifying influential spreaders is articulated which considers the relative importance of structure and dynamics on node influence. The number of outgoing edges and infection risks of neighbors represent the positive effect of the local structural characteristic and the negative effect of the dynamical states of nodes in identifying influential spreaders, respectively. We find that an appropriate combination of these two characteristics can greatly improve the accuracy of the proposed measure in identifying the most influential spreaders. Notably, compared with the positive effect of the local structural characteristic, slightly weakening the negative effect of dynamical states of nodes can make the proposed measure play the best performance. Quantitatively understanding the relative importance of structure and dynamics on node influence provides a significant insight into identifying influential nodes in the reversible spreading processes.


title: Training Mixed-Objective Pointing Decoders for Block-Level Optimization in Search Recommendation

abstract: Related or ideal follow-up suggestions to a web query in search engines are often optimized based on several different parameters -- relevance to the original query, diversity, click probability etc. One or many rankers may be trained to score each suggestion from a candidate pool based on these factors. These scorers are usually pairwise classification tasks where each training example consists of a user query and a single suggestion from the list of candidates. We propose an architecture that takes all candidate suggestions associated with a given query and outputs a suggestion block. We discuss the benefits of such an architecture over traditional approaches and experiment with further enforcing each individual metric through mixed-objective training.


title: How Can I Swing Like Pro?: Golf Swing Analysis Tool for Self Training

abstract: In this work, we present an analysis tool to help golf beginners compare their swing motion with experts' swing motion. The proposed application synchronizes videos with different swing phase timings using the latent features extracted by a neural network-based encoder and detects key frames where discrepant motions occur. We visualize synchronized image frames and 3D poses that help users recognize the difference and the key factors that can be important for their swing skill improvement.


title: ViPNAS: Efficient Video Pose Estimation via Neural Architecture Search

abstract: Human pose estimation has achieved significant progress in recent years. However, most of the recent methods focus on improving accuracy using complicated models and ignoring real-time efficiency. To achieve a better trade-off between accuracy and efficiency, we propose a novel neural architecture search (NAS) method, termed ViPNAS, to search networks in both spatial and temporal levels for fast online video pose estimation. In the spatial level, we carefully design the search space with five different dimensions including network depth, width, kernel size, group number, and attentions. In the temporal level, we search from a series of temporal feature fusions to optimize the total accuracy and speed across multiple video frames. To the best of our knowledge, we are the first to search for the temporal feature fusion and automatic computation allocation in videos. Extensive experiments demonstrate the effectiveness of our approach on the challenging COCO2017 and PoseTrack2018 datasets. Our discovered model family, S-ViPNAS and T-ViPNAS, achieve significantly higher inference speed (CPU real-time) without sacrificing the accuracy compared to the previous state-of-the-art methods.


title: Should We Trust This Summary? Bayesian Abstractive Summarization to The Rescue

abstract: We explore the notion of uncertainty in the context of modern abstractive summarization models, using the tools of Bayesian Deep Learning. Our approach approximates Bayesian inference by first extending state-of-the-art summarization models with Monte Carlo dropout and then using them to perform multiple stochastic forward passes. Based on Bayesian inference we are able to effectively quantify uncertainty at prediction time. Having a reliable uncertainty measure, we can improve the experience of the end user by filtering out generated summaries of high uncertainty. Furthermore, uncertainty estimation could be used as a criterion for selecting samples for annotation, and can be paired nicely with active learning and human-in-the-loop approaches. Finally, Bayesian inference enables us to find a Bayesian summary which performs better than a deterministic one and is more robust to uncertainty. In practice, we show that our Variational Bayesian equivalents of BART and PEGASUS can outperform their deterministic counterparts on multiple benchmark datasets.


title: Global Context for improving recognition of Online Handwritten Mathematical Expressions

abstract: This paper presents a temporal classification method for all three subtasks of symbol segmentation, symbol recognition and relation classification in online handwritten mathematical expressions (HMEs). The classification model is trained by multiple paths of symbols and spatial relations derived from the Symbol Relation Tree (SRT) representation of HMEs. The method benefits from global context of a deep bidirectional Long Short-term Memory network, which learns the temporal classification directly from online handwriting by the Connectionist Temporal Classification loss. To recognize an online HME, a symbol-level parse tree with Context-Free Grammar is constructed, where symbols and spatial relations are obtained from the temporal classification results. We show the effectiveness of the proposed method on the two latest CROHME datasets.


title: Changes from the Trenches: Should We Automate Them?

abstract: Code changes constitute one of the most important features of software evolution. Studying them can provide insights into the nature of software development and also lead to practical solutions - recommendations and automations of popular changes for developers. In our work, we developed a tool called PythonChangeMiner that allows to discover code change patterns in the histories of Python projects. We validated the tool and then employed it to discover patterns in the dataset of 120 projects from four different domains of software engineering. We manually categorized patterns that occur in more than one project from the standpoint of their structure and content, and compared different domains and patterns in that regard. We conducted a survey of the authors of the discovered changes: 82.9% of them said that they can give the change a name and 57.9% expressed their desire to have the changes automated, indicating the ability of the tool to discover valuable patterns. Finally, we interviewed 9 members of a popular integrated development environment (IDE) development team to estimate the feasibility of automating the discovered changes. It was revealed that independence from the context and high precision made a pattern a better candidate for automation. The patterns received mainly positive reviews and several were ranked as very likely for automation.


title: Revisiting the Negative Data of Distantly Supervised Relation Extraction

abstract: Distantly supervision automatically generates plenty of training samples for relation extraction. However, it also incurs two major problems: noisy labels and imbalanced training data. Previous works focus more on reducing wrongly labeled relations (false positives) while few explore the missing relations that are caused by incompleteness of knowledge base (false negatives). Furthermore, the quantity of negative labels overwhelmingly surpasses the positive ones in previous problem formulations. In this paper, we first provide a thorough analysis of the above challenges caused by negative data. Next, we formulate the problem of relation extraction into as a positive unlabeled learning task to alleviate false negative problem. Thirdly, we propose a pipeline approach, dubbed \textsc{ReRe}, that performs sentence-level relation detection then subject/object extraction to achieve sample-efficient training. Experimental results show that the proposed method consistently outperforms existing approaches and remains excellent performance even learned with a large quantity of false positive samples.


title: GSSF: A Generative Sequence Similarity Function based on a Seq2Seq model for clustering online handwritten mathematical answers

abstract: Toward a computer-assisted marking for descriptive math questions,this paper presents clustering of online handwritten mathematical expressions (OnHMEs) to help human markers to mark them efficiently and reliably. We propose a generative sequence similarity function for computing a similarity score of two OnHMEs based on a sequence-to-sequence OnHME recognizer. Each OnHME is represented by a similarity-based representation (SbR) vector. The SbR matrix is inputted to the k-means algorithm for clustering OnHMEs. Experiments are conducted on an answer dataset (Dset_Mix) of 200 OnHMEs mixed of real patterns and synthesized patterns for each of 10 questions and a real online handwritten mathematical answer dataset of 122 student answers at most for each of 15 questions (NIER_CBT). The best clustering results achieved around 0.916 and 0.915 for purity, and around 0.556 and 0.702 for the marking cost on Dset_Mix and NIER_CBT, respectively. Our method currently outperforms the previous methods for clustering HMEs.


title: Act Like a Radiologist: Towards Reliable Multi-view Correspondence Reasoning for Mammogram Mass Detection

abstract: Mammogram mass detection is crucial for diagnosing and preventing the breast cancers in clinical practice. The complementary effect of multi-view mammogram images provides valuable information about the breast anatomical prior structure and is of great significance in digital mammography interpretation. However, unlike radiologists who can utilize the natural reasoning ability to identify masses based on multiple mammographic views, how to endow the existing object detection models with the capability of multi-view reasoning is vital for decision-making in clinical diagnosis but remains the boundary to explore. In this paper, we propose an Anatomy-aware Graph convolutional Network (AGN), which is tailored for mammogram mass detection and endows existing detection methods with multi-view reasoning ability. The proposed AGN consists of three steps. Firstly, we introduce a Bipartite Graph convolutional Network (BGN) to model the intrinsic geometric and semantic relations of ipsilateral views. Secondly, considering that the visual asymmetry of bilateral views is widely adopted in clinical practice to assist the diagnosis of breast lesions, we propose an Inception Graph convolutional Network (IGN) to model the structural similarities of bilateral views. Finally, based on the constructed graphs, the multi-view information is propagated through nodes methodically, which equips the features learned from the examined view with multi-view reasoning ability. Experiments on two standard benchmarks reveal that AGN significantly exceeds the state-of-the-art performance. Visualization results show that AGN provides interpretable visual cues for clinical diagnosis.


title: Wick rotation and the positivity of energy in quantum field theory

abstract: We propose a new axiom system for unitary quantum field theories on curved space-time backgrounds, by postulating that the partition function and the correlators extend analytically to a certain domain of complex-valued metrics. Ordinary Riemannian metrics are contained in the allowable domain, while Lorentzian metrics lie on its boundary.


title: Variational Quantum Classifiers Through the Lens of the Hessian

abstract: In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ) devices suffers from noisy outputs. Just like classical deep learning, it also suffers from vanishing gradient problems. It is a realistic goal to study the topology of loss landscape, to visualize the curvature information and trainability of these circuits in the existence of vanishing gradients. In this paper, we calculate the Hessian and visualize the loss landscape of variational quantum classifiers at different points in parameter space. The curvature information of variational quantum classifiers (VQC) is interpreted and the loss function's convergence is shown. It helps us better understand the behavior of variational quantum circuits to tackle optimization problems efficiently. We investigated the variational quantum classifiers via Hessian on quantum computers, starting with a simple 4-bit parity problem to gain insight into the practical behavior of Hessian, then thoroughly analyzed the behavior of Hessian's eigenvalues on training the variational quantum classifier for the Diabetes dataset. Finally, we show how the adaptive Hessian learning rate can influence the convergence while training the variational circuits.


title: Optical Spectroscopy of Dual Quasar Candidates from the Subaru HSC-SSP program

abstract: We report on a spectroscopic program to search for dual quasars using Subaru Hyper Suprime-Cam (HSC) images of SDSS quasars which represent an important stage during galaxy mergers. Using Subaru/FOCAS and Gemini-N/GMOS, we identify three new physically associated quasar pairs having projected separations less than 20 kpc, out of 26 observed candidates. These include the discovery of the highest redshift ($z=3.1$) quasar pair with a separation $<$ 10 kpc. Based on the sample acquired to date, the success rate of identifying physically associated dual quasars is $19\%$ when excluding stars based on their HSC colors. Using the full sample of six spectroscopically confirmed dual quasars, we find that the black holes in these systems have black hole masses ($M_{BH} \sim 10^{8-9}M_{\odot}$) similar to single SDSS quasars as well as their bolometric luminosities and Eddington ratios. We measure the stellar mass of their host galaxies based on 2D image decomposition of the five-band ($grizy$) optical emission and assess the mass relation between supermassive black holes (SMBHs) and their hosts. Dual SMBHs appear to have elevated masses relative to their host galaxies. Thus mergers may not necessarily align such systems onto the local mass relation, as suggested by the Horizon-AGN simulation. This study suggests that dual luminous quasars are triggered prior to the final coalescence of the two SMBHs, resulting in early mass growth of the black holes relative to their host galaxies.


title: Expressivity of Quantitative Modal Logics: Categorical Foundations via Codensity and Approximation

abstract: A modal logic that is strong enough to fully characterize the behavior of a system is called expressive. Recently, with the growing diversity of systems to be reasoned about (probabilistic, cyber-physical, etc.), the focus shifted to quantitative settings which resulted in a number of expressivity results for quantitative logics and behavioral metrics. Each of these quantitative expressivity results uses a tailor-made argument; distilling the essence of these arguments is non-trivial, yet important to support the design of expressive modal logics for new quantitative settings. In this paper, we present the first categorical framework for deriving quantitative expressivity results, based on the new notion of approximating family. A key ingredient is the codensity lifting -- a uniform observation-centric construction of various bisimilarity-like notions such as bisimulation metrics. We show that several recent quantitative expressivity results (e.g. by K\"onig et al. and by Fijalkow et al.) are accommodated in our framework; a new expressivity result is derived, too, for what we call bisimulation uniformity.


title: Have you tried Neural Topic Models? Comparative Analysis of Neural and Non-Neural Topic Models with Application to COVID-19 Twitter Data

abstract: Topic models are widely used in studying social phenomena. We conduct a comparative study examining state-of-the-art neural versus non-neural topic models, performing a rigorous quantitative and qualitative assessment on a dataset of tweets about the COVID-19 pandemic. Our results show that not only do neural topic models outperform their classical counterparts on standard evaluation metrics, but they also produce more coherent topics, which are of great benefit when studying complex social problems. We also propose a novel regularization term for neural topic models, which is designed to address the well-documented problem of mode collapse, and demonstrate its effectiveness.


title: The fragmentation equation with size diffusion: Small and large size behavior of stationary solutions

abstract: The small and large size behavior of stationary solutions to the fragmentation equation with size diffusion is investigated. It is shown that these solutions behave like stretched exponentials for large sizes, the exponent in the exponential being solely given by the behavior of the overall fragmentation rate at infinity. In contrast, the small size behavior is partially governed by the daughter fragmentation distribution and is at most linear, with possibly non-algebraic behavior. Explicit solutions are also provided for particular fragmentation coefficients.


title: Using an Impact Hammer to Perform Biomechanical Measurements during Osteotomies: Study of an Animal Model

abstract: Osteotomies are common surgical procedures used for instance in rhinoplasty and usually performed using an osteotome impacted by a mallet. Visual control being difficult, osteotomies are often based on the surgeon proprioception to determine the number and energy of each impact. The aim of this study is to determine whether a hammer instrumented with a piezoelectric force sensor can be used to i) follow the displacement of the osteotome and ii) determine when the tip of the osteotome arrives in frontal bone, which corresponds to the end of the osteotomy pathway. Seven New Zealand White rabbit heads were collected, and two osteotomies were performed on their left and right nasal bones using the instrumented hammer to record the variation of the force as a function of time during each impact. The second peak time $\tau$ was derived from each signal while the displacement of the osteotome tip D was determined using video motion tracking. The results showed a significant correlation between $\tau$ and D ($\rho$${}^2$ = 0,74), allowing to estimate the displacement of the osteotome through the measurement of $\tau$. The values of $\tau$ measured in the frontal bone were significantly lower than in the nasal bone (p < 10-10), which allows to determine the transition between the nasal and frontal boneswhen $\tau$ becomes lower than 0.78 its initial averaged value. Although results should be validated clinically, this technology could be used by surgeons in the future as a decision support system to help assessing the osteotome environment.


title: FMM: An R Package for Modeling Rhythmic Patterns in Oscillatory Systems

abstract: This paper is dedicated to the R package FMM which implements a novel approach to describe rhythmic patterns in oscillatory signals. The frequency modulated M\"obius (FMM) model is defined as a parametric signal plus a gaussian noise, where the signal can be described as a single or a sum of waves. The FMM approach is flexible enough to describe a great variety of rhythmic patterns. The FMM package includes all required functions to fit and explore single and multi-wave FMM models, as well as a restricted version that allows equality constraints between parameters representing a priori knowledge about the shape to be included. Moreover, the FMM package can generate synthetic data and visualize the results of the fitting process. The potential of this methodology is illustrated with examples of such biological oscillations as the circadian rhythm in gene expression, the electrical activity of the heartbeat and neuronal activity.


title: Optimisation of the total population size for logistic diffusive equations: bang-bang property and fragmentation rate

abstract: In this article, we give an in-depth analysis of the problem of optimising the total population size for a standard logistic-diffusive model. This optimisation problem stems from the study of spatial ecology and amounts to the following question: assuming a species evolves in a domain, what is the best way to spread resources in order to ensure a maximal population size at equilibrium? {In recent years, many authors contributed to this topic.} We settle here the proof of two fundamental properties of optimisers: the bang-bang one which had so far only been proved under several strong assumptions, and the other one is the fragmentation of maximisers. Here, we prove the bang-bang property in all generality using a new spectral method. The technique introduced to demonstrate the bang-bang character of optimizers can be adapted and generalized to many optimization problems with other classes of bilinear optimal control problems where the state equation is semilinear and elliptic. We comment on it in a conclusion section.Regarding the geometry of maximisers, we exhibit a blow-up rate for the $BV$-norm of maximisers as the diffusivity gets smaller: if $\O$ is an orthotope and if $m_\mu$ is an optimal control, then $\Vert m_\mu\Vert_{BV}\gtrsim \sqrt{\mu}$. The proof of this results relies on a very fine energy argument.


title: A versatile flexure-based 6-axes force/torque sensor and its application to tribology

abstract: Six-axes force/torque sensors are increasingly needed in mechanical engineering. Here, we introduce a flexure-based design for such sensors, which solves some of the drawbacks of the existing designs. In particular, it is backlash-free, it can be wirelessly monitored, it exactly enforces 90 degrees angles between axes, and it enables visual inspection of the monitored system thanks to its hollow structure. We first describe the generic design, implementation and calibration procedure. We then demonstrate its capabilities through three illustration examples relevant to the field of tribology: low friction measurements under ultra-high vacuum, multi-directional friction measurements of elastomer contacts, and force/torque-based contact position monitoring.


title: Self-adjointness of magnetic laplacians on triangulations

abstract: The notions of magnetic difference operator defined on weighted graphs or magnetic exterior derivative are discrete analogues of the notionof covariant derivative on sections of a fibre bundle and its extension on differential forms. In this paper, we extend this notion to certain 2-simplicial complexes called triangulations, in a manner compatible with changes of gauge. Then we study the magnetic Gauss-Bonnet operator naturally defined in this context and introduce the geometric hypothesis of $\chi-$completeness which ensures the essential self-adjointness of this operator. This gives also the essential self-adjointness of the magnetic Laplacian on triangulations. Finally we introduce an hypothesis of bounded curvature for the magnetic potential which permits to characterize the domain of the self-adjoint extension.


title: Explainable Machine Learning with Prior Knowledge: An Overview

abstract: This survey presents an overview of integrating prior knowledge into machine learning systems in order to improve explainability. The complexity of machine learning models has elicited research to make them more explainable. However, most explainability methods cannot provide insight beyond the given data, requiring additional information about the context. We propose to harness prior knowledge to improve upon the explanation capabilities of machine learning models. In this paper, we present a categorization of current research into three main categories which either integrate knowledge into the machine learning pipeline, into the explainability method or derive knowledge from explanations. To classify the papers, we build upon the existing taxonomy of informed machine learning and extend it from the perspective of explainability. We conclude with open challenges and research directions.


title: Construction of the multi-soliton trains for a generalized derivative nonlinear Schr\''odinger equations by a fixed point method

abstract: We consider a derivative nonlinear Schr{\"o}dinger equation with general nonlinearlity: i$\partial$tu + $\partial$ 2 x u + i|u| 2$\sigma$ $\partial$xu = 0, In [12], the authors prove the stability of two solitary waves in energy space for $\sigma$ $\in$ (1, 2). As a consequence, there exists a two-soliton trains in energy space for $\sigma$ $\in$ (1, 2). Our goal in this paper is proving the existence of multi-soliton trains in energy space for $\sigma$ 5 2. Our proofs proceed by xed point arguments around the desired prole, using Strichartz estimates.


title: Algorithmic Audit of Italian Car Insurance: Evidence of Unfairness in Access and Pricing

abstract: We conduct an audit of pricing algorithms employed by companies in the Italian car insurance industry, primarily by gathering quotes through a popular comparison website. While acknowledging the complexity of the industry, we find evidence of several problematic practices. We show that birthplace and gender have a direct and sizeable impact on the prices quoted to drivers, despite national and international regulations against their use. Birthplace, in particular, is used quite frequently to the disadvantage of foreign-born drivers and drivers born in certain Italian cities. In extreme cases, a driver born in Laos may be charged 1,000 euros more than a driver born in Milan, all else being equal. For a subset of our sample, we collect quotes directly on a company website, where the direct influence of gender and birthplace is confirmed. Finally, we find that drivers with riskier profiles tend to see fewer quotes in the aggregator result pages, substantiating concerns of differential treatment raised in the past by Italian insurance regulators.


title: Rotation invariant CNN using scattering transform for image classification

abstract: Deep convolutional neural networks accuracy is heavily impacted by rotations of the input data. In this paper, we propose a convolutional predictor that is invariant to rotations in the input. This architecture is capable of predicting the angular orientation without angle-annotated data. Furthermore, the predictor maps continuously the random rotation of the input to a circular space of the prediction. For this purpose, we use the roto-translation properties existing in the Scattering Transform Networks with a series of 3D Convolutions. We validate the results by training with upright and randomly rotated samples. This allows further applications of this work on fields like automatic re-orientation of randomly oriented datasets.


title: Efficient Temporal Piecewise-Linear Numeric Planning with Lazy Consistency Checking

abstract: Temporal planning often involves numeric effects that are directly proportional to their action's duration. These include continuous effects, where a numeric variable is subjected to a rate of change while the action is being executed, and discrete duration-dependent effects, where the variable is updated instantaneously but the magnitude of such change is computed from the action's duration. When these effects are linear, state--of--the--art temporal planners often make use of Linear Programming to ensure that these numeric updates are consistent with the chosen start times and durations of the plan's actions. This is typically done for each evaluated state as part of the search process. This exhaustive approach is not scalable to solve real-world problems that require long plans, because the linear program's size becomes larger and slower to solve. In this work we propose techniques that minimise this overhead by computing these checks more selectively and formulating linear programs that have a smaller footprint. The effectiveness of these techniques is demonstrated on domains that use a mix of discrete and continuous effects, which is typical of real-world planning problems. The resultant planner also outperforms most state-of-the-art temporal-numeric and hybrid planners, in terms of both coverage and scalability.


title: Existence of absolutely continuous spectrum for Galton-Watson random trees

abstract: We establish a quantitative criterion for an operator defined on a Galton-Watson random tree for having an absolutely continuous spectrum. For the adjacency operator, this criterion requires that the offspring distribution has a relative variance below a threshold. As a byproduct, we prove that the adjacency operator of a supercritical Poisson Galton-Watson tree has a non-trivial absolutely continuous part if the average degree is large enough. We also prove that its Karp and Sipser core has purely absolutely spectrum on an interval if the average degree is large enough. We finally illustrate our criterion on the Anderson model on a d-regular infinite tree with d $\ge$ 3 and give a quantitative version of Klein's Theorem on the existence of absolutely continuous spectrum at disorder smaller that C $\sqrt$ d for some absolute constant C.


title: Thermodynamics of scale-dependent Friedmann equations

abstract: In this work, the role of a time-varying Newton constant under the scale-dependent approach is investigated in the thermodynamics of the Friedman equations. In particular, we show that the extended Friedman equations can be derived either from equilibrium thermodynamics when the non-matter energy momentum tensor is interpreted as a fluid or from non-equilibrium thermodynamics when an entropy production term, which depends on the time-varying Newton constant, is included. Finally, a comparison between black hole and cosmological thermodynamics in the framework of scale--dependent gravity is briefly discussed.