title: Structure/property relationship of semi-crystalline polymer during tensile deformation: A molecular dynamics approach

abstract: A coarse-grained molecular dynamics model of linear polyethylene-like polymer chain system was built to investigate the responds of structure and mechanical properties during uniaxial deformation. The influence of chain length, temperature, and strain rate were studied. The molecular dynamic tests showed that yielding may governed by different mechanisms at temperatures above and below Tg. Melt-recrystallization was observed at higher temperature, and destruction of crystal structures was observed at lower temperatures beyond yield point. While the higher temperature and lower strain rate have similar effects on mechanical properties. The correlated influences of time and temperature in the microscopic structures are more complicated. The evolution of microscopic characteristics such as the orientation parameter, the bond length, and the content of trans-trans conformation were calculated from the simulation. The results showed that the temperature have double effects on polymer chains. Higher temperature on one hand makes the chains more flexible, while on the other hand shortens the relaxation time of polymers. It is the interaction of these two aspects that determine the orientation parameter. During deformation, the trans conformation has experienced a rising process after the first drop process. And these microscopic structure parameters exhibit critical transaction, which are closely related to the yield point. A hypothetical model was thus proposed to describe the micro-structure and property relations based the investigations of this study.


title: The NTNU System at the Interspeech 2020 Non-Native Children's Speech ASR Challenge

abstract: This paper describes the NTNU ASR system participating in the Interspeech 2020 Non-Native Children's Speech ASR Challenge supported by the SIG-CHILD group of ISCA. This ASR shared task is made much more challenging due to the coexisting diversity of non-native and children speaking characteristics. In the setting of closed-track evaluation, all participants were restricted to develop their systems merely based on the speech and text corpora provided by the organizer. To work around this under-resourced issue, we built our ASR system on top of CNN-TDNNF-based acoustic models, meanwhile harnessing the synergistic power of various data augmentation strategies, including both utterance- and word-level speed perturbation and spectrogram augmentation, alongside a simple yet effective data-cleansing approach. All variants of our ASR system employed an RNN-based language model to rescore the first-pass recognition hypotheses, which was trained solely on the text dataset released by the organizer. Our system with the best configuration came out in second place, resulting in a word error rate (WER) of 17.59 %, while those of the top-performing, second runner-up and official baseline systems are 15.67%, 18.71%, 35.09%, respectively.


title: Expedited Multi-Target Search with Guaranteed Performance via Multi-fidelity Gaussian Processes

abstract: We consider a scenario in which an autonomous vehicle equipped with a downward facing camera operates in a 3D environment and is tasked with searching for an unknown number of stationary targets on the 2D floor of the environment. The key challenge is to minimize the search time while ensuring a high detection accuracy. We model the sensing field using a multi-fidelity Gaussian process that systematically describes the sensing information available at different altitudes from the floor. Based on the sensing model, we design a novel algorithm called Expedited Multi-Target Search (EMTS) that (i) addresses the coverage-accuracy trade-off: sampling at locations farther from the floor provides wider field of view but less accurate measurements, (ii) computes an occupancy map of the floor within a prescribed accuracy and quickly eliminates unoccupied regions from the search space, and (iii) travels efficiently to collect the required samples for target detection. We rigorously analyze the algorithm and establish formal guarantees on the target detection accuracy and the expected detection time. We illustrate the algorithm using a simulated multi-target search scenario.


title: Mining Environment Assumptions for Cyber-Physical System Models

abstract: Many complex cyber-physical systems can be modeled as heterogeneous components interacting with each other in real-time. We assume that the correctness of each component can be specified as a requirement satisfied by the output signals produced by the component, and that such an output guarantee is expressed in a real-time temporal logic such as Signal Temporal Logic (STL). In this paper, we hypothesize that a large subset of input signals for which the corresponding output signals satisfy the output requirement can also be compactly described using an STL formula that we call the environment assumption. We propose an algorithm to mine such an environment assumption using a supervised learning technique. Essentially, our algorithm treats the environment assumption as a classifier that labels input signals as good if the corresponding output signal satisfies the output requirement, and as bad otherwise. Our learning method simultaneously learns the structure of the STL formula as well as the values of the numeric constants appearing in the formula. To achieve this, we combine a procedure to systematically enumerate candidate Parametric STL (PSTL) formulas, with a decision-tree based approach to learn parameter values. We demonstrate experimental results on real world data from several domains including transportation and health care.


title: Frequency-dependent topological phases and photonic detouring in valley photonic crystals

abstract: Here, the frequency degree of freedom is introduced into valley photonic crystals with dual band gaps. Based on the high-order plane wave expansion model, we derive an effective Hamiltonian which characterizes dual band gaps. Metallic valley photonic crystals are demonstrated as examples in which all four topological phases are found. At the domain walls between topologically distinct valley photonic crystals, frequency-dependent edge states are demonstrated and a broadband photonic detouring is proposed. Our findings provide the guidance for designing the frequency-dependent property of topological structures and show its potential applications in wavelength division multiplexers.


title: Meronic AdS Black Holes in Gauss-Bonnet Theory

abstract: We examine analytical, intrinsically non-Abelian, black holes with SU(2) Yang-Mills matter content. Working in the extended thermodynamics scenario of Lovelock black holes we study the phase structure of a four and a five-dimensional spherically symmetric configuration. We work in Gauss-Bonnet-Einstein-Yang-Mills gravity with negative cosmological constant and use Euclidean methods to explore the thermodynamics of the systems. We observe that the solutions belong to the expected universality class of van der Waals and find a reentrant phase transition.


title: Fundamental energy scale of the thick brane in mimetic gravity

abstract: In this paper, thick branes generated by the mimetic scalar field with Lagrange multiplier formulation are investigated. We give three typical thick brane background solutions with different asymptotic behaviors and show that all the solutions are stable under tensor perturbations. The effective potentials of the tensor perturbations exhibit as volcano potential, Po\"{o}schl-Teller potential, and harmonic oscillator potential for the three background solutions, respectively. All the tensor zero modes (massless gravitons) of the three cases can be localized on the brane. We also calculate the corrections to the Newtonian potential. On a large scale, the corrections to the Newtonian potential can be ignored. While on a small scale, the correction from the volcano-like potential is more pronounced than the other two cases. Combining the specific corrections to the Newtonian potential of these three cases and the latest results of short-range gravity experiments, we get the constraint on the scale parameter as $k\gtrsim 10^{-4}$eV, and constraint on the corresponding five-dimensional fundamental scale as $M_\ast \gtrsim10^5$TeV.


title: A Comparative Exploration of ML Techniques for Tuning Query Degree of Parallelism

abstract: There is a large body of recent work applying machine learning (ML) techniques to query optimization and query performance prediction in relational database management systems (RDBMSs). However, these works typically ignore the effect of \textit{intra-parallelism} -- a key component used to boost the performance of OLAP queries in practice -- on query performance prediction. In this paper, we take a first step towards filling this gap by studying the problem of \textit{tuning the degree of parallelism (DOP) via ML techniques} in Microsoft SQL Server, a popular commercial RDBMS that allows an individual query to execute using multiple cores. In our study, we cast the problem of DOP tuning as a {\em regression} task, and examine how several popular ML models can help with query performance prediction in a multi-core setting. We explore the design space and perform an extensive experimental study comparing different models against a list of performance metrics, testing how well they generalize in different settings: $(i)$ to queries from the same template, $(ii)$ to queries from a new template, $(iii)$ to instances of different scale, and $(iv)$ to different instances and queries. Our experimental results show that a simple featurization of the input query plan that ignores cost model estimations can accurately predict query performance, capture the speedup trend with respect to the available parallelism, as well as help with automatically choosing an optimal per-query DOP.


title: An Effective End-to-End Modeling Approach for Mispronunciation Detection

abstract: Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the widespread adoption of E2E modeling frameworks on ASR, there still is a dearth of work on investigating the E2E frameworks for use in computer-assisted pronunciation learning (CAPT), particularly for Mispronunciation detection (MD). In response, we first present a novel use of hybrid CTCAttention approach to the MD task, taking advantage of the strengths of both CTC and the attention-based model meanwhile getting around the need for phone-level forced alignment. Second, we perform input augmentation with text prompt information to make the resulting E2E model more tailored for the MD task. On the other hand, we adopt two MD decision methods so as to better cooperate with the proposed framework: 1) decision-making based on a recognition confidence measure or 2) simply based on speech recognition results. A series of Mandarin MD experiments demonstrate that our approach not only simplifies the processing pipeline of existing hybrid DNN-HMM systems but also brings about systematic and substantial performance improvements. Furthermore, input augmentation with text prompts seems to hold excellent promise for the E2E-based MD approach.


title: Nature of the spin resonance mode in CeCoIn$_5$

abstract: Spin-fluctuation-mediated unconventional superconductivity can emerge at the border of magnetism, featuring a superconducting order parameter that changes sign in momentum space. Detection of such a sign-change is experimentally challenging, since most probes are not phase-sensitive. The observation of a spin resonance mode (SRM) from inelastic neutron scattering is often seen as strong phase-sensitive evidence for a sign-changing superconducting order parameter, by assuming the SRM is a spin-excitonic bound state. Here, we show that for the heavy fermion superconductor CeCoIn$_5$, its SRM defies expectations for a spin-excitonic bound state, and is not a manifestation of sign-changing superconductivity. Instead, the SRM in CeCoIn$_5$ likely arises from a reduction of damping to a magnon-like mode in the superconducting state, due to its proximity to magnetic quantum criticality. Our findings emphasize the need for more stringent tests of whether SRMs are spin-excitonic, when using their presence to evidence sign-changing superconductivity.


title: Parsimonious Computing: A Minority Training Regime for Effective Prediction in Large Microarray Expression Data Sets

abstract: Rigorous mathematical investigation of learning rates used in back-propagation in shallow neural networks has become a necessity. This is because experimental evidence needs to be endorsed by a theoretical background. Such theory may be helpful in reducing the volume of experimental effort to accomplish desired results. We leveraged the functional property of Mean Square Error, which is Lipschitz continuous to compute learning rate in shallow neural networks. We claim that our approach reduces tuning efforts, especially when a significant corpus of data has to be handled. We achieve remarkable improvement in saving computational cost while surpassing prediction accuracy reported in literature. The learning rate, proposed here, is the inverse of the Lipschitz constant. The work results in a novel method for carrying out gene expression inference on large microarray data sets with a shallow architecture constrained by limited computing resources. A combination of random sub-sampling of the dataset, an adaptive Lipschitz constant inspired learning rate and a new activation function, A-ReLU helped accomplish the results reported in the paper.


title: Deep Learning of Protein Structural Classes: Any Evidence for an 'Urfold'?

abstract: Recent computational advances in the accurate prediction of protein three-dimensional (3D) structures from amino acid sequences now present a unique opportunity to decipher the interrelationships between proteins. This task entails--but is not equivalent to--a problem of 3D structure comparison and classification. Historically, protein domain classification has been a largely manual and subjective activity, relying upon various heuristics. Databases such as CATH represent significant steps towards a more systematic (and automatable) approach, yet there still remains much room for the development of more scalable and quantitative classification methods, grounded in machine learning. We suspect that re-examining these relationships via a Deep Learning (DL) approach may entail a large-scale restructuring of classification schemes, improved with respect to the interpretability of distant relationships between proteins. Here, we describe our training of DL models on protein domain structures (and their associated physicochemical properties) in order to evaluate classification properties at CATH's "homologous superfamily" (SF) level. To achieve this, we have devised and applied an extension of image-classification methods and image segmentation techniques, utilizing a convolutional autoencoder model architecture. Our DL architecture allows models to learn structural features that, in a sense, 'define' different homologous SFs. We evaluate and quantify pairwise 'distances' between SFs by building one model per SF and comparing the loss functions of the models. Hierarchical clustering on these distance matrices provides a new view of protein interrelationships--a view that extends beyond simple structural/geometric similarity, and towards the realm of structure/function properties.


title: Information Geometric Inequalities of Chemical Thermodynamics

abstract: We study a connection between chemical thermodynamics and information geometry. We clarify a relation between the Gibbs free energy of an ideal dilute solution and an information-geometric quantity called an $f$-divergence. From this relation, we derive information-geometric inequalities that give a speed limit for a changing rate of the Gibbs free energy and a general bound of chemical fluctuations. These information-geometric inequalities can be regarded as generalizations of the Cram\'{e}r--Rao inequality for chemical reaction networks described by rate equations, where unnormalized concentration distributions are of importance rather than probability distributions. They hold true for damped oscillatory reaction networks and systems where the total concentration is not conserved so that the distribution cannot be normalized. We also formulate a trade-off relation between speed and time on a manifold of concentration distribution by using the geometrical structure induced by the $f$-divergence. Our results apply to both closed and open chemical reaction networks, thus they are widely useful for thermodynamic analysis of chemical systems from the viewpoint of information geometry.


title: Many-to-Many Voice Transformer Network

abstract: This paper proposes a voice conversion (VC) method based on a sequence-to-sequence (S2S) learning framework, which enables simultaneous conversion of the voice characteristics, pitch contour, and duration of input speech. We previously proposed an S2S-based VC method using a transformer network architecture called the voice transformer network (VTN). The original VTN was designed to learn only a mapping of speech feature sequences from one speaker to another. The main idea we propose is an extension of the original VTN that can simultaneously learn mappings among multiple speakers. This extension called the many-to-many VTN makes it able to fully use available training data collected from multiple speakers by capturing common latent features that can be shared across different speakers. It also allows us to introduce a training loss called the identity mapping loss to ensure that the input feature sequence will remain unchanged when the source and target speaker indices are the same. Using this particular loss for model training has been found to be extremely effective in improving the performance of the model at test time. We conducted speaker identity conversion experiments and found that our model obtained higher sound quality and speaker similarity than baseline methods. We also found that our model, with a slight modification to its architecture, could handle any-to-many conversion tasks reasonably well.


title: On the generalized SO(2n,C)-opers

abstract: Since their introduction by Beilinson-Drinfeld \cite{BD,Opers1}, opers have seen several generalizations. In \cite{BSY} a higher rank analog was studied, named {generalized $B$-opers}, where the successive quotients of the oper filtration are allowed to have higher rank and the underlying holomorphic vector bundle is endowed with a bilinear form which is compatible with both the filtration and the oper connection. Since the definition didn't encompass the even orthogonal groups, we dedicate this paper to study generalized $B$-opers whose structure group is ${\rm SO}(2n,\mathbb{C})$, and show their close relationship with geometric structures on a Riemann surface.


title: Augmenting Generative Adversarial Networks for Speech Emotion Recognition

abstract: Generative adversarial networks (GANs) have shown potential in learning emotional attributes and generating new data samples. However, their performance is usually hindered by the unavailability of larger speech emotion recognition (SER) data. In this work, we propose a framework that utilises the mixup data augmentation scheme to augment the GAN in feature learning and generation. To show the effectiveness of the proposed framework, we present results for SER on (i) synthetic feature vectors, (ii) augmentation of the training data with synthetic features, (iii) encoded features in compressed representation. Our results show that the proposed framework can effectively learn compressed emotional representations as well as it can generate synthetic samples that help improve performance in within-corpus and cross-corpus evaluation.


title: Deep Convolutional Sparse Coding Networks for Image Fusion

abstract: Image fusion is a significant problem in many fields including digital photography, computational imaging and remote sensing, to name but a few. Recently, deep learning has emerged as an important tool for image fusion. This paper presents three deep convolutional sparse coding (CSC) networks for three kinds of image fusion tasks (i.e., infrared and visible image fusion, multi-exposure image fusion, and multi-modal image fusion). The CSC model and the iterative shrinkage and thresholding algorithm are generalized into dictionary convolution units. As a result, all hyper-parameters are learned from data. Our extensive experiments and comprehensive comparisons reveal the superiority of the proposed networks with regard to quantitative evaluation and visual inspection.


title: Cross-Task Transfer for Geotagged Audiovisual Aerial Scene Recognition

abstract: Aerial scene recognition is a fundamental task in remote sensing and has recently received increased interest. While the visual information from overhead images with powerful models and efficient algorithms yields considerable performance on scene recognition, it still suffers from the variation of ground objects, lighting conditions etc. Inspired by the multi-channel perception theory in cognition science, in this paper, for improving the performance on the aerial scene recognition, we explore a novel audiovisual aerial scene recognition task using both images and sounds as input. Based on an observation that some specific sound events are more likely to be heard at a given geographic location, we propose to exploit the knowledge from the sound events to improve the performance on the aerial scene recognition. For this purpose, we have constructed a new dataset named AuDio Visual Aerial sceNe reCognition datasEt (ADVANCE). With the help of this dataset, we evaluate three proposed approaches for transferring the sound event knowledge to the aerial scene recognition task in a multimodal learning framework, and show the benefit of exploiting the audio information for the aerial scene recognition. The source code is publicly available for reproducibility purposes.


title: Glassy dielectric anomaly and negative magneto-capacitance effect in electron-doped Ca$_{1-x}$Sr$_x$Mn$_{0.85}$Sb$_{0.15}$O$_3$

abstract: Manganites exhibit various types of electronic phenomena, and these electronic characteristics can be controlled by carrier doping. Herein, we report the dielectric and magnetic properties of electron-doped manganite Ca$_{1-x}$Sr$_x$Mn$_{0.85}$Sb$_{0.15}$O$_3$ ($x$ = 0, 0.1, 0.2, and 0.3). The temperature dependence of the real part of the dielectric constant exhibits a broad and large peak just below the kink temperature of magnetization and a sharp decrease at lower temperatures, accompanied by an anomaly of the imaginary part. Furthermore, isovalent Sr substitution enhances the temperature of the dielectric peak by more than 50 K. Interestingly, the dielectric peak exhibits a negative magnetic-field effect. For all measured samples, the low-temperature variation of the dielectric constant can be qualitatively explained based on the Maxwell-Wagner (MW) model that describes a system composed of grain boundaries and semiconducting grains. However, the observed peak and its negative magneto-capacitance effect at high temperatures cannot be reproduced by a combination of the MW model and magnetoresistance effect. The dielectric peak strongly indicates polaronic relaxation in the present system. These results suggest that polarons form clusters with a dipole ordering and magneto-electric coupling, which might be consistently understood by the charge-ordering scenario.


title: Qubit coupled cluster singles and doubles variational quantum eigensolver ansatz for electronic structure calculations

abstract: Variational quantum eigensolver (VQE) for electronic structure calculations is believed to be one major potential application of near term quantum computing. Among all proposed VQE algorithms, the unitary coupled cluster singles and doubles excitations (UCCSD) VQE ansatz has achieved high accuracy and received a lot of research interest. However, the UCCSD VQE based on fermionic excitations needs extra terms for the parity when using Jordan-Wigner transformation. Here we introduce a new VQE ansatz based on the particle preserving exchange gate to achieve qubit excitations. The proposed VQE ansatz has gate complexity up-bounded to $O(n^4)$ where $n$ is the number of qubits of the Hamiltonian. Numerical results of simple molecular systems such as BeH$_2$, H$_2$O, N$_2$, H$_4$ and H$_6$ using the proposed VQE ansatz gives very accurate results within errors about $10^{-3}$ Hartree.


title: Direct imaging of liquid-nanoparticle interface with atom probe tomography

abstract: Understanding the structure and chemical composition at the liquid-nanoparticle (NP) interface is crucial for a wide range of physical, chemical and biological processes. In this study, direct imaging of the liquid-NP interface by atom probe tomography (APT) is reported for the first time, which reveals the distributions and the interactions of key atoms and molecules in this critical domain. The APT specimen is prepared by controlled graphene encapsulation of the solution containing nanoparticles on a metal tip, with an end radius in the range of 50 nm to allow field ionization and evaporation. Using Au nanoparticles (AuNPs) in suspension as an example, analysis of the mass spectrum and three-dimensional (3D) chemical maps from APT provides a detailed image of the water-gold interface with near-atomic resolution. At the water-gold interface, the formation of an electrical double layer (EDL) rich in water (H2O) molecules has been observed, which results from the charge from the binding between the trisodium-citrate layer and the AuNP. In the bulk water region, the density of reconstructed H2O has been shown to be consistent, reflecting a highly packed density of H2O molecules after graphene encapsulation. This study is the first demonstration of direct imaging of liquid-NP interface using APT with results providing an atom-by-atom 3D dissection of the liquid-NP interface.


title: Deep Architecture Enhancing Robustness to Noise, Adversarial Attacks, and Cross-corpus Setting for Speech Emotion Recognition

abstract: Speech emotion recognition systems (SER) can achieve high accuracy when the training and test data are identically distributed, but this assumption is frequently violated in practice and the performance of SER systems plummet against unforeseen data shifts. The design of robust models for accurate SER is challenging, which limits its use in practical applications. In this paper we propose a deeper neural network architecture wherein we fuse DenseNet, LSTM and Highway Network to learn powerful discriminative features which are robust to noise. We also propose data augmentation with our network architecture to further improve the robustness. We comprehensively evaluate the architecture coupled with data augmentation against (1) noise, (2) adversarial attacks and (3) cross-corpus settings. Our evaluations on the widely used IEMOCAP and MSP-IMPROV datasets show promising results when compared with existing studies and state-of-the-art models.


title: Reliability and Robustness analysis of Machine Learning based Phishing URL Detectors

abstract: ML-based Phishing URL (MLPU) detectors serve as the first level of defence to protect users and organisations from being victims of phishing attacks. Lately, few studies have launched successful adversarial attacks against specific MLPU detectors raising questions about their practical reliability and usage. Nevertheless, the robustness of these systems has not been extensively investigated. Therefore, the security vulnerabilities of these systems, in general, remain primarily unknown which calls for testing the robustness of these systems. In this article, we have proposed a methodology to investigate the reliability and robustness of 50 representative state-of-the-art MLPU models. Firstly, we have proposed a cost-effective Adversarial URL generator URLBUG that created an Adversarial URL dataset. Subsequently, we reproduced 50 MLPU (traditional ML and Deep learning) systems and recorded their baseline performance. Lastly, we tested the considered MLPU systems on Adversarial Dataset and analyzed their robustness and reliability using box plots and heat maps. Our results showed that the generated adversarial URLs have valid syntax and can be registered at a median annual price of \$11.99. Out of 13\% of the already registered adversarial URLs, 63.94\% were used for malicious purposes. Moreover, the considered MLPU models Matthew Correlation Coefficient (MCC) dropped from a median 0.92 to 0.02 when tested against $Adv_\mathrm{data}$, indicating that the baseline MLPU models are unreliable in their current form. Further, our findings identified several security vulnerabilities of these systems and provided future directions for researchers to design dependable and secure MLPU systems.


title: Large-Scale Object Detection in the Wild from Imbalanced Multi-Labels

abstract: Training with more data has always been the most stable and effective way of improving performance in deep learning era. As the largest object detection dataset so far, Open Images brings great opportunities and challenges for object detection in general and sophisticated scenarios. However, owing to its semi-automatic collecting and labeling pipeline to deal with the huge data scale, Open Images dataset suffers from label-related problems that objects may explicitly or implicitly have multiple labels and the label distribution is extremely imbalanced. In this work, we quantitatively analyze these label problems and provide a simple but effective solution. We design a concurrent softmax to handle the multi-label problems in object detection and propose a soft-sampling methods with hybrid training scheduler to deal with the label imbalance. Overall, our method yields a dramatic improvement of 3.34 points, leading to the best single model with 60.90 mAP on the public object detection test set of Open Images. And our ensembling result achieves 67.17 mAP, which is 4.29 points higher than the best result of Open Images public test 2018.


title: Ultrasound Response in Quantum Critical $\beta$-YbAlB$_4$ and $\alpha$-YbAl$_{0.986}$Fe$_{0.014}$B$_4$

abstract: We analyze the key origin of quantum valence criticality in the heavy electron metal $\beta$-YbAlB$_4$ evidenced in the sister compound $\alpha$-YbAl$_{0.986}$Fe$_{0.014}$B$_4$. By constructing a realistic canonical model for $\beta$-YbAlB$_4$, we evaluate Coulomb repulsion between the 4f and 5d electrons at Yb $U_{\rm fd}\approx 6.2$ eV realizing the quantum critical point (QCP) of the Yb-valence transition. To reveal the Yb 5d contribution to the quantum critical state, we propose ultrasound measurement. We find that softening of elastic constants of not only the bulk modulus but also the shear moduli is caused by electric quadrupole fluctuations enhanced by critical 4f and 5d charge fluctuations for low temperatures at the valence QCP. Possible relevance of these results to $\beta$-YbAlB$_4$ and also $\alpha$-YbAl$_{1-x}$Fe$_x$B$_4$ is discussed.


title: Simultaneous Differential Network Analysis and Classification for High-dimensional Matrix-variate Data, with application to Brain Connectivity Alteration Detection and fMRI-guided Medical Diagnoses of Alzheimer's Disease

abstract: Alzheimer's disease (AD) is the most common form of dementia, which causes problems with memory, thinking and behavior. Growing evidence has shown that the brain connectivity network experiences alterations for such a complex disease. Network comparison, also known as differential network analysis, is thus particularly powerful to reveal the disease pathologies and identify clinical biomarkers for medical diagnoses (classification). Data from neurophysiological measurements are multi-dimensional and in matrix-form, which poses major challenges in brain connectivity analysis and medical diagnoses. Naive vectorization method is not sufficient as it ignores the structural information within the matrix. In the article, we adopt the Kronecker product covariance matrix framework to capture both spatial and temporal correlations of the matrix-variate data while the temporal covariance matrix is treated as a nuisance parameter. By recognizing that the strengths of network connections may vary across subjects, we develop an ensemble-learning procedure, which identifies the differential interaction patterns of brain regions between the AD group and the control group and conducts medical diagnosis (classification) of AD simultaneously. We applied the proposed procedure to functional connectivity analysis of fMRI dataset related with Alzheimer's disease. The hub nodes and differential interaction patterns identified are consistent with existing experimental studies, and satisfactory out-of-sample classification performance is achieved for medical diagnosis of Alzheimer's disease. An R package \SDNCMV" for implementation is available at https://github.com/heyongstat/SDNCMV.


title: Statistical Robustness of Empirical Risks in Machine Learning

abstract: This paper studies convergence of empirical risks in reproducing kernel Hilbert spaces (RKHS). A conventional assumption in the existing research is that empirical training data do not contain any noise but this may not be satisfied in some practical circumstances. Consequently the existing convergence results do not provide a guarantee as to whether empirical risks based on empirical data are reliable or not when the data contain some noise. In this paper, we fill out the gap in a few steps. First, we derive moderate sufficient conditions under which the expected risk changes stably (continuously) against small perturbation of the probability distribution of the underlying random variables and demonstrate how the cost function and kernel affect the stability. Second, we examine the difference between laws of the statistical estimators of the expected optimal loss based on pure data and contaminated data using Prokhorov metric and Kantorovich metric and derive some qualitative and quantitative statistical robustness results. Third, we identify appropriate metrics under which the statistical estimators are uniformly asymptotically consistent. These results provide theoretical grounding for analysing asymptotic convergence and examining reliability of the statistical estimators in a number of well-known machine learning models.


title: Bayesian adjustment for preferential testing in estimating the COVID-19 infection fatality rate

abstract: A key challenge in estimating the infection fatality rate (IFR) -- and its relation with various factors of interest -- is determining the total number of cases. The total number of cases is not known because not everyone is tested, but also, more importantly, because tested individuals are not representative of the population at large. We refer to the phenomenon whereby infected individuals are more likely to be tested than non-infected individuals, as "preferential testing." An open question is whether or not it is possible to reliably estimate the IFR without any specific knowledge about the degree to which the data are biased by preferential testing. In this paper we take a partial identifiability approach, formulating clearly where deliberate prior assumptions can be made and presenting a Bayesian model which pools information from different samples. When the model is fit to European data obtained from seroprevalence studies and national official COVID-19 statistics, we estimate the overall COVID-19 IFR for Europe to be 0.53%, 95% C.I. = [0.39%, 0.69%].


title: Bayesian convolutional neural network based MRI brain extraction on nonhuman primates

abstract: Brain extraction or skull stripping of magnetic resonance images (MRI) is an essential step in neuroimaging studies, the accuracy of which can severely affect subsequent image processing procedures. Current automatic brain extraction methods demonstrate good results on human brains, but are often far from satisfactory on nonhuman primates, which are a necessary part of neuroscience research. To overcome the challenges of brain extraction in nonhuman primates, we propose a fully-automated brain extraction pipeline combining deep Bayesian convolutional neural network (CNN) and fully connected three-dimensional (3D) conditional random field (CRF). The deep Bayesian CNN, Bayesian SegNet, is used as the core segmentation engine. As a probabilistic network, it is not only able to perform accurate high-resolution pixel-wise brain segmentation, but also capable of measuring the model uncertainty by Monte Carlo sampling with dropout in the testing stage. Then, fully connected 3D CRF is used to refine the probability result from Bayesian SegNet in the whole 3D context of the brain volume. The proposed method was evaluated with a manually brain-extracted dataset comprising T1w images of 100 nonhuman primates. Our method outperforms six popular publicly available brain extraction packages and three well-established deep learning based methods with a mean Dice coefficient of 0.985 and a mean average symmetric surface distance of 0.220 mm. A better performance against all the compared methods was verified by statistical tests (all p-values<10-4, two-sided, Bonferroni corrected). The maximum uncertainty of the model on nonhuman primate brain extraction has a mean value of 0.116 across all the 100 subjects...


title: An Experimental Mathematics Approach to Several Combinatorial Problems

abstract: Experimental mathematics is an experimental approach to mathematics in which programming and symbolic computation are used to investigate mathematical objects, identify properties and patterns, discover facts and formulas and even automatically prove theorems. With an experimental mathematics approach, this dissertation deals with several combinatorial problems and demonstrates the methodology of experimental mathematics. We start with parking functions and their moments of certain statistics. Then we discuss about spanning trees and "almost diagonal" matrices to illustrate the methodology of experimental mathematics. We also apply experimental mathematics to Quicksort algorithms to study the running time. Finally we talk about the interesting peaceable queens problem.


title: Probing Cosmic Rays with Fe K$\alpha$ Line Structures Generated by Multiple Ionization Process

abstract: Supernova remnants (SNRs) have been regarded as major acceleration sites of Galactic cosmic rays. Recent X-ray studies revealed neutral Fe K$\alpha$ line emission from dense gas in the vicinity of some SNRs, which can be best interpreted as K-shell ionization of Fe atoms in the gas by sub-relativistic particles accelerated in the SNRs. In this Letter, we propose a novel method of constraining the composition of particles accelerated in SNRs, which is currently unknown. When energetic heavy ions collide with target atoms, their strong Coulomb field can easily cause simultaneous ejection of multiple inner-shell electrons of the target. This results in shifts in characteristic X-ray line energies, forming distinctive spectral structures. Detection of such structures in the neutral Fe K$\alpha$ line strongly supports the particle ionization scenario, and furthermore provides direct evidence of heavy ions in the accelerated particles. We construct a model for the Fe K$\alpha$ line structures by various projectile ions utilizing atomic-collision data.


title: Feature Transformation Ensemble Model with Batch Spectral Regularization for Cross-Domain Few-Shot Classification

abstract: In this paper, we propose a feature transformation ensemble model with batch spectral regularization for the Cross-domain few-shot learning (CD-FSL) challenge. Specifically, we proposes to construct an ensemble prediction model by performing diverse feature transformations after a feature extraction network. On each branch prediction network of the model we use a batch spectral regularization term to suppress the singular values of the feature matrix during pre-training to improve the generalization ability of the model. The proposed model can then be fine tuned in the target domain to address few-shot classification. We also further apply label propagation, entropy minimization and data augmentation to mitigate the shortage of labeled data in target domains. Experiments are conducted on a number of CD-FSL benchmark tasks with four target domains and the results demonstrate the superiority of our proposed model.


title: Hardy-Littlewood inequality and $L^p$-$L^q$ Fourier multipliers on compact hypergroups

abstract: This paper deals with the inequalities devoted to the comparison between the norm of a function on a compact hypergroup and the norm of its Fourier coefficients. We prove the classical Paley inequality in the setting of compact hypergroups which further gives the Hardy-Littlewood and Hausdorff-Young-Paley (Pitt) inequalities in the noncommutative context. We establish H\"ormander's $L^p$-$L^q$ Fourier multiplier theorem on compact hypergroups for $1<p \leq 2 \leq q<\infty$ as an application of Hausdorff-Young-Paley inequality. We examine our results for the hypergroups constructed from the conjugacy classes of compact Lie groups and for a class of countable compact hypergroups.


title: Context-aware and Scale-insensitive Temporal Repetition Counting

abstract: Temporal repetition counting aims to estimate the number of cycles of a given repetitive action. Existing deep learning methods assume repetitive actions are performed in a fixed time-scale, which is invalid for the complex repetitive actions in real life. In this paper, we tailor a context-aware and scale-insensitive framework, to tackle the challenges in repetition counting caused by the unknown and diverse cycle-lengths. Our approach combines two key insights: (1) Cycle lengths from different actions are unpredictable that require large-scale searching, but, once a coarse cycle length is determined, the variety between repetitions can be overcome by regression. (2) Determining the cycle length cannot only rely on a short fragment of video but a contextual understanding. The first point is implemented by a coarse-to-fine cycle refinement method. It avoids the heavy computation of exhaustively searching all the cycle lengths in the video, and, instead, it propagates the coarse prediction for further refinement in a hierarchical manner. We secondly propose a bidirectional cycle length estimation method for a context-aware prediction. It is a regression network that takes two consecutive coarse cycles as input, and predicts the locations of the previous and next repetitive cycles. To benefit the training and evaluation of temporal repetition counting area, we construct a new and largest benchmark, which contains 526 videos with diverse repetitive actions. Extensive experiments show that the proposed network trained on a single dataset outperforms state-of-the-art methods on several benchmarks, indicating that the proposed framework is general enough to capture repetition patterns across domains.


title: HaoCL: Harnessing Large-scale Heterogeneous Processors Made Easy

abstract: The pervasive adoption of Deep Learning (DL) and Graph Processing (GP) makes it a de facto requirement to build large-scale clusters of heterogeneous accelerators including GPUs and FPGAs. The OpenCL programming framework can be used on the individual nodes of such clusters but is not intended for deployment in a distributed manner. Fortunately, the original OpenCL semantics naturally fit into the programming environment of heterogeneous clusters. In this paper, we propose a heterogeneity-aware OpenCL-like (HaoCL) programming framework to facilitate the programming of a wide range of scientific applications including DL and GP workloads on large-scale heterogeneous clusters. With HaoCL, existing applications can be directly deployed on heterogeneous clusters without any modifications to the original OpenCL source code and without awareness of the underlying hardware topologies and configurations. Our experiments show that HaoCL imposes a negligible overhead in a distributed environment, and provides near-linear speedups on standard benchmarks when computation or data size exceeds the capacity of a single node. The system design and the evaluations are presented in this demo paper.


title: Deep Latent-Variable Kernel Learning

abstract: Deep kernel learning (DKL) leverages the connection between Gaussian process (GP) and neural networks (NN) to build an end-to-end, hybrid model. It combines the capability of NN to learn rich representations under massive data and the non-parametric property of GP to achieve automatic regularization that incorporates a trade-off between model fit and model complexity. However, the deterministic encoder may weaken the model regularization of the following GP part, especially on small datasets, due to the free latent representation. We therefore present a complete deep latent-variable kernel learning (DLVKL) model wherein the latent variables perform stochastic encoding for regularized representation. We further enhance the DLVKL from two aspects: (i) the expressive variational posterior through neural stochastic differential equation (NSDE) to improve the approximation quality, and (ii) the hybrid prior taking knowledge from both the SDE prior and the posterior to arrive at a flexible trade-off. Intensive experiments imply that the DLVKL-NSDE performs similarly to the well calibrated GP on small datasets, and outperforms existing deep GPs on large datasets.


title: An error reduced and uniform parameter approximation in fitting of B-spline curves to data points

abstract: Approximating data points in three or higher dimension space based on cubic B-spline curve is presented. Representations for planar curves, are merged and extended to the higher dimension. The curve is fitted to the order of data points, or uniform parameter values are assumed for the points. Tangents are assumed at the data points, corresponding to the property used in cardinal splines, for shape preserving and visually pleasing fit. Control points of piecewise continuous cubic bezier curves, meeting the boundary conditions of cardinal spline segments, are used for b-spline curve in corresponding coordinate planes. Approximation using error computed in the least square sense, based on a fraction of data points, is also presented.


title: Text Classification with Few Examples using Controlled Generalization

abstract: Training data for text classification is often limited in practice, especially for applications with many output classes or involving many related classification problems. This means classifiers must generalize from limited evidence, but the manner and extent of generalization is task dependent. Current practice primarily relies on pre-trained word embeddings to map words unseen in training to similar seen ones. Unfortunately, this squishes many components of meaning into highly restricted capacity. Our alternative begins with sparse pre-trained representations derived from unlabeled parsed corpora; based on the available training data, we select features that offers the relevant generalizations. This produces task-specific semantic vectors; here, we show that a feed-forward network over these vectors is especially effective in low-data scenarios, compared to existing state-of-the-art methods. By further pairing this network with a convolutional neural network, we keep this edge in low data scenarios and remain competitive when using full training sets.


title: Convex pentagons and concave octagons that can form rotationally symmetric tilings

abstract: In this study, the properties of convex pentagons that can form rotationally symmetric edge-to-edge tilings are discussed. Because the rotationally symmetric tilings are formed by concave octagons that are generated by two convex pentagons connected through a line symmetry, they are considered to be equivalent to rotationally symmetric tilings with concave octagons. In addition, under certain circumstances, tiling-like patterns with a regular polygonal hole at the center can be formed using these convex pentagons.


title: Chiral random matrix theory for colorful quark-antiquark condensates

abstract: In QCD at high density, the color-octet quark-antiquark condensate $\langle\overline\psi\gamma_0(\lambda^A)_C (\lambda^A)_F\psi\rangle$ is generally nonzero and dynamically breaks the $\mathrm{SU}(3)_C\times \mathrm{SU}(3)_L\times\mathrm{SU}(3)_R$ symmetry down to the diagonal $\mathrm{SU}(3)_V$. We evaluate this condensate in the mean-field approximation and find that it is of order $\mu\Delta^2\log(\mu/\Delta)$ where $\Delta$ is the BCS gap of quarks. Next we propose a novel non-Hermitian chiral random matrix theory that describes the formation of colorful quark-antiquark condensates. We take the microscopic large-$N$ limit and find that three phases appear depending on the parameter of the model. They are the color-flavor locked phase, the polar phase, and the normal phase. We rigorously derive the effective theory of Nambu-Goldstone modes and determine the quark-mass dependence of the partition function.


title: Leptophobic $Z^\prime$ bosons in the secluded UMSSM

abstract: We perform a comprehensive analysis of the secluded UMSSM model, consistent with present experimental constraints. We find that in this model the additional $Z^\prime$ gauge boson can be leptophobic without resorting to gauge kinetic mixing and, consequently, also $d$-quark-phobic, thus lowering the LHC bounds on its mass. The model can accommodate very light singlinos as DM candidates, consistent with present day cosmological and collider constraints. Light charginos and neutralinos are responsible for muon anomalous magnetic predictions within 1$\sigma$ of the measured experimental value. Finally, we look at the possibility that a lighter $Z^\prime$, expected to decay mainly into chargino pairs and followed by the decay into lepton pairs, could be observed at 27 TeV.


title: Charmonium transition in electromagnetic and rotational fields

abstract: We study charmonia in electromagnetic and rotational fields in the frame of a potential model. Different from the temperature field which is isotropic and leads to the well-known charmonium dissociation, the electromagnetic and rotational fields break down the radial symmetry, and the competition between strong interaction and electromagnetic and rotational interaction in the direction of Lorentz force makes the charmonia transit from an isotropic bound state of strong interaction with positive binding energy to an anisotropic bound state of electromagnetic and rotational interaction with negative binding energy. The transition seems possible to be realized in high energy nuclear collisions.


title: Mechanically modulated spin orbit couplings in oligopeptides

abstract: Recently experiments have shown very significant spin activity in biological molecules such as DNA, proteins, oligopeptides and aminoacids. Such molecules have in common their chiral structure, time reversal symmetry and the absence of magnetic exchange interactions. The spin activity is then assumed to be due to either the pure Spin-orbit (SO) interaction or SO coupled to the presence of strong local sources of electric fields. Here we derive an analytical tight-binding Hamiltonian model for Oligopeptides that contemplates both intrinsic SO and Rashba interaction induced by hydrogen bond. We use a lowest order perturbation theory band folding scheme and derive the reciprocal space intrinsic and Rashba type Hamiltonian terms to evaluate the spin activity of the oligopeptide and its dependence of molecule uniaxial deformations. SO strengths in the tens of meV are found and explicit spin active deformation potentials. We find a rich interplay between responses to deformations both to enhance and diminish SO strength that allow for experimental testing of the orbital model. Qualitative consistency with recent experiments shows the role of hydrogen bonding in spin activity.


title: The property of unique continuation for second order evolution PDEs

abstract: We present a simple and self-contained approach to establish the unique continuation property for some classical evolution equations of second order in a cylindrical domain. We namely discuss this property for wave, parabolic and Sch\"odinger operators with time-independent principal part. Our method is builds on two-parameter Carleman inequalities combined with unique continuation across a pseudo-convex hypersurface with respect to the space variable. The most results we demonstrate in this work are more or less classical. Some of them are not stated exactly as in their original form.


title: Beam-Domain Secret Key Generation for Multi-User Massive MIMO Networks

abstract: Physical-layer key generation (PKG) in multi-user massive MIMO networks faces great challenges due to the large length of pilots and the high dimension of channel matrix. To tackle these problems, we propose a novel massive MIMO key generation scheme with pilot reuse based on the beam domain channel model and derive close-form expression of secret key rate. Specifically, we present two algorithms, i.e., beam-domain based channel probing (BCP) algorithm and interference neutralization based multi-user beam allocation (IMBA) algorithm for the purpose of channel dimension reduction and multi-user pilot reuse, respectively. Numerical results verify that the proposed PKG scheme can achieve the secret key rate that approximates the perfect case, and significantly reduce the dimension of the channel estimation and pilot overhead.


title: Another Problem of J\'onsson and McKenzie from 1982: Refinement Properties for Connected Powers of Posets

abstract: In 1982, J\'onsson and McKenzie posed the following problem: "Find counter examples (or prove that none exist) to the refinement of $A^C\cong B^D$ [$A$, $B$, $C$, and $D$ non-empty posets] under" the condition "$C$, $D$, and $A^C$ are finite and connected." That is, in this situation, are there posets $E$, $X$, $Y$, and $Z$ such that $A\cong E^X$, $B\cong E^Y$, $C\cong Y\times Z$, and $D\cong X\times Z$? In this note, this problem is solved.


title: Energy-Efficient On-Chip Networks through Profiled Hybrid Switching

abstract: Virtual channel flow control is the de facto choice for modern networks-on-chip to allow better utilization of the link bandwidth through buffering and packet switching, which are also the sources of large power footprint and long per-hop latency. On the other hand, bandwidth can be plentiful for parallel workloads under virtual channel flow control. Thus, dated but simpler flow controls such as circuit switching can be utilized to improve the energy efficiency of modern networks-on-chip. In this paper, we propose to utilize part of the link bandwidth under circuit switching so that part of the traffic can be transmitted bufferlessly without routing. Our evaluations reveal that this proposal leads to a reduction of energy per flit by up to 32% while also provides very competitive latency per flit when compared to networks under virtual channel flow control.


title: Large-Scale Secure XGB for Vertical Federated Learning

abstract: Privacy-preserving machine learning has drawn increasingly attention recently, especially with kinds of privacy regulations come into force. Under such situation, Federated Learning (FL) appears to facilitate privacy-preserving joint modeling among multiple parties. Although many federated algorithms have been extensively studied, there is still a lack of secure and practical gradient tree boosting models (e.g., XGB) in literature. In this paper, we aim to build large-scale secure XGB under vertically federated learning setting. We guarantee data privacy from three aspects. Specifically, (i) we employ secure multi-party computation techniques to avoid leaking intermediate information during training, (ii) we store the output model in a distributed manner in order to minimize information release, and (iii) we provide a novel algorithm for secure XGB predict with the distributed model. Furthermore, by proposing secure permutation protocols, we can improve the training efficiency and make the framework scale to large dataset. We conduct extensive experiments on both public datasets and real-world datasets, and the results demonstrate that our proposed XGB models provide not only competitive accuracy but also practical performance.


title: Non-Clicks Mean Irrelevant? Propensity Ratio Scoring As a Correction

abstract: Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS ignores the bias caused by (implicitly) treating non-clicked ones as irrelevant. In this work, we first rigorously prove that such use of click data leads to unnecessary pairwise comparisons between relevant documents, which prevent unbiased ranker optimization. Based on the proof, we derive a simple yet well justified new weighting scheme, called Propensity Ratio Scoring (PRS), which provides treatments on both clicks and non-clicks. Besides correcting the bias in clicks, PRS avoids relevant-relevant document comparisons in LTR training and enjoys a lower variability. Our extensive empirical evaluations confirm that PRS ensures a more effective use of click data and improved performance in both synthetic data from a set of LTR benchmarks, as well as in the real-world large-scale data from GMail search.


title: Precision measurement of $^{\mathbf{210}}$Bi $\beta$-spectrum

abstract: The precision measurement of the $\beta-$spectrum shape for $^{210}$Bi (historically RaE) have been performed with a spectrometer based on semiconductor Si(Li) detector. This first forbidden non-unique transition has the transition form-factor strongly deviated from unity and knowledge of its spectrum would play an important role in low-background physics in presence of $^{210}$Pb background. The measured transition form-factor could be approximated as $S(W) = 1 + (-0.4363 \pm 0.0037) W + (0.0523 \pm 0.0010) W^2$, that is in good agreement with previous studies and has significantly increased parameter precision.

categories: nucl-ex hep-ex hep-ph nucl-th physics.ins-det


title: Variational Hyper-Encoding Networks

abstract: We propose a framework called HyperVAE for encoding distributions of distributions. When a target distribution is modeled by a VAE, its neural network parameters \theta is drawn from a distribution p(\theta) which is modeled by a hyper-level VAE. We propose a variational inference using Gaussian mixture models to implicitly encode the parameters \theta into a low dimensional Gaussian distribution. Given a target distribution, we predict the posterior distribution of the latent code, then use a matrix-network decoder to generate a posterior distribution q(\theta). HyperVAE can encode the parameters \theta in full in contrast to common hyper-networks practices, which generate only the scale and bias vectors as target-network parameters. Thus HyperVAE preserves much more information about the model for each task in the latent space. We discuss HyperVAE using the minimum description length (MDL) principle and show that it helps HyperVAE to generalize. We evaluate HyperVAE in density estimation tasks, outlier detection and discovery of novel design classes, demonstrating its efficacy.


title: Improving Reverse k Nearest Neighbors Queries

abstract: The reverse $k$ nearest neighbor query finds all points that have the query point as one of their $k$ nearest neighbors, where the $k$NN query finds the $k$ closest points to its query point. Based on conics, we propose an efficent R$k$NN verification method. By using the proposed verification method, we implement an efficient R$k$NN algorithm on VoR-tree, which has a computational complexity of $O(k^{1.5}\cdot log\,k)$. The comparative experiments are conducted between our algorithm and other two state-of-the-art R$k$NN algorithms. The experimental results indicate that the efficiency of our algorithm is significantly higher than its competitors.


title: Attentron: Few-Shot Text-to-Speech Utilizing Attention-Based Variable-Length Embedding

abstract: On account of growing demands for personalization, the need for a so-called few-shot TTS system that clones speakers with only a few data is emerging. To address this issue, we propose Attentron, a few-shot TTS model that clones voices of speakers unseen during training. It introduces two special encoders, each serving different purposes. A fine-grained encoder extracts variable-length style information via an attention mechanism, and a coarse-grained encoder greatly stabilizes the speech synthesis, circumventing unintelligible gibberish even for synthesizing speech of unseen speakers. In addition, the model can scale out to an arbitrary number of reference audios to improve the quality of the synthesized speech. According to our experiments, including a human evaluation, the proposed model significantly outperforms state-of-the-art models when generating speech for unseen speakers in terms of speaker similarity and quality.


title: Graphs, Entities, and Step Mixture

abstract: Existing approaches for graph neural networks commonly suffer from the oversmoothing issue, regardless of how neighborhoods are aggregated. Most methods also focus on transductive scenarios for fixed graphs, leading to poor generalization for unseen graphs. To address these issues, we propose a new graph neural network that considers both edge-based neighborhood relationships and node-based entity features, i.e. Graph Entities with Step Mixture via random walk (GESM). GESM employs a mixture of various steps through random walk to alleviate the oversmoothing problem, attention to dynamically reflect interrelations depending on node information, and structure-based regularization to enhance embedding representation. With intensive experiments, we show that the proposed GESM achieves state-of-the-art or comparable performances on eight benchmark graph datasets comprising transductive and inductive learning tasks. Furthermore, we empirically demonstrate the significance of considering global information.


title: Eigenvalue bifurcations in Kac-Murdock-Szego matrices with a complex parameter

abstract: For complex $\rho$, the spectral properties of the Toeplitz matrix $K_{n}(\rho)=\left[\rho^{|j-k|}\right]_{j,k=1}^{n}$, often called the Kac-Murdock-Szeg{\omicron} matrix, have been examined in detail in two recent papers. The second paper, in particular, introduced the concept of borderline curves. These are two closed curves in the complex-$\rho$ plane that consist of all the $\rho$ for which $K_n(\rho)$ possesses some eigenvalue whose magnitude equals the matrix dimension $n$. The purpose of the present paper is to examine eigenvalue bifurcations in both a qualitative and a quantitative manner, and to discuss connections between bifurcations and the borderline curves.


title: Sigma Delta quantization for images

abstract: In signal quantization, it is well-known that introducing adaptivity to quantization schemes can improve their stability and accuracy in quantizing bandlimited signals. However, adaptive quantization has only been designed for one-dimensional signals. The contribution of this paper is two-fold: i). we propose the first family of two-dimensional adaptive quantization schemes that maintain the same mathematical and practical merits as their one-dimensional counterparts, and ii). we show that both the traditional 1-dimensional and the new 2-dimensional quantization schemes can effectively quantize signals with jump discontinuities. These results immediately enable the usage of adaptive quantization on images. Under mild conditions, we show that the adaptivity is able to reduce the reconstruction error of images from the presently best $O(\sqrt P)$ to the much smaller $O(\sqrt s)$, where $s$ is the number of jump discontinuities in the image and $P$ ($P\gg s$) is the total number of samples. This $\sqrt{P/s}$-fold error reduction is achieved via applying a total variation norm regularized decoder, whose formulation is inspired by the mathematical super-resolution theory in the field of compressed sensing. Compared to the super-resolution setting, our error reduction is achieved without requiring adjacent spikes/discontinuities to be well-separated, which ensures its broad scope of application. We numerically demonstrate the efficacy of the new scheme on medical and natural images. We observe that for images with small pixel intensity values, the new method can significantly increase image quality over the state-of-the-art method.


title: On Simple Transitive 2-representations of Bimodules over the Dual Numbers

abstract: We study the problem of classification of simple transitive 2-representations for the (non-finitary) 2-category of bimodules over the dual numbers. We show that simple transitive 2-representations with finitary apex are necessarily of rank 1 or 2, and those of rank 2 are exactly the cell 2-representations. For 2-representations of rank 1, we show that they cannot be constructed using the approach of (co)algebra 1-morphisms. We also propose an alternative definition of (co-)Duflo 1-morphisms for finitary 2-categories and describe them in the case of bimodules over the dual numbers.


title: Ergotropy from coherences in an open quantum system

abstract: We show that it is possible to have non-zero ergotropy in the steady-states of an open quantum system consisting of qubits that are collectively coupled to a thermal bath at a finite temperature. The dynamics of our model leads the qubits into a steady-state that has coherences in the energy eigenbasis when the number of qubits in the system is more than one. We observe that even though the system do not have inverted populations, it is possible to extract work from the coherences and analytically show that in the high temperature limit, ergotropy per unit energy is equal to the $l_1$ norm of coherence for the two qubit case. Further, we analyze the scaling of coherence and ergotropy as a function of the number of qubits in the system for different initial states. Our results suggest that one can design a quantum battery that is charged by a dissipative thermal bath in the weak coupling regime.


title: Dual of 2D fractional Fourier transform associated to It\^o--Hermite polynomials

abstract: A class of integral transforms, on the planar Gaussian Hilbert space with range in the weighted Bergman space on the bi-disk, is defined as the dual transforms of the 2d fractional Fourier transform associated with the Mehler function for It\^o--Hermite polynomials. Some spectral properties of these transforms are investigated. Namely, we study their boundedness and identify their null spaces as well as their ranges. Such identification depends on the zeros set of It\^o--Hermite polynomials. Moreover, the explicit expressions of their singular values are given and compactness and membership in p-Schatten class are studied. The relationship to specific fractional Hankel transforms is also established


title: Construction and heat kernel estimates of general stable-like Markov processes

abstract: A stable-like process is a Feller process $(X_t)_{t\geq 0}$ taking values in $\mathbb{R}^d$ and whose generator behaves, locally, like an $\alpha$-stable L\'evy process, but the index $\alpha$ and all other characteristics may depend on the state space. More precisely, the jump measure need not to be symmetric and it strongly depends on the current state of the process; moreover, we do not require the gradient term to be dominated by the pure jump part. Our approach is to understand the above phenomena as suitable microstructural perturbations. We show that the corresponding martingale problem is well-posed, and its solution is a strong Feller process which admits a transition density. For the transition density we obtain a representation as a sum of an explicitly given principal term -- this is essentially the density of an $\alpha$-stable random variable whose parameters depend on the current state $x$ -- and a residual term; the $L^\infty\otimes L^1$-norm of the residual term is negligible and so is, under an additional structural assumption, the $L^\infty\otimes L^\infty$-norm. Concrete examples illustrate the relation between the assumptions and possible transition density estimates.


title: Properties of $R(X), R(a, X) \mbox{ and } RW(a, X)$

abstract: In the context of metric fixed point theory in Banach spaces three moduli have played an important role. These are R(X), R(a, X) and RW(a, X). This paper looks at some of their properties. Also investigated is what happens when they take on the value of 1. The situation where these moduli are set in dual space is also considered.


title: $X^*$ with weak* uniform Kadec-Klee property has Property($K^*$)

abstract: It is shown that if the dual of a Banach space, $X^*$, where the dual ball is weak* sequentially compact, has the weak* uniform Kadec-Klee property then $X^*$ has Property($K^*$). An example is given where the reverse implication does not hold. That is, there is a Banach space $X$ whose dual, $X^*$, has Property($K^*$) but $X^*$ does not have the weak* uniform Kadec-Klee property.


title: Optimal Emergency Frequency Control Based on Coordinated Droop in Multi-Infeed Hybrid AC-DC System

abstract: In multi-infeed hybrid AC-DC (MIDC) systems, the asynchronous interconnection between regional grids, the complicated system dynamics and possible cascading failures have an enormous effect on the frequency stability. In order to deal with the frequency instability problems in emergency situations, this paper proposes a decentralized emergency frequency control strategy based on coordinated droop for the MIDC system. First, a P-f droop control for LCC-HVDC systems is introduced and the coordinated droop mechanism among LCC-HVDC systems and generators is designed. Then, to reasonably allocate the power imbalance among LCC-HVDC systems and generators, an optimal emergency frequency control (OEFC) problem is formulated, and the optimal droop coefficients are selected in a decentralized approach, which can deal with various control objectives. A Lyapunov stability analysis shows that the closed-loop equilibrium is locally asymptotically stable considering the LCC-HVDC dynamics. The effectiveness of the proposed emergency control strategy is verified through simulations.


title: Monotone iterative schemes for positive solutions of a fractional differential system with integral boundary conditions on an infinite interval

abstract: In this paper, using the monotone iterative technique and the Banach contraction mapping principle, we study a class of fractional differential system with integral boundary on an infinite interval. Some explicit monotone iterative schemes for approximating the extreme positive solutions and the unique positive solution are constructed.


title: Shape optimization of a Dirichlet type energy for semilinear elliptic partial differential equations

abstract: Minimizing the so-called "Dirichlet energy" with respect to the domain under a volume constraint is a standard problem in shape optimization which is now well understood. This article is devoted to a prototypal non-linear version of the problem, where one aims at minimizing a Dirichlet-type energy involving the solution to a semilinear elliptic PDE with respect to the domain, under a volume constraint. One of the main differences with the standard version of this problem rests upon the fact that the criterion to minimize does not write as the minimum of an energy, and thus most of the usual tools to analyze this problem cannot be used. By using a relaxed version of this problem, we first prove the existence of optimal shapes under several assumptions on the problem parameters. We then analyze the stability of the ball, expected to be a good candidate for solving the shape optimization problem, when the coefficients of the involved PDE are radially symmetric.


title: Attention-based Transducer for Online Speech Recognition

abstract: Recent studies reveal the potential of recurrent neural network transducer (RNN-T) for end-to-end (E2E) speech recognition. Among some most popular E2E systems including RNN-T, Attention Encoder-Decoder (AED), and Connectionist Temporal Classification (CTC), RNN-T has some clear advantages given that it supports streaming recognition and does not have frame-independency assumption. Although significant progresses have been made for RNN-T research, it is still facing performance challenges in terms of training speed and accuracy. We propose attention-based transducer with modification over RNN-T in two aspects. First, we introduce chunk-wise attention in the joint network. Second, self-attention is introduced in the encoder. Our proposed model outperforms RNN-T for both training speed and accuracy. For training, we achieves over 1.7x speedup. With 500 hours LAIX non-native English training data, attention-based transducer yields ~10.6% WER reduction over baseline RNN-T. Trained with full set of over 10K hours data, our final system achieves ~5.5% WER reduction over that trained with the best Kaldi TDNN-f recipe. After 8-bit weight quantization without WER degradation, RTF and latency drop to 0.34~0.36 and 268~409 milliseconds respectively on a single CPU core of a production server.


title: Spin-Nematic Vortex States in Cold Atoms

abstract: The (pseudo-)spin degrees of freedom greatly enriches the physics of cold atoms. This is particularly so for systems with high spins (i.e., spin quantum number larger than 1/2). For example, one can construct not only the rank-1 spin vector, but also the rank-2 spin tensor in high spin systems. Here we propose a simple scheme to couple the spin tensor and the center-of-mass orbital angular momentum in a spin-1 cold atom system, and show that this leads to a new quantum phase of the matter: the spin-nematic vortex state that features vorticity in an SU(2) spin-nematic tensor subspace. Under proper conditions, such states are characterized by quantized topological numbers. Our work opens up new avenues of research in topological quantum matter with high spins.


title: Epidemic parameters for COVID-19 in several regions of India

abstract: Bayesian analysis of publicly available time series of cases and fatalities in different geographical regions of India during April 2020 is reported. It is found that the initial apparent rapid growthin infections could be partly due to confounding factors such as initial rapid ramp-up of disease surveillance. A brief discussion is given of the fallacies which arise if this possibility is neglected. The growth after April 10 is consistent with a time independent but region dependent exponential. From this, R0 is extracted using both known cases and fatalities. The two estimates are seen to agree in many cases; for these CFR is reported. It is seen that CFR and R0 increase together. Some public health implications of this observation are discussed, including a target doubling interval if medical facilities are to remain adequate.


title: Aligning biological sequences by exploiting residue conservation and coevolution

abstract: Sequences of nucleotides (for DNA and RNA) or amino acids (for proteins) are central objects in biology. Among the most important computational problems is that of sequence alignment, i.e. arranging sequences from different organisms in such a way to identify similar regions, to detect evolutionary relationships between sequences, and to predict biomolecular structure and function. This is typically addressed through profile models, which capture position-specificities like conservation in sequences, but assume an independent evolution of different positions. Over the last years, it has been well established that coevolution of different amino-acid positions is essential for maintaining three-dimensional structure and function. Modeling approaches based on inverse statistical physics can catch the coevolution signal in sequence ensembles; and they are now widely used in predicting protein structure, protein-protein interactions, and mutational landscapes. Here, we present DCAlign, an efficient alignment algorithm based on an approximate message-passing strategy, which is able to overcome the limitations of profile models, to include coevolution among positions in a general way, and to be therefore universally applicable to protein- and RNA-sequence alignment without the need of using complementary structural information. The potential of DCAlign is carefully explored using well-controlled simulated data, as well as real protein and RNA sequences.

categories: q-bio.QM cond-mat.dis-nn physics.bio-ph q-bio.BM


title: VecQ: Minimal Loss DNN Model Compression With Vectorized Weight Quantization

abstract: Quantization has been proven to be an effective method for reducing the computing and/or storage cost of DNNs. However, the trade-off between the quantization bitwidth and final accuracy is complex and non-convex, which makes it difficult to be optimized directly. Minimizing direct quantization loss (DQL) of the coefficient data is an effective local optimization method, but previous works often neglect the accurate control of the DQL, resulting in a higher loss of the final DNN model accuracy. In this paper, we propose a novel metric called Vector Loss. Based on this new metric, we develop a new quantization solution called VecQ, which can guarantee minimal direct quantization loss and better model accuracy. In addition, in order to speed up the proposed quantization process during model training, we accelerate the quantization process with a parameterized probability estimation method and template-based derivation calculation. We evaluate our proposed algorithm on MNIST, CIFAR, ImageNet, IMDB movie review and THUCNews text data sets with numerical DNN models. The results demonstrate that our proposed quantization solution is more accurate and effective than the state-of-the-art approaches yet with more flexible bitwidth support. Moreover, the evaluation of our quantized models on Saliency Object Detection (SOD) tasks maintains comparable feature extraction quality with up to 16$\times$ weight size reduction.


title: COVI White Paper

abstract: The SARS-CoV-2 (Covid-19) pandemic has caused significant strain on public health institutions around the world. Contact tracing is an essential tool to change the course of the Covid-19 pandemic. Manual contact tracing of Covid-19 cases has significant challenges that limit the ability of public health authorities to minimize community infections. Personalized peer-to-peer contact tracing through the use of mobile apps has the potential to shift the paradigm. Some countries have deployed centralized tracking systems, but more privacy-protecting decentralized systems offer much of the same benefit without concentrating data in the hands of a state authority or for-profit corporations. Machine learning methods can circumvent some of the limitations of standard digital tracing by incorporating many clues and their uncertainty into a more graded and precise estimation of infection risk. The estimated risk can provide early risk awareness, personalized recommendations and relevant information to the user. Finally, non-identifying risk data can inform epidemiological models trained jointly with the machine learning predictor. These models can provide statistical evidence for the importance of factors involved in disease transmission. They can also be used to monitor, evaluate and optimize health policy and (de)confinement scenarios according to medical and economic productivity indicators. However, such a strategy based on mobile apps and machine learning should proactively mitigate potential ethical and privacy risks, which could have substantial impacts on society (not only impacts on health but also impacts such as stigmatization and abuse of personal data). Here, we present an overview of the rationale, design, ethical considerations and privacy strategy of `COVI,' a Covid-19 public peer-to-peer contact tracing and risk awareness mobile application developed in Canada.


title: Lissajous scanning magnetic particle imaging as a multifunctional platform for magnetic hyperthermia therapy

abstract: The use of engineered nanoscale magnetic materials in healthcare and biomedical technologies is rapidly growing. Two examples which have recently attracted significant attention are magnetic particle imaging (MPI) for biological monitoring, and magnetic field hyperthermia (MFH) for cancer therapy. Here for the first time, the capability of a Lissajous scanning MPI device to act as a standalone platform to support the application of MFH cancer treatment is presented. The platform is shown to offer functionalities for nanoparticle localization, focused hyperthermia therapy application, and non-invasive tissue thermometry in one device. Combined, these capabilities have the potential to significantly enhance the accuracy, effectiveness and safety of MFH therapy. Measurements of nanoparticle hyperthermia during protracted exposure to the MPI scanner's 3D imaging field sequence revealed spatially focused heating, with a maximum that is significantly enhanced compared with a simple 1-dimensional sinusoidal excitation. The observed spatial heating behavior is qualitatively described based on a phenomenological model considering torques exerted in the Brownian regime. In-vitro cell studies using a human acute monocytic leukemia cell line (THP-1) demonstrated strong suppression of both structural integrity and metabolic activity within 24 h following a 40 min MFH treatment actuated within the Lissajous MPI scanner. Furthermore, reconstructed MPI images of the nanoparticles distributed among the cells, and the temperature-sensitivity of the MPI imaging signal obtained during treatment are demonstrated. In summary, combined Lissajous MPI and MFH technologies are presented; demonstrating for the first time their potential for cancer treatment with maximum effectiveness, and minimal collateral damage to surrounding tissues.


title: Spatially resolved spectral phase interferometry with isolated attosecond pulse

abstract: We characterized spatially resolved spectral phase interferometry with an isolated attosecond pulse (IAP). The measured spatial-spectral interferogram and spectral interference fringe visibility show a high degree of IAPs spatial and spectral coherences. In addition, the characterized spectral-delay interferogram shows periodic temporal oscillations over the full IAP continuous spectrum, which indicates high temporal coherence. The IAP coherence over broad continuous spectral region holds potential for realizing the time-resolved IAP phase-based spectroscopy, which will contribute to exploring spatiotemporal dispersive electronic wave dynamics in the future.


title: Sudden Attention Shifts on Wikipedia During the COVID-19 Crisis

abstract: We study how the COVID-19 pandemic, alongside the severe mobility restrictions that ensued, has impacted information access on Wikipedia, the world's largest online encyclopedia. A longitudinal analysis that combines pageview statistics for 12 Wikipedia language editions with mobility reports published by Apple and Google reveals massive shifts in the volume and nature of information seeking patterns during the pandemic. Interestingly, while we observe a transient increase in Wikipedia's pageview volume following mobility restrictions, the nature of information sought was impacted more permanently. These changes are most pronounced for language editions associated with countries where the most severe mobility restrictions were implemented. We also find that articles belonging to different topics behaved differently; e.g., attention towards entertainment-related topics is lingering and even increasing, while the interest in health- and biology-related topics was either small or transient. Our results highlight the utility of Wikipedia for studying how the pandemic is affecting people's needs, interests, and concerns.


title: Unification in pretabular extensions of S4

abstract: L.L. Maksimova and L. Esakia, V. Meskhi showed that the modal logic S4 has exactly 5 pretabular extensions: PM1-PM5. In this paper, we study and systematize the problem of unification for all given pretabular logics. We showed that PM2,PM3 have finitary, and PM1,PM4,PM5 have unitary types of unification. Complete sets of unifiers in logics are described.


title: The exterior gravitational potential of toroids

abstract: We perform a bivariate Taylor expansion of the axisymmetric Green function in order to determine the exterior potential of a static thin toroidal shell having a circular section, as given by the Laplace equation. This expansion, performed at the centre of the section, consists in an infinite series in the powers of the minor-to-major radius ratio $e$ of the shell. It is appropriate for a solid, homogeneous torus, as well as for inhomogeneous bodies (the case of a core stratification is considered). We show that the leading term is identical to the potential of a loop having the same main radius and the same mass | this "similarity" is shown to hold in the ${\cal O}(e^2)$ order. The series converges very well, especially close to the surface of the toroid where the average relative precision is $\sim 10^{-3}$ for $e\! = \!0.1$ at order zero, and as low as a few $10^{-6}$ at second order. The Laplace equation is satisfied {\em exactly} in every order, so no extra density is induced by truncation. The gravitational acceleration, important in dynamical studies, is reproduced with the same accuracy. The technique also applies to the magnetic potential and field generated by azimuthal currents as met in terrestrial and astrophysical plasmas.


title: Quantum Chaos in Topologically Massive Gravity

abstract: We study quantum chaos of rotating BTZ black holes in Topologically Massive gravity (TMG). We discuss the relationship between chaos parameters including Lyapunov exponents and butterfly velocities from shock wave calculations of out-of-time-order correlators (OTOC) and from pole-skipping analysis. We find a partial match between pole-skipping and the OTOC results in the high temperature regime. We also find that the velocity bound puts a chaos constraint on the gravitational Chern-Simons coupling.


title: Exploring the role of asymmetric-pulse modulation in quantum thermal machines and quantum thermometry

abstract: We explore the consequences of periodically modulating a quantum two-level system (TLS) with an asymmetric pulse when the system is in contact with thermal baths. By adopting the Floquet-Lindblad formalism for our analysis, we find that the unequal "up" and "down" time duration of the pulse has two main ramifications. First, the energy gap of the multiple sidebands or photon sectors created as a result of the periodic modulation are renormalized by a term which is dependent on both the modulation strength as well as the fraction of up (or down) time duration. Second, the weights of the different sidebands are no longer symmetrically distributed about the central band or zero photon sector. We illustrate the advantages of these findings in the context of applications in quantum thermal machines and thermometry. For a thermal machine constructed by coupling the TLS to two thermal baths, we demonstrate that the asymmetric pulse provides an extra degree of control over the mode of operation of the thermal machine. Further, by appropriately tuning the weight of the subbands, we also show that an asymmetric pulse may provide superior optimality in a recently proposed protocol for quantum thermometry, where dynamical control has been shown to enhance the precision of measurement.


title: Improving Learning Efficiency for Wireless Resource Allocation with Symmetric Prior

abstract: Improving learning efficiency is paramount for learning resource allocation with deep neural networks (DNNs) in wireless communications over highly dynamic environments. Incorporating domain knowledge into learning is a promising way of dealing with this issue, which is an emerging topic in the wireless community. In this article, we first briefly summarize two classes of approaches to using domain knowledge: introducing mathematical models or prior knowledge to deep learning. Then, we consider a kind of symmetric prior, permutation equivariance, which widely exists in wireless tasks. To explain how such a generic prior is harnessed to improve learning efficiency, we resort to ranking, which jointly sorts the input and output of a DNN. We use power allocation among subcarriers, probabilistic content caching, and interference coordination to illustrate the improvement of learning efficiency by exploiting the property. From the case study, we find that the required training samples to achieve given system performance decreases with the number of subcarriers or contents, owing to an interesting phenomenon: "sample hardening". Simulation results show that the training samples, the free parameters in DNNs and the training time can be reduced dramatically by harnessing the prior knowledge. The samples required to train a DNN after ranking can be reduced by $15 \sim 2,400$ folds to achieve the same system performance as the counterpart without using prior.


title: A new Evans function for quasi-periodic solutions of the linearised sine-Gordon equation

abstract: We construct a new Evans function for quasi-periodic solutions to the linearisation of the sine-Gordon equation about a periodic travelling wave. This Evans function is written in terms of fundamental solutions to a Hill's equation. Applying Evans-Krein function theory to our Evans function, we provide a new method for computing the Krein signatures of simple characteristic values of the linearised sine-Gordon equation. By varying the Floquet exponent parametrising the quasi-periodic solutions, we compute the linearised spectra of periodic travelling wave solutions of the sine-Gordon equation and and track dynamical Hamiltonian-Hopf bifurcations via the Krein signature. Finally, we show that our new Evans function can be readily applied to the general case of the nonlinear Klein-Gordon equation with a non-periodic potential.


title: Thermodynamics of Chiral Fermion System in a Uniform Magnetic Field

abstract: We construct the grand partition function of the system of chiral fermions in a uniform magnetic field from Landau levels, through which all thermodynamic quantities can be obtained. Taking use of Abel-Plana formula, these thermodynamic quantities can be expanded as series with respect to a dimensionless variable $b=2eB/T^{2}$. We find that the series expansions of energy density, pressure, magnetization intensity and magnetic susceptibility contain a singular term with $\ln b^{2}$, while particle number density, entropy density and heat capacity are power series of $b^{2}$. The asymptotic behaviors of these thermodynamic quantities in extreme conditions are also discussed.


title: Convergence of constant step stochastic gradient descent for non-smooth non-convex functions

abstract: This paper studies the asymptotic behavior of the constant step Stochastic Gradient Descent for the minimization of an unknown function F , defined as the expectation of a non convex, non smooth, locally Lipschitz random function. As the gradient may not exist, it is replaced by a certain operator: a reasonable choice is to use an element of the Clarke subdifferential of the random function; an other choice is the output of the celebrated backpropagation algorithm, which is popular amongst practionners, and whose properties have recently been studied by Bolte and Pauwels [7]. Since the expectation of the chosen operator is not in general an element of the Clarke subdifferential BF of the mean function, it has been assumed in the literature that an oracle of BF is available. As a first result, it is shown in this paper that such an oracle is not needed for almost all initialization points of the algorithm. Next, in the small step size regime, it is shown that the interpolated trajectory of the algorithm converges in probability (in the compact convergence sense) towards the set of solutions of the differential inclusion. Finally, viewing the iterates as a Markov chain whose transition kernel is indexed by the step size, it is shown that the invariant distribution of the kernel converge weakly to the set of invariant distribution of this differential inclusion as the step size tends to zero. These results show that when the step size is small, with large probability, the iterates eventually lie in a neighborhood of the critical points of the mean function F .


title: Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Prediction

abstract: Understanding crowd motion dynamics is critical to real-world applications, e.g., surveillance systems and autonomous driving. This is challenging because it requires effectively modeling the socially aware crowd spatial interaction and complex temporal dependencies. We believe attention is the most important factor for trajectory prediction. In this paper, we present STAR, a Spatio-Temporal grAph tRansformer framework, which tackles trajectory prediction by only attention mechanisms. STAR models intra-graph crowd interaction by TGConv, a novel Transformer-based graph convolution mechanism. The inter-graph temporal dependencies are modeled by separate temporal Transformers. STAR captures complex spatio-temporal interactions by interleaving between spatial and temporal Transformers. To calibrate the temporal prediction for the long-lasting effect of disappeared pedestrians, we introduce a read-writable external memory module, consistently being updated by the temporal Transformer. We show that with only attention mechanism, STAR achieves state-of-the-art performance on 5 commonly used real-world pedestrian prediction datasets.


title: A fragmentation phenomenon for a non-energetic optimal control problem: optimisation of the total population size in logistic diffusive models

abstract: Following some recent works, we investigate the problem of optimising the total population size for logistic diffusive models with respect to resources distributions. Using the spatially heterogeneous Fisher-KPP equation, we obtain a surprising fragmentation phenomenon: depending on the scale of diffusivity (i.e the dispersal rate), it is better to either concentrate or fragment resources. Our main result is that, the smaller the dispersal rate of the species in the domain, the more optimal resources distributions tend to oscillate. This is in sharp contrast with other criteria in population dynamics, such as the classical problem of optimising the survival ability of a species, where concentrating resources is always favourable, regardless of the diffusivity. Our study is completed by numerous numerical simulations that confirm our results.


title: Towards Question Format Independent Numerical Reasoning: A Set of Prerequisite Tasks

abstract: Numerical reasoning is often important to accurately understand the world. Recently, several format-specific datasets have been proposed, such as numerical reasoning in the settings of Natural Language Inference (NLI), Reading Comprehension (RC), and Question Answering (QA). Several format-specific models and architectures in response to those datasets have also been proposed. However, there exists a strong need for a benchmark which can evaluate the abilities of models, in performing question format independent numerical reasoning, as (i) the numerical reasoning capabilities we want to teach are not controlled by question formats, (ii) for numerical reasoning technology to have the best possible application, it must be able to process language and reason in a way that is not exclusive to a single format, task, dataset or domain. In pursuit of this goal, we introduce NUMBERGAME, a multifaceted benchmark to evaluate model performance across numerical reasoning tasks of eight diverse formats. We add four existing question types in our compilation. Two of the new types we add are about questions that require external numerical knowledge, commonsense knowledge and domain knowledge. For building a more practical numerical reasoning system, NUMBERGAME demands four capabilities beyond numerical reasoning: (i) detecting question format directly from data (ii) finding intermediate common format to which every format can be converted (iii) incorporating commonsense knowledge (iv) handling data imbalance across formats. We build several baselines, including a new model based on knowledge hunting using a cheatsheet. However, all baselines perform poorly in contrast to the human baselines, indicating the hardness of our benchmark. Our work takes forward the recent progress in generic system development, demonstrating the scope of these under-explored tasks.


title: Automatic Knowledge Acquisition for Object-Oriented Expert Systems

abstract: We describe an Object Oriented Model for building Expert Systems. This model and the detection of similarities allow to implement reasoning modes as induction, deduction and simulation. We specially focus on similarity and its use in induction. We propose original algorithms which deal with total and partial structural similitude of objects to facilitate knowledge acquisition.


title: Asymptotic K-soliton-like Solutions of the Zakharov-Kuznetsov type equations

abstract: We study here the Zakharov-Kuznetsov equation in dimension $2$ and $3$ and the modified Zakharov-Kuznetsov equation in dimension $2$. Those equations admit solitons, characterized by their velocity and their shift. Given the parameters of $K$ solitons $R^k$ (with distinct velocities), we prove the existence and uniqueness of a multi-soliton $u$ such that $\left\| u- \sum_{k=1}^K R^k \right\|_{H^1}\rightarrow 0 $ as $t \rightarrow +\infty$. The convergence takes place in $H^s$ with an exponential rate for all $s\geq 0$. The construction is made by successive approximations of the multi-soliton. We use classical arguments to control of $H^1$-norms of the errors (inspired by Martel [21]), and introduce a new ingredient for the control of the $H^s$-norm in dimension $d \geq2$, by a technique close to monotonicity.