title: Go Wide, Then Narrow: Efficient Training of Deep Thin Networks

abstract: For deploying a deep learning model into production, it needs to be both accurate and compact to meet the latency and memory constraints. This usually results in a network that is deep (to ensure performance) and yet thin (to improve computational efficiency). In this paper, we propose an efficient method to train a deep thin network with a theoretic guarantee. Our method is motivated by model compression. It consists of three stages. First, we sufficiently widen the deep thin network and train it until convergence. Then, we use this well-trained deep wide network to warm up (or initialize) the original deep thin network. This is achieved by layerwise imitation, that is, forcing the thin network to mimic the intermediate outputs of the wide network from layer to layer. Finally, we further fine tune this already well-initialized deep thin network. The theoretical guarantee is established by using the neural mean field analysis. It demonstrates the advantage of our layerwise imitation approach over backpropagation. We also conduct large-scale empirical experiments to validate the proposed method. By training with our method, ResNet50 can outperform ResNet101, and BERT Base can be comparable with BERT Large, when ResNet101 and BERT Large are trained under the standard training procedures as in the literature.


title: MAGIC: Multi-scale Heterogeneity Analysis and Clustering for Brain Diseases

abstract: There is a growing amount of clinical, anatomical and functional evidence for the heterogeneous presentation of neuropsychiatric and neurodegenerative diseases such as schizophrenia and Alzheimers Disease (AD). Elucidating distinct subtypes of diseases allows a better understanding of neuropathogenesis and enables the possibility of developing targeted treatment programs. Recent semi-supervised clustering techniques have provided a data-driven way to understand disease heterogeneity. However, existing methods do not take into account that subtypes of the disease might present themselves at different spatial scales across the brain. Here, we introduce a novel method, MAGIC, to uncover disease heterogeneity by leveraging multi-scale clustering. We first extract multi-scale patterns of structural covariance (PSCs) followed by a semi-supervised clustering with double cyclic block-wise optimization across different scales of PSCs. We validate MAGIC using simulated heterogeneous neuroanatomical data and demonstrate its clinical potential by exploring the heterogeneity of AD using T1 MRI scans of 228 cognitively normal (CN) and 191 patients. Our results indicate two main subtypes of AD with distinct atrophy patterns that consist of both fine-scale atrophy in the hippocampus as well as large-scale atrophy in cortical regions. The evidence for the heterogeneity is further corroborated by the clinical evaluation of two subtypes, which indicates that there is a subpopulation of AD patients that tend to be younger and decline faster in cognitive performance relative to the other subpopulation, which tends to be older and maintains a relatively steady decline in cognitive abilities.


title: Stabilization of the critical and subcritical semilinear inhomogeneous and anisotropic elastic wave equation

abstract: {\bf Abstract} \,\,We prove exponential decay of the critical and subcritical semilinear inhomogeneous and anisotropic elastic wave equation with locally distributed damping on bounded domain. One novelty compared to previous results, is to give a checkable condition of the inhomogeneous and anisotropic medias. Another novelty is to establish a framework to study the stability of the damped semilinear inhomogeneous and anisotropic elastic wave equation, which is hard to apply Carleman estimates to deal with. We develop the Morawetz estimates and the compactness-uniqueness arguments for the semiliear elastic wave equation to prove the unique continuation, observability inequality and stabilization result. It is pointing that our proof is different from the classical method (See Dehman et al.\cite{ZYY11}, Joly et al.\cite{ZYY16} and Zuazua \cite{ZYY43}), which succeeds for the subcritical semilinear wave equation and fails for the critical semilinear wave equation.


title: Relevance-guided Supervision for OpenQA with ColBERT

abstract: Systems for Open-Domain Question Answering (OpenQA) generally depend on a retriever for finding candidate passages in a large corpus and a reader for extracting answers from those passages. In much recent work, the retriever is a learned component that uses coarse-grained vector representations of questions and passages. We argue that this modeling choice is insufficiently expressive for dealing with the complexity of natural language questions. To address this, we define ColBERT-QA, which adapts the scalable neural retrieval model ColBERT to OpenQA. ColBERT creates fine-grained interactions between questions and passages. We propose an efficient weak supervision strategy that iteratively uses ColBERT to create its own training data. This greatly improves OpenQA retrieval on Natural Questions, SQuAD, and TriviaQA, and the resulting system attains state-of-the-art extractive OpenQA performance on all three datasets.


title: Threshold Logic with Current-Driven Magnetic Domain Walls

abstract: The recent demonstration of current-driven magnetic domain wall logic [Z. Luo et al., Nature 579:214] was based on a three-input logic gate that was identified as a reconfigurable NAND/NOR function. We reinterpret this logic gate as a minority gate within the context of threshold logic, enabling a domain wall threshold logic paradigm in which the device count can be reduced by 80%. Furthermore, by extending the logic gate to more than three inputs of non-equal weight, an 87% reduction in device count can be achieved.


title: Multi-resolution Super Learner for Voxel-wise Classification of Prostate Cancer Using Multi-parametric MRI

abstract: While current research has shown the importance of Multi-parametric MRI (mpMRI) in diagnosing prostate cancer (PCa), further investigation is needed for how to incorporate the specific structures of the mpMRI data, such as the regional heterogeneity and between-voxel correlation within a subject. This paper proposes a machine learning-based method for improved voxel-wise PCa classification by taking into account the unique structures of the data. We propose a multi-resolution modeling approach to account for regional heterogeneity, where base learners trained locally at multiple resolutions are combined using the super learner, and account for between-voxel correlation by efficient spatial Gaussian kernel smoothing. The method is flexible in that the super learner framework allows implementation of any classifier as the base learner, and can be easily extended to classifying cancer into more sub-categories. We describe detailed classification algorithm for the binary PCa status, as well as the ordinal clinical significance of PCa for which a weighted likelihood approach is implemented to enhance the detection of the less prevalent cancer categories. We illustrate the advantages of the proposed approach over conventional modeling and machine learning approaches through simulations and application to in vivo data.


title: Absence of diffusion and fractal geometry in the Holstein model at high temperature

abstract: We investigate the dynamics of an electron coupled to dispersionless optical phonons in the Holstein model, at high temperatures. The dynamics is conventionally believed to be diffusive, as the electron is repeatedly scattered by optical phonons. In a semiclassical approximation, however, the motion is not diffusive. In one dimension, the electron moves in a constant direction and does not turn around. In two dimensions, the electron follows and then continues to retrace a fractal trajectory. Aspects of these nonstandard dynamics are retained in more accurate calculations, including a fully quantum calculation of the electron and phonon dynamics.


title: Charge density wave and superconducting phase in monolayer InSe

abstract: In this paper, the completed investigation of a possible superconducting phase in monolayer indium selenide is determined using first-principles calculations for both the hole and electron doping systems. The hole-doped dependence of the Fermi surface is exclusively fundamental for monolayer InSe. It leads to the extensive modification of the Fermi surface from six separated pockets to two pockets by increasing the hole densities. For low hole doping levels of the system, below the Lifshitz transition point, superconductive critical temperatures $T_c \sim 55-75$ K are obtained within anisotropic Eliashberg theory depending on varying amounts of the Coulomb potential from 0.2 to 0.1. However, for some hole doping above the Lifshitz transition point, the combination of the temperature dependence of the bare susceptibility and the strong electron-phonon interaction gives rise to a charge density wave that emerged at a temperature far above the corresponding $T_c$. Having included non-adiabatic effects, we could carefully analyze conditions for which either a superconductive or charge density wave phase occurs in the system. In addition, monolayer InSe becomes dynamically stable by including non-adiabatic effects for different carrier concentrations at room temperature.


title: Assessing the defect tolerance of kesterite-inspired solar absorbers

abstract: Various thin-film I$_2$-II-IV-VI$_4$ photovoltaic absorbers derived from kesterite Cu$_2$ZnSn(S,Se)$_4$ have been synthesized, characterized, and theoretically investigated in the past few years. The availability of this homogeneous materials dataset is an opportunity to examine trends in their defect properties and identify criteria to find new defect-tolerant materials in this vast chemical space. We find that substitutions on the Zn site lead to a smooth decrease in band tailing as the ionic radius of the substituting cation increases. Unfortunately, this substitution strategy does not ensure the suppression of deeper defects and non-radiative recombination. Trends across the full dataset suggest that Gaussian and Urbach band tails in kesterite-inspired semiconductors are two separate phenomena caused by two different antisite defect types. Deep Urbach tails are correlated with the calculated band gap narrowing caused by the (2I$_\mathrm{II}$+IV$_\mathrm{II}$) defect cluster. Shallow Gaussian tails are correlated with the energy difference between the kesterite and stannite polymorphs, which points to the role of (I$_\mathrm{II}$+II$_\mathrm{I}$) defect clusters involving Group IB and Group IIB atoms swapping across \textit{different} cation planes. This finding can explain why \textit{in-plane} cation disorder and band tailing are uncorrelated in kesterites. Our results provide quantitative criteria for discovering new kesterite-inspired photovoltaic materials with low band tailing.


title: Designing Environments Conducive to Interpretable Robot Behavior

abstract: Designing robots capable of generating interpretable behavior is a prerequisite for achieving effective human-robot collaboration. This means that the robots need to be capable of generating behavior that aligns with human expectations and, when required, provide explanations to the humans in the loop. However, exhibiting such behavior in arbitrary environments could be quite expensive for robots, and in some cases, the robot may not even be able to exhibit the expected behavior. Given structured environments (like warehouses and restaurants), it may be possible to design the environment so as to boost the interpretability of the robot's behavior or to shape the human's expectations of the robot's behavior. In this paper, we investigate the opportunities and limitations of environment design as a tool to promote a type of interpretable behavior -- known in the literature as explicable behavior. We formulate a novel environment design framework that considers design over multiple tasks and over a time horizon. In addition, we explore the longitudinal aspect of explicable behavior and the trade-off that arises between the cost of design and the cost of generating explicable behavior over a time horizon.


title: Soliton Distillation in Fiber Lasers

abstract: Pure solitons are for the first time distilled from the resonant continuous wave (CW) background in a fiber laser by utilizing nonlinear Fourier transform (NFT). It is identified that the soliton and the resonant CW background have different eigenvalue distributions in the nonlinear frequency domain. Similar to water distillation, we propose the approach of soliton distillation, by making NFT on a steady pulse generated from a fiber laser, then filtering out the eigenvalues of the resonant CW background in the nonlinear frequency domain, and finally recovering the soliton by inverse NFT (INFT). Simulation results verify that the soliton can be distinguished from the resonant CW background in the nonlinear frequency domain and pure solitons can be obtained by INFT.


title: Understanding Road Layout from Videos as a Whole

abstract: In this paper, we address the problem of inferring the layout of complex road scenes from video sequences. To this end, we formulate it as a top-view road attributes prediction problem and our goal is to predict these attributes for each frame both accurately and consistently. In contrast to prior work, we exploit the following three novel aspects: leveraging camera motions in videos, including context cuesand incorporating long-term video information. Specifically, we introduce a model that aims to enforce prediction consistency in videos. Our model consists of one LSTM and one Feature Transform Module (FTM). The former implicitly incorporates the consistency constraint with its hidden states, and the latter explicitly takes the camera motion into consideration when aggregating information along videos. Moreover, we propose to incorporate context information by introducing road participants, e.g. objects, into our model. When the entire video sequence is available, our model is also able to encode both local and global cues, e.g. information from both past and future frames. Experiments on two data sets show that: (1) Incorporating either globalor contextual cues improves the prediction accuracy and leveraging both gives the best performance. (2) Introducing the LSTM and FTM modules improves the prediction consistency in videos. (3) The proposed method outperforms the SOTA by a large margin.


title: Dropout as a Regularizer of Interaction Effects

abstract: We examine Dropout through the perspective of interactions. This view provides a symmetry to explain Dropout: given $N$ variables, there are ${N \choose k}$ possible sets of $k$ variables to form an interaction (i.e. $\mathcal{O}(N^k)$); conversely, the probability an interaction of $k$ variables survives Dropout at rate $p$ is $(1-p)^k$ (decaying with $k$). These rates effectively cancel, and so Dropout regularizes against higher-order interactions. We prove this perspective analytically and empirically. This perspective of Dropout as a regularizer against interaction effects has several practical implications: (1) higher Dropout rates should be used when we need stronger regularization against spurious high-order interactions, (2) caution should be exercised when interpreting Dropout-based explanations and uncertainty measures, and (3) networks trained with Input Dropout are biased estimators. We also compare Dropout to other regularizers and find that it is difficult to obtain the same selective pressure against high-order interactions.


title: Lightme: Analysing Language in Internet Support Groups for Mental Health

abstract: Background: Assisting moderators to triage harmful posts in Internet Support Groups is relevant to ensure its safe use. Automated text classification methods analysing the language expressed in posts of online forums is a promising solution. Methods: Natural Language Processing and Machine Learning technologies were used to build a triage post classifier using a dataset from Reachout mental health forum for young people. Results: When comparing with the state-of-the-art, a solution mainly based on features from lexical resources, received the best classification performance for the crisis posts (52%), which is the most severe class. Six salient linguistic characteristics were found when analysing the crisis post; 1) posts expressing hopelessness, 2) short posts expressing concise negative emotional responses, 3) long posts expressing variations of emotions, 4) posts expressing dissatisfaction with available health services, 5) posts utilising storytelling, and 6) posts expressing users seeking advice from peers during a crisis. Conclusion: It is possible to build a competitive triage classifier using features derived only from the textual content of the post. Further research needs to be done in order to translate our quantitative and qualitative findings into features, as it may improve overall performance.


title: Energy scan/dependence of kinetic freeze-out scenarios of multi-strange and other identified particles in central nucleus-nucleus collisions

abstract: The transverse momentum (mass) spectra of the multi-strange and non-multi-strange (i.e. other identified) particles in central gold-gold (Au-Au), lead-lead (Pb-Pb), argon-muriate (Ar-KCl) and nickel-nickel (Ni-Ni) collisions over a wide energy range have been studied in this work. The experimental data measured by various collaborations have been analyzed. The blast-wave fit with Tsallis statistics is used to extract the kinetic freeze-out temperature and transverse flow velocity from the experimental data of transverse momentum (mass) spectra. The extracted parameters increase with the increase of collision energy and appear with the trend of saturation at the Beam Energy Scan (BES) energies at the Relativistic Heavy Ion Collider (RHIC). This saturation implies that the onset energy of phase transition of partial deconfinement is 7.7 GeV and that of whole deconfinement is 39 GeV. Furthermore, the energy scan/dependence of kinetic freeze-out scenarios are observed for the multi-strange and other identified particles, though the multiple freeze-out scenarios are also observed for various particles.


title: Secret Sharing MPC on FPGAs in the Datacenter

abstract: Multi-Party Computation (MPC) is a technique enabling data from several sources to be used in a secure computation revealing only the result while protecting the original data, facilitating shared utilization of data sets gathered by different entities. The presence of Field Programmable Gate Array (FPGA) hardware in datacenters can provide accelerated computing as well as low latency, high bandwidth communication that bolsters the performance of MPC and lowers the barrier to using MPC for many applications. In this work, we propose a Secret Sharing FPGA design based on the protocol described by Araki et al. We compare our hardware design to the original authors' software implementations of Secret Sharing and to work accelerating MPC protocols based on Garbled Circuits with FPGAs. Our conclusion is that Secret Sharing in the datacenter is competitive and when implemented on FPGA hardware was able to use at least 10$\times$ fewer computer resources than the original work using CPUs.


title: Theoretical evidence for new adsorption sites of CO$_2$ on the Ag electrode surface

abstract: Nowadays, electrochemical reduction of CO$_2$ has been considered as an effective method to solve the problem of global warming. The primary challenge in studying the mechanism is to determine the adsorption states of CO$_2$, since complicated metal surfaces often result in many different adsorption sites. Based on the density functional theory (DFT) calculations, we performed a theoretical study on the adsorption of CO$_2$ on the Ag electrode surface. The results show that the adsorption populations of CO$_2$ are extremely sensitive to the adsorption sites. Importantly, we found that the preferable adsorption positions are the terrace sites, rather than the previous reported step sites. The adsorption populations were found with the order of (211) > (110) > (111) > (100). Subsequently, the adsorption characteristics were correlated with the d-band theory and the charge transfers between Ag surfaces and CO$_2$.


title: Strong lensing as a giant telescope to localize the host galaxy of gravitational wave event

abstract: Standard siren cosmology of gravitational wave (GW) merger events relies on the identification of host galaxies and their redshifts. But this can be highly challenging due to numerous candidates of galaxies in the GW localization area. We point out that the number of candidates can be reduced by orders of magnitude for strongly lensed GW events, due to extra observational constraints. For the next-generation GW detectors like Einstein Telescope (ET), we estimate that this number is usually significantly less than one, as long as the GW localization uncertainty is better than $\sim 10\, \rm deg^2$. This implies that the unique identification of the host galaxy of lensed GW event detected by ET and Cosmic Explorer (CE) is possible. This provides us a promising opportunity to measure the redshift of the GW event and facilitate the standard siren cosmology. We also discuss its potential applications in understanding the evolution process and environment of the GW event.


title: LineStacker: A spectral line stacking tool for interferometric data

abstract: LineStacker is a new open access and open source tool for stacking of spectral lines in interferometric data. LineStacker is an ensemble of CASA tasks, and can stack both 3D cubes or already extracted spectra. The algorithm is tested on increasingly complex simulated data sets, mimicking Atacama Large Millimeter/submillimeter Array and Karl G. Jansky Very Large Array observations of [CII] and CO(3-2) emission lines, from $z\sim7$ and $z\sim4$ galaxies respectively. We find that the algorithm is very robust, successfully retrieving the input parameters of the stacked lines in all cases with an accuracy $\gtrsim90$\%. However, we distinguish some specific situations showcasing the intrinsic limitations of the method. Mainly that high uncertainties on the redshifts ($\Delta z > 0.01$) can lead to poor signal to noise ratio improvement, due to lines being stacked on shifted central frequencies. Additionally we give an extensive description of the embedded statistical tools included in LineStacker: mainly bootstrapping, rebinning and subsampling. Velocity rebinning {is applied on the data before stacking and} proves necessary when studying line profiles, in order to avoid artificial spectral features in the stack. Subsampling is useful to sort the stacked sources, allowing to find a subsample maximizing the searched parameters, while bootstrapping allows to detect inhomogeneities in the stacked sample. LineStacker is a useful tool for extracting the most from spectral observations of various types.


title: Unlinked monotone regression

abstract: We consider so-called univariate unlinked (sometimes ``decoupled,'' or ``shuffled'') regression when the unknown regression curve is monotone. In standard monotone regression, one observes a pair $(X,Y)$ where a response $Y$ is linked to a covariate $X$ through the model $Y= m_0(X) + \epsilon$, with $m_0$ the (unknown) monotone regression function and $\epsilon$ the unobserved error (assumed to be independent of $X$). In the unlinked regression setting one gets only to observe a vector of realizations from both the response $Y$ and from the covariate $X$ where now $Y \stackrel{d}{=} m_0(X) + \epsilon$. There is no (observed) pairing of $X$ and $Y$. Despite this, it is actually still possible to derive a consistent non-parametric estimator of $m_0$ under the assumption of monotonicity of $m_0$ and knowledge of the distribution of the noise $\epsilon$. In this paper, we establish an upper bound on the rate of convergence of such an estimator under minimal assumption on the distribution of the covariate $X$. We discuss extensions to the case in which the distribution of the noise is unknown. We develop a second order algorithm for its computation, and we demonstrate its use on synthetic data. Finally, we apply our method (in a fully data driven way, without knowledge of the error distribution) on longitudinal data from the US Consumer Expenditure Survey.


title: Core Excitations with Excited State Mean Field and Perturbation Theory

abstract: We test the efficacy of excited state mean field theory and its excited-state-specific perturbation theory on the prediction of K-edge positions and X-ray peak separations. We find that the mean field theory is surprisingly accurate, even though it contains no accounting of differential electron correlation effects. In the perturbation theory, we test multiple core-valence separation schemes and find that, with the mean field theory already so accurate, electron-counting biases in one popular separation scheme become a dominant error when predicting K-edges. Happily, these appear to be relatively easy to correct for, leading to a perturbation theory for K-edge positions that is lower scaling and more accurate than coupled cluster theory and competitive in accuracy with recent high-accuracy results from restricted open-shell Kohn Sham theory. For peak separations, our preliminary data show excited state mean field theory to be exceptionally accurate, but more extensive testing will be needed to see how it and its perturbation theory compare to coupled cluster peak separations more broadly.


title: Why aren't more theories named after women?: Teaching women's history in physics

abstract: Barriers to women's education and employment in Europe and the U.S. in the nineteenth century made it unlikely that any women would be among the few physicists whose ideas are taught in high school and college courses. This paper explores the social settings in which three influential physicists worked--James Clerk Maxwell, Robert Millikan, and Albert Einstein--to better understand the limited opportunities available to women. By acknowledging and explaining why there weren't more women among these founding physicists, instructors may help students understand the barriers that still exist and feel more empowered to overcome them and pursue physics as a career.


title: Uncertainty-Guided Efficient Interactive Refinement of Fetal Brain Segmentation from Stacks of MRI Slices

abstract: Segmentation of the fetal brain from stacks of motion-corrupted fetal MRI slices is important for motion correction and high-resolution volume reconstruction. Although Convolutional Neural Networks (CNNs) have been widely used for automatic segmentation of the fetal brain, their results may still benefit from interactive refinement for challenging slices. To improve the efficiency of interactive refinement process, we propose an Uncertainty-Guided Interactive Refinement (UGIR) framework. We first propose a grouped convolution-based CNN to obtain multiple automatic segmentation predictions with uncertainty estimation in a single forward pass, then guide the user to provide interactions only in a subset of slices with the highest uncertainty. A novel interactive level set method is also proposed to obtain a refined result given the initial segmentation and user interactions. Experimental results show that: (1) our proposed CNN obtains uncertainty estimation in real time which correlates well with mis-segmentations, (2) the proposed interactive level set is effective and efficient for refinement, (3) UGIR obtains accurate refinement results with around 30% improvement of efficiency by using uncertainty to guide user interactions. Our code is available online.


title: The stringent upper limit on jet power in the persistent soft state source 4U~1957+11

abstract: We present extremely deep upper limits on the radio emission from 4U~1957+11, an X-ray binary that is generally believed to be a persistently accreting black hole that is almost always in the soft state. We discuss a more comprehensive search for Type I bursts than in past work, revealing a stringent upper limit on the burst rate, bolstering the case for a black hole accretor. The lack of detection of this source at the 1.07 $\mu$Jy/beam noise level indicates jet suppression that is stronger than expected even in the most extreme thin disk models for radio jet production -- the radio power here is 1500--3700 times lower than the extrapolation of the hard state radio/X-ray correlation, with the uncertainties depending primarily on the poorly constrained source distance. We also discuss the location and velocity of the source and show that it must have either formed in the halo or with a strong asymmetric natal kick.


title: Computationally Efficient Learning of Large Scale Dynamical Systems: A Koopman Theoretic Approach

abstract: In recent years there has been a considerable drive towards data-driven analysis, discovery and control of dynamical systems. To this end, operator theoretic methods, namely, Koopman operator methods have gained a lot of interest. In general, the Koopman operator is obtained as a solution to a least-squares problem, and as such, the Koopman operator can be expressed as a closed-form solution that involves the computation of Moore-Penrose inverse of a matrix. For high dimensional systems and also if the size of the obtained data-set is large, the computation of the Moore-Penrose inverse becomes computationally challenging. In this paper, we provide an algorithm for computing the Koopman operator for high dimensional systems in a time-efficient manner. We further demonstrate the efficacy of the proposed approach on two different systems, namely a network of coupled oscillators (with state-space dimension up to 2500) and IEEE 68 bus system (with state-space dimension 204 and up to 24,000 time-points).


title: Testing for publication bias in meta-analysis under Copas selection model

abstract: In meta-analyses, publication bias is a well-known, important and challenging issue because the validity of the results from a meta-analysis is threatened if the sample of studies retrieved for review is biased. One popular method to deal with publication bias is the Copas selection model, which provides a flexible sensitivity analysis for correcting the estimates with considerable insight into the data suppression mechanism. However, rigorous testing procedures under the Copas selection model to detect bias are lacking. To fill this gap, we develop a score-based test for detecting publication bias under the Copas selection model. We reveal that the behavior of the standard score test statistic is irregular because the parameters of the Copas selection model disappear under the null hypothesis, leading to an identifiability problem. We propose a novel test statistic and derive its limiting distribution. A bootstrap procedure is provided to obtain the p-value of the test for practical applications. We conduct extensive Monte Carlo simulations to evaluate the performance of the proposed test and apply the method to several existing meta-analyses.


title: Control of Walking Assist Exoskeleton with Time-delay Based on the Prediction of Plantar Force

abstract: Many kinds of lower-limb exoskeletons were developed for walking assistance. However, when controlling these exoskeletons, time-delay due to the computation time and the communication delays is still a general problem. In this research, we propose a novel method to prevent the time-delay when controlling a walking assist exoskeleton by predicting the future plantar force and walking status. By using Long Short-Term Memory and a fully-connected network, the plantar force can be predicted using only data measured by inertial measurement unit sensors, not only during the walking period but also at the start and end of walking. From the predicted plantar force, the walking status and the desired assistance timing can also be determined. By considering the time-delay and sending the control commands beforehand, the exoskeleton can be moved precisely on the desired assistance timing. In experiments, the prediction accuracy of the plantar force and the assistance timing are confirmed. The performance of the proposed method is also evaluated by using the trained model to control the exoskeleton.


title: Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning

abstract: Manipulate and control of the complex quantum system with high precision are essential for achieving universal fault tolerant quantum computing. For a physical system with restricted control resources, it is a challenge to control the dynamics of the target system efficiently and precisely under disturbances. Here we propose a multi-level dissipative quantum control framework and show that deep reinforcement learning provides an efficient way to identify the optimal strategies with restricted control parameters of the complex quantum system. This framework can be generalized to be applied to other quantum control models. Compared with the traditional optimal control method, this deep reinforcement learning algorithm can realize efficient and precise control for multi-level quantum systems with different types of disturbances.


title: Bloch-Gr\"{u}neisen temperature and universal scaling of normalized resistivity in doped graphene revisited

abstract: In this work, we resolved some controversial issues on the Bloch-Gr\"{u}neisen (BG) temperature in doped graphene via analytical and numerical calculations based on full inelastic electron-acoustic-phonon (EAP) scattering rate and various approximation schemes. Analytic results for BG temperature obtained by semi-inelastic (SI) approximation (which gives scattering rates in excellent agreement with the full inelastic scattering rates) are compared with those obtained by quasi-elastic (QE) approximation and the commonly adopted value of $\Theta^{LA}_{F} = 2\hbar v_{LA} k_F/k_B$. It is found that the commonly adopted BG temperature in graphene ($\Theta^{LA}_{F}$) is about 5 times larger than the value obtained by the QE approximation and about 2.5 times larger than that by the SI approximation, when using the crossing-point temperature where low-temperature and high-temperature limits of the resistivity meet. The corrected analytic relation based on SI approximation agrees extremely well with the transition temperatures determined by fitting the the low- and high-$T$ behavior of available experimental data of graphene's resistivity. We also introduce a way to determine the BG temperature including the full inelastic EAP scattering rate and the deviation of electron energy from the chemical potential ($\mu$) numerically by finding the maximum of $\partial \rho(\mu,T)/\partial T$. Using the analytic expression of $\Theta_{BG,1}$ we can prove that the normalized resistivity defined as $R_{1}=\rho(\mu,T)/\rho(\mu,\Theta_{BG,1})$ plotted as a function of $(T/\Theta_{BG,1})$ is independent of the carrier density. Applying our results to previous experimental data extracted shows a universal scaling behavior, which is different from previous studies.


title: GSoFa: Scalable Sparse Symbolic LU Factorization on GPUs

abstract: Decomposing matrix A into a lower matrix L and an upper matrix U, which is also known as LU decomposition, is an essential operation in numerical linear algebra. For a sparse matrix, LU decomposition often introduces more nonzero entries in the L and U factors than in the original matrix. A symbolic factorization step is needed to identify the nonzero structures of L and U matrices. Attracted by the enormous potentials of the Graphics Processing Units (GPUs), an array of efforts have surged to deploy various LU factorization steps except for the symbolic factorization, to the best of our knowledge, on GPUs. This paper introduces gSoFa, the first GPU-based Symbolic factorization design with the following three optimizations to enable scalable LU symbolic factorization for nonsymmetric pattern sparse matrices on GPUs. First, we introduce a novel fine-grained parallel symbolic factorization algorithm that is well suited for the Single Instruction Multiple Thread (SIMT) architecture of GPUs. Second, we tailor supernode detection into a SIMT friendly process and strive to balance the workload, minimize the communication and saturate the GPU computing resources during supernode detection. Third, we introduce a three-pronged optimization to reduce the excessive space consumption problem faced by multi-source concurrent symbolic factorization. Taken together, gSoFa achieves up to 31x speedup from 1 to 44 Summit nodes (6 to 264 GPUs) and outperforms the state-of-the-art CPU project, on average, by 5x. Notably, gSoFa also achieves {up to 47%} of the peak memory throughput of a V100 GPU in Summit.


title: Deep Learning Methods for Universal MISO Beamforming

abstract: This letter studies deep learning (DL) approaches to optimize beamforming vectors in downlink multi-user multi-antenna systems that can be universally applied to arbitrarily given transmit power limitation at a base station. We exploit the sum power budget as side information so that deep neural networks (DNNs) can effectively learn the impact of the power constraint in the beamforming optimization. Consequently, a single training process is sufficient for the proposed universal DL approach, whereas conventional methods need to train multiple DNNs for all possible power budget levels. Numerical results demonstrate the effectiveness of the proposed DL methods over existing schemes.


title: Surface Denoising based on Normal Filtering in a Robust Statistics Framework

abstract: During a surface acquisition process using 3D scanners, noise is inevitable and an important step in geometry processing is to remove these noise components from these surfaces (given as points-set or triangulated mesh). The noise-removal process (denoising) can be performed by filtering the surface normals first and by adjusting the vertex positions according to filtered normals afterwards. Therefore, in many available denoising algorithms, the computation of noise-free normals is a key factor. A variety of filters have been introduced for noise-removal from normals, with different focus points like robustness against outliers or large amplitude of noise. Although these filters are performing well in different aspects, a unified framework is missing to establish the relation between them and to provide a theoretical analysis beyond the performance of each method. In this paper, we introduce such a framework to establish relations between a number of widely-used nonlinear filters for face normals in mesh denoising and vertex normals in point set denoising. We cover robust statistical estimation with M-smoothers and their application to linear and non-linear normal filtering. Although these methods originate in different mathematical theories - which include diffusion-, bilateral-, and directional curvature-based algorithms - we demonstrate that all of them can be cast into a unified framework of robust statistics using robust error norms and their corresponding influence functions. This unification contributes to a better understanding of the individual methods and their relations with each other. Furthermore, the presented framework provides a platform for new techniques to combine the advantages of known filters and to compare them with available methods.


title: Low-light Environment Neural Surveillance

abstract: We design and implement an end-to-end system for real-time crime detection in low-light environments. Unlike Closed-Circuit Television, which performs reactively, the Low-Light Environment Neural Surveillance provides real time crime alerts. The system uses a low-light video feed processed in real-time by an optical-flow network, spatial and temporal networks, and a Support Vector Machine to identify shootings, assaults, and thefts. We create a low-light action-recognition dataset, LENS-4, which will be publicly available. An IoT infrastructure set up via Amazon Web Services interprets messages from the local board hosting the camera for action recognition and parses the results in the cloud to relay messages. The system achieves 71.5% accuracy at 20 FPS. The user interface is a mobile app which allows local authorities to receive notifications and to view a video of the crime scene. Citizens have a public app which enables law enforcement to push crime alerts based on user proximity.


title: Gearhart-Koshy Acceleration for Affine Subspaces

abstract: The method of cyclic projections finds nearest points in the intersection of finitely many affine subspaces. To accelerate convergence, Gearhart and Koshy proposed a modification which, in each iteration, performs an exact line search based on minimising the distance to the solution. When the subspaces are linear, the procedure can be made explicit using feasibility of the zero vector. This work studies an alternative approach which does not rely on this fact, thus providing an efficient implementation in the affine setting.


title: Many Body Scars as a Group Invariant Sector of Hilbert Space

abstract: We present a class of Hamiltonians $H$ for which a sector of the Hilbert space invariant under a Lie group $G$, which is not a symmetry of $H$, possesses the essential properties of many-body scar states. These include the absence of thermalization and the "revivals" of special initial states in time evolution. Some of the scar states found in earlier work may be viewed as special cases of our construction. A particular class of examples concerns interacting spin-1/2 fermions on a lattice consisting of $N$ sites (it includes deformations of the Fermi-Hubbard model as special cases), and we show that it contains two families of $N+1$ scar states. One of these families, which was found in recent literature, is comprised of the well-known $\eta$-pairing states. We find another family of scar states which is $U(N)$ invariant. Both families and most of the group-invariant scar states produced by our construction in general, give rise to the off-diagonal long range order which survives at high temperatures and is insensitive to the details of the dynamics. Such states could be used for reliable quantum information processing because the information is stored non-locally, and thus cannot be easily erased by local perturbations. In contrast, other scar states we find are product states which could be easily prepared experimentally. The dimension of scar subspace is directly controlled by the choice of group $G$ and can be made exponentially large.


title: Towards a bihamiltonian structure for the double ramification hierarchy

abstract: We propose a remarkably simple and explicit conjectural formula for a bihamiltonian structure of the double ramification hierarchy corresponding to an arbitrary homogeneous cohomological field theory. Various checks are presented to support the conjecture.


title: Formation of mass gap objects in highly asymmetric mergers

abstract: The LIGO/Virgo Collaboration (LVC) recently reported the detection of GW190814, a merger of a $23^{+1.0}_{-0.9}~M_{\odot}$ primary black hole (BH), and a $2.6^{+0.08}_{-0.08}~M_{\odot}$ secondary. The secondary's mass falls into the mass-gap regime, which refers to the scarcity of compact objects in the mass range of 2-5 $M_{\odot}$. The first clue to the formation of the GW190814 lies in the fact that the primary is a very massive BH. We suggest that the secondary was born as a neutron star (NS) where a significant amount of the supernova ejecta mass from its formation remained bound to the binary due to the presence of the massive BH companion. The bound mass forms a circumbinary accretion disk, and its accretion onto the NS created a mass-gap object. In this scenario, LIGO/Virgo will only detect mass-gap objects in binary mergers with an extreme mass ratio. We also predict a correlation between the mass of the secondary and the mass of the primary in such asymmetric mergers. Our model can be tested with future data from the LVC's third-observing run.


title: A robust nonlinear mixed-effects model for COVID-19 deaths data

abstract: The analysis of complex longitudinal data such as COVID-19 deaths is challenging due to several inherent features: (i) Similarly-shaped profiles with different decay patterns; (ii) Unexplained variation among repeated measurements within each country, these repeated measurements may be viewed as clustered data since they are taken on the same country at roughly the same time; (iii) Skewness, outliers or skew-heavy-tailed noises are possibly embodied within response variables. This article formulates a robust nonlinear mixed-effects model based in the class of scale mixtures of skew-normal distributions for modeling COVID-19 deaths, which allows the analysts to model such data in the presence of the above described features simultaneously. An efficient EM-type algorithm is proposed to carry out maximum likelihood estimation of model parameters. The bootstrap method is used to determine inherent characteristics of the nonlinear individual profiles such as confidence interval of the predicted deaths and fitted curves. The target is to model COVID-19 deaths curves from some Latin American countries since this region is the new epicenter of the disease. Moreover, since a mixed-effect framework borrows information from the population-average effects, in our analysis we include some countries from Europe and North America that are in a more advanced stage of their COVID-19 deaths curve.


title: Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge

abstract: Massive language models are the core of modern NLP modeling and have been shown to encode impressive amounts of commonsense and factual information. However, that knowledge exists only within the latent parameters of the model, inaccessible to inspection and interpretation, and even worse, factual information memorized from the training corpora is likely to become stale as the world changes. Knowledge stored as parameters will also inevitably exhibit all of the biases inherent in the source materials. To address these problems, we develop a neural language model that includes an explicit interface between symbolically interpretable factual information and subsymbolic neural knowledge. We show that this model dramatically improves performance on two knowledge-intensive question-answering tasks. More interestingly, the model can be updated without re-training by manipulating its symbolic representations. In particular this model allows us to add new facts and overwrite existing ones in ways that are not possible for earlier models.


title: A variational Monte Carlo approach for core excitations

abstract: We present a systematically-improvable approach to core excitations in variational Monte Carlo. Building on recent work in excited-state-specific Monte Carlo, we show how a straightforward protocol, starting from a quantum chemistry guess, is able to capture core state's strong orbital relaxations, maintain accuracy in the near-nuclear region during these relaxations, and explicitly balance accuracy between ground and core excited states. In water, ammonia, and methane, which serve as prototypical representatives for oxygen, nitrogen, and carbon core states, respectively, this approach delivers accuracies on par with the best available theoretical methods even when using relatively small wave function expansions.


title: Rabi Spectroscopy and Sensitivity of a Floquet Engineered Optical Lattice Clock

abstract: We periodically modulate the lattice trapping potential of a $^{87}$Sr optical clock to Floquet engineer the clock transition. In the context of atomic gases in lattices, Floquet engineering has been used to shape the dispersion and topology of Bloch quasi-energy bands. Differently from these previous works manipulating the external (spatial) quasi-energies, we target the internal atomic degrees of freedom. We shape Floquet spin quasi-energies and measure their resonance profiles with Rabi spectroscopy. We provide the spectroscopic sensitivity of each band by measuring the Fisher information and show that this is not depleted by the Floquet dynamical modulation. The demonstration that the internal degrees of freedom can be selectively engineered by manipulating the external degrees of freedom inaugurates a novel device with potential applications in metrology, sensing and quantum simulations.


title: Differential rotation of the halo traced by the K-giant stars

abstract: We use K-giant stars selected from the LAMOST DR5 to study the variation of the rotational velocity of the galactic halo at different space positions. Modelling the rotational velocity distribution with both the halo and disk components, we find that the rotational velocity of the halo population decreases almost linearly with increasing vertical distance to the galactic disk plane, $Z$, at fixed galactocentric radius, $R$. The samples are separated into two parts with $6<R<12$ kpc and $12<R<20$ kpc. We derive that the decreasing rates along $Z$ for the two subsamples are $-3.07\pm0.63$ and $-1.89\pm0.37$ km s$^{-1}$ kpc$^{-1}$, respectively. Compared with the TNG simulations, we suggest that this trend is probably caused by the interaction between the disk and halo. The results from the simulations show that only the oblate halo can provide a decreasing rotational velocity with an increasing $Z$. This indicates that the Galactic halo is oblate with galactocentric radius $R<20$ kpc. On the other hand, the flaring of the disk component (mainly the thick disk) is clearly traced by this study, with $R$ between 12 and 20 kpc, the disk can vertically extend to $6\sim10$ kpc above the disk plane. What is more interesting is that, we find the Gaia-Enceladus-Sausage (GES) component has a significant contribution only in the halo with $R<12$ kpc, i.e. a fraction of 23$-$47\%. While in the outer subsample, the contribution is too low to be well constrained.


title: Amplified graph C*-algebras II: reconstruction

abstract: Let $E$ be a countable directed graph that is amplified in the sense that whenever there is an edge from $v$ to $w$, there are infinitely many edges from $v$ to $w$. We show that $E$ can be recovered from $C^*(E)$ together with its canonical gauge-action, and also from $L_K(E)$ together with its canonical grading.


title: Random errors are not necessarily politically neutral

abstract: Errors are inevitable in the implementation of any complex process. Here we examine the effect of random errors on Single Transferable Vote (STV) elections, a common approach to deciding multi-seat elections. It is usually expected that random errors should have nearly equal effects on all candidates, and thus be fair. We find to the contrary that random errors can introduce systematic bias into election results. This is because, even if the errors are random, votes for different candidates occur in different patterns that are affected differently by random errors. In the STV context, the most important effect of random errors is to invalidate the ballot. This removes far more votes for those candidates whose supporters tend to list a lot of preferences, because their ballots are much more likely to be invalidated by random error. Different validity rules for different voting styles mean that errors are much more likely to penalise some types of votes than others. For close elections this systematic bias can change the result of the election.


title: Quantum Entanglement and Spectral Form Factor

abstract: We replace a Hamiltonian with a modular Hamiltonian in the spectral form factor and the level spacing distribution function. This study establishes a connection between quantities within Quantum Entanglement and Quantum Chaos. To have a universal study for Quantum Entanglement, we consider the Gaussian random 2-qubit model. The maximum violation of Bell's inequality demonstrates a positive correlation with the entanglement entropy. Thus, the violation plays an equivalent role as Quantum Entanglement. We first provide an analytical estimation of the relation between quantum entanglement quantities and the dip when a subregion only has one qubit. The time of the first dip is monotone for entanglement entropy. The dynamics in a subregion is independent of the initial state at a late time. It is one of the signaling conditions for classical chaos. We also extend our analysis to the Gaussian random 3-qubit state, and it indicates a similar result. The simulation shows that the level spacing distribution function approaches GUE at a late time. In the end, we develop a technique within QFT to the spectral form factor for its relation to an $n$-sheet manifold. We apply the technology to a single interval in CFT$_2$ and the spherical entangling surface in $\mathcal{N}=4$ super Yang-Mills theory. The result is one for both cases, but the R\'enyi entropy can depend on the R\'enyi index. For the case of CFT$_2$, it indicates the difference between the continuum and discrete spectrum.


title: Cache-Aided Matrix Multiplication Retrieval

abstract: Coded caching is a promising technique to smooth out network traffic by storing part of the library content at the users' local caches. The seminal work on coded caching for single file retrieval by Maddah-Ali and Niesen (MAN) showed the existence of a global caching gain that scales with the total memory in the system, in addition to the known local caching gain in uncoded systems. This paper formulates a novel cache-aided matrix multiplication retrieval problem, relevant for data analytics and machine learning applications. In the considered problem, each cache-aided user requests the product of two matrices from the library. A structure-agnostic solution is to treat each possible matrix product as an independent file and use the MAN coded caching scheme for single file retrieval. This paper proposes two structure-aware schemes, which partition each matrix in the library by either rows or columns and let a subset of users cache some sub-matrices, that improve on the structure-agnostic scheme. For the case where the library matrices are "fat" matrices, the structure-aware row-partition scheme is shown to be order optimal under some constraint.


title: Efficient Hybrid Beamforming with Anti-Blockage Design for High-Speed Railway Communications

abstract: Future railway is expected to accommodate both train operation services and passenger broadband services. The millimeter wave (mmWave) communication is a promising technology in providing multi-gigabit data rates to onboard users. However, mmWave communications suffer from severe propagation attenuation and vulnerability to blockage, which can be very challenging in high-speed railway (HSR) scenarios. In this paper, we investigate efficient hybrid beamforming (HBF) design for train-to-ground communications. First, we develop a two-stage HBF algorithm in blockage-free scenarios. In the first stage, the minimum mean square error method is adopted for optimal hybrid beamformer design with low complexity and fast convergence; in the second stage, the orthogonal matching pursuit method is utilized to approximately recover the analog and digital beamformers. Second, in blocked scenarios, we design an anti-blockage scheme by adaptively invoking the proposed HBF algorithm, which can efficiently deal with random blockages. Extensive simulation results are presented to show the sum rate performance of the proposed algorithms under various configurations, including transmission power, velocity of the train, blockage probability, etc. It is demonstrated that the proposed anti-blockage algorithm can improve the effective rate by 20% in severely-blocked scenarios while maintaining low outage probability.


title: MSA-MIL: A deep residual multiple instance learning model based on multi-scale annotation for classification and visualization of glomerular spikes

abstract: Membranous nephropathy (MN) is a frequent type of adult nephrotic syndrome, which has a high clinical incidence and can cause various complications. In the biopsy microscope slide of membranous nephropathy, spikelike projections on the glomerular basement membrane is a prominent feature of the MN. However, due to the whole biopsy slide contains large number of glomeruli, and each glomerulus includes many spike lesions, the pathological feature of the spikes is not obvious. It thus is time-consuming for doctors to diagnose glomerulus one by one and is difficult for pathologists with less experience to diagnose. In this paper, we establish a visualized classification model based on the multi-scale annotation multi-instance learning (MSA-MIL) to achieve glomerular classification and spikes visualization. The MSA-MIL model mainly involves three parts. Firstly, U-Net is used to extract the region of the glomeruli to ensure that the features learned by the succeeding algorithm are focused inside the glomeruli itself. Secondly, we use MIL to train an instance-level classifier combined with MSA method to enhance the learning ability of the network by adding a location-level labeled reinforced dataset, thereby obtaining an example-level feature representation with rich semantics. Lastly, the predicted scores of each tile in the image are summarized to obtain glomerular classification and visualization of the classification results of the spikes via the usage of sliding window method. The experimental results confirm that the proposed MSA-MIL model can effectively and accurately classify normal glomeruli and spiked glomerulus and visualize the position of spikes in the glomerulus. Therefore, the proposed model can provide a good foundation for assisting the clinical doctors to diagnose the glomerular membranous nephropathy.


title: Reconfigurable Intelligent Surface Assisted Device-to-Device Communications

abstract: With the evolution of the 5G, 6G and beyond, device-to-device (D2D) communication has been developed as an energy-, and spectrum-efficient solution. In cellular network, D2D links need to share the same spectrum resources with the cellular link. A reconfigurable intelligent surface (RIS) can reconfigure the phase shifts of elements and create favorable beam steering, which can mitigate aggravated interference caused by D2D links. In this paper, we study a RIS-assisted single cell uplink communication network scenario, where the cellular link and multiple D2D links utilize direct propagation and reflecting one-hop propagation. The problem of maximizing the total system rate is formulated by jointly optimizing transmission powers of all links and discrete phase shifts of all elements. The formulated problem is an NP-hard mixed integer non-convex non-linear problem. To obtain practical solutions, we capitalize on alternating maximization and the problem is decomposed into two sub-problems. For the power allocation, the problem is a difference of concave functions (DC) problem, which is solved with the gradient descent method. For the phase shift, a local search algorithm with lower complexity is utilized. Simulation results show that deploying RIS and optimizing the phase shifts have a significant effect on mitigating D2D network interference.


title: Enhanced graphitic domains of unreduced graphene oxide and the interplay of hydration behaviour and catalytic activity

abstract: Previous studies indicate that the properties of graphene oxide (GO) can be significantly improved by enhancing its graphitic domain size through thermal diffusion and clustering of functional groups. Remarkably, this transition takes place below the decomposition temperature of the functional groups and thus allows fine-tuning of graphitic domains without compromising with the functionality of GO. By studying the transformation of GO under mild thermal treatment, we directly observe this size enhancement of graphitic domains from originally 40 nm2 to 200 nm2 through an extensive transmission electron microscopy (TEM) study. Additionally, we confirm the integrity of the functional groups during this process by comprehensive chemical analysis. A closer look into the process confirms the theoretically predicted relevance for the room temperature stability of GO. We further investigate the influence of enlarged graphitic domains on the hydration behaviour of GO and catalytic performance of single-atom catalysts supported by GO.


title: An encoder-decoder-based method for COVID-19 lung infection segmentation

abstract: The novelty of the COVID-19 disease and the speed of spread has created a colossal chaos, impulse among researchers worldwide to exploit all the resources and capabilities to understand and analyze characteristics of the coronavirus in term of the ways it spreads and virus incubation time. For that, the existing medical features like CT and X-ray images are used. For example, CT-scan images can be used for the detection of lung infection. But the challenges of these features such as the quality of the image and infection characteristics limitate the effectiveness of these features. Using artificial intelligence (AI) tools and computer vision algorithms, the accuracy of detection can be more accurate and can help to overcome these issues. This paper proposes a multi-task deep-learning-based method for lung infection segmentation using CT-scan images. Our proposed method starts by segmenting the lung regions that can be infected. Then, segmenting the infections in these regions. Also, to perform a multi-class segmentation the proposed model is trained using the two-stream inputs. The multi-task learning used in this paper allows us to overcome shortage of labeled data. Also, the multi-input stream allows the model to do the learning on many features that can improve the results. To evaluate the proposed method, many features have been used. Also, from the experiments, the proposed method can segment lung infections with a high degree performance even with shortage of data and labeled images. In addition, comparing with the state-of-the-art method our method achieves good performance results.


title: Noticing Motion Patterns: Temporal CNN with a Novel Convolution Operator for Human Trajectory Prediction

abstract: We propose a Convolutional Neural Network-based approach to learn, detect,and extract patterns in sequential trajectory data, known here as Social Pattern Extraction Convolution (Social-PEC). A set of experiments carried out on the human trajectory prediction problem shows that our model performs comparably to the state of the art and outperforms in some cases. More importantly,the proposed approach unveils the obscurity in the previous use of pooling layer, presenting a way to intuitively explain the decision-making process.


title: Traces on General Sets in $\mathbb{R}^n$ for Functions with no Differentiability Requirements

abstract: This paper is concerned with developing a theory of traces for functions that are integrable but need not possess any differentiability within their domain. Moreover, the domain can have an irregular boundary with cusp-like features and codimension not necessarily equal to one, or even an integer. Given $\Omega\subseteq\mathbb{R}^n$ and $\Gamma\subseteq\partial\Omega$, we introduce a function space $\mathscr{N}^{s(\cdot),p}(\Omega)\subseteq L^p_{\text{loc}}(\Omega)$ for which a well-defined trace operator can be identified. Membership in $\mathscr{N}^{s(\cdot),p}(\Omega)$ constrains the oscillations in the function values as $\Gamma$ is approached, but does not imply any regularity away from $\Gamma$. Under connectivity assumptions between $\Omega$ and $\Gamma$, we produce a linear trace operator from $\mathscr{N}^{s(\cdot),p}(\Omega)$ to the space of measurable functions on $\Gamma$. The connectivity assumptions are satisfied, for example, by all $1$-sided nontangentially accessible domains. If $\Gamma$ is upper Ahlfors-regular, then the trace is a continuous operator into a Sobolev-Slobodeckij space. If $\Gamma=\partial\Omega$ and is further assumed to be lower Ahlfors-regular, then the trace exhibits the standard Lebesgue point property. To demonstrate the generality of the results, we construct $\Omega\subseteq\mathbb{R}^2$ with a $t>1$-dimensional Ahlfors-regular $\Gamma\subseteq\partial\Omega$ satisfying the main domain hypotheses, yet $\Gamma$ is nowhere rectifiable and for every neighborhood of every point in $\Gamma$, there exists a boundary point within that neighborhood that is only tangentially accessible.


title: Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights

abstract: Machine learning (ML) models are widely used in many important domains. For efficiently processing these computational- and memory-intensive applications, tensors of these over-parameterized models are compressed by leveraging sparsity, size reduction, and quantization of tensors. Unstructured sparsity and tensors with varying dimensions yield irregular computation, communication, and memory access patterns; processing them on hardware accelerators in a conventional manner does not inherently leverage acceleration opportunities. This paper provides a comprehensive survey on the efficient execution of sparse and irregular tensor computations of ML models on hardware accelerators. In particular, it discusses enhancement modules in the architecture design and the software support; categorizes different hardware designs and acceleration techniques and analyzes them in terms of hardware and execution costs; analyzes achievable accelerations for recent DNNs; highlights further opportunities in terms of hardware/software/model co-design optimizations (inter/intra-module). The takeaways from this paper include: understanding the key challenges in accelerating sparse, irregular-shaped, and quantized tensors; understanding enhancements in accelerator systems for supporting their efficient computations; analyzing trade-offs in opting for a specific design choice for encoding, storing, extracting, communicating, computing, and load-balancing the non-zeros; understanding how structured sparsity can improve storage efficiency and balance computations; understanding how to compile and map models with sparse tensors on the accelerators; understanding recent design trends for efficient accelerations and further opportunities.


title: System inference for the spatio-temporal evolution of infectious diseases: Michigan in the time of COVID-19

abstract: We extend the classical SIR model of infectious disease spread to account for time dependence in the parameters, which also include diffusivities. The temporal dependence accounts for the changing characteristics of testing, quarantine and treatment protocols, while diffusivity incorporates a mobile population. This model has been applied to data on the evolution of the COVID-19 pandemic in the US state of Michigan. For system inference, we use recent advances; specifically our framework for Variational System Identification (Wang et al., Comp. Meth. App. Mech. Eng., 356, 44-74, 2019; arXiv:2001.04816 [cs.CE]) as well as Bayesian machine learning methods.


title: Triple Scissor Extender: A 6-DOF Lifting and Positioning Robot

abstract: We present a novel 6 DOF robotic mechanism for reaching high ceilings and positioning an end-effector. The end-effector is supported with three scissor mechanisms that extend towards the ceiling with 6 independent linear actuators moving the base ends of the individual scissors. The top point of each scissor is connected to one of three ball joints located at the three vertices of the top triangular plate holding the end-effector. Coordinated motion of the 6 linear actuators at the base allows the end-effector to reach an arbitrary position with an arbitrary orientation. The design concept of the Triple Scissor Extender is presented, followed by kinematic modeling and analysis of the the Inverse Jacobian relating actuator velocities to the end-effector velocities. The Inverse Jacobian eigenvalues are determined for diverse configurations in order to characterize the kinematic properties. A proof-of-concept prototype has been designed and built. The Inverse Jacobian for use in differential control is evaluated through experiments.


title: The continuous part of the axial distance spectrum for Kleinian groups

abstract: Elements $f$ of finite order in the isometry group of hyperbolic three-space $\IH^3$ have a hyperbolic line as a fixed point set, this line is the axis of $f$. The possible hyperbolic distances between axes of elements of order $p$ and $q$, not both two, among {\em all} discrete subgroups $\Gamma$ of $Isom^+(\IH^3)$ has an initial discrete spectrum \[ 0 =\delta_0< \delta_1 < \delta_2 < \ldots <\delta_\infty,\] each value taken with finite multiplicity, and above $\delta_\infty$ this spectrum of possible distances is continuous. The value $\delta_\infty$ is the smallest number with the property that for each $\lambda<1$ there are only finitely many discrete groups generated by elements of order $p$ and $q$ whose axes are no more than $\lambda \delta_\infty(p,q)$ apart. Geometrically $\delta_\infty$ places a bound on embedded tubular neighbourhoods of components of the singular set in the orbifold quotients $\IH^3/\Gamma$ and provides other geometric information about this set. The value $\delta_1(p,q)$ is known and tends to $\infty$ with $\min\{p,q\}$. Here we seek to determine - actually find asymptotically sharp upper-bounds for - $\delta_\infty(p,q)$. We also show that the gap $\delta_\infty(p,q)-\delta_1(p,q)$ is surprisingly small, less than $1.4059\ldots$, the sharp value for the Fuchsian case, independent of $p$ and $q$. This is despite both of these numbers tending to $\infty$ with either $p$ or $q$.


title: Design and Analysis of 6-DOF Triple Scissor Extender Robots with Applications in Aircraft Assembly

abstract: A new type of parallel robot mechanism with an extendable structure is presented, and its kinematic properties and design parameters are analyzed. The Triple Scissor Extender (TSE) is a 6 Degree-Of-Freedom robotic mechanism for reaching high ceilings and positioning an end effector. Three scissor mechanisms are arranged in parallel, with the bottom ends coupled to linear slides, and the top vertex attached to an end effector plate. Arbitrary positions and orientations of the end effector can be achieved through the coordinated motion of the six linear actuators located at the base. By changing key geometric parameters, the TSE's design can yield a specific desired workspace volume and differential motion behavior. A general kinematic model for diverse TSEs is derived, and the kinematic properties, including workspace, singularity, and the Jacobian singular values, are evaluated. From these expressions, four key design parameters are identified, and their sensitivity upon the workspace volume and the Jacobian singular values is analyzed. A case study in autonomous aircraft assembly is presented using the insights gained from the design parameter studies.


title: {\epsilon}-BMC: A Bayesian Ensemble Approach to Epsilon-Greedy Exploration in Model-Free Reinforcement Learning

abstract: Resolving the exploration-exploitation trade-off remains a fundamental problem in the design and implementation of reinforcement learning (RL) algorithms. In this paper, we focus on model-free RL using the epsilon-greedy exploration policy, which despite its simplicity, remains one of the most frequently used forms of exploration. However, a key limitation of this policy is the specification of $\varepsilon$. In this paper, we provide a novel Bayesian perspective of $\varepsilon$ as a measure of the uniformity of the Q-value function. We introduce a closed-form Bayesian model update based on Bayesian model combination (BMC), based on this new perspective, which allows us to adapt $\varepsilon$ using experiences from the environment in constant time with monotone convergence guarantees. We demonstrate that our proposed algorithm, $\varepsilon$-\texttt{BMC}, efficiently balances exploration and exploitation on different problems, performing comparably or outperforming the best tuned fixed annealing schedules and an alternative data-dependent $\varepsilon$ adaptation scheme proposed in the literature.


title: Efficient Document Exchange and Error Correcting Codes with Asymmetric Information

abstract: We study two fundamental problems in communication, Document Exchange (DE) and Error Correcting Code (ECC). In the first problem, two parties hold two strings, and one party tries to learn the other party's string through communication. In the second problem, one party tries to send a message to another party through a noisy channel, by adding some redundant information to protect the message. Two important goals in both problems are to minimize the communication complexity or redundancy, and to design efficient protocols or codes. Both problems have been studied extensively. In this paper we study whether asymmetric partial information can help in these two problems. We focus on the case of Hamming distance/errors, and the asymmetric partial information is modeled by one party having a vector of disjoint subsets $\vec{S}=(S_1, \cdots, S_t)$ of indices and a vector of integers $\vec{k}=(k_1, \cdots, k_t)$, such that in each $S_i$ the Hamming distance/errors is at most $k_i$. We establish both lower bounds and upper bounds in this model, and provide efficient randomized constructions that achieve a $\min\lbrace O(t^2), O\left((\log \log n)^2\right) \rbrace $ factor within the optimum, with almost linear running time. We further show a connection between the above document exchange problem and the problem of document exchange under edit distance, and use our techniques to give an efficient randomized protocol with optimal communication complexity and \emph{exponentially} small error for the latter. This improves the previous result by Haeupler \cite{haeupler2018optimal} (FOCS'19) and that by Belazzougui and Zhang \cite{BelazzouguiZ16} (FOCS'16). Our techniques are based on a generalization of the celebrated expander codes by Sipser and Spielman \cite{sipser1996expander}, which may be of independent interests.


title: Valley magnetism, nematicity, and density wave orders in twisted bilayer graphene

abstract: We analyze density-wave and Pomeranchuk orders in twisted bilayer graphene. This compliments our earlier analysis of the pairing instabilities. We assume that near half-filling of either conduction or valence band, the Fermi level is close to Van Hove points, where the density of states diverges, and study potential instabilities in the particle-hole channel within a patch model with two valley degrees of freedom. The hexagonal symmetry of twisted bilayer graphene allows for either six or twelve Van Hove points. We consider both cases and find the same two leading candidates for particle-hole order. One is an SU(2)-breaking spin state with ferromagnetism within a valley. A subleading inter-valley hopping induces antiferromagnetism between the valleys. The same state has also been obtained in strong coupling approaches, indicating that this order is robust. The other is a mixed state with $120^\circ$ complex spin order and orthogonal complex charge order. In addition, we find a weaker, but still attractive interaction in nematic channels, and discuss the type of a nematic order.


title: Design of Extra Robotic Legs for Augmenting Human Payload Capabilities by Exploiting Singularity and Torque Redistribution

abstract: We present the design of a new robotic human augmentation system that will assist the operator in carrying a heavy payload, reaching and maintaining difficult postures, and ultimately better performing their job. The Extra Robotic Legs (XRL) system is worn by the operator and consists of two articulated robotic legs that move with the operator to bear a heavy payload. The design was driven by a need to increase the effectiveness of hazardous material emergency response personnel who are encumbered by their personal protective equipment (PPE). The legs will ultimately walk, climb stairs, crouch down, and crawl with the operator while eliminating all external PPE loads on the operator. The forces involved in the most extreme loading cases were analyzed to find an effective strategy for reducing actuator loads. The analysis reveals that the maximum torque is exerted during the transition from the crawling to standing mode of motion. Peak torques are significantly reduced by leveraging redundancy in force application resulting from a closed-loop kinematic chain formed by a particular posture of the XRL. The actuators, power systems, and transmission elements were designed from the results of these analyses. Using differential mechanisms to combine the inputs of multiple actuators into a single degree of freedom, the gear reductions needed to bear the heavy loads could be kept at a minimum, enabling high bandwidth force control due to the near-direct-drive transmission. A prototype was fabricated utilizing the insights gained from these analyses and initial tests indicate the feasibility of the XRL system.


title: Compressed Sensing via Measurement-Conditional Generative Models

abstract: A pre-trained generator has been frequently adopted in compressed sensing (CS) due to its ability to effectively estimate signals with the prior of NNs. In order to further refine the NN-based prior, we propose a framework that allows the generator to utilize additional information from a given measurement for prior learning, thereby yielding more accurate prediction for signals. As our framework has a simple form, it is easily applied to existing CS methods using pre-trained generators. We demonstrate through extensive experiments that our framework exhibits uniformly superior performances by large margin and can reduce the reconstruction error up to an order of magnitude for some applications. We also explain the experimental success in theory by showing that our framework can slightly relax the stringent signal presence condition, which is required to guarantee the success of signal recovery.


title: The KSVZ Axion and Pseudo-Nambu-Goldstone Boson Models for the XENON1T Excess

abstract: The XENON1T excess can be explained by the Axion Like Particle (ALP) dark matter with mass around 2.5 keV. However, there are three problems needed to be solved: suppressing the coupling $g_{a\gamma}$ between the ALP and photon, and generating the proper coupling $g_{ae}$ between the ALP and electron as well as the correct ALP mass. We propose three models to solve these problems. In our models, the $g_{ae}$ couplings are produced by integrating out the vector-like leptons, and the correct ALP masses arise from high-dimensional operators. In the KSVZ axion model, the coupling $g_{a\gamma}$ can be suppressed by choosing proper sets of vector-like fermions, but we need some fine-tunings to obtain the ALP mass. Similarly, one can study the DFSZ axion model. In the $Z_8$ and $ U(1)_X$ models with approximate Pseudo-Nambu-Goldstone Bosons (PNGBs), the coupling $g_{a\gamma}$ is suppressed due to $SU(3)_C \times U(1)_{\rm EM}$ anomaly free. In the $Z_8$ model, the PNGB mass can be generated naturally at the keV scale via the dimension-8 operator. To solve the PNGB quality problem in the $ Z_8$ model, we embed it into the model with $ U(1)_X$ gauge symmetry.


title: Can We Achieve More with Less? Exploring Data Augmentation for Toxic Comment Classification

abstract: This paper tackles one of the greatest limitations in Machine Learning: Data Scarcity. Specifically, we explore whether high accuracy classifiers can be built from small datasets, utilizing a combination of data augmentation techniques and machine learning algorithms. In this paper, we experiment with Easy Data Augmentation (EDA) and Backtranslation, as well as with three popular learning algorithms, Logistic Regression, Support Vector Machine (SVM), and Bidirectional Long Short-Term Memory Network (Bi-LSTM). For our experimentation, we utilize the Wikipedia Toxic Comments dataset so that in the process of exploring the benefits of data augmentation, we can develop a model to detect and classify toxic speech in comments to help fight back against cyberbullying and online harassment. Ultimately, we found that data augmentation techniques can be used to significantly boost the performance of classifiers and are an excellent strategy to combat lack of data in NLP problems.


title: Boltzmann machine learning with a variational quantum algorithm

abstract: Boltzmann machine is a powerful tool for modeling probability distributions that govern the training data. A thermal equilibrium state is typically used for Boltzmann machine learning to obtain a suitable probability distribution. The Boltzmann machine learning consists of calculating the gradient of the loss function given in terms of the thermal average, which is the most time consuming procedure. Here, we propose a method to implement the Boltzmann machine learning by using Noisy Intermediate-Scale Quantum (NISQ) devices. We prepare an initial pure state that contains all possible computational basis states with the same amplitude, and apply a variational imaginary time simulation. Readout of the state after the evolution in the computational basis approximates the probability distribution of the thermal equilibrium state that is used for the Boltzmann machine learning. We actually perform the numerical simulations of our scheme and confirm that the Boltzmann machine learning works well by our scheme.


title: Bimonotone Subdivisions of Point Configurations in the Plane

abstract: Bimonotone subdivisions in two dimensions are subdivisions all of whose sides are either vertical or have nonnegative slope. They correspond to statistical estimates of probability distributions of strongly positively dependent random variables. The number of bimonotone subdivisions compared to the total number of subdivisions of a point configuration provides insight into how often the random variables are positively dependent. We give recursions as well as formulas for the numbers of bimonotone and total subdivisions of $2\times n$ grid configurations in the plane. Furthermore, we connect the former to the large Schr\"oder numbers. We also show that the numbers of bimonotone and total subdivisions of a $2\times n$ grid are asymptotically equal. We then provide algorithms for counting bimonotone subdivisions for any $m \times n$ grid. Finally, we prove that all bimonotone triangulations of an $m \times n$ grid are connected by flips. This gives rise to an algorithm for counting the number of bimonotone (and total) triangulations of an $m\times n$ grid.


title: On the Outsized Importance of Learning Rates in Local Update Methods

abstract: We study a family of algorithms, which we refer to as local update methods, that generalize many federated learning and meta-learning algorithms. We prove that for quadratic objectives, local update methods perform stochastic gradient descent on a surrogate loss function which we exactly characterize. We show that the choice of client learning rate controls the condition number of that surrogate loss, as well as the distance between the minimizers of the surrogate and true loss functions. We use this theory to derive novel convergence rates for federated averaging that showcase this trade-off between the condition number of the surrogate loss and its alignment with the true loss function. We validate our results empirically, showing that in communication-limited settings, proper learning rate tuning is often sufficient to reach near-optimal behavior. We also present a practical method for automatic learning rate decay in local update methods that helps reduce the need for learning rate tuning, and highlight its empirical performance on a variety of tasks and datasets.


title: Sensitivity analysis and incompressible Navier-Stokes-Poisson limit of Vlasov-Poisson-Boltzmann equations with uncertainty

abstract: For the Vlasov-Poisson-Boltzmann equations with random uncertainties from the initial data or collision kernels, we proved the sensitivity analysis and energy estimates uniformly with respect to the Knudsen number in the diffusive scaling using hypocoercivity method. As a consequence, we also justified the incompressible Navier-Stokes-Poisson limit with random inputs. In particular, for the first time, we obtain the precise convergence rate {\em without} employing any results based on Hilbert expansion. We not only generalized the previous deterministic Navier-Stokes-Poisson limits to random initial data case, also improve the previous uncertainty quantification results to the case where the initial data include both kinetic and fluid parts.


title: Spectral mapping of polarization-correlated photon-pair sources using quantum-classical correspondence

abstract: Direct spectral characterization of a quantum photon-pair source usually involves cumbersome, costly, and time-consuming detection issues. In this study, we experimentally characterize the spectral properties of a type-II phase-matched spontaneous parametric down-conversion (SPDC) source based on a titanium-diffused periodically poled lithium niobate (Ti:PPLN) waveguide. The characterization of the spectral information of the generated cross-polarized photon pairs is of importance for the use of such sources in applications including quantum information and communication. We demonstrate that the joint spectral intensity of the cross-polarized photon-pair source can be fully reconstructed using the quantum-classical correspondence through classical sum-frequency generation (SFG) measurements. This technique, which uses a much less complex detection system for visible light, opens the possibility of fast monitoring and control of the quantum state of (polarization-correlated) photon-pair sources to facilitate the realization of a stable and high-usability quantum source.


title: Multi-mode OAM Radio Waves: Generation, Angle of Arrival Estimation and Reception With UCAs

abstract: Orbital angular momentum (OAM) at radio frequency (RF) provides a novel approach of multiplexing a set of orthogonal modes on the same frequency channel to achieve high spectrum efficiencies. However, there are still big challenges in the multi-mode OAM generation, OAM antenna alignment and OAM signal reception. To solve these problems, we propose an overall scheme of the line-of-sight multi-carrier and multi-mode OAM (LoS MCMM-OAM) communication based on uniform circular arrays (UCAs). First, we verify that UCA can generate multi-mode OAM radio beam with both the RF analog synthesis method and the baseband digital synthesis method. Then, for the considered UCA-based LoS MCMM-OAM communication system, a distance and AoA estimation method is proposed based on the two-dimensional ESPRIT (2-D ESPRIT) algorithm. A salient feature of the proposed LoS MCMM-OAM and LoS MCMM-OAM-MIMO systems is that the channel matrices are completely characterized by three parameters, namely, the azimuth angle, the elevation angle and the distance, independent of the numbers of subcarriers and antennas, which significantly reduces the burden by avoiding estimating large channel matrices, as traditional MIMO-OFDM systems. After that, we propose an OAM reception scheme including the beam steering with the estimated AoA and the amplitude detection with the estimated distance. At last, the proposed methods are extended to the LoS MCMM-OAM-MIMO system equipped with uniform concentric circular arrays (UCCAs). Both mathematical analysis and simulation results validate that the proposed OAM reception scheme can eliminate the effect of the misalignment error of a practical OAM channel and approaches the performance of an ideally aligned OAM channel.


title: BusTr: Predicting Bus Travel Times from Real-Time Traffic

abstract: We present BusTr, a machine-learned model for translating road traffic forecasts into predictions of bus delays, used by Google Maps to serve the majority of the world's public transit systems where no official real-time bus tracking is provided. We demonstrate that our neural sequence model improves over DeepTTE, the state-of-the-art baseline, both in performance (-30% MAPE) and training stability. We also demonstrate significant generalization gains over simpler models, evaluated on longitudinal data to cope with a constantly evolving world.


title: Drone swarms in fire suppression activities

abstract: Recent huge technological development of Unmanned Aerial Vehicles (UAVs) can provide breakthrough means of fighting wildland fires. We propose an innovative forest firefighting system based on the use of a swarm of hundreds of UAVs able to generate a continuous flow of extinguishing liquid on the fire front, simulating rain effect. Automatic battery replacement and refilling of the extinguishing liquid ensure the continuity of the action, and fire-resistant materials protect drones exposed to possible high temperatures. We demonstrate the validity of the approach in Mediterranean scrub first computing the critical water flow rate according to the main factors involved in the evolution of a fire, then estimating the number of linear meters of active fire front that can be extinguished depending on the number of drones available and the amount of extinguishing fluid carried. A fire propagation cellular automata model is also employed to study the evolution of the fire. Simulation results suggest that the proposed system can successfully integrate, or in case of low-intensity and limited extent fires completely replace, current forest firefighting techniques.


title: A Revision of Neural Tangent Kernel-based Approaches for Neural Networks

abstract: Recent theoretical works based on the neural tangent kernel (NTK) have shed light on the optimization and generalization of over-parameterized networks, and partially bridge the gap between their practical success and classical learning theory. Especially, using the NTK-based approach, the following three representative results were obtained: (1) A training error bound was derived to show that networks can fit any finite training sample perfectly by reflecting a tighter characterization of training speed depending on the data complexity. (2) A generalization error bound invariant of network size was derived by using a data-dependent complexity measure (CMD). It follows from this CMD bound that networks can generalize arbitrary smooth functions. (3) A simple and analytic kernel function was derived as indeed equivalent to a fully-trained network. This kernel outperforms its corresponding network and the existing gold standard, Random Forests, in few shot learning. For all of these results to hold, the network scaling factor $\kappa$ should decrease w.r.t. sample size n. In this case of decreasing $\kappa$, however, we prove that the aforementioned results are surprisingly erroneous. It is because the output value of trained network decreases to zero when $\kappa$ decreases w.r.t. n. To solve this problem, we tighten key bounds by essentially removing $\kappa$-affected values. Our tighter analysis resolves the scaling problem and enables the validation of the original NTK-based results.


title: Robust two-dimensional ice on graphene built from finite-length water molecular chains

abstract: Interfacial ice on graphene has attracted much attention because it is a model system to study two-dimensional (2D) ice structures on chemically inert substrates. While water-graphene interaction was usually assumed to be negligible, the structures of the 2D ice are believed to be not appreciably perturbed by the graphene substrate. Here we report atomic-resolved characterizations of an exotic 2D ice structure on graphene built from water molecular chains with finite lengths. Our experiments demonstrated that the water molecular chains are exactly orientated along zigzag directions of the graphene substrate, which evidences an anomalously strong interlayer interaction between the 2D ice and the graphene substrate. Moreover, the length of the water molecular chains closely links to the number of graphene layers, indicating layer-number-dependent water-graphene interfacial interactions. Our work highlights the important role of the 2D ice structures on the water-graphene interfacial interactions.


title: Modelling Drosophila Motion Vision Pathways for Decoding the Direction of Translating Objects Against Cluttered Moving Backgrounds

abstract: Decoding the direction of translating objects in front of cluttered moving backgrounds, accurately and efficiently, is still a challenging problem. In nature, lightweight and low-powered flying insects apply motion vision to detect a moving target in highly variable environments during flight, which are excellent paradigms to learn motion perception strategies. This paper investigates the fruit fly \textit{Drosophila} motion vision pathways and presents computational modelling based on cutting-edge physiological researches. The proposed visual system model features bio-plausible ON and OFF pathways, wide-field horizontal-sensitive (HS) and vertical-sensitive (VS) systems. The main contributions of this research are on two aspects: 1) the proposed model articulates the forming of both direction-selective (DS) and direction-opponent (DO) responses, revealed as principal features of motion perception neural circuits, in a feed-forward manner; 2) it also shows robust direction selectivity to translating objects in front of cluttered moving backgrounds, via the modelling of spatiotemporal dynamics including combination of motion pre-filtering mechanisms and ensembles of local correlators inside both the ON and OFF pathways, which works effectively to suppress irrelevant background motion or distractors, and to improve the dynamic response. Accordingly, the direction of translating objects is decoded as global responses of both the HS and VS systems with positive or negative output indicating preferred-direction (PD) or null-direction (ND) translation. The experiments have verified the effectiveness of the proposed neural system model, and demonstrated its responsive preference to faster-moving, higher-contrast and larger-size targets embedded in cluttered moving backgrounds.


title: Computational methods for cancer driver discovery: A survey

abstract: Motivation: Uncovering the genomic causes of cancer, known as cancer driver genes, is a fundamental task in biomedical research. Cancer driver genes drive the development and progression of cancer, thus identifying cancer driver genes and their regulatory mechanism is crucial to the design of cancer treatment and intervention. Many computational methods, which take the advantages of computer science and data science, have been developed to utilise multiple types of genomic data to reveal cancer drivers and their regulatory mechanism behind cancer development and progression. Due to the complexity of the mechanistic insight of cancer genes in driving cancer and the fast development of the field, it is necessary to have a comprehensive review about the current computational methods for discovering different types of cancer drivers. Results: We survey computational methods for identifying cancer drivers from genomic data. We categorise the methods into three groups, methods for single driver identification, methods for driver module identification, and methods for identifying personalised cancer drivers. We also conduct a case study to compare the performance of the current methods. We further analyse the advantages and limitations of the current methods, and discuss the challenges and future directions of the topic. In addition, we investigate the resources for discovering and validating cancer drivers in order to provide a one-stop reference of the tools to facilitate cancer driver discovery. The ultimate goal of the paper is to help those interested in the topic to establish a solid background to carry out further research in the field.


title: Thermal destabilization of self-bound ultradilute quantum droplets

abstract: We theoretically investigate the temperature effect in a Bose-Bose mixture with attractive inter-species interactions, in the regime where a self-bound ultradilute quantum droplet forms due to the subtle balance between the attractive mean-field force and the repulsive force provided by Lee-Huang-Yang quantum fluctuations. We find that in contrast to quantum fluctuations, thermal fluctuations destabilize the droplet state and completely destroy it above a threshold temperature. We show that the threshold temperature is determined by the intra-species interaction energy. For a three-dimensional Bose-Bose mixture, the threshold temperature is less than one-tenth of the Bose-Einstein condensation temperature under the typical experimental conditions. With increasing temperature, the droplet's equilibrium density gradually decreases and can be reduced by several tens of percent upon reaching the threshold temperature. We also consider a one-dimensional quantum droplet and find a similar destabilization effect due to thermal fluctuations. The threshold temperature in one dimension is roughly set by the binding energy of the inter-species dimer. The pronounced thermal instability of a self-bound quantum droplet predicted in our work could be examined in future experiments, by measuring the temperature dependence of its central density and observing its sudden disappearance at the threshold temperature.


title: Image Analysis Based on Nonnegative/Binary Matrix Factorization

abstract: Using nonnegative/binary matrix factorization (NBMF), a matrix can be decomposed into a nonnegative matrix and a binary matrix. Our analysis of facial images, based on NBMF and using the Fujitsu Digital Annealer, leads to successful image reconstruction and image classification. The NBMF algorithm converges in fewer iterations than those required for the convergence of nonnegative matrix factorization (NMF), although both techniques perform comparably in image classification.