title: The Accreted Nuclear Clusters of the Milky Way

abstract: A number of the massive clusters in the halo, bulge and disc of the Galaxy are not genuine globular clusters (GCs), but instead are different beasts altogether. They are the remnant nuclear star clusters (NSCs) of ancient galaxies since accreted by the Milky Way. While some clusters are readily identifiable as NSCs, and can be readily traced back to their host galaxy (e.g., M54 and the Sagittarius Dwarf galaxy) others have proven more elusive. Here we combine a number of independent constraints, focusing on their internal abundances and overall kinematics, to find NSCs accreted by the Galaxy and trace them to their accretion event. We find that the true NSCs accreted by the Galaxy are: M54 from the Sagittarius Dwarf, $\omega$ Centari from Gaia-Enceladus/Sausage, NGC 6273 from Kraken and (potentially) NGC 6934 from the Helmi Streams. These NSCs are prime candidates for searches of intermediate mass black holes (BHs) within star clusters, given the common occurrence of galaxies hosting both NSCs and central massive BHs. No NSC appears to be associated with Sequoia or other minor accretion events. Other claimed NSCs are shown not to be such. We also discuss the peculiar case of Terzan 5, which may represent a unique case of a cluster-cluster merger.


title: Deep-Learning-Aided Path Planning and Map Construction for Expediting Indoor Mapping

abstract: The problem of autonomous indoor mapping is addressed. The goal is to minimize the time to achieve a predefined percentage of exposure with some desired level of certainty. The use of a pre-trained generative deep neural network, acting as a map predictor, in both the path planning and the map construction is proposed in order to expedite the mapping process. This method is examined in combination with several frontier-based path planners for two distinct floorplan datasets. Simulations are run for several configurations of the integrated map predictor, the results of which reveal that by utilizing the prediction a significant reduction in mapping time is possible. When the prediction is integrated in both path planning and map construction processes it is shown that the mapping time may in some cases be cut by over 50%.


title: Circuit lower bounds for low-energy states of quantum code Hamiltonians

abstract: The No Low-energy Trivial States (NLTS) conjecture of Freedman and Hastings, 2014 -- which posits the existence of a local Hamiltonian with a super-constant quantum circuit lower bound on the complexity of all low-energy states -- identifies a fundamental obstacle to the resolution of the quantum PCP conjecture. In this work, we provide new techniques, based on entropic and local indistinguishability arguments, that prove circuit lower bounds for all the low-energy states of local Hamiltonians arising from quantum error-correcting codes. For local Hamiltonians arising from nearly linear-rate or nearly linear-distance LDPC stabilizer codes, we prove super-constant circuit lower bounds for the complexity of all states of energy o(n). Such codes are known to exist and are not necessarily locally testable, a property previously suspected to be essential for the NLTS conjecture. Curiously, such codes can also be constructed on a two-dimensional lattice, showing that low-depth states cannot accurately approximate the ground-energy even in physically relevant systems.


title: Face Morphing Attack Generation & Detection: A Comprehensive Survey

abstract: The vulnerability of Face Recognition System (FRS) to various kind of attacks (both direct and in-direct attacks) and face morphing attacks has received a great interest from the biometric community. The goal of a morphing attack is to subvert the FRS at Automatic Border Control (ABC) gates by presenting the Electronic Machine Readable Travel Document (eMRTD) or e-passport that is obtained based on the morphed face image. Since the application process for the e-passport in the majority countries requires a passport photo to be presented by the applicant, a malicious actor and the accomplice can generate the morphed face image and to obtain the e-passport. An e-passport with a morphed face images can be used by both the malicious actor and the accomplice to cross the border as the morphed face image can be verified against both of them. This can result in a significant threat as a malicious actor can cross the border without revealing the track of his/her criminal background while the details of accomplice are recorded in the log of the access control system. This survey aims to present a systematic overview of the progress made in the area of face morphing in terms of both morph generation and morph detection. In this paper, we describe and illustrate various aspects of face morphing attacks, including different techniques for generating morphed face images but also the state-of-the-art regarding Morph Attack Detection (MAD) algorithms based on a stringent taxonomy and finally the availability of public databases, which allow to benchmark new MAD algorithms in a reproducible manner. The outcomes of competitions/benchmarking, vulnerability assessments and performance evaluation metrics are also provided in a comprehensive manner. Furthermore, we discuss the open challenges and potential future works that need to be addressed in this evolving field of biometrics.


title: Beyond Worst-case Analysis of Multicore Caching Strategies

abstract: Every processor with multiple cores sharing a cache needs to implement a cache-replacement algorithm. Previous work demonstrated that the competitive ratio of a large class of online algorithms, including Least-Recently-Used (LRU), grows with the length of the input. Furthermore, even offline algorithms like Furthest-In-Future, the optimal algorithm in single-core caching, cannot compete in the multicore setting. These negative results motivate a more in-depth comparison of multicore caching algorithms via alternative analysis measures. Specifically, the power of the adversary to adapt to online algorithms suggests the need for a direct comparison of online algorithms to each other. In this paper, we introduce cyclic analysis, a generalization of bijective analysis introduced by Angelopoulos and Schweitzer [JACM'13]. Cyclic analysis captures the advantages of bijective analysis while offering flexibility that makes it more useful for comparing algorithms for a variety online problems. In particular, we take the first steps beyond worst-case analysis for analysis of multicore caching algorithms. We use cyclic analysis to establish relationships between multicore caching algorithms, including the advantage of LRU over all other multicore caching algorithms in the presence of locality of reference.


title: When Shall I Be Empathetic? The Utility of Empathetic Parameter Estimation in Multi-Agent Interactions

abstract: Human-robot interactions (HRI) can be modeled as dynamic or differential games with incomplete information, where each agent holds private reward parameters. Due to the open challenge in finding perfect Bayesian equilibria of such games, existing studies often consider approximated solutions composed of parameter estimation and motion planning steps, in order to decouple the belief and physical dynamics. In parameter estimation, current approaches often assume that the reward parameters of the robot are known by the humans. We argue that by falsely conditioning on this assumption, the robot performs non-empathetic estimation of the humans' parameters, leading to undesirable values even in the simplest interactions. We test this argument by studying a two-vehicle uncontrolled intersection case with short reaction time. Results show that when both agents are unknowingly aggressive (or non-aggressive), empathy leads to more effective parameter estimation and higher reward values, suggesting that empathy is necessary when the true parameters of agents mismatch with their common belief. The proposed estimation and planning algorithms are therefore more robust than the existing approaches, by fully acknowledging the nature of information asymmetry in HRI. Lastly, we introduce value approximation techniques for real-time execution of the proposed algorithms.


title: SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translation

abstract: Simultaneous text translation and end-to-end speech translation have recently made great progress but little work has combined these tasks together. We investigate how to adapt simultaneous text translation methods such as wait-k and monotonic multihead attention to end-to-end simultaneous speech translation by introducing a pre-decision module. A detailed analysis is provided on the latency-quality trade-offs of combining fixed and flexible pre-decision with fixed and flexible policies. We also design a novel computation-aware latency metric, adapted from Average Lagging.


title: Atomic data for the Gaia-ESO Survey

abstract: We describe the atomic and molecular data that were used for the abundance analyses of FGK-type stars carried out within the Gaia-ESO Survey. We present an unprecedented effort to create a homogeneous line list, which was used by several abundance analysis groups to calculate synthetic spectra and equivalent widths. The atomic data are accompanied by quality indicators and detailed references to the sources. The atomic and molecular data are made publicly available in electronic form. In general experimental transition probabilities were preferred but theoretical values were also used. Astrophysical gf-values were avoided due to the model-dependence of such a procedure. For elements whose lines are significantly affected by hyperfine structure or isotopic splitting a concerted effort has been made to collate the necessary data for the individual line components. We also performed a detailed investigation of available data for line broadening due to collisions with neutral hydrogen atoms. Synthetic spectra calculated for the Sun and Arcturus were used to assess the blending properties of the lines. Among a subset of over 1300 lines of 35 elements in the wavelength ranges from 475 nm to 685 nm and from 850 nm to 895 nm we identified about 200 lines of 24 species which have accurate gf-values and are free of blends in the spectra of the Sun and Arcturus. For the broadening due to collisions with neutral hydrogen we recommend data based on Anstee-Barklem-O'Mara theory, where available, and to avoid lines of neutral species otherwise. Theoretical broadening data by R.L. Kurucz should be used for Sc II, Ti II, and Y II lines. For ionised rare-earth species the Uns\"old approximation with an enhancement factor of 1.5 for the line width can be used. Desirable improvements in atomic data were identified for a number of species, including Al I, S I, Cr II, Na I, Si I, Ca II, and Ni I.


title: Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations

abstract: Modern conversational AI systems support natural language understanding for a wide variety of capabilities. While a majority of these tasks can be accomplished using a simple and flat representation of intents and slots, more sophisticated capabilities require complex hierarchical representations supported by semantic parsing. State-of-the-art semantic parsers are trained using supervised learning with data labeled according to a hierarchical schema which might be costly to obtain or not readily available for a new domain. In this work, we explore the possibility of generating synthetic data for neural semantic parsing using a pretrained denoising sequence-to-sequence model (i.e., BART). Specifically, we first extract masked templates from the existing labeled utterances, and then fine-tune BART to generate synthetic utterances conditioning on the extracted templates. Finally, we use an auxiliary parser (AP) to filter the generated utterances. The AP guarantees the quality of the generated data. We show the potential of our approach when evaluating on the Facebook TOP dataset for navigation domain.


title: Timber Volume Estimation Based on Airborne Laser Scanning -- Comparing the Use of National Forest Inventory and Forest Management Inventory Data

abstract: Large-scale forest resource maps based on national forest inventory (NFI) data and airborne laser scanning may facilitate synergies between NFIs and forest management inventories (FMIs). A comparison of models used in such a NFI-based map and a FMI indicate that NFI-based maps can directly be used in FMIs to estimate timber volume of mature spruce forests. Traditionally, FMIs and NFIs have been separate activities. The increasing availability of detailed NFI-based forest resource maps provides the possibility to eliminate or reduce the need of field sample plot measurements in FMIs if their accuracy is similar. We aim to 1) compare a timber volume model used in a NFI-based map and models used in a FMI, and 2) evaluate utilizing additional local sample plots in the model of the NFI-based map. Accuracies of timber volume estimates using models from an existing NFI-based map and a FMI were compared at plot and stand level. Estimates from the NFI-based map were similar to or more accurate than the FMI. The addition of local plots to the modeling data did not clearly improve the model of the NFI-based map.The comparison indicates that NFI-based maps can directly be used in FMIs for timber volume estimation in mature spruce stands, leading to potentially large cost savings.


title: Time and Charge-Sign Dependence of the Heliospheric Modulation of Cosmic Rays

abstract: Simultaneous and continuous observations of galactic cosmic-ray electrons and positrons from the PAMELA and AMS02 space experiments are most suitable for numerical modeling studies of the heliospheric modulation of these particles below 50 GeV. A well-established comprehensive three-dimensional modulation model is applied to compute full spectra for electrons and positrons with the purpose of reproducing the observed ratio positrons/electrons for a period which covers the previous long and unusual deep solar minimum activity and the recent maximum activity phase including the polarity reversal of the solar magnetic field. For this purpose the very local interstellar spectra for these particles were established first. Our study is focused on how the main modulation processes, including particle drifts, and other parameters such as the three major diffusion coefficients, had evolved, and how the corresponding charge-sign dependent modulation had occurred subsequently. The end result of our effort is the detailed reproduction of positron/electrons from 2006 to 2015, displaying both qualitative and quantitative agreement with the main observed features. Particularly, we determine how much particle drifts is needed to explain the time dependence exhibited by the observed positron/electron during each solar activity phase, especially during the polarity reversal phase when no well-defined magnetic polarity was found.


title: Multi-hop Routing with Proactive Route Refinement for 60 GHz Millimeter-Wave Networks

abstract: Fundamental requirements of mmWave systems are peak data rates of multiple Gbps and latencies of the order of at most a few milliseconds. However, highly directional mmWave links are susceptible to frequent link failures under stress conditions such as mobility and human blockage. Under these conditions, multi-hop routing can achieve reliable and robust performance. In this paper, we consider multi-hop millimeter wave (mmWave) wireless systems and propose proactive route refinement schemes that are particularly important under dynamic scenarios. First, we consider the AODV-type protocols and propose a cross-layer approach that integrates sectorized communication at the MAC layer with on-demand multi-hop routing at the network layer. Next, we consider Backpressure routing protocol, and enhance this protocol with periodic HELLO status messages. System-level simulation results based on the IEEE 802.11ad standard are provided that confirm the benefits of proactive route refinement for the ADOV-type and Backpressure routing protocols.


title: Floquet exceptional contours in Lindblad dynamics with time-periodic drive and dissipation

abstract: The dynamics of an isolated quantum system is coherent and unitary. Weak coupling to the environment leads to decoherence, which is traditionally modeled with a Lindblad equation for the system's density matrix. Starting from a pure state, such a system approaches a steady state (mixed or otherwise) in an underdamped or overdamped manner. This transition occurs at an eigenvalue degeneracy of a Lindblad superoperator, called an exceptional point (EP), where corresponding eigenvectors coalesce. Recent years have seen an explosion of interest in creating exceptional points in a truly quantum domain, driven by the enhanced sensitivity and topological features EPs have shown in their classical realizations. Here, we present Floquet analysis of a prototypical qubit whose drive or dissipator strengths are varied periodically. We consider models with a single dissipator that generate global loss (phase damping) or mode-selective loss (spontaneous emission). In all cases, we find that periodic modulations lead to EP lines at small dissipator strengths, and a rich EP structure in the parameter space. Our analytical and numerical results show that extending Lindblad Liouvillians to the Floquet domain is a new, potentially preferred route to accessing exceptional points in the transient dynamics towards the Lindblad steady state.


title: Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs

abstract: Moire artifacts are common in digital photography, resulting from the interference between high-frequency scene content and the color filter array of the camera. Existing deep learning-based demoireing methods trained on large scale datasets are limited in handling various complex moire patterns, and mainly focus on demoireing of photos taken of digital displays. Moreover, obtaining moire-free ground-truth in natural scenes is difficult but needed for training. In this paper, we propose a self-adaptive learning method for demoireing a high-frequency image, with the help of an additional defocused moire-free blur image. Given an image degraded with moire artifacts and a moire-free blur image, our network predicts a moire-free clean image and a blur kernel with a self-adaptive strategy that does not require an explicit training stage, instead performing test-time adaptation. Our model has two sub-networks and works iteratively. During each iteration, one sub-network takes the moire image as input, removing moire patterns and restoring image details, and the other sub-network estimates the blur kernel from the blur image. The two sub-networks are jointly optimized. Extensive experiments demonstrate that our method outperforms state-of-the-art methods and can produce high-quality demoired results. It can generalize well to the task of removing moire artifacts caused by display screens. In addition, we build a new moire dataset, including images with screen and texture moire artifacts. As far as we know, this is the first dataset with real texture moire patterns.


title: The generalized Klein-Gordon oscillator in a Cosmic Space-Time with a Space-Like Dislocation and the Aharonov-Bohm Effect

abstract: In the present work, we investigated the quantum behavior of a charged particle that is under the effect of a uniform magnetic external field. We assumed that space-time has a space-like dislocation with an internal magnetic flux. We examined two different types of potential energies that are known as the pseudo harmonic and Cornell type potential energies, with the nonminimal coupling. We observed the Aharonov-Bohm effect in both cases. We extended the analysis on the energy spectrum functions to the different limits.


title: Online Observer-Based Inverse Reinforcement Learning

abstract: In this paper, a novel approach to the output-feedback inverse reinforcement learning (IRL) problem is developed by casting the IRL problem, for linear systems with quadratic cost functions, as a state estimation problem. Two observer-based techniques for IRL are developed, including a novel observer method that re-uses previous state estimates via history stacks. Theoretical guarantees for convergence and robustness are established under appropriate excitation conditions. Simulations demonstrate the performance of the developed observers and filters under noisy and noise-free measurements.


title: Local and Global Analysis

abstract: The objective of this article is to give an introduction to p-adic analysis along the lines of Tate's thesis, as well as incorporating material of a more recent vintage, for example Weil groups.


title: Primal-Dual Incremental Gradient Method for Nonsmooth and Convex Optimization Problems

abstract: In this paper, we consider a nonsmooth convex finite-sum problem with a conic constraint. To overcome the challenge of projecting onto the constraint set and computing the full (sub)gradient, we introduce a primal-dual incremental gradient scheme where only a component function and two constraints are used to update each primal-dual sub-iteration in a cyclic order. We demonstrate an asymptotic sublinear rate of convergence in terms of suboptimality and infeasibility which is an improvement over the state-of-the-art incremental gradient schemes in this setting. Numerical results suggest that the proposed scheme compares well with competitive methods.


title: Constrained-degree percolation in random environment

abstract: We consider the Constrained-degree percolation model in random environment on the square lattice. In this model, each vertex $v$ has an independent random constraint ${\kappa}_v$ which takes the value $j\in \{0,1,2,3\}$ with probability $\rho_j$. Each edge $e$ attempts to open at a random uniform time $U_e$ in $[0,1]$, independently of all other edges. It succeeds if at time $U_e$ both its end-vertices have degrees strictly smaller than their respectively attached constraints. We show that this model undergoes a non-trivial phase transition when $\rho_3$ is sufficiently large. The proof consists of a decoupling inequality, the continuity of the probability for local events, and a coarse-graining argument.


title: Toward Impact-resilient Quadrotor Design, Collision Characterization and Recovery Control to Sustain Flight after Collisions

abstract: Collision detection and recovery for aerial robots remain a challenge because of the limited space for sensors and local stability of the flight controller. We introduce a novel collision-resilient quadrotor that features a compliant arm design to enable free flight while allowing for one passive degree of freedom to absorb shocks. We further propose a novel collision detection and characterization method based on Hall sensors, as well as a new recovery control method to generate and track a smooth trajectory after a collision occurs. Experimental results demonstrate that the robot can detect and recover from high-speed collisions with various obstacles such as walls and poles. Moreover, it can survive collisions that are hard to detect with existing methods based on IMU data and contact models, for example, when colliding with unstructured surfaces, or being hit by a moving obstacle while hovering.


title: NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofing

abstract: Face anti-spoofing (FAS) plays a vital role in securing face recognition systems. Existing methods heavily rely on the expert-designed networks, which may lead to a sub-optimal solution for FAS task. Here we propose the first FAS method based on neural architecture search (NAS), called NAS-FAS, to discover the well-suited task-aware networks. Unlike previous NAS works mainly focus on developing efficient search strategies in generic object classification, we pay more attention to study the search spaces for FAS task. The challenges of utilizing NAS for FAS are in two folds: the networks searched on 1) a specific acquisition condition might perform poorly in unseen conditions, and 2) particular spoofing attacks might generalize badly for unseen attacks. To overcome these two issues, we develop a novel search space consisting of central difference convolution and pooling operators. Moreover, an efficient static-dynamic representation is exploited for fully mining the FAS-aware spatio-temporal discrepancy. Besides, we propose Domain/Type-aware Meta-NAS, which leverages cross-domain/type knowledge for robust searching. Finally, in order to evaluate the NAS transferability for cross datasets and unknown attack types, we release a large-scale 3D mask dataset, namely CASIA-SURF 3DMask, for supporting the new 'cross-dataset cross-type' testing protocol. Experiments demonstrate that the proposed NAS-FAS achieves state-of-the-art performance on nine FAS benchmark datasets with four testing protocols.


title: Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations

abstract: This article presents a discussion on the main linguistic phenomena which cause difficulties in the analysis of user-generated texts found on the web and in social media, and proposes a set of annotation guidelines for their treatment within the Universal Dependencies (UD) framework of syntactic analysis. Given on the one hand the increasing number of treebanks featuring user-generated content, and its somewhat inconsistent treatment in these resources on the other, the aim of this article is twofold: (1) to provide a condensed, though comprehensive, overview of such treebanks -- based on available literature -- along with their main features and a comparative analysis of their annotation criteria, and (2) to propose a set of tentative UD-based annotation guidelines, to promote consistent treatment of the particular phenomena found in these types of texts. The overarching goal of this article is to provide a common framework for researchers interested in developing similar resources in UD, thus promoting cross-linguistic consistency, which is a principle that has always been central to the spirit of UD.


title: Asymptotic distribution of traces of singular moduli

abstract: We determine the asymptotic behavior of twisted traces of singular moduli with a power-saving error term in both the discriminant and the order of the pole at $i\infty$. Using this asymptotic formula, we obtain an exact formula for these traces involving the class number and a finite sum involving the exponential function evaluated at CM points.


title: Applications of Differential Graded Algebra Techniques in Commutative Algebra

abstract: Differential graded (DG) algebras are powerful tools from rational homotopy theory. We survey some recent applications of these in the realm of homological commutative algebra.


title: University of Washington at TREC 2020 Fairness Ranking Track

abstract: InfoSeeking Lab's FATE (Fairness Accountability Transparency Ethics) group at University of Washington participated in 2020 TREC Fairness Ranking Track. This report describes that track, assigned data and tasks, our group definitions, and our results. Our approach to bringing fairness in retrieval and re-ranking tasks with Semantic Scholar data was to extract various dimensions of author identity. These dimensions included gender and location. We developed modules for these extractions in a way that allowed us to plug them in for either of the tasks as needed. After trying different combinations of relative weights assigned to relevance, gender, and location information, we chose five runs for retrieval and five runs for re-ranking tasks. The results showed that our runs performed below par for re-ranking task, but above average for retrieval.


title: Uncertainty Estimation in Medical Image Localization: Towards Robust Anterior Thalamus Targeting for Deep Brain Stimulation

abstract: Atlas-based methods are the standard approaches for automatic targeting of the Anterior Nucleus of the Thalamus (ANT) for Deep Brain Stimulation (DBS), but these are known to lack robustness when anatomic differences between atlases and subjects are large. To improve the localization robustness, we propose a novel two-stage deep learning (DL) framework, where the first stage identifies and crops the thalamus regions from the whole brain MRI and the second stage performs per-voxel regression on the cropped volume to localize the targets at the finest resolution scale. To address the issue of data scarcity, we train the models with the pseudo labels which are created based on the available labeled data using multi-atlas registration. To assess the performance of the proposed framework, we validate two sampling-based uncertainty estimation techniques namely Monte Carlo Dropout (MCDO) and Test-Time Augmentation (TTA) on the second-stage localization network. Moreover, we propose a novel uncertainty estimation metric called maximum activation dispersion (MAD) to estimate the image-wise uncertainty for localization tasks. Our results show that the proposed method achieved more robust localization performance than the traditional multi-atlas method and TTA could further improve the robustness. Moreover, the epistemic and hybrid uncertainty estimated by MAD could be used to detect the unreliable localizations and the magnitude of the uncertainty estimated by MAD could reflect the degree of unreliability for the rejected predictions.


title: Exhaustive Entity Recognition for Coptic: Challenges and Solutions

abstract: Entity recognition provides semantic access to ancient materials in the Digital Humanities: itexposes people and places of interest in texts that cannot be read exhaustively, facilitates linkingresources and can provide a window into text contents, even for texts with no translations. Inthis paper we present entity recognition for Coptic, the language of Hellenistic era Egypt. Weevaluate NLP approaches to the task and lay out difficulties in applying them to a low-resource,morphologically complex language. We present solutions for named and non-named nested en-tity recognition and semi-automatic entity linking to Wikipedia, relying on robust dependencyparsing, feature-based CRF models, and hand-crafted knowledge base resources, enabling highaccuracy NER with orders of magnitude less data than those used for high resource languages.The results suggest avenues for research on other languages in similar settings.


title: SPECULOOS -- Ultracool Dwarf Transit Survey: Target List and Strategy

abstract: One of the most promising avenues for the detailed study of temperate Earth-sized exoplanets is the detection of such planets in transit in front of stars small and nearby enough to make possible their thorough atmospheric characterisation with next generation telescopes like the James Webb Space telescope (JWST) or Extremely Large Telescope (ELT). In this context, the TRAPPIST-1 planets form an unique benchmark system that has gathered the interest of a large scientific community. The SPECULOOS survey is an exoplanet transit survey, that targets a volume-limited (40 pc) sample of ultracool dwarf stars. We define the SPECULOOS target list as the sum of three non-overlapping sub-programs incorporating the latest type objects (T_eff < 3000K): Program1: 365 dwarfs that are small and nearby enough to make possible the detailed atmospheric characterisation of an `Earth-like' planet with the upcoming JWST, Program2: 171 dwarfs of M5-type and later for which a significant detection of a planet similar to TRAPPIST-1b should be within reach of the exoplanet transit survey TESS, and Program3: 1121 dwarfs later than M6-type that aims to perform a statistical census of short-period planets around ultracool dwarf stars. Our compound target list includes 1657 photometrically classified late-type dwarfs. 260 of these targets are classified for the first time as possible nearby ultracool dwarf stars. Our general observational strategy is to monitor each target for 100 to 200hr with our telescope network, by efficiently using the synergy with TESS for our Program2 and a fraction of the targets of Program1. We expect to detect up to a few dozens temperate, rocky planets, a handful of them being amenable for atmospheric characterisation with JWST and other future giant telescopes which will improve drastically our understanding of the planetary population of the latest-type stars.


title: Probing Multilingual BERT for Genetic and Typological Signals

abstract: We probe the layers in multilingual BERT (mBERT) for phylogenetic and geographic language signals across 100 languages and compute language distances based on the mBERT representations. We 1) employ the language distances to infer and evaluate language trees, finding that they are close to the reference family tree in terms of quartet tree distance, 2) perform distance matrix regression analysis, finding that the language distances can be best explained by phylogenetic and worst by structural factors and 3) present a novel measure for measuring diachronic meaning stability (based on cross-lingual representation variability) which correlates significantly with published ranked lists based on linguistic approaches. Our results contribute to the nascent field of typological interpretability of cross-lingual text representations.


title: On the interactions between a propagating shock wave and evaporating water droplets

abstract: One-dimensional numerical simulations based on hybrid Eulerian-Lagrangian approach are performed to investigate the interactions between propagating shock waves and dispersed evaporating water droplets in two-phase gas-droplet flows. Two-way coupling for interphase exchanges of mass, momentum and energy is adopted. Parametric study on shock attenuation, droplet evaporation, motion and heating is conducted, through considering various initial droplet diameters (5-20 {\mu}m), number densities (2.5 x 1011 - 2 x 1012 1/m3) and incident shock Mach numbers (1.17-1.9). It is found that the leading shock may be attenuated to sonic wave and even subsonic wave when droplet volume fraction is large and/or incident shock Mach number is low. Attenuation in both strength and propagation speed of the leading shock is mainly caused by momentum transfer to the droplets that interact at the shock front. Total pressure recovery is observed in the evaporation region, whereas pressure loss results from shock compression, droplet drag and pressure gradient force behind the shock front. Recompression of the region between the leading shock and two-phase contact surface is observed when the following compression wave is supersonic. After a critical point, this region gets stable in width and interphase exchanges in mass, momentum, and energy. However, the recompression phenomenon is sensitive to droplet volume fraction and may vanish with high droplet loading. For an incident shock Mach number of 1.6, recompression only occurs when the initial droplet volume fraction is below 3.28 x 10-5.


title: Model Reduction for Multi-Scale Transport Problems using Model-form Preserving Least-Squares Projections with Variable Transformation

abstract: A projection-based formulation is presented for non-linear model reduction of problems with extreme scale disparity. The approach allows for the selection of an arbitrary, but complete, set of solution variables while preserving the structure of the governing equations. Least-squares-based minimization is leveraged to guarantee symmetrization and discrete consistency with the full-order model (FOM). Two levels of scaling are used to achieve the conditioning required to effectively handle problems with extremely disparate physical phenomena, characterized by extreme stiffness in the system of equations. The formulation -- referred to as model-form preserving least-squares with variable transformation (MP-LSVT) -- provides global stabilization for both implicit and explicit time integration schemes. To achieve computational efficiency, a pivoted QR decomposition is used with oversampling, and adapted to the MP-LSVT method. The framework is demonstrated in representative two- and three-dimensional reacting flow problems, and the MP-LSVT is shown to exhibit improved stability and accuracy over standard projection-based ROM techniques. Physical realizability and local stability are promoted by enforcing limiters in both temperature and species mass fractions. These limiters are demonstrated to be important in eliminating regions of spurious burning, thus enabling the ROMs to provide accurate representations of the heat release rate and flame propagation speed. In the 3D application, it is shown that more than two orders of magnitude acceleration in computational efficiency can be achieved, while also providing reasonable future-state predictions. A key contribution of this work is the development and demonstration of a comprehensive ROM formulation that targets highly challenging multi-scale transport-dominated problems.


title: MBB: Model-Based Baseline for Global Guidance of Model-Free Reinforcement Learning via Lower-Dimensional Solutions

abstract: One spectrum on which robotic control paradigms lie is the degree in which a model of the environment is involved, from methods that are completely model-free such as model-free RL, to methods that require a known model such as optimal control, with other methods such as model-based RL somewhere in the middle. On one end of the spectrum, model-free RL can learn control policies for high-dimensional (hi-dim), complex robotic tasks through trial-and-error without knowledge of a model of the environment, but tends to require a large amount of data. On the other end, "classical methods" such as optimal control generate solutions without collecting data, but assume that an accurate model of the system and environment is known and are mostly limited to problems with low-dimensional (lo-dim) state spaces. In this paper, we bring the two ends of the spectrum together. Although models of hi-dim systems and environments may not exist, lo-dim approximations of these systems and environments are widely available, especially in robotics. Therefore, we propose to solve hi-dim, complex robotic tasks in two stages. First, assuming a coarse model of the hi-dim system, we compute a lo-dim value function for the lo-dim version of the problem using classical methods (eg. value iteration and optimal control). Then, the lo-dim value function is used as a baseline function to warm-start the model-free RL process that learns hi-dim policies. The lo-dim value function provides global guidance for model-free RL, alleviating the data inefficiency of model-free RL. We demonstrate our approach on two robot learning tasks with hi-dim state spaces and observe significant improvement in policy performance and learning efficiency. We also give an empirical analysis of our method with a third task.


title: Positive supersolutions for the Lane-Emden system with inverse-square potentials

abstract: In this paper, we study the nonexistence of positive supersolutions for the following Lane-Emden system with inverse-square potentials \begin{equation}\label{0} \left\{ \begin{array}{lll} -\Delta u+\frac{\mu_1}{|x|^2} u= v^p \quad {\rm in}\ \, \Omega\setminus\{0\},\\[2mm] -\Delta v+\frac{\mu_2}{|x|^2} v= u^q \quad {\rm in}\ \, \Omega\setminus\{0\} \end{array} \right. \end{equation} for suitable $p,q>0$, $\mu_1,\mu_2\geq -(N-2)^2/4$, where $\Omega$ is a smooth bounded domain containing the origin in $\mathbb{R}^N$ with $N\geq 3$. Precisely, we provide sharp supercritical regions of $(p,q)$ for the nonexistence of positive supersolutions to system (\ref{0}) in the cases $-(N-2)^2/4\leq \mu_1,\mu_2<0$ and $-(N-2)^2/4\leq \mu_1<0\leq \mu_2$. Due to the negative coefficients $\mu_1,\mu_2$ of the inverse-square potentials, an initial blowing-up at the origin could be derived and an iteration procedure could be applied in the supercritical case to improve the blowing-up rate until the nonlinearities are not admissible in some weighted $L^1$ spaces. In the subcritical case, we prove the existence of positive supersolutions for system (\ref{s 1.1}) by specific radially symmetric functions.


title: Optimal Mixing of Glauber Dynamics: Entropy Factorization via High-Dimensional Expansion

abstract: We prove an optimal mixing time bound on the single-site update Markov chain known as the Glauber dynamics or Gibbs sampling in a variety of settings. Our work presents an improved version of the spectral independence approach of Anari et al. (2020) and shows $O(n\log{n})$ mixing time on any $n$-vertex graph of bounded degree when the maximum eigenvalue of an associated influence matrix is bounded. As an application of our results, for the hard-core model on independent sets weighted by a fugacity $\lambda$, we establish $O(n\log{n})$ mixing time for the Glauber dynamics on any $n$-vertex graph of constant maximum degree $\Delta$ when $\lambda<\lambda_c(\Delta)$ where $\lambda_c(\Delta)$ is the critical point for the uniqueness/non-uniqueness phase transition on the $\Delta$-regular tree. More generally, for any antiferromagnetic 2-spin system we prove $O(n\log{n})$ mixing time of the Glauber dynamics on any bounded degree graph in the corresponding tree uniqueness region. Our results apply more broadly; for example, we also obtain $O(n\log{n})$ mixing for $q$-colorings of triangle-free graphs of maximum degree $\Delta$ when the number of colors satisfies $q > \alpha \Delta$ where $\alpha \approx 1.763$, and $O(m\log{n})$ mixing for generating random matchings of any graph with bounded degree and $m$ edges.


title: An On-Line POMDP Solver for Continuous Observation Spaces

abstract: Planning under partial obervability is essential for autonomous robots. A principled way to address such planning problems is the Partially Observable Markov Decision Process (POMDP). Although solving POMDPs is computationally intractable, substantial advancements have been achieved in developing approximate POMDP solvers in the past two decades. However, computing robust solutions for problems with continuous observation spaces remains challenging. Most on-line solvers rely on discretising the observation space or artificially limiting the number of observations that are considered during planning to compute tractable policies. In this paper we propose a new on-line POMDP solver, called Lazy Belief Extraction for Continuous POMDPs (LABECOP), that combines methods from Monte-Carlo-Tree-Search and particle filtering to construct a policy reprentation which doesn't require discretised observation spaces and avoids limiting the number of observations considered during planning. Experiments on three different problems involving continuous observation spaces indicate that LABECOP performs similar or better than state-of-the-art POMDP solvers.


title: Learning from Forecast Errors: A New Approach to Forecast Combinations

abstract: Forecasters often use common information and hence make common mistakes. We propose a new approach, Factor Graphical Model (FGM), to forecast combinations that separates idiosyncratic forecast errors from the common errors. FGM exploits the factor structure of forecast errors and the sparsity of the precision matrix of the idiosyncratic errors. We prove the consistency of forecast combination weights and mean squared forecast error estimated using FGM, supporting the results with extensive simulations. Empirical applications to forecasting macroeconomic series shows that forecast combination using FGM outperforms combined forecasts using equal weights and graphical models without incorporating factor structure of forecast errors.


title: Multi-frequency Point Supported LLRF Front-end for CiADS Wide-bandwidth Application

abstract: The China initiative Accelerator Driven System, CiADS, physics design adopts $162.5 \,\mathrm{MHz}$, $325 \,\mathrm{MHz}$, and $650 \,\mathrm{MHz}$ cavities, which are driven by the corresponding radio frequency (RF) power system, requiring frequency translation front-end for the RF station. For that application, a general-purpose design front-end prototype has been developed to evaluate the multi-frequency point supported design feasibility. The difficult parts to achieve the requirements of the general-purpose design are reasonable device selection and balanced design. With a carefully selected low-noise wide-band RF mixer and amplifier to balance the performance of multi-frequency supported down-conversion, specially designed local oscillator (LO) distribution net to increase isolation between adjacent channels, and external band-pass filter to realize expected up-conversion frequencies, high maintenance and modular front-end general-purpose design has been implemented. Results of standard parameters show an $R^2$ value of at least $99.991\%$ in the range of $-60 \sim 10\,\mathrm{dBm}$ for linearity, up to $18\,\mathrm{dBm}$ for P1dB, and up to $89\,\mathrm{dBc}$ for crosstalk between adjacent channels. The phase noise spectrum is lower than $80\,\mathrm{dBc}$ in the range of $0 \sim 1\,\mathrm{MHz}$, and cumulative phase noise is $0.006^\circ$; amplitude and phase stability are $0.022\%$ and $0.034^\circ$, respectively.


title: On the Moral Justification of Statistical Parity

abstract: A crucial but often neglected aspect of algorithmic fairness is the question of how we justify enforcing a certain fairness metric from a moral perspective. When fairness metrics are proposed, they are typically argued for by highlighting their mathematical properties. Rarely are the moral assumptions beneath the metric explained. Our aim in this paper is to consider the moral aspects associated with the statistical fairness criterion of independence (statistical parity). To this end, we consider previous work, which discusses the two worldviews "What You See Is What You Get" (WYSIWYG) and "We're All Equal" (WAE) and by doing so provides some guidance for clarifying the possible assumptions in the design of algorithms. We present an extension of this work, which centers on morality. The most natural moral extension is that independence needs to be fulfilled if and only if differences in predictive features (e.g. high school grades and standardized test scores are predictive of performance at university) between socio-demographic groups are caused by unjust social disparities or measurement errors. Through two counterexamples, we demonstrate that this extension is not universally true. This means that the question of whether independence should be used or not cannot be satisfactorily answered by only considering the justness of differences in the predictive features.


title: Improved Bohr's inequality for mappings defined on simply connected domains

abstract: In this paper, we study the Bohr phenomenon for functions that are defined on a general simply connected domain of the complex plane. We improve known results of R. Fournier and St. Ruscheweyh for a class of analytic functions. Furthermore, we examine the case where a harmonic mapping is defined in a disk containing $\mathbb{D}$ and obtain a Bohr type inequality.


title: A deep learning classifier for local ancestry inference

abstract: Local ancestry inference (LAI) identifies the ancestry of each segment of an individual's genome and is an important step in medical and population genetic studies of diverse cohorts. Several techniques have been used for LAI, including Hidden Markov Models and Random Forests. Here, we formulate the LAI task as an image segmentation problem and develop a new LAI tool using a deep convolutional neural network with an encoder-decoder architecture. We train our model using complete genome sequences from 982 unadmixed individuals from each of five continental ancestry groups, and we evaluate it using simulated admixed data derived from an additional 279 individuals selected from the same populations. We show that our model is able to learn admixture as a zero-shot task, yielding ancestry assignments that are nearly as accurate as those from the existing gold standard tool, RFMix.


title: DeepReach: A Deep Learning Approach to High-Dimensional Reachability

abstract: Hamilton-Jacobi (HJ) reachability analysis is an important formal verification method for guaranteeing performance and safety properties of dynamical control systems. Its advantages include compatibility with general nonlinear system dynamics, formal treatment of bounded disturbances, and the ability to deal with state and input constraints. However, it involves solving a PDE, whose computational and memory complexity scales exponentially with respect to the number of state variables, limiting its direct use to small-scale systems. We propose DeepReach, a method that leverages new developments in sinusoidal networks to develop a neural PDE solver for high-dimensional reachability problems. The computational requirements of DeepReach do not scale directly with the state dimension, but rather with the complexity of the underlying reachable tube. DeepReach achieves comparable results to the state-of-the-art reachability methods, does not require any explicit supervision for the PDE solution, can easily handle external disturbances, adversarial inputs, and system constraints, and also provides a safety controller for the system. We demonstrate DeepReach on a 9D multi-vehicle collision problem, and a 10D narrow passage problem, motivated by autonomous driving applications.


title: Direction of Arrival Estimation for Non-Coherent Sub-Arrays via Joint Sparse and Low-Rank Signal Recovery

abstract: Estimating the directions of arrival (DOAs) of multiple sources from a single snapshot obtained by a coherent antenna array is a well-known problem, which can be addressed by sparse signal reconstruction methods, where the DOAs are estimated from the peaks of the recovered high-dimensional signal. In this paper, we consider a more challenging DOA estimation task where the array is composed of non-coherent sub-arrays (i.e., sub-arrays that observe different unknown phase shifts due to using low-cost unsynchronized local oscillators). We formulate this problem as the reconstruction of a joint sparse and low-rank matrix and solve its convex relaxation. While the DOAs can be estimated from the solution of the convex problem, we further show how an improvement is obtained if instead one estimates from this solution the phase shifts, creates "phase-corrected" observations and applies another final (plain, coherent) sparsity-based DOA estimation. Numerical experiments show that the proposed approach outperforms strategies that are based on non-coherent processing of the sub-arrays as well as other sparsity-based methods.


title: Understanding Capacity-Driven Scale-Out Neural Recommendation Inference

abstract: Deep learning recommendation models have grown to the terabyte scale. Traditional serving schemes--that load entire models to a single server--are unable to support this scale. One approach to support this scale is with distributed serving, or distributed inference, which divides the memory requirements of a single large model across multiple servers. This work is a first-step for the systems research community to develop novel model-serving solutions, given the huge system design space. Large-scale deep recommender systems are a novel workload and vital to study, as they consume up to 79% of all inference cycles in the data center. To that end, this work describes and characterizes scale-out deep learning recommendation inference using data-center serving infrastructure. This work specifically explores latency-bounded inference systems, compared to the throughput-oriented training systems of other recent works. We find that the latency and compute overheads of distributed inference are largely a result of a model's static embedding table distribution and sparsity of input inference requests. We further evaluate three embedding table mapping strategies of three DLRM-like models and specify challenging design trade-offs in terms of end-to-end latency, compute overhead, and resource efficiency. Overall, we observe only a marginal latency overhead when the data-center scale recommendation models are served with the distributed inference manner--P99 latency is increased by only 1% in the best case configuration. The latency overheads are largely a result of the commodity infrastructure used and the sparsity of embedding tables. Even more encouragingly, we also show how distributed inference can account for efficiency improvements in data-center scale recommendation serving.


title: $\tau$-tilting finite triangular matrix algebras

abstract: First, we give a new example of silting-discrete algebras. Second, one explores when the algebra of triangular matrices over a finite dimensional algebra is $\tau$-tilting finite. In particular, we classify algebras over which triangular matrix algebras are $\tau$-tilting finite. Finally, we investigate when a triangular matrix algebra is silting-discrete.


title: Residual Likelihood Forests

abstract: This paper presents a novel ensemble learning approach called Residual Likelihood Forests (RLF). Our weak learners produce conditional likelihoods that are sequentially optimized using global loss in the context of previous learners within a boosting-like framework (rather than probability distributions that are measured from observed data) and are combined multiplicatively (rather than additively). This increases the efficiency of our strong classifier, allowing for the design of classifiers which are more compact in terms of model capacity. We apply our method to several machine learning classification tasks, showing significant improvements in performance. When compared against several ensemble approaches including Random Forests and Gradient Boosted Trees, RLFs offer a significant improvement in performance whilst concurrently reducing the required model size.


title: Gravitational memory effects in Brans-Dicke theory

abstract: There exist gravitational memory effects in Brans-Dicke theory. They are closely related to the Bondi-Metzner-Sachs symmetries living on the null infinity in an isolated system. By studying the asymptotically flat spacetime in Brans-Dicke theory and the asymptotic symmetries, one discovers that the displacement memory effect in the tensor sector is due to the vacuum transition caused by the null energy fluxes panetrating the null infinity, while in the scalar sector, the vacuum transition is due to the angular momentum fluxes. Together with the spin and the center-of-mass memory effects, the displacement memories are constrained by various flux-balance laws.


title: The trigger slow control system of the Belle II experiment

abstract: The Belle II experiment at the SuperKEKB $e^{+}e^{-}$ collider in KEK, Japan, started physics data-taking with a complete detector from early 2019 with the primary physics goal of probing new physics in heavy quark and lepton decays. An online trigger system is indispensable for the Belle II experiment to reduce the beam background events associated with high electron and positron beam currents without sacrificing the target physics-oriented events. During the Belle II operation upon beam collision, the trigger system must be consistently controlled and its status must be carefully monitored in the process of data acquisition against unexpected situations. For this purpose, we have developed a slow control system for the Belle II trigger system. Around seventy thousand configuration parameters are saved in the Belle II central database server for every run when a run starts and stops. These parameters play an essential role in offline validation of the quality of runs. Around three thousand real-time variables are stored in the Belle II main archiving server, and the trend of some of these variables are regularly used for online and offline monitoring purposes. Various operator interface tools have been prepared and used. When the configuration parameters are not correctly applied, or some of the processes are unexpectedly terminated, the slow control system detects it, stops the data-taking process, and generates an alarm. In this article, we report how we constructed the Belle II trigger slow control system, and how we successfully managed to operate during its initial stage.


title: Extended Missing Data Imputation via GANs for Ranking Applications

abstract: We propose Conditional Imputation GAN, an extended missing data imputation method based on Generative Adversarial Networks (GANs). The motivating use case is learning-to-rank, the cornerstone of modern search, recommendation system, and information retrieval applications. Empirical ranking datasets do not always follow standard Gaussian distributions or Missing Completely At Random (MCAR) mechanism, which are standard assumptions of classic missing data imputation methods. Our methodology provides a simple solution that offers compatible imputation guarantees while relaxing assumptions for missing mechanisms and sidesteps approximating intractable distributions to improve imputation quality. We prove that the optimal GAN imputation is achieved for Extended Missing At Random (EMAR) and Extended Always Missing At Random (EAMAR) mechanisms, beyond the naive MCAR. Our method demonstrates the highest imputation quality on the open-source Microsoft Research Ranking (MSR) Dataset and a synthetic ranking dataset compared to state-of-the-art benchmarks and across various feature distributions. Using a proprietary Amazon Search ranking dataset, we also demonstrate comparable ranking quality metrics for ranking models trained on GAN-imputed data compared to ground-truth data.


title: Frustratingly Easy Noise-aware Training of Acoustic Models

abstract: Environmental noises and reverberation have a detrimental effect on the performance of automatic speech recognition (ASR) systems. Multi-condition training of neural network-based acoustic models is used to deal with this problem, but it requires many-folds data augmentation, resulting in increased training time. In this paper, we propose utterance-level noise vectors for noise-aware training of acoustic models in hybrid ASR. Our noise vectors are obtained by combining the means of speech frames and silence frames in the utterance, where the speech/silence labels may be obtained from a GMM-HMM model trained for ASR alignments, such that no extra computation is required beyond averaging of feature vectors. We show through experiments on AMI and Aurora-4 that this simple adaptation technique can result in 6-7% relative WER improvement. We implement several embedding-based adaptation baselines proposed in literature, and show that our method outperforms them on both the datasets. Finally, we extend our method to the online ASR setting by using frame-level maximum likelihood for the mean estimation.


title: dMVX: Secure and Efficient Multi-Variant Execution in a Distributed Setting

abstract: Multi-variant execution (MVX) systems amplify the effectiveness of software diversity techniques. The key idea is to run multiple diversified program variants in lockstep while providing them with the same input and monitoring their run-time behavior for divergences. Thus, adversaries have to compromise all program variants simultaneously to mount an attack successfully. Recent work proposed distributed, heterogeneous MVX systems that leverage different ABIs and ISAs to increase the diversity between program variants further. However, existing distributed MVX system designs suffer from high performance overhead due to time-consuming network transactions for the MVX system's operations. This paper presents dMVX, a novel hybrid distributed MVX design, which incorporates new techniques that significantly reduce the overhead of MVX systems in a distributed setting. Our key insight is that we can intelligently reduce the MVX operations that use expensive network transfers. First, we can limit the monitoring of system calls that are not security-critical. Second, we observe that, in many circumstances, we can also safely cache or avoid replication operations needed for I/O related system calls. Our evaluation shows that dMVX reduces the performance degradation from over 50% to 3.1% for realistic server benchmarks.


title: Soft Robot Optimal Control Via Reduced Order Finite Element Models

abstract: Finite element methods have been successfully used to develop physics-based models of soft robots that capture the nonlinear dynamic behavior induced by continuous deformation. These high-fidelity models are therefore ideal for designing controllers for complex dynamic tasks such as trajectory optimization and trajectory tracking. However, finite element models are also typically very high-dimensional, which makes real-time control challenging. In this work we propose an approach for finite element model-based control of soft robots that leverages model order reduction techniques to significantly increase computational efficiency. In particular, a constrained optimal control problem is formulated based on a nonlinear reduced order finite element model and is solved via sequential convex programming. This approach is demonstrated through simulation of a cable-driven soft robot for a constrained trajectory tracking task, where a 9768-dimensional finite element model is used for controller design.


title: Chinese Grammatical Correction Using BERT-based Pre-trained Model

abstract: In recent years, pre-trained models have been extensively studied, and several downstream tasks have benefited from their utilization. In this study, we verify the effectiveness of two methods that incorporate a BERT-based pre-trained model developed by Cui et al. (2020) into an encoder-decoder model on Chinese grammatical error correction tasks. We also analyze the error type and conclude that sentence-level errors are yet to be addressed.


title: A Survey on Contact Tracing: the Latest Advancements and Challenges

abstract: Infectious diseases are caused by pathogenic microorganisms, such as bacteria, viruses, parasites or fungi, which can be spread, directly or indirectly, from one person to another. Infectious diseases pose a serious threat to human health, especially COVID-19 that has became a serious worldwide health concern since the end of 2019. Contact tracing is the process of identifying, assessing, and managing people who have been exposed to a disease to prevent its onward transmission. Contact tracing can help us better understand the transmission link of the virus, whereby better interrupting its transmission. Given the worldwide pandemic of COVID-19, contact tracing has become one of the most critical measures to effectively curb the spread of the virus. This paper presents a comprehensive survey on contact tracing, with a detailed coverage of the recent advancements the models, digital technologies, protocols and issues involved in contact tracing. The current challenges as well as future directions of contact tracing technologies are also presented.


title: Lagrangian study of dispersion and transport by submesoscale currents at an upper-ocean front

abstract: The three-dimensional transport pathways, the time scales of vertical transport, and the dispersion characteristics of submesoscale currents at an upper-ocean front are investigated using material points (tracer particles) that advect with the local fluid velocity. Coherent submesoscale vortex filaments and eddies which dominate submesoscale (0.1 - 10 km) dynamics are found to play a crucial role which is quantified here. These coherent structures are generated and sustained through nonlinear evolution of baroclinic instability. The collective motion of particles helps identify common features of transport at the front. It is found that the particles in the central region organize into inclined lobes, each associated with an eddy, and the filaments associated with the heavy- and light-edges of the front transfer edge particles to the lobes. This flux of new particles into the lobe causes local particles to adjust, which leads to slumping of the front. The particle motion in the vertical shows multiple time scales -- a fast time scale with O(10) m vertical displacement within an hour and a slower near-inertial time scale, comparable to the intrinsic time scale of the growing instability. The fast time scale motions typically occur in the vortex filaments. The overall slumping process is slower than what one might anticipate from the large magnitude of vertical velocity in the filaments and requires a sustained correlation over time between the lateral and the vertical motion. By tracking clouds of particles, we show that their centers of mass downwell/upwell over 1-2 inertial time periods, after which an adjustment follows with a sub-inertial time scale. The dispersion characteristics of the submesoscale turbulent currents using single- and pair-particle statistics have been investigated. The shape change in clusters of four particles reveals deformation into thin, needle-like structures.


title: Non contrast Doppler Microvessel Image Reconstruction by a semi Nonrigid Motion Compensation and Localized Clutter Filtering; a Qualitative and Quantitative Evaluation

abstract: Vascular networks can provide invaluable information about tumor angiogenesis. Ultrafast Doppler imaging enables ultrasound to image micro-vessels by applying tissue clutter filtering methods on the Spatio-temporal data obtained from plane-wave imaging. However, motion is an intrinsic part of microvasculature imaging due to various reasons e.g breathing and vessel pulsation. Part of such a motion is taken care of by using Spatio-temporal cluttering filtering. Nonetheless, the remaining part of the motion who manifests itself as blurring or generating ghost vessels should be corrected using another level of motion compensation. We proposed a robust and computationally efficient motion compensation algorithm for Ultrasound micro-vessel imaging. We successfully evaluated the performance of the algorithm by a simulation study. Finally, we tested the proposed motion compensation method on the in vivo data of microvasculature in different organs including breast and thyroid. Results show blurring and ghost vessel problems are significantly reduced using the proposed algorithm. Moreover, our quantitative assessment demonstrated that image correlation among different frames in Ultrafast Doppler imaging is significantly improved utilizing the proposed motion correction method.


title: Non-Hermitian Fabry-Perot Resonances in a PT-symmetric system

abstract: In non-Hermitian scattering problems the behavior of the transmission probability is very different from its Hermitian counterpart; it can exceed unity or even be divergent, since the non-Hermiticity can add or remove the probability to and from the scattering system. In the present paper, we consider the scattering problem of a PT-symmetric potential and find a counter-intuitive behavior. In the usual PT-symmetric non-Hermitian system, we would typically find stationary semi-Hermitian dynamics in a regime of weak non-Hermiticity but observe instability once the non-Hermiticity goes beyond an exceptional point. Here, in contrast, the behavior of the transmission probability is strongly non-Hermitian in the regime of weak non-Hermiticity with divergent peaks, while it is superficially Hermitian in the regime of strong non-Hermiticity, recovering the conventional Fabry-Perot-type peak structure. We show that the unitarity of the S-matrix is generally broken in both of the regimes, but is recovered in the limit of infinitely strong non-Hermiticity.


title: Microelectromechanical deformable mirror development for high-contrast imaging, part 1: miniaturized, flight-capable control electronics

abstract: Deformable mirrors (DMs) are a critical technology to enable coronagraphic direct imaging of exoplanets with current and planned ground - and space-based telescopes as well as future mission concepts that aim to image exoplanet types ranging from gas giants to Earth analogs. This places several requirements on the DMs such as requires a large actuator count (>3000), fine surface height resolution (<10 pm), and radiation hardened driving electronics with low mass and volume. We present the design and testing of a flight-capable, miniaturized DM controller. Having achieved contrasts on the order of 5x10-9 on a coronagraph testbed in vacuum in the high contrast imaging testbed facility at NASA's Jet Propulsion Laboratory (JPL), we demonstrate that the electronics are capable of meeting the requirements of future coronagraph-equipped space telescopes. We also report on functionality testing onboard the high-altitude balloon experiment "Planetary Imaging Concept Testbed Using a Recoverable Experiment Coronagraph," which aims to directly image debris disks and exozodiacal dust around nearby stars. The controller is designed for the Boston Micromachines Corporation Kilo-DM and is readily scalable to larger DM formats. The three main components of the system (the DM, driving electronics, and mechanical and heat management) are designed to be compact and have low-power consumption to enable its use not only on exoplanet missions, but also in a wide-range of applications that require precision optical systems, such as direct line-of-sight laser communications. The controller is capable of handling 1024 actuators with 220 V maximum dynamic range, 16-bit resolution, 14-bit accuracy, and 1 kHz operating frequency. The system fits in a 10 x 10 x 5 cm3 volume, weighs <0.5 kg, and consumes <8 W. We have developed a turnkey solution reducing the risk for future missions.


title: Augmenting Images for ASR and TTS through Single-loop and Dual-loop Multimodal Chain Framework

abstract: Previous research has proposed a machine speech chain to enable automatic speech recognition (ASR) and text-to-speech synthesis (TTS) to assist each other in semi-supervised learning and to avoid the need for a large amount of paired speech and text data. However, that framework still requires a large amount of unpaired (speech or text) data. A prototype multimodal machine chain was then explored to further reduce the need for a large amount of unpaired data, which could improve ASR or TTS even when no more speech or text data were available. Unfortunately, this framework relied on the image retrieval (IR) model, and thus it was limited to handling only those images that were already known during training. Furthermore, the performance of this framework was only investigated with single-speaker artificial speech data. In this study, we revamp the multimodal machine chain framework with image generation (IG) and investigate the possibility of augmenting image data for ASR and TTS using single-loop and dual-loop architectures on multispeaker natural speech data. Experimental results revealed that both single-loop and dual-loop multimodal chain frameworks enabled ASR and TTS to improve their performance using an image-only dataset.


title: Deoscillated Graph Collaborative Filtering

abstract: Collaborative Filtering (CF) signals are crucial for a Recommender System~(RS) model to learn user and item embeddings. High-order information can alleviate the cold-start issue of CF-based methods, which is modelled through propagating the information over the user-item bipartite graph. Recent Graph Neural Networks~(GNNs) propose to stack multiple aggregation layers to propagate high-order signals. However, the oscillation problem, varying locality of bipartite graph, and the fix propagation pattern spoil the ability of multi-layer structure to propagate information. The oscillation problem results from the bipartite structure, as the information from users only propagates to items. Besides oscillation problem, varying locality suggests the density of nodes should be considered in the propagation process. Moreover, the layer-fixed propagation pattern introduces redundant information between layers. In order to tackle these problems, we propose a new RS model, named as \textbf{D}eoscillated \textbf{G}raph \textbf{C}ollaborative \textbf{F}iltering~(DGCF). We introduce cross-hop propagation layers in it to break the bipartite propagating structure, thus resolving the oscillation problem. Additionally, we design innovative locality-adaptive layers which adaptively propagate information. Stacking multiple cross-hop propagation layers and locality layers constitutes the DGCF model, which models high-order CF signals adaptively to the locality of nodes and layers. Extensive experiments on real-world datasets show the effectiveness of DGCF. Detailed analyses indicate that DGCF solves oscillation problem, adaptively learns local factor, and has layer-wise propagation pattern. Our code is available online at https://github.com/JimLiu96/DeosciRec.


title: Bed form-induced hyporheic exchange and geochemical hotspots

abstract: Small-scale bed form topographies control hyporheic exchange and biogeochemical processes within aquatic sediments, which ultimately affect water quality and nutrient cycling at the watershed scale. The impact of three-dimensional (3D) and small-scale bed form topographies on hyporheic exchange and solute mixing is investigated in the present work. The effect of bed form morphologies on the development of zones of enhanced reaction rates (i.e., hot spots) is also studied. A computational fluid dynamics model to simulate river flow over bed forms is combined with a subsurface flow and multicomponent reactive solute transport model. A wide variety of bed form topographies are generated using geometric models by varying parameters controlling curvature as well as bed form wavelength and amplitude. Our results show that the pressure distribution at the sediment-water interface is strongly affected by the bed form geometry. Higher phase shifts in bed form shapes result in overall higher average velocity, larger zones of enhanced pressure and reaction rates, and higher amounts of solute exchange. Moreover, the bed form shapes control the reaction process for a wide range of sediment conductivities. This study advances the understanding of the effects of complex and small scale morphological features on hyporheic exchange processes.


title: Robust Speaker Extraction Network Based on Iterative Refined Adaptation

abstract: Speaker extraction aims to extract target speech signal from a multi-talker environment with interference speakers and surrounding noise, given the target speaker's reference information. Most speaker extraction systems achieve satisfactory performance on the premise that the test speakers have been encountered during training time. Such systems suffer from performance degradation given unseen target speakers and/or mismatched reference voiceprint information. In this paper we propose a novel strategy named Iterative Refined Adaptation (IRA) to improve the robustness and generalization capability of speaker extraction systems in the aforementioned scenarios. Given an initial speaker embedding encoded by an auxiliary network, the extraction network can obtain a latent representation of the target speaker, which is fed back to the auxiliary network to get a refined embedding to provide more accurate guidance for the extraction network. Experiments on WSJ0-2mix-extr and WHAM! dataset confirm the superior performance of the proposed method over the network without IRA in terms of SI-SDR and PESQ improvement.


title: COMO: A Pipeline for Multi-Omics Data Integration in Metabolic Modeling and Drug Discovery

abstract: Identifying potential drug targets using metabolic modeling requires integrating multiple modeling methods and heterogenous biological datasets, which can be challenging without sophisticated tools. We developed COMO, a user-friendly pipeline that integrates multi-omics data processing, context-specific metabolic model development, simulations, drug databases, and disease data to aid drug discovery. COMO can be installed as a Docker image and includes intuitive instructions within a Jupyter Lab environment. It provides a comprehensive solution for multi-omics integration of bulk and single-cell RNA-seq, microarrays, and proteomics to develop context-specific metabolic models. Using public databases, open-source solutions for model construction, and a streamlined approach for predicting repurposable drugs, COMO empowers researchers to investigate low-cost alternatives and novel disease treatments. As a case study, we used the pipeline to construct metabolic models of B cells, which simulate and analyze them to predict 25 and 23 metabolic drug targets for rheumatoid arthritis and systemic lupus erythematosus, respectively. COMO can be used to construct models for any cell or tissue type and identify drugs for any human disease. The pipeline has the potential to improve the health of the global community cost-effectively by providing high-confidence targets to pursue in preclinical and clinical studies.


title: Large angle precession of magnetization maintained by a microwave voltage

abstract: Effects of a microwave voltage on magnetization precession are analyzed based on a macrospin model. The microwave voltage induces the oscillating anisotropy field through the voltage controlled magnetic anisotropy (VCMA) effect, and then stimulates the magnetization. The large angle precession is maintained if the magnetization synchronizes with the microwave voltage. The effective equations of motion of the magnetization with an oscillating anisotropy field are derived, and the mechanism of the synchronization is clarified by analyzing the derived equations of motion. The conditions of the angular frequency detuning and the amplitude of the oscillating anisotropy field for synchronization are obtained. The results are useful for development of the VCMA-based energy-efficient spintronics devices using magnetization precession such as a VCMA-based magnetoresistive random access memory and a nano-scale microwave magnetic field generator.


title: Constrained extrapolation problem and order-dependent mappings

abstract: We consider the problem of extrapolating the perturbation series for the dilute Fermi gas in three dimensions to the unitary limit of infinite scattering length and into the BEC region, using the available strong-coupling information to constrain the extrapolation problem. In this constrained extrapolation problem (CEP) the goal is to find classes of approximants that give well converged results already for low perturbative truncation orders. First, we show that standard Pad\'{e} and Borel methods are too restrictive to give satisfactory results for this CEP. A generalization of Borel extrapolation is given by the so-called Maximum Entropy extrapolation method (MaxEnt). However, we show that MaxEnt requires extensive elaborations to be applicable to the dilute Fermi gas and is thus not practical for the CEP in this case. Instead, we propose order-dependent-mapping extrapolation (ODME) as a simple, practical, and general method for the CEP. We find that the ODME approximants for the ground-state energy of the dilute Fermi gas are robust with respect to changes of the mapping choice and agree with results from quantum Monte Carlo simulations within uncertainties.


title: An efficient second-order energy stable BDF scheme for the space fractional Cahn-Hilliard equation

abstract: The space fractional Cahn-Hilliard phase-field model is more adequate and accurate in the description of the formation and phase change mechanism than the classical Cahn-Hilliard model. In this article, we propose a temporal second-order energy stable scheme for the space fractional Cahn-Hilliard model. The scheme is based on the second-order backward differentiation formula in time and a finite difference method in space. Energy stability and convergence of the scheme are analyzed, and the optimal convergence orders in time and space are illustrated numerically. Note that the coefficient matrix of the scheme is a $2 \times 2$ block matrix with a Toeplitz-like structure in each block. Combining the advantages of this special structure with a Krylov subspace method, a preconditioning technique is designed to solve the system efficiently. Numerical examples are reported to illustrate the performance of the preconditioned iteration.


title: Dual application of Chebyshev polynomial for efficiently computing thousands of central eigenvalues in many-spin systems

abstract: It is known that the statistical properties of the spectrum provide an essential characterization of quantum chaos. The computation of a large group of interior eigenvalues at the middle spectrum is thus an important problem for quantum many-body systems. We propose a dual application of Chebyshev polynomial (DACP) method to effciently find thousands of central eigenvalues, which are exponentially close to each other in terms of the system size. To cope with the near-degenerate problem, we use the Chebyshev polynomial to both construct an exponential of semicircle filter as the preconditioning step and generate a large set of proper states as the basis of the desired subspace. Besides, DACP owes an excellent property that its computation time is not influenced by the required number of eigenvalues. Numerical experiments on Ising spin chain and spin glass shards show the correctness and effciency of the proposed method. As our results demonstrate, DACP is a factor of 30 faster than the state-of-the-art shift-invert method for the Ising spin chain while 8 times faster for the spin glass shards. The memory requirements scale better with system size and could be a factor of 100 less than in the shift-invert approach.


title: Gauge Theory Formulation of Hyperbolic Gravity

abstract: We formulate the most general gravitational models with constant negative curvature ("hyperbolic gravity") on an arbitrary orientable two-dimensional surface of genus $g$ with $b$ circle boundaries in terms of a $\text{PSL}(2,\mathbb R)_\partial$ gauge theory of flat connections. This includes the usual JT gravity with Dirichlet boundary conditions for the dilaton field as a special case. A key ingredient is to realize that the correct gauge group is not the full $\text{PSL}(2,\mathbb R)$, but a subgroup $\text{PSL}(2,\mathbb R)_{\partial}$ of gauge transformations that go to $\text{U}(1)$ local rotations on the boundary. We find four possible classes of boundary conditions, with associated boundary terms, that can be applied to each boundary component independently. Class I has five inequivalent variants, corresponding to geodesic boundaries of fixed length, cusps, conical defects of fixed angle or large cylinder-shaped asymptotic regions with boundaries of fixed lengths and extrinsic curvatures one or greater than one. Class II precisely reproduces the usual JT gravity. In particular, the crucial extrinsic curvature boundary term of the usual second order formulation is automatically generated by the gauge theory boundary term. Class III is a more exotic possibility for which the integrated extrinsic curvature is fixed on the boundary. Class IV is the Legendre transform of class II; the constraint of fixed length is replaced by a boundary cosmological constant term.


title: Deep Multi-task Network for Delay Estimation and Echo Cancellation

abstract: Echo path delay (or ref-delay) estimation is a big challenge in acoustic echo cancellation. Different devices may introduce various ref-delay in practice. Ref-delay inconsistency slows down the convergence of adaptive filters, and also degrades the performance of deep learning models due to 'unseen' ref-delays in the training set. In this paper, a multi-task network is proposed to address both ref-delay estimation and echo cancellation tasks. The proposed architecture consists of two convolutional recurrent networks (CRNNs) to estimate the echo and enhanced signals separately, as well as a fully-connected (FC) network to estimate the echo path delay. Echo signal is first predicted, and then is combined with reference signal together for delay estimation. At the end, delay compensated reference and microphone signals are used to predict the enhanced target signal. Experimental results suggest that the proposed method makes reliable delay estimation and outperforms the existing state-of-the-art solutions in inconsistent echo path delay scenarios, in terms of echo return loss enhancement (ERLE) and perceptual evaluation of speech quality (PESQ). Furthermore, a data augmentation method is studied to evaluate the model performance on different portion of synthetical data with artificially introduced ref-delay.


title: Can We Trust Deep Speech Prior?

abstract: Recently, speech enhancement (SE) based on deep speech prior has attracted much attention, such as the variational auto-encoder with non-negative matrix factorization (VAE-NMF) architecture. Compared to conventional approaches that represent clean speech by shallow models such as Gaussians with a low-rank covariance, the new approach employs deep generative models to represent the clean speech, which often provides a better prior. Despite the clear advantage in theory, we argue that deep priors must be used with much caution, since the likelihood produced by a deep generative model does not always coincide with the speech quality. We designed a comprehensive study on this issue and demonstrated that based on deep speech priors, a reasonable SE performance can be achieved, but the results might be suboptimal. A careful analysis showed that this problem is deeply rooted in the disharmony between the flexibility of deep generative models and the nature of the maximum-likelihood (ML) training.


title: A half-space problem on the full Euler-Poisson system

abstract: This paper is concerned with the initial-boundary value problem on the full Euler-Poisson system for ions over a half line. We establish the existence of stationary solutions under the Bohm criterion similar to the isentropic case and further obtain the large time asymptotic stability of small-amplitude stationary solutions provided that the initial perturbation is sufficiently small in some weighted Sobolev spaces. Moreover, the convergence rate of the solution toward the stationary solution is obtained. The proof is based on the energy method. A key point is to capture the positivity of the temporal energy dissipation functional and boundary terms with suitable space weight functions either algebraic or exponential depending on whether or not the incoming far-field velocity is critical.


title: Toward Force Estimation in Robot-Assisted Surgery using Deep Learning with Vision and Robot State

abstract: Knowledge of interaction forces during teleoperated robot-assisted surgery could be used to enable force feedback to human operators and evaluate tissue handling skill. However, direct force sensing at the end-effector is challenging because it requires biocompatible, sterilizable, and cost-effective sensors. Vision-based deep learning using convolutional neural networks is a promising approach for providing useful force estimates, though questions remain about generalization to new scenarios and real-time inference. We present a force estimation neural network that uses RGB images and robot state as inputs. Using a self-collected dataset, we compared the network to variants that included only a single input type, and evaluated how they generalized to new viewpoints, workspace positions, materials, and tools. We found that vision-based networks were sensitive to shifts in viewpoints, while state-only networks were robust to changes in workspace. The network with both state and vision inputs had the highest accuracy for an unseen tool, and was moderately robust to changes in viewpoints. Through feature removal studies, we found that using only position features produced better accuracy than using only force features as input. The network with both state and vision inputs outperformed a physics-based baseline model in accuracy. It showed comparable accuracy but faster computation times than a baseline recurrent neural network, making it better suited for real-time applications.


title: Quantum metamorphism

abstract: Crystals form regular and robust structures that under extreme conditions can melt and recrystallize into different arrangements in a process that is called crystal metamorphism. While crystals exist due to the breaking of a continuous translation symmetry in space, it has recently been proposed that discrete crystalline order can also emerge in time and give raise to a novel phase of matter named discrete time crystal (DTC). In this paper, we join these two ideas and propose a model for quantum metamorphism between two DTCs of different periodicity, a 2T and 4T-DTC. In our model the conditions for metamorphism come from the modulation of perturbative terms in the 4T-DTC Hamiltonian that gradually melt its structure and transform it into a 2T-DTC. This process is studied in detail from the viewpoint of manybody physics of periodically driven systems. We also propose a protocol to experimentally observe quantum metamorphism using current quantum technology.


title: Unidirectional weak visibility in band gap and singular scattering in conduction band of one-dimensional parity-time symmetric photonic crystal

abstract: We explore the absorption and scattering properties of one dimensional parity-time ($\mathcal{PT}$)-symmetric photonic crystal. In addition to the familiar transmittance and reflectance, we give the definition of the generalized absorptance to include the amplifying effect of the dielectric with negative imaginary part of the permittivity, moreover, we present the mathematical expressions of the transmittance, reflectances and absorptances from both sides of this photonic crystal with N periods in terms of the elements of the transfer matrix of the primitive cell. The complex band structure of this photonic crystal is studied and the corresponding evolutions of the exceptional points, $\mathcal{PT}$-exact phase and $\mathcal{PT}$-broken phase are disclosed. Near the exceptional points, we find some singular behaviors, the transmittance and reflectances from both sides are all greater than one and even all reach large values at the same time, then the corresponding absorptances from both sides are negative. In the band gap, the transmittance is zero, the reflectance form one side can be very large, while the reflectance from the other side is very small, we call this phenomenon unidirectional weak visibility. We believe that these phenomena are very beneficial for the design of the optical devices.


title: Sparse Array Beamforming Design for Wideband Signal Models

abstract: We develop sparse array receive beamformer design methods achieving maximum signal-to-interference plus noise ratio (MaxSINR) for wideband sources and jammers. Both tapped delay line (TDL) filtering and the DFT realizations to wideband array processing are considered. The array sparsity stems from the limited number of available RF transmission chains that switch between the sensors, thereby configuring different arrays at different times. The sparse array configuration design problem is formulated as a quadratically constraint quadratic program (QCQP) and solved by using SDR (semidefinite relaxation). A computationally viable approach through SCA (successive convex relaxation) is also pursued. In order to realize an implementable design, in presence of missing autocorrelation lags, we propose parameter-free block Toeplitz matrix completion to estimate the received data correlation matrix across the entire array aperture. It is shown that the optimum wideband sparse array effectively utilizes the array aperture and provides considerable performance improvement over suboptimal array topologies.


title: What is the Halo Mass Function in a Fuzzy Dark Matter Cosmology?

abstract: Fuzzy dark matter (FDM) or wave dark matter is an alternative theory designed to solve the small-scale problems faced by the standard cold dark matter proposal for the primary material component of the universe. It is made up of ultra-light axions having mass $\sim 10^{-22}$ eV that typically have de Broglie wavelength of several kpc, alleviating some of the apparent small-scale discrepancies faced by the standard $\Lambda$CDM paradigm. In this paper, we calculate the halo mass function for the fuzzy dark matter using a sharp-k window function and compare it with one calculated using numerical simulations, finding the peak mass at roughly $10^{10} {M_{\odot}}$ for a particle mass of $2\times 10^{-22}$ eV. We also constrain the mass of FDM particle to be $\gtrapprox 2\times10^{-22}$ eV using the observations of high-redshift ($z\sim 10$) lensed galaxies from CLASH survey.


title: Statistical Properties of Superflares on Solar-type Stars: Results Using All of the Kepler Primary Mission Data

abstract: We report the latest statistical analyses of superflares on solar-type (G-type main-sequence; effective temperature is 5100 - 6000 K) stars using all of the $Kepler$ primary mission data, and $Gaia$-DR2 (Data Release 2) catalog. We updated the flare detection method from our previous studies by using high-pass filter to remove rotational variations caused by starspots. We also examined the sample biases on the frequency of superflares, taking into account gyrochronology and flare detection completeness. The sample size of solar-type stars and Sun-like stars (effective temperature is 5600 - 6000 K and rotation period is over 20 days in solar-type stars) are $\sim$4 and $\sim$12 times, respectively, compared with Notsu et al. (2019, ApJ, 876, 58). As a result, we found 2341 superflares on 265 solar-type stars, and 26 superflares on 15 Sun-like stars: the former increased from 527 to 2341 and the latter from 3 to 26 events compared with our previous study. This enabled us to have a more well-established view on the statistical properties of superflares. The observed upper limit of the flare energy decreases as the rotation period increases in solar-type stars. The frequency of superflares decreases as the stellar rotation period increases. The maximum energy we found on Sun-like stars is $4 \times 10^{34}$ erg. Our analysis of Sun-like stars suggest that the Sun can cause superflares with energies of $\sim 7 \times 10^{33}$ erg ($\sim$X700-class flares) and $\sim 1 \times 10^{34}$ erg ($\sim$X1000-class flares) once every $\sim$3,000 years and $\sim$6,000 years, respectively.


title: Sums of Quaternion Squares and a Theorem of Watson

abstract: We use a representability theorem of G. L. Watson to examine sums of squares in Quaternion rings with integer coefficients. This allows us to determine a large family of such rings where every element expressible as the sum of squares can be written as the sum of 3 squares.


title: Realtime CNN-based Keypoint Detector with Sobel Filter and CNN-based Descriptor Trained with Keypoint Candidates

abstract: The local feature detector and descriptor are essential in many computer vision tasks, such as SLAM and 3D reconstruction. In this paper, we introduce two separate CNNs, lightweight SobelNet and DesNet, to detect key points and to compute dense local descriptors. The detector and the descriptor work in parallel. Sobel filter provides the edge structure of the input images as the input of CNN. The locations of key points will be obtained after exerting the non-maximum suppression (NMS) process on the output map of the CNN. We design Gaussian loss for the training process of SobelNet to detect corner points as keypoints. At the same time, the input of DesNet is the original grayscale image, and circle loss is used to train DesNet. Besides, output maps of SobelNet are needed while training DesNet. We have evaluated our method on several benchmarks including HPatches benchmark, ETH benchmark, and FM-Bench. SobelNet achieves better or comparable performance with less computation compared with SOTA methods in recent years. The inference time of an image of 640x480 is 7.59ms and 1.09ms for SobelNet and DesNet respectively on RTX 2070 SUPER.


title: Learning Discriminative Representations for Fine-Grained Diabetic Retinopathy Grading

abstract: Diabetic retinopathy (DR) is one of the leading causes of blindness. However, no specific symptoms of early DR lead to a delayed diagnosis, which results in disease progression in patients. To determine the disease severity levels, ophthalmologists need to focus on the discriminative parts of the fundus images. In recent years, deep learning has achieved great success in medical image analysis. However, most works directly employ algorithms based on convolutional neural networks (CNNs), which ignore the fact that the difference among classes is subtle and gradual. Hence, we consider automatic image grading of DR as a fine-grained classification task, and construct a bilinear model to identify the pathologically discriminative areas. In order to leverage the ordinal information among classes, we use an ordinal regression method to obtain the soft labels. In addition, other than only using a categorical loss to train our network, we also introduce the metric loss to learn a more discriminative feature space. Experimental results demonstrate the superior performance of the proposed method on two public IDRiD and DeepDR datasets.


title: PheMT: A Phenomenon-wise Dataset for Machine Translation Robustness on User-Generated Contents

abstract: Neural Machine Translation (NMT) has shown drastic improvement in its quality when translating clean input, such as text from the news domain. However, existing studies suggest that NMT still struggles with certain kinds of input with considerable noise, such as User-Generated Contents (UGC) on the Internet. To make better use of NMT for cross-cultural communication, one of the most promising directions is to develop a model that correctly handles these expressions. Though its importance has been recognized, it is still not clear as to what creates the great gap in performance between the translation of clean input and that of UGC. To answer the question, we present a new dataset, PheMT, for evaluating the robustness of MT systems against specific linguistic phenomena in Japanese-English translation. Our experiments with the created dataset revealed that not only our in-house models but even widely used off-the-shelf systems are greatly disturbed by the presence of certain phenomena.