title: Automated speech tools for helping communities process restricted-access corpora for language revival efforts

abstract: Many archival recordings of speech from endangered languages remain unannotated and inaccessible to community members and language learning programs. One bottleneck is the time-intensive nature of annotation. An even narrower bottleneck occurs for recordings with access constraints, such as language that must be vetted or filtered by authorised community members before annotation can begin. We propose a privacy-preserving workflow to widen both bottlenecks for recordings where speech in the endangered language is intermixed with a more widely-used language such as English for meta-linguistic commentary and questions (e.g. What is the word for 'tree'?). We integrate voice activity detection (VAD), spoken language identification (SLI), and automatic speech recognition (ASR) to transcribe the metalinguistic content, which an authorised person can quickly scan to triage recordings that can be annotated by people with lower levels of access. We report work-in-progress processing 136 hours archival audio containing a mix of English and Muruwari. Our collaborative work with the Muruwari custodian of the archival materials show that this workflow reduces metalanguage transcription time by 20% even given only minimal amounts of annotated training data: 10 utterances per language for SLI and for ASR at most 39 minutes, and possibly as little as 39 seconds.


title: A bound for twists of $\rm GL_3\times GL_2$ $L$-functions with composite modulus

abstract: Let $\pi$ be a Hecke-Maass cusp form for $\rm SL_3(\mathbf{Z})$ and let $g$ be a holomorphic or Maass cusp form for $\rm SL_2(\mathbf{Z})$. Let $\chi$ be a primitive Dirichlet character of modulus $M=M_1M_2$ with $M_i$ prime, $i=1,2$. Suppose that $M^{1/2+2\eta}<M_1<M^{1-2\eta}$ with $0<\eta<1/8$. Then we have $$ L\left(\frac{1}{2},\pi\otimes g \otimes \chi\right)\ll_{\pi,g,\varepsilon} M^{3/2-\eta+\varepsilon}. $$


title: Spatial Geometry of the Large-Scale Universe: The Role of Quantum Gravity, Dark Energy and other Unknowns

abstract: It has been known for some time that the usual inference drawn from the observed near-flatness of the large-scale Universe - namely the existence of a cosmological "flatness problem", which is then taken as a partial, but key motivation for assuming the existence of an ultra-short, inflationary expansion of the very early Universe - is in itself deeply problematic. The present contribution consolidates the earlier results regarding the absence of a cosmological flatness problem of the sort that could potentially be resolved by inflation, by clearing up some common misunderstandings and by presenting some arguments in more detail.


title: Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection

abstract: Lifelong event detection aims to incrementally update a model with new event types and data while retaining the capability on previously learned old types. One critical challenge is that the model would catastrophically forget old types when continually trained on new data. In this paper, we introduce Episodic Memory Prompts (EMP) to explicitly preserve the learned task-specific knowledge. Our method adopts continuous prompt for each task and they are optimized to instruct the model prediction and learn event-specific representation. The EMPs learned in previous tasks are carried along with the model in subsequent tasks, and can serve as a memory module that keeps the old knowledge and transferring to new tasks. Experiment results demonstrate the effectiveness of our method. Furthermore, we also conduct a comprehensive analysis of the new and old event types in lifelong learning.


title: auton-survival: an Open-Source Package for Regression, Counterfactual Estimation, Evaluation and Phenotyping with Censored Time-to-Event Data

abstract: Applications of machine learning in healthcare often require working with time-to-event prediction tasks including prognostication of an adverse event, re-hospitalization or death. Such outcomes are typically subject to censoring due to loss of follow up. Standard machine learning methods cannot be applied in a straightforward manner to datasets with censored outcomes. In this paper, we present auton-survival, an open-source repository of tools to streamline working with censored time-to-event or survival data. auton-survival includes tools for survival regression, adjustment in the presence of domain shift, counterfactual estimation, phenotyping for risk stratification, evaluation, as well as estimation of treatment effects. Through real world case studies employing a large subset of the SEER oncology incidence data, we demonstrate the ability of auton-survival to rapidly support data scientists in answering complex health and epidemiological questions.


title: P\'{o}lya-type inequalities on spheres and hemispheres

abstract: Given an eigenvalue $\lambda$ of the Laplace-Beltrami operator on $n-$spheres or $-$hemispheres, with multiplicity $m$ such that $\lambda=\lambda_{k}=\dots = \lambda_{k+m-1}$, we characterise the lowest and highest orders in the set $\left\{k,\dots,k+m-1\right\}$ for which P\'{o}lya's conjecture holds and fails. In particular, we show that P\'{o}lya's conjecture holds for hemispheres in the Neumann case, but not in the Dirichlet case when $n$ is greater than two. We further derive P\'{o}lya-type inequalities by adding a correction term providing sharp lower and upper bounds for all eigenvalues. This allows us to measure the deviation from the leading term in the Weyl asymptotics for eigenvalues on spheres and hemispheres. As a direct consequence, we obtain similar results for domains which tile hemispheres. We also obtain direct and reversed Li-Yau inequalities for $\mathbb{S}^2$ and $\mathbb{S}^4$, respectively.


title: A fictitious-play finite-difference method for linearly solvable mean field games

abstract: An iterative finite difference scheme for mean field games (MFGs) is proposed. The target MFGs are derived from control problems for multidimensional systems with advection terms. For such MFGs, linearization using the Cole-Hopf transformation and iterative computation using fictitious play are introduced. This leads to an implementation-friendly algorithm that iteratively solves explicit schemes. The convergence properties of the proposed scheme are mathematically proved by tracking the error of the variable through iterations. Numerical calculations show that the proposed method works stably for both one- and two-dimensional control problems.


title: Parabolic Homogenization with an Interface

abstract: This paper considers a family of second-order parabolic equations in divergence form with rapidly oscillating and time-dependent periodic coefficients and an interface between two periodic structures. Following a framework initiated by Blanc, Le Bris and Lions and a generalized two-scale expansion in divergence form of elliptic homogenization with an interface by Josien, we can determine the effective (or homogenized) equation with the coefficient matrix being piecewise constant and discontinuous across the interface. Moreover, we obtain the $O(\varepsilon)$ convergence rates in $L^{2(d+2)/{d}}_{x,t}$ with $\varepsilon$-smoothing method and the uniform interior Lipschitz estimates via compactness argument.


title: Invisible-to-Visible: Privacy-Aware Human Instance Segmentation using Airborne Ultrasound via Collaborative Learning Variational Autoencoder

abstract: In action understanding in indoor, we have to recognize human pose and action considering privacy. Although camera images can be used for highly accurate human action recognition, camera images do not preserve privacy. Therefore, we propose a new task for human instance segmentation from invisible information, especially airborne ultrasound, for action recognition. To perform instance segmentation from invisible information, we first convert sound waves to reflected sound directional images (sound images). Although the sound images can roughly identify the location of a person, the detailed shape is ambiguous. To address this problem, we propose a collaborative learning variational autoencoder (CL-VAE) that simultaneously uses sound and RGB images during training. In inference, it is possible to obtain instance segmentation results only from sound images. As a result of performance verification, CL-VAE could estimate human instance segmentations more accurately than conventional variational autoencoder and some other models. Since this method can obtain human segmentations individually, it could be applied to human action recognition tasks with privacy protection.


title: Pricing and Remunerating Electricity Storage Flexibility Using Virtual Links

abstract: Ambitious renewable portfolio standards motivate the incorporation of energy storage resources (ESR) as sources of flexibility. While the United States government aims to promote ESR participation in electricity markets, work on market designs for properly remunerating ESRs is still lacking. In this paper, we propose a new energy market clearing framework that incorporates ESR systems. The new market design is computationally attractive in that it avoids mixed-integer formulations and formulations with complementarity constraints. Moreover, compared to previous market designs, our market decomposes the operations of ESRs using the concept of virtual links, which capture the transfer of energy across time. The virtual link representation reveals economic incentives available for ESR operations and sheds light into how electricity markets should remunerate ESRs. We also explore the role of ESR physical parameters on market behavior; we show that, while energy and power capacity defines the amount of flexibility each ESR can provide, storage charge/discharge efficiencies play a fundamental role in ESR remuneration and in mitigating market price volatility. We use our proposed framework to analyze the interplay between ESRs and independent system operators (ISOs) and to provide insights into optimal deployment strategies of ESRs in power grids.


title: Blackhole Mergers Through Evection Resonances

abstract: Mechanisms have been proposed to enhance the merger rate of stellar mass black hole binaries, such as the Von Zeipel-Lidov-Kozai mechanism (vZLK). However, high inclinations are required in order to greatly excite the eccentricity and to reduce the merger time through vZLK. Here, we propose a novel pathway through which compact binaries could merge due to eccentricity increase in general, including in a near coplanar configuration. Specifically, a compact binary migrating in an AGN disk could be captured in an evection resonance, when the precession rate of the binary equals their orbital period around the supermassive black hole. In our study we include precession to due first-order post Newtonian precession as well as that due to disk around one or both components of the binary. Eccentricity is excited when the binary sweeps through the resonance which happens only when it migrates on a timescale 10-100 times the libration timescale of the resonance. Libration timescale decreases as the mass of the disk increases. The eccentricity excitation of the binary can reduce the merger timescale by a factor up to $\sim 10^{3-5}$.


title: Observing frustrated quantum magnetism in two-dimensional ion crystals

abstract: Two-dimensional (2D) quantum magnetism is a paradigm in strongly correlated many-body physics. The understanding of 2D quantum magnetism can be expedited by employing a controllable quantum simulator that faithfully maps 2D-spin Hamiltonians. The 2D quantum simulators can exhibit exotic phenomena such as frustrated quantum magnetism and topological order and can be used to show quantum computational advantages. Many experimental platforms are being developed, including Rydberg atoms and superconducting annealers. However, with trapped-ion systems, which showed the most advanced controllability and quantum coherence, quantum magnetism was explored in one-dimensional chains. Here, we report simulations of frustrated quantum magnetism with 2D ion crystals. We create a variety of spin-spin interactions for quantum magnets, including those that exhibit frustration by driving different vibrational modes and adiabatically prepare the corresponding ground states. The experimentally measured ground states are consistent with the theoretical predictions and are highly degenerate for geometrically frustrated spin models in two dimensions. Quantum coherence of the ground states is probed by reversing the time evolution of the B-field to the initial value and then measuring the extent to which the remaining state coincides with the initial state. Our results open the door for quantum simulations with 2D ion crystals.


title: Quantum gradient descent algorithms for nonequilibrium steady states and linear algebraic systems

abstract: The gradient descent approach is the key ingredient in variational quantum algorithms and machine learning tasks, which is an optimization algorithm for finding a local minimum of an objective function. The quantum versions of gradient descent have been investigated and implemented in calculating molecular ground states and optimizing polynomial functions. Based on the quantum gradient descent algorithm and Choi-Jamiolkowski isomorphism, we present approaches to simulate efficiently the nonequilibrium steady states of Markovian open quantum many-body systems. Two strategies are developed to evaluate the expectation values of physical observables on the nonequilibrium steady states. Moreover, we adapt the quantum gradient descent algorithm to solve linear algebra problems including linear systems of equations and matrix-vector multiplications, by converting these algebraic problems into the simulations of closed quantum systems with well-defined Hamiltonians. Detailed examples are given to test numerically the effectiveness of the proposed algorithms for the dissipative quantum transverse Ising models and matrix-vector multiplications.


title: Enabling Capabilities for Infrastructure and Workforce in Electronics and ASICs

abstract: The impressive progress in data rate capabilities, pattern recognition, and spatial resolution of current detectors in experimental particle physics has been possible thanks to the availability of sophisticated analog processors combined with complex digital signal processors implemented in custom made front end ASICs. The demands in terms of performance and increasingly smaller feature sizes are significant. In order to meet these instrumentation challenges, we need to educate and retain a skilled work force, as well as aggregate design tools and acquired knowledge. We propose a multifaceted initiative to ensure that these needs are met.


title: Guided Co-Modulated GAN for 360{\deg} Field of View Extrapolation

abstract: We propose a method to extrapolate a 360{\deg} field of view from a single image that allows for user-controlled synthesis of the out-painted content. To do so, we propose improvements to an existing GAN-based in-painting architecture for out-painting panoramic image representation. Our method obtains state-of-the-art results and outperforms previous methods on standard image quality metrics. To allow controlled synthesis of out-painting, we introduce a novel guided co-modulation framework, which drives the image generation process with a common pretrained discriminative model. Doing so maintains the high visual quality of generated panoramas while enabling user-controlled semantic content in the extrapolated field of view. We demonstrate the state-of-the-art results of our method on field of view extrapolation both qualitatively and quantitatively, providing thorough analysis of our novel editing capabilities. Finally, we demonstrate that our approach benefits the photorealistic virtual insertion of highly glossy objects in photographs.


title: Long time asymptotic behavior for the nonlocal mKdV equation in space-time solitonic regions-II

abstract: We study the long time asymptotic behavior for the Cauchy problem of an integrable real nonlocal mKdV equation with nonzero initial data in the solitonic regions \begin{align*} &q_t(x,t)-6\sigma q(x,t)q(-x,-t)q_{x}(x,t)+q_{xxx}(x,t)=0, &q(x,0)=q_{0}(x),\ \ \lim_{x\to \pm\infty} q_{0}(x)=q_{\pm}, \end{align*} where $|q_{\pm}|=1$ and $q_{+}=\delta q_{-}$, $\sigma\delta=-1$. In our previous article, we have obtained long time asymptotics for the nonlocal mKdV equation in the solitonic region $-6<\xi<6$ with $\xi=\frac{x}{t}$. In this paper, we calculate the asymptotic expansion of the solution $q(x,t)$ for other solitonic regions $\xi<-6$ and $\xi>6$. Based on the Riemann-Hilbert problem of the the Cauchy problem, further using the $\bar{\partial}$ steepest descent method, we derive different long time asymptotic expansions of the solution $q(x,t)$ in above two different space-time solitonic regions. In the region $\xi<-6$, phase function $\theta(z)$ has four stationary phase points on the $\mathbb{R}$. Correspondingly, $q(x,t)$ can be characterized with an $\mathcal{N}(\Lambda)$-soliton on discrete spectrum, the leading order term on continuous spectrum and an residual error term, which are affected by a function ${\rm Im}\nu(\zeta_i)$. In the region $\xi>6$, phase function $\theta(z)$ has four stationary phase points on $i\mathbb{R}$, the corresponding asymptotic approximations can be characterized with an $\mathcal{N}(\Lambda)$-soliton with diverse residual error order $\mathcal{O}(t^{-1})$.


title: Characterizing the Efficiency vs. Accuracy Trade-off for Long-Context NLP Models

abstract: With many real-world applications of Natural Language Processing (NLP) comprising of long texts, there has been a rise in NLP benchmarks that measure the accuracy of models that can handle longer input sequences. However, these benchmarks do not consider the trade-offs between accuracy, speed, and power consumption as input sizes or model sizes are varied. In this work, we perform a systematic study of this accuracy vs. efficiency trade-off on two widely used long-sequence models - Longformer-Encoder-Decoder (LED) and Big Bird - during fine-tuning and inference on four datasets from the SCROLLS benchmark. To study how this trade-off differs across hyperparameter settings, we compare the models across four sequence lengths (1024, 2048, 3072, 4096) and two model sizes (base and large) under a fixed resource budget. We find that LED consistently achieves better accuracy at lower energy costs than Big Bird. For summarization, we find that increasing model size is more energy efficient than increasing sequence length for higher accuracy. However, this comes at the cost of a large drop in inference speed. For question answering, we find that smaller models are both more efficient and more accurate due to the larger training batch sizes possible under a fixed resource budget.


title: Identifying and Measuring Token-Level Sentiment Bias in Pre-trained Language Models with Prompts

abstract: Due to the superior performance, large-scale pre-trained language models (PLMs) have been widely adopted in many aspects of human society. However, we still lack effective tools to understand the potential bias embedded in the black-box models. Recent advances in prompt tuning show the possibility to explore the internal mechanism of the PLMs. In this work, we propose two token-level sentiment tests: Sentiment Association Test (SAT) and Sentiment Shift Test (SST) which utilize the prompt as a probe to detect the latent bias in the PLMs. Our experiments on the collection of sentiment datasets show that both SAT and SST can identify sentiment bias in PLMs and SST is able to quantify the bias. The results also suggest that fine-tuning can possibly augment the existing bias in PLMs.


title: Gradient estimates for the insulated conductivity problem with inclusions of the general $m$-convex shapes

abstract: In this paper, the insulated conductivity model with two touching or close-to-touching inclusions is considered in $\mathbb{R}^{d}$ with $d\geq3$. We establish the pointwise upper bounds on the gradient of the solution for the generalized $m$-convex inclusions under these two cases with $m\geq2$, which show that the singular behavior of the gradient in the thin gap between two inclusions is described by the first non-zero eigenvalue of an elliptic operator of divergence form on $\mathbb{S}^{d-2}$. Finally, the sharpness of the estimates is also proved for two touching axisymmetric insulators, especially including curvilinear cubes.


title: The training response law explains how deep neural networks learn

abstract: Deep neural network is the widely applied technology in this decade. In spite of the fruitful applications, the mechanism behind that is still to be elucidated. We study the learning process with a very simple supervised learning encoding problem. As a result, we found a simple law, in the training response, which describes neural tangent kernel. The response consists of a power law like decay multiplied by a simple response kernel. We can construct a simple mean-field dynamical model with the law, which explains how the network learns. In the learning, the input space is split into sub-spaces along competition between the kernels. With the iterated splits and the aging, the network gets more complexity, but finally loses its plasticity.


title: Unsupervised Probabilistic Models for Sequential Electronic Health Records

abstract: We develop an unsupervised probabilistic model for heterogeneous Electronic Health Record (EHR) data. Utilizing a mixture model formulation, our approach directly models sequences of arbitrary length, such as medications and laboratory results. This allows for subgrouping and incorporation of the dynamics underlying heterogeneous data types. The model consists of a layered set of latent variables that encode underlying structure in the data. These variables represent subject subgroups at the top layer, and unobserved states for sequences in the second layer. We train this model on episodic data from subjects receiving medical care in the Kaiser Permanente Northern California integrated healthcare delivery system. The resulting properties of the trained model generate novel insight from these complex and multifaceted data. In addition, we show how the model can be used to analyze sequences that contribute to assessment of mortality likelihood.


title: Towards a Unified Framework for Uncertainty-aware Nonlinear Variable Selection with Theoretical Guarantees

abstract: We develop a simple and unified framework for nonlinear variable selection that incorporates uncertainty in the prediction function and is compatible with a wide range of machine learning models (e.g., tree ensembles, kernel methods, neural networks, etc). In particular, for a learned nonlinear model $f(\mathbf{x})$, we consider quantifying the importance of an input variable $\mathbf{x}^j$ using the integrated partial derivative $\Psi_j = \Vert \frac{\partial}{\partial \mathbf{x}^j} f(\mathbf{x})\Vert^2_{P_\mathcal{X}}$. We then (1) provide a principled approach for quantifying variable selection uncertainty by deriving its posterior distribution, and (2) show that the approach is generalizable even to non-differentiable models such as tree ensembles. Rigorous Bayesian nonparametric theorems are derived to guarantee the posterior consistency and asymptotic uncertainty of the proposed approach. Extensive simulations and experiments on healthcare benchmark datasets confirm that the proposed algorithm outperforms existing classic and recent variable selection methods.


title: Systematic analysis of the proton mass radius based on photoproduction of vector charmoniums

abstract: In this work, the cross-section of the reaction $\gamma p \rightarrow V(J/\psi,\psi(2S)) p$ from the production threshold to medium energy is studied and systematically analyzed within two gluon exchange model. The obtained numerical results are in agreement with experimental data and other theoretical predictions. Under the assumption of the scalar form factor of dipole form, the value of proton mass radius is calculated as $0.55\pm 0.09$ fm and $ 0.77\pm 0.12$ fm from the fit to the predicted $J/\psi $ and $\psi(2S)$ differential cross-section, respectively. Finally the average value of proton mass radius is estimated to be $\sqrt{\left<R^2_m \right>}=0.67\pm 0.11$ fm. Moreover, one find that extracting mass radius from the near-threshold differential cross-section of heavy quarkoniums is always affected by large $|t|_{min}$. These obtained results may provide important theoretical reference for understanding of nucleon structure and future relevant experiments.


title: On extracting the positions of multiple unknown cracks that occur on the junction line of two elastic plates

abstract: This paper is concerned with the reconstruction issue of an inverse crack problem in a two-dimensional bounded domain which may have a possible application to the nondestructive evaluation of materials. It is assumed that the domain consists of two elastic plates welded together and has some unknown cracks on the junction line and the governing equation of in-plane displacement is Navier's equation. The problem is to extract information about the location of cracks from the observation data which is a single set of a loading surface traction and the resulted in-plane displacement field on the boundary of the domain. It is shown that the enclosure method combined with the Kelvin transform yields explicit extraction formulae of such information from the observation data.


title: Large-scale Dynamics of Winds Driven by Line Force from a Thin Accretion Disk

abstract: Winds play a significant role in active galactic nuclei feedback process. Previous simulations studying winds only focus on a small dynamical range. Therefore, it is unknown how far the winds can go and what the properties of the winds will be if they can move to large radii. We perform simulations to study the large scale dynamics of winds driven by line force. We find that the properties of the winds depend on both black hole mass ($M_{BH}$) and accretion disk luminosity. When the accretion disk luminosity is $0.6L_{edd}$ ($L_{edd}$ being Eddington luminosity), independent of $M_{BH}$, the winds have kinetic energy flux exceeding $1\% L_{edd}$ and can escape from the black hole potential. For the case with the accretion disk luminosity equaling 0.3$L_{edd}$, the strength of the winds decreases with the decrease of $M_{BH}$. If $M_{BH}$ decreases from $10^9$ to $10^6$ solar mass ($M_\odot$), the winds kinetic energy flux decreases from $\sim 0.01 L_{edd}$ to $ \sim 10^{-6} L_{edd}$. In case of $M_{BH}\geq 10^7 M_\odot$, winds can escape from black hole potential. In the case of $M_{BH}=10^6 M_\odot$, the winds can not escape. We find that for the ultra-fast winds observed in hard X-ray bands (\citealt{Gofford et al. 2015}), the observed dependence of the mass flux and the kinetic energy flux on accretion disk luminosity can be well produced by line force driven winds model. We also find that the properties of the ultra-fast winds observed in soft X-ray bands can be explained by the line force driven winds model.


title: A Geometric Approach on Circular Photon Orbits and Black Hole Shadow

abstract: Circular photon orbit and black hole shadow are significantly important issues in physics and astronomy, and a number of breakthroughs have been witnessed in recent years. Conventionally, the stable and unstable circular photon orbits are obtained using the effective potential of test particles moving in black hole spacetime. In this work, a pure geometric approach is developed to calculate these circular photon orbits and black hole shadow radius. Furthermore, it can be proved that our geometric approach is completely equivalent to the conventional approach based on effective potentials of test particles.


title: Cartan Connection for h-Matsumoto change

abstract: In the present paper, we have studied the Matsumoto change $\overline{L}(x,y)= \frac{L^{2}(x,y)}{L(x,y) - \beta(x,y)} $ with an \textsl{h-}vector $b_{i}(x,y)$. We have derived some fundamental tensors for this transformation. We have also obtained the necessary and sufficient condition for which the Cartan connection coefficients for both the spaces $F^{n}=(M^n,L)$ and $\overline{F}^{\,n}=(M^{n},\overline{L})$ are same.


title: Where to Go for the Holidays: Towards Mixed-Type Dialogs for Clarification of User Goals

abstract: Most dialog systems posit that users have figured out clear and specific goals before starting an interaction. For example, users have determined the departure, the destination, and the travel time for booking a flight. However, in many scenarios, limited by experience and knowledge, users may know what they need, but still struggle to figure out clear and specific goals by determining all the necessary slots. In this paper, we identify this challenge and make a step forward by collecting a new human-to-human mixed-type dialog corpus. It contains 5k dialog sessions and 168k utterances for 4 dialog types and 5 domains. Within each session, an agent first provides user-goal-related knowledge to help figure out clear and specific goals, and then help achieve them. Furthermore, we propose a mixed-type dialog model with a novel Prompt-based continual learning mechanism. Specifically, the mechanism enables the model to continually strengthen its ability on any specific type by utilizing existing dialog corpora effectively.


title: Dense Learning based Semi-Supervised Object Detection

abstract: Semi-supervised object detection (SSOD) aims to facilitate the training and deployment of object detectors with the help of a large amount of unlabeled data. Though various self-training based and consistency-regularization based SSOD methods have been proposed, most of them are anchor-based detectors, ignoring the fact that in many real-world applications anchor-free detectors are more demanded. In this paper, we intend to bridge this gap and propose a DenSe Learning (DSL) based anchor-free SSOD algorithm. Specifically, we achieve this goal by introducing several novel techniques, including an Adaptive Filtering strategy for assigning multi-level and accurate dense pixel-wise pseudo-labels, an Aggregated Teacher for producing stable and precise pseudo-labels, and an uncertainty-consistency-regularization term among scales and shuffled patches for improving the generalization capability of the detector. Extensive experiments are conducted on MS-COCO and PASCAL-VOC, and the results show that our proposed DSL method records new state-of-the-art SSOD performance, surpassing existing methods by a large margin. Codes can be found at \textcolor{blue}{https://github.com/chenbinghui1/DSL}.


title: Deformed in-medium similarity renormalization group

abstract: We have developed an {\it ab initio} deformed in-medium similarity renormalization group (IMSRG) for open-shell nuclei. This is a single-reference IMSRG in deformed Hartree-Fock (HF) basis. Deformed wave functions are more efficient in describing deformed nuclei. The broken spherical symmetry needs to be restored by angular momentum projection, which is computational expensive. The angular momentum mainly capture the static correlations and can be estimated by the projection of the HF state. In this work, we do deformed IMSRG calculation and add the correlation energy from projected HF as a leading order approximation. As the test ground, we have calculated the deformed $^{8,10}\rm Be$ isotopes with the optimized chiral interaction NNLO$_{\rm opt}$. The results are benchmarked with the no-core shell model and valence space IMSRG calculations. Then we systematically investigated the ground-state energies and charge radii of even-even isotopes from light beryllium to medium-mass magnesium. The calculated energies are extrapolated to infinite basis space by an exponential form, and compared with the extrapolated valence-space IMSRG results and experimental data available.


title: Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning

abstract: Visual Dialog is a challenging vision-language task since the visual dialog agent needs to answer a series of questions after reasoning over both the image content and dialog history. Though existing methods try to deal with the cross-modal understanding in visual dialog, they are still not enough in ranking candidate answers based on their understanding of visual and textual contexts. In this paper, we analyze the cross-modal understanding in visual dialog based on the vision-language pre-training model VD-BERT and propose a novel approach to improve the cross-modal understanding for visual dialog, named ICMU. ICMU enhances cross-modal understanding by distinguishing different pulled inputs (i.e. pulled images, questions or answers) based on four-way contrastive learning. In addition, ICMU exploits the single-turn visual question answering to enhance the visual dialog model's cross-modal understanding to handle a multi-turn visually-grounded conversation. Experiments show that the proposed approach improves the visual dialog model's cross-modal understanding and brings satisfactory gain to the VisDial dataset.


title: General inertial smoothing proximal gradient algorithm for the relaxation of matrix rank minimization problem

abstract: We consider the exact continuous relaxation model of matrix rank minimization problem proposed by Yu and Zhang (Comput.Optim.Appl. 1-20, 2022). Motivated by the inertial techinique, we propose a general inertial smoothing proximal gradient algorithm(GIMSPG) for this kind of problems. It is shown that the singular values of any accumulation point have a common support set and the nonzero singular values have a unified lower bound. Besides, the zero singular values of the accumulation point can be achieved within finite iterations. Moreover, we prove that any accumulation point of the sequence generated by the GIMSPG algorithm is a lifted stationary point of the continuous relaxation model under the flexible parameter constraint. Finally, we carry out numerical experiments on random data and image data respectively to illustrate the efficiency of the GIMSPG algorithm.


title: On Variants of Root Normalised Order-aware Divergence and a Divergence based on Kendall's Tau

abstract: This paper reports on a follow-up study of the work reported in Sakai, which explored suitable evaluation measures for ordinal quantification tasks. More specifically, the present study defines and evaluates, in addition to the quantification measures considered earlier, a few variants of an ordinal quantification measure called Root Normalised Order-aware Divergence (RNOD), as well as a measure which we call Divergence based on Kendall's $\tau$ (DNKT). The RNOD variants represent alternative design choices based on the idea of Sakai's Distance-Weighted sum of squares (DW), while DNKT is designed to ensure that the system's estimated distribution over classes is faithful to the target priorities over classes. As this Priority Preserving Property (PPP) of DNKT may be useful in some applications, we also consider combining some of the existing quantification measures with DNKT. Our experiments with eight ordinal quantification data sets suggest that the variants of RNOD do not offer any benefit over the original RNOD at least in terms of system ranking consistency, i.e., robustness of the system ranking to the choice of test data. Of all ordinal quantification measures considered in this study (including Normalised Match Distance, a.k.a. Earth Mover's Distance), RNOD is the most robust measure overall. Hence the design choice of RNOD is a good one from this viewpoint. Also, DNKT is the worst performer in terms of system ranking consistency. Hence, if DNKT seems appropriate for a task, sample size design should take its statistical instability into account.


title: Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference

abstract: Few-shot learning (FSL) is an important and topical problem in computer vision that has motivated extensive research into numerous methods spanning from sophisticated meta-learning methods to simple transfer learning baselines. We seek to push the limits of a simple-but-effective pipeline for more realistic and practical settings of few-shot image classification. To this end, we explore few-shot learning from the perspective of neural network architecture, as well as a three stage pipeline of network updates under different data supplies, where unsupervised external data is considered for pre-training, base categories are used to simulate few-shot tasks for meta-training, and the scarcely labelled data of an novel task is taken for fine-tuning. We investigate questions such as: (1) How pre-training on external data benefits FSL? (2) How state-of-the-art transformer architectures can be exploited? and (3) How fine-tuning mitigates domain shift? Ultimately, we show that a simple transformer-based pipeline yields surprisingly good performance on standard benchmarks such as Mini-ImageNet, CIFAR-FS, CDFSL and Meta-Dataset. Our code and demo are available at https://hushell.github.io/pmf.


title: Congestion Reduction via Personalized Incentives

abstract: With rapid population growth and urban development, traffic congestion has become an inescapable issue, especially in large cities. Many congestion reduction strategies have been proposed in the past, ranging from roadway extension to transportation demand management. In particular, congestion pricing schemes have been used as negative reinforcements for traffic control. In this project, we study an alternative approach of offering positive incentives to drivers to take different routes. More specifically, we propose an algorithm to reduce traffic congestion and improve routing efficiency via offering personalized incentives to drivers. We exploit the wide-accessibility of smart devices to communicate with drivers and develop an incentive offering mechanism using individuals' preferences and aggregate traffic information. The incentives are offered after solving a large-scale optimization problem in order to minimize the total travel time (or minimize any cost function of the network such as total Carbon emission). Since this massive size optimization problem needs to be solved continually in the network, we developed a distributed computational approach. The proposed distributed algorithm is guaranteed to converge under a mild set of assumptions that are verified with real data. We evaluated the performance of our algorithm using traffic data from the Los Angeles area. Our experiments show congestion reduction of up to 11% in arterial roads and highways.


title: Dynamical mean-field theory study of a ferromagnetic CrI3 monolayer

abstract: We have employed one of the well-known many-body techniques, density functional theory plus dynamical mean-field theory (DFT + DMFT), to investigate the electronic structure of ferromagnetic monolayer CrI3 as a function of temperature and hole-doping concentration. The computed magnetic susceptibility follows the Curie's law, indicating that the ferromagnetism of monolayer CrI3 originates from localized magnetic moments of Cr atoms rather than Stoner-type itinerant ones. The DFT + DMFT calculations show a different coherent temperature for each spin component, demonstrating apparent strong spin-dependent electronic correlation effects in monolayer CrI3. Furthermore, we have explored the doping-dependent electronic structure of monolayer CrI3 and found that its electronic and magnetic properties are easily tunable by the hole-doping.


title: Ensemble diverse hypotheses and knowledge distillation for unsupervised cross-subject adaptation

abstract: Recognizing human locomotion intent and activities is important for controlling the wearable robots while walking in complex environments. However, human-robot interface signals are usually user-dependent, which causes that the classifier trained on source subjects performs poorly on new subjects. To address this issue, this paper designs the ensemble diverse hypotheses and knowledge distillation (EDHKD) method to realize unsupervised cross-subject adaptation. EDH mitigates the divergence between labeled data of source subjects and unlabeled data of target subjects to accurately classify the locomotion modes of target subjects without labeling data. Compared to previous domain adaptation methods based on the single learner, which may only learn a subset of features from input signals, EDH can learn diverse features by incorporating multiple diverse feature generators and thus increases the accuracy and decreases the variance of classifying target data, but it sacrifices the efficiency. To solve this problem, EDHKD (student) distills the knowledge from the EDH (teacher) to a single network to remain efficient and accurate. The performance of the EDHKD is theoretically proved and experimentally validated on a 2D moon dataset and two public human locomotion datasets. Experimental results show that the EDHKD outperforms all other methods. The EDHKD can classify target data with 96.9%, 94.4%, and 97.4% average accuracy on the above three datasets with a short computing time (1 ms). Compared to a benchmark (BM) method, the EDHKD increases 1.3% and 7.1% average accuracy for classifying the locomotion modes of target subjects. The EDHKD also stabilizes the learning curves. Therefore, the EDHKD is significant for increasing the generalization ability and efficiency of the human intent prediction and human activity recognition system, which will improve human-robot interactions.


title: Saga: A Platform for Continuous Construction and Serving of Knowledge At Scale

abstract: We introduce Saga, a next-generation knowledge construction and serving platform for powering knowledge-based applications at industrial scale. Saga follows a hybrid batch-incremental design to continuously integrate billions of facts about real-world entities and construct a central knowledge graph that supports multiple production use cases with diverse requirements around data freshness, accuracy, and availability. In this paper, we discuss the unique challenges associated with knowledge graph construction at industrial scale, and review the main components of Saga and how they address these challenges. Finally, we share lessons-learned from a wide array of production use cases powered by Saga.


title: Bayesian information engine that optimally exploits noisy measurements

abstract: We have experimentally realized an information engine consisting of an optically trapped, heavy bead in water. The device raises the trap center after a favorable "up" thermal fluctuation, thereby increasing the bead's average gravitational potential energy. In the presence of measurement noise, poor feedback decisions degrade its performance; below a critical signal-to-noise ratio, the engine shows a phase transition and cannot store any gravitational energy. However, using Bayesian estimates of the bead's position to make feedback decisions can extract gravitational energy at all measurement noise strengths and has maximum performance benefit at the critical signal-to-noise ratio.


title: MetaSets: Meta-Learning on Point Sets for Generalizable Representations

abstract: Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critical to learn generalizable representations that can transfer well across different point sets. In this paper, we study a new problem of 3D Domain Generalization (3DDG) with the goal to generalize the model to other unseen domains of point clouds without any access to them in the training process. It is a challenging problem due to the substantial geometry shift from simulated to real data, such that most existing 3D models underperform due to overfitting the complete geometries in the source domain. We propose to tackle this problem via MetaSets, which meta-learns point cloud representations from a group of classification tasks on carefully-designed transformed point sets containing specific geometry priors. The learned representations are more generalizable to various unseen domains of different geometries. We design two benchmarks for Sim-to-Real transfer of 3D point clouds. Experimental results show that MetaSets outperforms existing 3D deep learning methods by large margins.


title: Structural Analysis of Branch-and-Cut and the Learnability of Gomory Mixed Integer Cuts

abstract: The incorporation of cutting planes within the branch-and-bound algorithm, known as branch-and-cut, forms the backbone of modern integer programming solvers. These solvers are the foremost method for solving discrete optimization problems and thus have a vast array of applications in machine learning, operations research, and many other fields. Choosing cutting planes effectively is a major research topic in the theory and practice of integer programming. We conduct a novel structural analysis of branch-and-cut that pins down how every step of the algorithm is affected by changes in the parameters defining the cutting planes added to the input integer program. Our main application of this analysis is to derive sample complexity guarantees for using machine learning to determine which cutting planes to apply during branch-and-cut. These guarantees apply to infinite families of cutting planes, such as the family of Gomory mixed integer cuts, which are responsible for the main breakthrough speedups of integer programming solvers. We exploit geometric and combinatorial structure of branch-and-cut in our analysis, which provides a key missing piece for the recent generalization theory of branch-and-cut.


title: Rapid 3D Multiparametric Mapping of Brain Metastases with Deep Learning-Based Phase-Sensitive MR Fingerprinting

abstract: In MR fingerprinting (MRF) reconstruction, measured data is pattern-matched to simulated signals to extract quantitative tissue parameters. A critical drawback to this approach is the exponentially increasing compute time for mapping of multiple parameters. Previously, a deep learning (DL) reconstruction method called DRONE was shown to overcome this constraint by mapping the magnitude time-series signal to the underlying tissue parameters. However, relaxometry from magnitude images is susceptible to errors arising from ambiguities in the zero crossing of the signal or the non-zero noise mean. The aim of this study is to develop rapid acquisition and quantification methods to enable accurate multiparametric tissue mapping from complex data. An optimized EPI based MRF sequence is developed along with a novel phasesensitive DL quantification allowing the use of real-valued neural networks to reconstruct complex measured data and providing an additional quantitative map of the phase. Phantom experiments demonstrate the accuracy of the proposed approach. A comparison to previous DRONE methods in a healthy subject shows improved fidelity to known T1 and T2 values for the phase-sensitive approach. By processing the estimated phase map with conventional quantitative susceptibility mapping algorithms, we demonstrate the feasibility of simultaneous quantification of proton density, T1, T2, transmitter B1+ field and the quantitative susceptibility maps. In vivo experiments in a healthy volunteer and a subject with metastatic brain cancer are used to illustrate potential applications of this technology for treatment response assessment and tumor characterization.


title: Feature Compression for Rate Constrained Object Detection on the Edge

abstract: Recent advances in computer vision has led to a growth of interest in deploying visual analytics model on mobile devices. However, most mobile devices have limited computing power, which prohibits them from running large scale visual analytics neural networks. An emerging approach to solve this problem is to offload the computation of these neural networks to computing resources at an edge server. Efficient computation offloading requires optimizing the trade-off between multiple objectives including compressed data rate, analytics performance, and computation speed. In this work, we consider a "split computation" system to offload a part of the computation of the YOLO object detection model. We propose a learnable feature compression approach to compress the intermediate YOLO features with light-weight computation. We train the feature compression and decompression module together with the YOLO model to optimize the object detection accuracy under a rate constraint. Compared to baseline methods that apply either standard image compression or learned image compression at the mobile and perform image decompression and YOLO at the edge, the proposed system achieves higher detection accuracy at the low to medium rate range. Furthermore, the proposed system requires substantially lower computation time on the mobile device with CPU only.


title: Machine Learning Approaches to Automated Mechanism Design for Public Project Problem

abstract: Mechanism design is a central research branch in microeconomics. An effective mechanism can significantly improve performance and efficiency of social decisions under desired objectives, such as to maximize social welfare or to maximize revenue for agents. However, mechanism design is challenging for many common models including the public project problem model which we study in this thesis. A typical public project problem is a group of agents crowdfunding a public project (e.g., building a bridge). The mechanism will decide the payment and allocation for each agent (e.g., how much the agent pays, and whether the agent can use it) according to their valuations. The mechanism can be applied to various economic scenarios, including those related to cyber security. There are different constraints and optimized objectives for different public project scenarios (sub-problems), making it unrealistic to design a universal mechanism that fits all scenarios, and designing mechanisms for different settings manually is a taxing job. Therefore, we explore automated mechanism design (AMD) of public project problems under different constraints. In this thesis, we focus on the public project problem, which includes many sub-problems (excludable/non-excludable, divisible/indivisible, binary/non-binary). We study the classical public project model and extend this model to other related areas such as the zero-day exploit markets. For different sub-problems of the public project problem, we adopt different novel machine learning techniques to design optimal or near-optimal mechanisms via automated mechanism design. We evaluate our mechanisms by theoretical analysis or experimentally comparing our mechanisms against existing mechanisms. The experiments and theoretical results show that our mechanisms are better than state-of-the-art automated or manual mechanisms.


title: XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding

abstract: Transformer-based models are widely used in natural language understanding (NLU) tasks, and multimodal transformers have been effective in visual-language tasks. This study explores distilling visual information from pretrained multimodal transformers to pretrained language encoders. Our framework is inspired by cross-modal encoders' success in visual-language tasks while we alter the learning objective to cater to the language-heavy characteristics of NLU. After training with a small number of extra adapting steps and finetuned, the proposed XDBERT (cross-modal distilled BERT) outperforms pretrained-BERT in general language understanding evaluation (GLUE), situations with adversarial generations (SWAG) benchmarks, and readability benchmarks. We analyze the performance of XDBERT on GLUE to show that the improvement is likely visually grounded.


title: Stochastic Search for a Parametric Cost Function Approximation: Energy storage with rolling forecasts

abstract: Rolling forecasts have been almost overlooked in the renewable energy storage literature. In this paper, we provide a new approach for handling uncertainty not just in the accuracy of a forecast, but in the evolution of forecasts over time. Our approach shifts the focus from modeling the uncertainty in a lookahead model to accurate simulations in a stochastic base model. We develop a robust policy for making energy storage decisions by creating a parametrically modified lookahead model, where the parameters are tuned in the stochastic base model. Since computing unbiased stochastic gradients with respect to the parameters require restrictive assumptions, we propose a simulation-based stochastic approximation algorithm based on numerical derivatives to optimize these parameters. While numerical derivatives, calculated based on the noisy function evaluations, provide biased gradient estimates, an online variance reduction technique built in the framework of our proposed algorithm, will enable us to control the accumulated bias errors and establish the finite-time rate of convergence of the algorithm. Our numerical experiments show the performance of this algorithm in finding policies outperforming the deterministic benchmark policy.


title: An \emph{ab initio} study of structural phase transitions of crystalline aluminum under ultrahigh pressures based on ensemble theory

abstract: It is a long-time pursuit of computations with \emph{ab initio} precision of thermal contributions to phase behaviors of condensed matters under extreme conditions. In this work, the pressure induced structural phase transitions of crystalline aluminum up to $600$ GPa at room temperature are investigated based on the criterion of Gibbs free energy derived directly from the partition function that formulated in the ensemble theory with the interatomic interactions characterized by density functional theory computations. The transition pressures of the FCC$\rightarrow$HCP$\rightarrow$BCC phase transitions are determined at $194$ and $361$ GPa, the axial ratio of the stable HCP structure is found to be equal to $1.62$ and the discontinuities in the equations of states are confirmed to be associated with $-0.67\%$ and $-0.90\%$ volume changes, which are all in an excellent agreement with the measurements by one of the recent experiments but differ from other experimental observations. Compared with the results obtained by the criterion of enthalpy at $0$K, this work further shows the nontrivial thermal impacts on the structural stability of aluminum under ultrahigh-pressure circumstances even at room temperature.


title: A review of path following control strategies for autonomous robotic vehicles: theory, simulations, and experiments

abstract: This article presents an in-depth review of the topic of path following for autonomous robotic vehicles, with a specific focus on vehicle motion in two dimensional space (2D). From a control system standpoint, path following can be formulated as the problem of stabilizing a path following error system that describes the dynamics of position and possibly orientation errors of a vehicle with respect to a path, with the errors defined in an appropriate reference frame. In spite of the large variety of path following methods described in the literature we show that, in principle, most of them can be categorized in two groups: stabilization of the path following error system expressed either in the vehicle's body frame or in a frame attached to a "reference point" moving along the path, such as a Frenet-Serret (F-S) frame or a Parallel Transport (P-T) frame. With this observation, we provide a unified formulation that is simple but general enough to cover many methods available in the literature. We then discuss the advantages and disadvantages of each method, comparing them from the design and implementation standpoint. We further show experimental results of the path following methods obtained from field trials testing with under-actuated and fully-actuated autonomous marine vehicles. In addition, we introduce open-source Matlab and Gazebo/ROS simulation toolboxes that are helpful in testing path following methods prior to their integration in the combined guidance, navigation, and control systems of autonomous vehicles.


title: Upper and lower $L^2$-decay bounds for a class of derivative nonlinear Schr\"odinger equations

abstract: We consider the initial value problem for cubic derivative nonlinear Schr\"odinger equations possessing weakly dissipative structure in one space dimension. We show that the small data solution decays like $O((\log t)^{-1/4})$ in $L^2$ as $t\to +\infty$. Furthermore, we find that this $L^2$-decay rate is optimal by giving a lower estimate of the same order.


title: Graph Pooling for Graph Neural Networks: Progress, Challenges, and Opportunities

abstract: Graph neural networks have emerged as a leading architecture for many graph-level tasks, such as graph classification and graph generation. As an essential component of the architecture, graph pooling is indispensable for obtaining a holistic graph-level representation of the whole graph. Although a great variety of methods have been proposed in this promising and fast-developing research field, to the best of our knowledge, little effort has been made to systematically summarize these works. To set the stage for the development of future works, in this paper, we attempt to fill this gap by providing a broad review of recent methods for graph pooling. Specifically, 1) we first propose a taxonomy of existing graph pooling methods with a mathematical summary for each category; 2) then, we provide an overview of the libraries related to graph pooling, including the commonly used datasets, model architectures for downstream tasks, and open-source implementations; 3) next, we further outline the applications that incorporate the idea of graph pooling in a variety of domains; 4) finally, we discuss certain critical challenges facing current studies and share our insights on future potential directions for research on the improvement of graph pooling.


title: Quantum cloning of steering

abstract: Quantum steering in a global state allows an observer to remotely steer a subsystem into different ensembles by performing different local measurements on the other part. We show that, in general, this property cannot be perfectly cloned by any joint operation between a steered subsystem and a third system. Perfect cloning is viable if and only if the initial state is of zero discord. We also investigate the process of cloning the steered qubit of a Bell state using a universal cloning machine. Einstein-Podolsky-Rosen (EPR) steering, which is a type of quantum correlation existing in the states without a local-hidden-state model, is observed in the two copy subsystems. This contradicts the conclusion of no-cloning of quantum steering (EPR steering) [C. Y. Chiu et al., npj Quantum Inf. 2, 16020 (2016)] based on a mutual information criterion for EPR steering.


title: Quantum phases of spin-orbital-angular-momentum coupled bosonic gases in optical lattices

abstract: Spin-orbit coupling plays an important role in understanding exotic quantum phases. In this work, we present a scheme to combine spin-orbital-angular-momentum (SOAM) coupling and strong correlations in ultracold atomic gases. Essential ingredients of this setting is the interplay of SOAM coupling and Raman-induced spin-flip hopping, engineered by lasers that couples different hyperfine spin states. In the presence of SOAM coupling only, we find rich quantum phases in the Mott-insulating regime, which support different types of spin defects such as spin vortex and composite vortex with antiferromagnetic core surrounded by the outer spin vortex. Based on an effective exchange model, we find that these competing spin textures are a result of the interplay of Dzyaloshinskii-Moriya and Heisenberg exchange interactions. In the presence of both SOAM coupling and Raman-induced spin-flip hopping, more many-body phases appear, including canted-antiferromagnetic and stripe phases. Our prediction suggests that SOAM coupling could induce rich exotic many-body phases in the strongly interacting regime.


title: Joint DoA-Range Estimation Using Space-Frequency Virtual Difference Coarray

abstract: In this paper, we address the problem of joint direction-of-arrival (DoA) and range estimation using frequency diverse coprime array (FDCA). By incorporating the coprime array structure and coprime frequency offsets, a two-dimensional space-frequency virtual difference coarray corresponding to uniform array and uniform frequency offset is considered to increase the number of degrees-of-freedom (DoFs). However, the reconstruction of the doubly-Toeplitz covariance matrix is computationally prohibitive. To solve this problem, we propose an interpolation algorithm based on decoupled atomic norm minimization (DANM), which converts the coarray signal to a simple matrix form. On this basis, a relaxation-based optimization problem is formulated to achieve joint DoA-range estimation with enhanced DoFs. The reconstructed coarray signal enables application of existing subspace-based spectral estimation methods. The proposed DANM problem is further reformulated as an equivalent rank-minimization problem which is solved by cyclic rank minimization. This approach avoids the approximation errors introduced in nuclear norm-based approach, thereby achieving superior root-mean-square error which is closer to the Cramer-Rao bound. The effectiveness of proposed method is confirmed by theoretical analyses and numerical simulations.


title: Sylvester power and weighted sums on the Frobenius set in arithmetic progression

abstract: Let $a_1,a_2,\dots,a_k$ be positive integers with $\gcd(a_1,a_2,\dots,a_k)=1$. Frobenius number is the largest positive integer that is NOT representable in terms of $a_1,a_2,\dots,a_k$. When $k\ge 3$, there is no explicit formula in general, but some formulae may exist for special sequences $a_1,a_2,\dots,a_k$, including, those forming arithmetic progressions and their modifications. In this paper, we give formulae for the power and weighted sum of nonrepresentable positive integers. As applications, we show explicit expressions of these sums for $a_1,a_2,\dots,a_k$ forming arithmetic progressions.


title: Spin Conductivity Based on Magnetic Toroidal Quadrupole Hidden in Antiferromagnets

abstract: We report our theoretical results on spin conductivity in antiferromagnets by focusing on the role of the magnetic toroidal quadrupole (MTQ) in electron systems. The MTQ is characterized as a time-reversal-odd rank-2 polar tensor degree of freedom in electrons, which is distinct from conventional rank-1 magnetic and magnetic toroidal dipoles. Based on a microscopic $sd$ model analysis for a tetragonal system under both collinear and noncollinear antiferromagnetic orderings, we clarify that the MTQ becomes a source of an extrinsic spin conductivity even with neither a uniform magnetization nor spin-orbit coupling. We also list all the magnetic point groups to accommodate the MTQs as a primary order parameter as well as the candidate antiferromagnetic materials.


title: Data structures for computing unique palindromes in static and non-static strings

abstract: A palindromic substring $T[i.. j]$ of a string $T$ is said to be a shortest unique palindromic substring (SUPS) in $T$ for an interval $[p, q]$ if $T[i.. j]$ is a shortest palindromic substring such that $T[i.. j]$ occurs only once in $T$, and $[i, j]$ contains $[p, q]$. The SUPS problem is, given a string $T$ of length $n$, to construct a data structure that can compute all the SUPSs for any given query interval. It is known that any SUPS query can be answered in $O(\alpha)$ time after $O(n)$-time preprocessing, where $\alpha$ is the number of SUPSs to output [Inoue et al., 2018]. In this paper, we first show that $\alpha$ is at most $4$, and the upper bound is tight. We also show that the total sum of lengths of minimal unique palindromic substrings of string $T$, which is strongly related to SUPSs, is $O(n)$. Then, we present the first $O(n)$-bits data structures that can answer any SUPS query in constant time. Also, we present an algorithm to solve the SUPS problem for a sliding window that can answer any query in $O(\log\log W)$ time and update data structures in amortized $O(\log\sigma + \log\log W)$ time, where $W$ is the size of the window, and $\sigma$ is the alphabet size. Furthermore, we consider the SUPS problem in the after-edit model and present an efficient algorithm. Namely, we present an algorithm that uses $O(n)$ time for preprocessing and answers any $k$ SUPS queries in $O(\log n\log\log n + k\log\log n)$ time after single character substitution. Finally, as a by-product, we propose a fully-dynamic data structure for range minimum queries (RmQs) with a constraint where the width of each query range is limited to poly-logarithmic. The constrained RmQ data structure can answer such a query in constant time and support a single-element edit operation in amortized constant time.


title: Knowledgebra: An Algebraic Learning Framework for Knowledge Graph

abstract: Knowledge graph (KG) representation learning aims to encode entities and relations into dense continuous vector spaces such that knowledge contained in a dataset could be consistently represented. Dense embeddings trained from KG datasets benefit a variety of downstream tasks such as KG completion and link prediction. However, existing KG embedding methods fell short to provide a systematic solution for the global consistency of knowledge representation. We developed a mathematical language for KG based on an observation of their inherent algebraic structure, which we termed as Knowledgebra. By analyzing five distinct algebraic properties, we proved that the semigroup is the most reasonable algebraic structure for the relation embedding of a general knowledge graph. We implemented an instantiation model, SemE, using simple matrix semigroups, which exhibits state-of-the-art performance on standard datasets. Moreover, we proposed a regularization-based method to integrate chain-like logic rules derived from human knowledge into embedding training, which further demonstrates the power of the developed language. As far as we know, by applying abstract algebra in statistical learning, this work develops the first formal language for general knowledge graphs, and also sheds light on the problem of neural-symbolic integration from an algebraic perspective.


title: Risk-Aware Stability, Ultimate Boundedness, and Positive Invariance

abstract: This paper introduces the notions of stability, ultimate boundedness, and positive invariance for stochastic systems in the view of risk. More specifically, those notions are defined in terms of the worst-case Conditional Value-at-Risk (CVaR), which quantifies the worst-case conditional expectation of losses exceeding a certain threshold over a set of possible uncertainties. Those notions allow us to focus our attention on the tail behavior of stochastic systems in the analysis of dynamical systems and the design of controllers. Furthermore, some event-triggered control strategies that guarantee ultimate boundedness and positive invariance with specified bounds are derived using the obtained results and illustrated using numerical examples.


title: Differentially Private Distributed Mismatch Tracking Algorithm for Constraint-Coupled Resource Allocation Problems

abstract: This paper considers privacy-concerned distributed constraint-coupled resource allocation problems over an undirected network, where each agent holds a private cost function and obtains the solution via only local communication. With privacy concerns, we mask the exchanged information with independent Laplace noise against a potential attacker with potential access to all network communications. We propose a differentially private distributed mismatch tracking algorithm (diff-DMAC) to achieve cost-optimal distribution of resources while preserving privacy. Adopting constant stepsizes, the linear convergence property of diff-DMAC in mean square is established under the standard assumptions of Lipschitz gradients and strong convexity. Moreover, it is theoretically proven that the proposed algorithm is {\epsilon}-differentially private.And we also show the trade-off between convergence accuracy and privacy level. Finally, a numerical example is provided for verification.


title: Accelerating Noisy VQE Optimization with Gaussian Processes

abstract: Hybrid variational quantum algorithms, which combine a classical optimizer with evaluations on a quantum chip, are the most promising candidates to show quantum advantage on current noisy, intermediate-scale quantum (NISQ) devices. The classical optimizer is required to perform well in the presence of noise in the objective function evaluations, or else it becomes the weakest link in the algorithm. We introduce the use of Gaussian Processes (GP) as surrogate models to reduce the impact of noise and to provide high quality seeds to escape local minima, whether real or noise-induced. We build this as a framework on top of local optimizations, for which we choose Implicit Filtering (ImFil) in this study. ImFil is a state-of-the-art, gradient-free method, which in comparative studies has been shown to outperform on noisy VQE problems. The result is a new method: "GP+ImFil". We show that when noise is present, the GP+ImFil approach finds results closer to the true global minimum in fewer evaluations than standalone ImFil, and that it works particularly well for larger dimensional problems. Using GP to seed local searches in a multi-modal landscape shows mixed results: although it is capable of improving on ImFil standalone, it does not do so consistently and would only be preferred over other, more exhaustive, multistart methods if resources are constrained.


title: Instantaneous Emission Rate of Electron Transport through a quantum point contact

abstract: We present a theory to describe the instantaneous emission rate of electron transport in quantum-coherent conductors. Due to the Pauli exclusion principle, electron emission events are usually correlated. This makes the emission rate is not a constant, but depends on the history of the emission process. To incorporate such history dependence, in this paper we characterize the emission rate via the conditional intensity function, which has been introduced in the theory of random point process. The conditional intensity function can be treated as the instantaneous emission rate observed by an ideal single-electron detector since a given starting time. We demonstrate the method by studying the instantaneous emission rate of a single-channel quantum point contact driven by a constant voltage. As the quantum point contact is opened up, we show that the emission process evolves from a simple Poisson process close to pinch-off to a non-renewal process at full transmission. These results shows that the conditional intensity function can provide an intuitive and unified description of the emission process in quantum-coherent conductors.


title: Topology optimization for additive manufacturing with length scale, overhang, and building orientation constraints

abstract: This paper presents a density-based topology optimization approach considering additive manufacturing limitations. The presented method considers the minimum size of parts, the minimum size of cavities, the inability of printing overhanging parts without the use of sacrificial supporting structures, and the printing directions. These constraints are geometrically addressed and implemented. The minimum size on solid and void zones is imposed through a well-known filtering technique. The sacrificial support material is reduced using a constraint that limits the maximum overhang angle of parts by comparing the structural gradient with a critical reference slope. Due to the local nature of the gradient, the chosen restriction is prone to introduce parts that meet the structural slope but that may not be self-supporting. The restriction limits the maximum overhang angle for a user-defined printing direction, which could reduce structural performance if the orientation is not properly selected. To ease these challenges, a new approach to reduce the introduction of such non-self-supporting parts and a novel method that includes different printing directions in the maximum overhang angle constraint are presented. The proposed strategy for considering the minimum size of solid and void phases, maximum overhang angle, and printing direction, is illustrated by solving a set of 2D benchmark design problems including stiff structures and compliant mechanisms. We also provide MATLAB codes in the appendix for educational purposes and for replication of the results.


title: Effect of right-handed currents and dark side of the solar neutrino parameter space to Neutrinoless Double Beta Decay

abstract: The Majorana nature of neutrinos will be the confirmed by the observation of the rare process called as neutrinoless double beta decay process, i.e. the simultaneous decay of two neutrons in the nucleus of an isotope (A, Z) into two protons and two electrons without the emission of any neutrinos i.e, $(A, Z) \to (A, Z + 2) + 2 e^-$. The non-observation of such a decay so far has been interpreted as a lower limit on the half life of the isotope under investigation, which puts severe constraints on any new physics giving rise to LNV in the electron sector. On the other hand, the standard mechanism with normal ordering and inverted ordering can not saturate the present experimental limit while quasi-degenerate light neutrinos are strongly disfavored by the upper limits on the sum of light neutrino masses from cosmological data sets. In this work, we show that how dark side of the solar neutrino parameter space and effect of new physics contributions from right-handed currents can saturate the experimental limit provided by KamLAND-Zen and GERDA.


title: A Keypoint-based Global Association Network for Lane Detection

abstract: Lane detection is a challenging task that requires predicting complex topology shapes of lane lines and distinguishing different types of lanes simultaneously. Earlier works follow a top-down roadmap to regress predefined anchors into various shapes of lane lines, which lacks enough flexibility to fit complex shapes of lanes due to the fixed anchor shapes. Lately, some works propose to formulate lane detection as a keypoint estimation problem to describe the shapes of lane lines more flexibly and gradually group adjacent keypoints belonging to the same lane line in a point-by-point manner, which is inefficient and time-consuming during postprocessing. In this paper, we propose a Global Association Network (GANet) to formulate the lane detection problem from a new perspective, where each keypoint is directly regressed to the starting point of the lane line instead of point-by-point extension. Concretely, the association of keypoints to their belonged lane line is conducted by predicting their offsets to the corresponding starting points of lanes globally without dependence on each other, which could be done in parallel to greatly improve efficiency. In addition, we further propose a Lane-aware Feature Aggregator (LFA), which adaptively captures the local correlations between adjacent keypoints to supplement local information to the global association. Extensive experiments on two popular lane detection benchmarks show that our method outperforms previous methods with F1 score of 79.63% on CULane and 97.71% on Tusimple dataset with high FPS. The code will be released at https://github.com/Wolfwjs/GANet.


title: Preparing for the Future -- Rethinking Proxy Apps

abstract: A considerable amount of research and engineering went into designing proxy applications, which represent common high-performance computing workloads, to co-design and evaluate the current generation of supercomputers, e.g., RIKEN's Supercomputer Fugaku, ANL's Aurora, or ORNL's Frontier. This process was necessary to standardize the procurement while avoiding duplicated effort at each HPC center to develop their own benchmarks. Unfortunately, proxy applications force HPC centers and providers (vendors) into a an undesirable state of rigidity, in contrast to the fast-moving trends of current technology and future heterogeneity. To accommodate an extremely-heterogeneous future, we have to reconsider how to co-design supercomputers during the next decade, and avoid repeating the past mistakes. This position paper outlines the current state-of-the-art in system co-design, challenges encountered over the past years, and a proposed plan to move forward.


title: Training Entire-Space Models for Target-oriented Opinion Words Extraction

abstract: Target-oriented opinion words extraction (TOWE) is a subtask of aspect-based sentiment analysis (ABSA). Given a sentence and an aspect term occurring in the sentence, TOWE extracts the corresponding opinion words for the aspect term. TOWE has two types of instance. In the first type, aspect terms are associated with at least one opinion word, while in the second type, aspect terms do not have corresponding opinion words. However, previous researches trained and evaluated their models with only the first type of instance, resulting in a sample selection bias problem. Specifically, TOWE models were trained with only the first type of instance, while these models would be utilized to make inference on the entire space with both the first type of instance and the second type of instance. Thus, the generalization performance will be hurt. Moreover, the performance of these models on the first type of instance cannot reflect their performance on entire space. To validate the sample selection bias problem, four popular TOWE datasets containing only aspect terms associated with at least one opinion word are extended and additionally include aspect terms without corresponding opinion words. Experimental results on these datasets show that training TOWE models on entire space will significantly improve model performance and evaluating TOWE models only on the first type of instance will overestimate model performance.


title: Energy Extraction via Magnetic Reconnection in the Ergosphere of a rotating non-Kerr Black Hole

abstract: Magnetic reconnection process in the ergosphere is investigated for a relativistic plasma around a rotating non-Kerr black hole. For a rotating non-Kerr black hole immersed in magnetic field generated by an externally material, anti-parallel magnetic field line could form in the ergosphere due to the frame dragging. Therefore, magnetic reconnection could occur in the ergosphere. Such magnetic reconnection may generate negative energy at infinity by redistributing the angular momentum during the process. The results show that, with the effect of the deformed parameter, extraction of energy from a rotating non-Kerr black hole by magnetic reconnection could be enhanced in the presence of a positive deformed parameter.


title: Properties of solutions of matrix Riccati equations

abstract: In this paper we study properties of regular solutions of matrix Riccati equations. The obtained results are used to study the asymptotic behavior of solutions of linear systems of ordinary differential equations.


title: Fragmentation of the $^4$He$_2$ dimer by relativistic highly charged projectiles in collisions with small kinetic energy release

abstract: We study theoretically the fragmentation of the helium dimer, $^4$He$_2$, into singly charged ions in collisions with relativistic highly-charged projectiles. We discuss the main mechanisms driving this process with the focus on the fragmentation caused by direct ionization of both atomic sites of the dimer in a single collision with the projectile. This direct mechanism dominates the He$_2$ $\to $ He$^+$ + He$^+$ breakup events with the kinetic energies of the emerging ionic fragments below $4$--$5$ eV. We explore the energy and angular distributions of the He$^+$ ions produced in collisions with $1$ and $7$ GeV/u U$^{92+}$ projectiles and show that their shape is significantly affected by relativistic and higher-order effects in the interaction between the projectile and the dimer. We also show that the shape of the energy spectrum is quite sensitive to the binding energy of the He$_2$ dimer which can be exploited for its precise determination. The contribution of the direct mechanism to the total cross section for the He$_2$ fragmentation by $1$ and $7$ GeV/u U$^{92+}$ was calculated to be $3.65$ Mb and $2.4$ Mb, respectively, representing roughly half of this cross section.


title: LaMemo: Language Modeling with Look-Ahead Memory

abstract: Although Transformers with fully connected self-attentions are powerful to model long-term dependencies, they are struggling to scale to long texts with thousands of words in language modeling. One of the solutions is to equip the model with a recurrence memory. However, existing approaches directly reuse hidden states from the previous segment that encodes contexts in a uni-directional way. As a result, this prohibits the memory to dynamically interact with the current context that provides up-to-date information for token prediction. To remedy this issue, we propose Look-Ahead Memory (LaMemo) that enhances the recurrence memory by incrementally attending to the right-side tokens, and interpolating with the old memory states to maintain long-term information in the history. LaMemo embraces bi-directional attention and segment recurrence with an additional computation overhead only linearly proportional to the memory length. Experiments on widely used language modeling benchmarks demonstrate its superiority over the baselines equipped with different types of memory.


title: Curvature-driven instabilities in thin active shells

abstract: Spontaneous material shape changes, such as swelling, growth or thermal expansion, can be used to trigger dramatic elastic instabilities in thin shells. These instabilities originate in geometric incompatibility between the preferred extrinsic and intrinsic curvature of the shell, which may be modified by active deformations through the thickness and in plane respectively. Here, we solve the simplest possible model of such instabilities, which assumes the shells are shallow, thin enough to bend but not stretch, and subject to homogeneous preferred curvatures. We consider separately the cases of zero, positive and negative Gaussian curvature. We identify two types of super-critical symmetry breaking instability, in which the shell's principal curvature spontaneously breaks discrete up-down symmetry and continuous planar isotropy respectively. These are then augmented by inversion instabilities, in which the shell jumps sub-critically between up/down broken symmetry states, and rotation instabilities, in which the curvatures rotate by 90 degrees between states of broken isotropy without release of energy. Each instability has a thickness independent threshold value for the preferred extrinsic curvature proportional to the square-root of Gauss curvature. Finally, we show that the threshold for the isotropy-breaking instability is the same for deep spherical caps, in good agreement with recently published data.


title: $T_2$-limited dc Quantum Magnetometry via Flux Modulation

abstract: High-sensitivity magnetometry is of critical importance to the fields of biomagnetism and geomagnetism. However, the magnetometry for the low-frequency signal detection meets the challenge of sensitivity improvement, due to multiple types of low-frequency noise sources. In particular, for the solid-state spin quantum magnetometry, the sensitivity of low frequency magnetic field has been limited by short $T_2^*$. Here, we demonstrate a $T_2$-limited dc quantum magnetometry based on the nitrogen-vacancy centers in diamond. The magnetometry, combining the flux modulation and the spin-echo protocol, promotes the sensitivity from being limited by $T_2^*$ to $T_2$ of orders of magnitude longer. The sensitivity of the dc magnetometry of 32 $\rm pT/Hz^{1/2}$ has been achieved, overwhelmingly improved by 100 folds over the Ramsey-type method result of 4.6 $\rm nT/Hz^{1/2}$. Further enhancement of the sensitivity have been systematically analyzed, although challenging but plenty of room is achievable. Our result sheds light on realization of room temperature dc quantum magnetomerty with femtotesla-sensitivity in the future.


title: CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging

abstract: Recently, self-supervised instance discrimination methods have achieved significant success in learning visual representations from unlabeled photographic images. However, given the marked differences between photographic and medical images, the efficacy of instance-based objectives, focusing on learning the most discriminative global features in the image (i.e., wheels in bicycle), remains unknown in medical imaging. Our preliminary analysis showed that high global similarity of medical images in terms of anatomy hampers instance discrimination methods for capturing a set of distinct features, negatively impacting their performance on medical downstream tasks. To alleviate this limitation, we have developed a simple yet effective self-supervised framework, called Context-Aware instance Discrimination (CAiD). CAiD aims to improve instance discrimination learning by providing finer and more discriminative information encoded from a diverse local context of unlabeled medical images. We conduct a systematic analysis to investigate the utility of the learned features from a three-pronged perspective: (i) generalizability and transferability, (ii) separability in the embedding space, and (iii) reusability. Our extensive experiments demonstrate that CAiD (1) enriches representations learned from existing instance discrimination methods; (2) delivers more discriminative features by adequately capturing finer contextual information from individual medial images; and (3) improves reusability of low/mid-level features compared to standard instance discriminative methods. As open science, all codes and pre-trained models are available on our GitHub page: https://github.com/JLiangLab/CAiD.


title: Extremal sequences for the unit-weighted Gao constant of $\mathbb Z_n$

abstract: For $A\subseteq \mathbb Z_n$, the $A$-weighted Gao constant $E_A(n)$ is defined to be the smallest natural number $k$, such that any sequence of $k$ elements in $\mathbb Z_n$ has a subsequence of length $n$, whose $A$-weighted sum is zero. Sequences of length $E_A(n)-1$ in $\mathbb Z_n$, which do not have any $A$-weighted zero-sum subsequence of length $n$ are called $A$-extremal sequences for the Gao constant. Such a sequence which has $n-1$ zeroes is said to be of the standard type. When $A=U(n)$ (units in $\mathbb Z_n$) where $n$ is odd, we characterize all such sequences and show that they are of the standard type. When $n$ is even, we give examples of such sequences which are not of the standard type. We also characterize the $U(n)$-extremal sequences for the Gao constant, when $n=2^rp$, where $p$ is an odd prime.


title: MVSTER: Epipolar Transformer for Efficient Multi-View Stereo

abstract: Learning-based Multi-View Stereo (MVS) methods warp source images into the reference camera frustum to form 3D volumes, which are fused as a cost volume to be regularized by subsequent networks. The fusing step plays a vital role in bridging 2D semantics and 3D spatial associations. However, previous methods utilize extra networks to learn 2D information as fusing cues, underusing 3D spatial correlations and bringing additional computation costs. Therefore, we present MVSTER, which leverages the proposed epipolar Transformer to learn both 2D semantics and 3D spatial associations efficiently. Specifically, the epipolar Transformer utilizes a detachable monocular depth estimator to enhance 2D semantics and uses cross-attention to construct data-dependent 3D associations along epipolar line. Additionally, MVSTER is built in a cascade structure, where entropy-regularized optimal transport is leveraged to propagate finer depth estimations in each stage. Extensive experiments show MVSTER achieves state-of-the-art reconstruction performance with significantly higher efficiency: Compared with MVSNet and CasMVSNet, our MVSTER achieves 34% and 14% relative improvements on the DTU benchmark, with 80% and 51% relative reductions in running time. MVSTER also ranks first on Tanks&Temples-Advanced among all published works. Code is released at https://github.com/JeffWang987.


title: Crowd counting with crowd attention convolutional neural network

abstract: Crowd counting is a challenging problem due to the scene complexity and scale variation. Although deep learning has achieved great improvement in crowd counting, scene complexity affects the judgement of these methods and they usually regard some objects as people mistakenly; causing potentially enormous errors in the crowd counting result. To address the problem, we propose a novel end-to-end model called Crowd Attention Convolutional Neural Network (CAT-CNN). Our CAT-CNN can adaptively assess the importance of a human head at each pixel location by automatically encoding a confidence map. With the guidance of the confidence map, the position of human head in estimated density map gets more attention to encode the final density map, which can avoid enormous misjudgements effectively. The crowd count can be obtained by integrating the final density map. To encode a highly refined density map, the total crowd count of each image is classified in a designed classification task and we first explicitly map the prior of the population-level category to feature maps. To verify the efficiency of our proposed method, extensive experiments are conducted on three highly challenging datasets. Results establish the superiority of our method over many state-of-the-art methods.


title: Search for periodic radio emission of gamma pulsar J0357+3205

abstract: The search for radio emission from the gamma pulsar J0357+3205 in the meter wavelength range was carried out. Periodic emission was found in one of the 1,700 observation sessions. The average pulsar profile is single-component with a half-width of 20-25 ms. Estimation of the pulsar flux density is 14 mJy.


title: Gravitational Waves from Double White Dwarfs as probes of the Milky Way

abstract: Future gravitational wave detectors, such as the Laser Interferometer Space Antenna (\textit{LISA}), will be able to resolve a significant number of the ultra compact stellar-mass binaries in our own Galaxy and its neighborhood. These will be mostly double white dwarf (DWD) binaries, and their underlying population characteristics can be directly correlated to the different properties of the Galaxy. In particular, with \textit{LISA} we will be able to resolve $\sim\mathcal{O}(10^4)$ binaries, while the rest will generate a confusion foreground signal. Analogously to how the total electromagnetic radiation emitted by a galaxy can be related to the underlying total stellar mass, in this work we propose a framework to infer the same quantity by investigating the spectral shape and amplitude of the confusion foreground signal. For a fixed DWD evolution model, and thus a fixed binary fraction, we retrieve percentage-level relative errors on the total stellar mass, which improves for increasing values of the mass. At the same time, we find that variations in the Milky Way shape, at a fixed mass and at scale heights smaller than 500~pc, are not distinguishable based on the shape of stochastic signal alone. We perform this analysis on simulations of the LISA data, estimating the resolvable sources based on signal-to-noise criteria. Finally, we utilize the catalogue of resolvable sources to probe the characteristics of the underlying population of DWD binaries. We show that the DWD frequency, coalescence time and chirp mass (up to $<0.7\,$M$_\odot$) distributions can be reconstructed from \textit{LISA} data with no bias.

categories: astro-ph.GA gr-qc physics.data-an physics.space-ph


title: Condition-Invariant and Compact Visual Place Description by Convolutional Autoencoder

abstract: Visual place recognition (VPR) in condition-varying environments is still an open problem. Popular solutions are CNN-based image descriptors, which have been shown to outperform traditional image descriptors based on hand-crafted visual features. However, there are two drawbacks of current CNN-based descriptors: a) their high dimension and b) lack of generalization, leading to low efficiency and poor performance in applications. In this paper, we propose to use a convolutional autoencoder (CAE) to tackle this problem. We employ a high-level layer of a pre-trained CNN to generate features, and train a CAE to map the features to a low-dimensional space to improve the condition invariance property of the descriptor and reduce its dimension at the same time. We verify our method in three challenging datasets involving significant illumination changes, and our method is shown to be superior to the state-of-the-art. For the benefit of the community, we make public the source code.


title: Exciton spectroscopy and diffusion in MoSe2-WSe2 lateral heterostructures encapsulated in hexagonal boron nitride

abstract: Chemical vapor deposition (CVD) allows lateral edge epitaxy of transition metal dichalcogenide heterostructures with potential applications in optoelectronics. Critical for carrier and exciton transport is the quality of the two materials that constitute the monolayer and the nature of the lateral heterojunction. Important details of the optical properties were inaccessible in as-grown heterostructure samples due to large inhomogeneous broadening of the optical transitions. Here we perform optical spectroscopy at T = 4 K and also at 300 K to access the optical transitions in CVD grown MoSe2-WSe2 lateral heterostructures that are transferred from the growth-substrate and are encapsulated in hBN. Photoluminescence (PL), reflectance contrast and Raman spectroscopy reveal considerably narrowed optical transition linewidth similar to high quality exfoliated monolayers. In high-resolution transmission electron microscopy (HRTEM) we find near-atomically sharp junctions with a typical extent of 3nm for the covalently bonded MoSe2-WSe2. In PL imaging experiments we find effective excitonic diffusion length that are longer for WSe2 than for MoSe2 at low T=4 K, whereas at 300 K this trend is reversed.


title: A Differentially Private Probabilistic Framework for Modeling the Variability Across Federated Datasets of Heterogeneous Multi-View Observations

abstract: We propose a novel federated learning paradigm to model data variability among heterogeneous clients in multi-centric studies. Our method is expressed through a hierarchical Bayesian latent variable model, where client-specific parameters are assumed to be realization from a global distribution at the master level, which is in turn estimated to account for data bias and variability across clients. We show that our framework can be effectively optimized through expectation maximization (EM) over latent master's distribution and clients' parameters. We also introduce formal differential privacy (DP) guarantees compatibly with our EM optimization scheme. We tested our method on the analysis of multi-modal medical imaging data and clinical scores from distributed clinical datasets of patients affected by Alzheimer's disease. We demonstrate that our method is robust when data is distributed either in iid and non-iid manners, even when local parameters perturbation is included to provide DP guarantees. Moreover, the variability of data, views and centers can be quantified in an interpretable manner, while guaranteeing high-quality data reconstruction as compared to state-of-the-art autoencoding models and federated learning schemes. The code is available at https://gitlab.inria.fr/epione/federated-multi-views-ppca.


title: Anomalous Sound Detection Based on Machine Activity Detection

abstract: We have developed an unsupervised anomalous sound detection method for machine condition monitoring that utilizes an auxiliary task -- detecting when the target machine is active. First, we train a model that detects machine activity by using normal data with machine activity labels and then use the activity-detection error as the anomaly score for a given sound clip if we have access to the ground-truth activity labels in the inference phase. If these labels are not available, the anomaly score is calculated through outlier detection on the embedding vectors obtained by the activity-detection model. Solving this auxiliary task enables the model to learn the difference between the target machine sounds and similar background noise, which makes it possible to identify small deviations in the target sounds. Experimental results showed that the proposed method improves the anomaly-detection performance of the conventional method complementarily by means of an ensemble.


title: WIP: Achieving Self-Interference-Free Operation on SDR Platform with Critical TDD Turnaround Time

abstract: Software Defined Radio (SDR) platforms are valuable for research and development activities or high-end systems that demand real-time adaptable wireless protocols. While low latency can be achieved using the dedicated digital processing unit of a state-of-the-art SDR platform, its Radio Frequency (RF) front-end often poses a limitation in terms of turnaround time (TT), the time needed for switching from the receiving to the transmitting mode (or vice versa). Zero Intermediate Frequency (ZIF) transceivers are favorable for SDR, but suffer from self-interference even if the device is not currently transmitting. The strict MAC-layer requirements of Time Division Duplex (TDD) protocols like Wi-Fi cannot be achieved using configurable ZIF transceivers without having to compromise receiver sensitivity. Using a novel approach, we show that the TT using the AD9361 RF front-end can be as low as 640 ns, while the self-interference is at the same level as achieved by the conventional TDD mode, which has a TT of at least 55 {\mu}s. As compared to Frequency Division Duplex (FDD) mode, a decrease of receiver noise floor by about 13 dB in the 2.4 GHz band and by about 4.5 dB in the 5 GHz band is achieved.