title: 1 Low power continuous-wave nonlinear optics in silica glass integrated waveguide structures

abstract: Photonic integrated circuits (PICs) are a key component [1] for future telecommunication networks, where demands for greater bandwidth, network flexibility, low energy consumption and cost must all be met. The quest for all optical components has naturally targeted materials with extremely large nonlinearity, including chalcogenide glasses (ChG) [2] and semiconductors, such as silicon [3] and AlGaAs [4]. Yet issues such as immature fabrication technologies for ChG, and high linear and nonlinear losses for semiconductors, motivate the search for other materials. Here we present the first demonstration of nonlinear optics in integrated silica based glass waveguides using continuous wave (CW) light. We demonstrate four wave mixing (FWM), with low (7mW) CW pump power at a wavelength of 1550nm, in high index doped silica glass ring resonators capable of performing in photonic telecommunications networks as linear filters [5]. The high reliability, design flexibility, and manufacturability of our device raises the possibility of a new platform for future low cost nonlinear all optical PICs.


title: Underproduction: An Approach for Measuring Risk in Open Source Software

abstract: The widespread adoption of Free/Libre and Open Source Software (FLOSS) means that the ongoing maintenance of many widely used software components relies on the collaborative effort of volunteers who set their own priorities and choose their own tasks. We argue that this has created a new form of risk that we call 'underproduction' which occurs when the supply of software engineering labor becomes out of alignment with the demand of people who rely on the software produced. We present a conceptual framework for identifying relative underproduction in software as well as a statistical method for applying our framework to a comprehensive dataset from the Debian GNU/Linux distribution that includes 21,902 source packages and the full history of 461,656 bugs. We draw on this application to present two experiments: (1) a demonstration of how our technique can be used to identify at-risk software packages in a large FLOSS repository and (2) a validation of these results using an alternate indicator of package risk. Our analysis demonstrates both the utility of our approach and reveals the existence of widespread underproduction in a range of widely-installed software components in Debian.


title: Non-unitarity of Minkowskian non-local quantum field theories

abstract: We show that Minkowskian non-local quantum field theories are not unitary. We consider a simple one loop diagram for a scalar non-local field and show that the imaginary part of the corresponding complex amplitude is not given by Cutkosky rules, indeed this diagram violates the unitarity condition. We compare this result with the case of an Euclidean non-local scalar field, that has been shown to satisfy the Cutkosky rules, and we clearly identify the reason of the breaking of unitarity of the Minkowskian theory.


title: Critical behavior of the 2d scalar theory: resumming the ${\rm N}^8{\rm LO}$ perturbative mass gap

abstract: We apply the optimized perturbation theory (OPT) to resum the perturbative series describing the mass gap of the bidimensional $\phi^4$ theory in the $\mathbb{Z}_2$ symmetric phase. Already at NLO (one loop) the method is capable of generating a quite reasonable non-perturbative result for the critical coupling. At order-$g^7$ we obtain $g_c = 2.779(25)$ which compares very well with the state of the art ${\rm N}^8{\rm LO}$ result, $g_c = 2.807(34)$. As a novelty we investigate the supercritical region showing that it contains some useful complimentary information that can be used in extrapolations to arbitrarily high orders.


title: SUM: A Benchmark Dataset of Semantic Urban Meshes

abstract: Recent developments in data acquisition technology allow us to collect 3D texture meshes quickly. Those can help us understand and analyse the urban environment, and as a consequence are useful for several applications like spatial analysis and urban planning. Semantic segmentation of texture meshes through deep learning methods can enhance this understanding, but it requires a lot of labelled data. The contributions of this work are threefold: (1) a new benchmark dataset of semantic urban meshes, (2) a novel semi-automatic annotation framework, and (3) an annotation tool for 3D meshes. In particular, our dataset covers about 4 km2 in Helsinki (Finland), with six classes, and we estimate that we save about 600 hours of labelling work using our annotation framework, which includes initial segmentation and interactive refinement. We also compare the performance of several state-of-theart 3D semantic segmentation methods on the new benchmark dataset. Other researchers can use our results to train their networks: the dataset is publicly available, and the annotation tool is released as open-source.


title: Online Behavioral Analysis with Application to Emotion State Identification

abstract: In this paper, we propose a novel discriminative model for online behavioral analysis with application to emotion state identification. The proposed model is able to extract more discriminative characteristics from behavioral data effectively and find the direction of optimal projection efficiently to satisfy requirements of online data analysis, leading to better utilization of the behavioral information to produce more accurate recognition results.


title: A Central Limit Theorem for Diffusion in Sparse Random Graphs

abstract: We consider bootstrap percolation and diffusion in sparse random graphs with fixed degrees, constructed by configuration model. Every node has two states: it is either active or inactive. We assume that to each node is assigned a nonnegative (integer) threshold. The diffusion process is initiated by a subset of nodes with threshold zero which consists of initially activated nodes, whereas every other node is inactive. Subsequently, in each round, if an inactive node with threshold $\theta$ has at least $\theta$ of its neighbours activated, then it also becomes active and remains so forever. This is repeated until no more nodes become activated. The main result of this paper provides a central limit theorem for the final size of activated nodes. Namely, under suitable assumptions on the degree and threshold distributions, we show that the final size of activated nodes has asymptotically Gaussian fluctuations.


title: A Holistic Motion Planning and Control Solution to Challenge a Professional Racecar Driver

abstract: We present a holistically designed three layer control architecture capable of outperforming a professional driver racing the same car. Our approach focuses on the co-design of the motion planning and control layers, extracting the full potential of the connected system. First, a high-level planner computes an optimal trajectory around the track, then in real-time a mid-level nonlinear model predictive controller follows this path using the high-level information as guidance. Finally a high frequency, low-level controller tracks the states predicted by the mid-level controller. Tracking the predicted behavior has two advantages: it reduces the mismatch between the model used in the upper layers and the real car, and allows for a torque vectoring command to be optimized by the higher level motion planners. The tailored design of the low-level controller proved to be crucial for bridging the gap between planning and control, unlocking unseen performance in autonomous racing. The proposed approach was verified on a full size racecar, considerably improving over the state-of-the-art results achieved on the same vehicle. Finally, we also show that the proposed co-design approach outperforms a professional racecar driver.


title: The Labeled Multiple Canonical Correlation Analysis for Information Fusion

abstract: The objective of multimodal information fusion is to mathematically analyze information carried in different sources and create a new representation which will be more effectively utilized in pattern recognition and other multimedia information processing tasks. In this paper, we introduce a new method for multimodal information fusion and representation based on the Labeled Multiple Canonical Correlation Analysis (LMCCA). By incorporating class label information of the training samples,the proposed LMCCA ensures that the fused features carry discriminative characteristics of the multimodal information representations, and are capable of providing superior recognition performance. We implement a prototype of LMCCA to demonstrate its effectiveness on handwritten digit recognition,face recognition and object recognition utilizing multiple features,bimodal human emotion recognition involving information from both audio and visual domains. The generic nature of LMCCA allows it to take as input features extracted by any means,including those by deep learning (DL) methods. Experimental results show that the proposed method enhanced the performance of both statistical machine learning (SML) methods, and methods based on DL.


title: Exploration and Incentives in Reinforcement Learning

abstract: How do you incentivize self-interested agents to $\textit{explore}$ when they prefer to $\textit{exploit}$? We consider complex exploration problems, where each agent faces the same (but unknown) MDP. In contrast with traditional formulations of reinforcement learning, agents control the choice of policies, whereas an algorithm can only issue recommendations. However, the algorithm controls the flow of information, and can incentivize the agents to explore via information asymmetry. We design an algorithm which explores all reachable states in the MDP. We achieve provable guarantees similar to those for incentivizing exploration in static, stateless exploration problems studied previously. To the best of our knowledge, this is the first work to consider mechanism design in a stateful, reinforcement learning setting.


title: Discriminative Multiple Canonical Correlation Analysis for Information Fusion

abstract: In this paper, we propose the Discriminative Multiple Canonical Correlation Analysis (DMCCA) for multimodal information analysis and fusion. DMCCA is capable of extracting more discriminative characteristics from multimodal information representations. Specifically, it finds the projected directions which simultaneously maximize the within-class correlation and minimize the between-class correlation, leading to better utilization of the multimodal information. In the process, we analytically demonstrate that the optimally projected dimension by DMCCA can be quite accurately predicted, leading to both superior performance and substantial reduction in computational cost. We further verify that Canonical Correlation Analysis (CCA), Multiple Canonical Correlation Analysis (MCCA) and Discriminative Canonical Correlation Analysis (DCCA) are special cases of DMCCA, thus establishing a unified framework for Canonical Correlation Analysis. We implement a prototype of DMCCA to demonstrate its performance in handwritten digit recognition and human emotion recognition. Extensive experiments show that DMCCA outperforms the traditional methods of serial fusion, CCA, MCCA and DCCA.


title: Robust Forecasting using Predictive Generalized Synchronization in Reservoir Computing

abstract: Reservoir computers (RC) are a form of recurrent neural network (RNN) used for forecasting timeseries data. As with all RNNs, selecting the hyperparameters presents a challenge when training onnew inputs. We present a method based on generalized synchronization (GS) that gives direction in designing and evaluating the architecture and hyperparameters of an RC. The 'auxiliary method' for detecting GS provides a computationally efficient pre-training test that guides hyperparameterselection. Furthermore, we provide a metric for RC using the reproduction of the input system's Lyapunov exponentsthat demonstrates robustness in prediction.


title: Tiny Adversarial Mulit-Objective Oneshot Neural Architecture Search

abstract: Due to limited computational cost and energy consumption, most neural network models deployed in mobile devices are tiny. However, tiny neural networks are commonly very vulnerable to attacks. Current research has proved that larger model size can improve robustness, but little research focuses on how to enhance the robustness of tiny neural networks. Our work focuses on how to improve the robustness of tiny neural networks without seriously deteriorating of clean accuracy under mobile-level resources. To this end, we propose a multi-objective oneshot network architecture search (NAS) algorithm to obtain the best trade-off networks in terms of the adversarial accuracy, the clean accuracy and the model size. Specifically, we design a novel search space based on new tiny blocks and channels to balance model size and adversarial performance. Moreover, since the supernet significantly affects the performance of subnets in our NAS algorithm, we reveal the insights into how the supernet helps to obtain the best subnet under white-box adversarial attacks. Concretely, we explore a new adversarial training paradigm by analyzing the adversarial transferability, the width of the supernet and the difference between training the subnets from scratch and fine-tuning. Finally, we make a statistical analysis for the layer-wise combination of certain blocks and channels on the first non-dominated front, which can serve as a guideline to design tiny neural network architectures for the resilience of adversarial perturbations.


title: Predicting post-operative right ventricular failure using video-based deep learning

abstract: Non-invasive and cost effective in nature, the echocardiogram allows for a comprehensive assessment of the cardiac musculature and valves. Despite progressive improvements over the decades, the rich temporally resolved data in echocardiography videos remain underutilized. Human reads of echocardiograms reduce the complex patterns of cardiac wall motion, to a small list of measurements of heart function. Furthermore, all modern echocardiography artificial intelligence (AI) systems are similarly limited by design - automating measurements of the same reductionist metrics rather than utilizing the wealth of data embedded within each echo study. This underutilization is most evident in situations where clinical decision making is guided by subjective assessments of disease acuity, and tools that predict disease onset within clinically actionable timeframes are unavailable. Predicting the likelihood of developing post-operative right ventricular failure (RV failure) in the setting of mechanical circulatory support is one such clinical example. To address this, we developed a novel video AI system trained to predict post-operative right ventricular failure (RV failure), using the full spatiotemporal density of information from pre-operative echocardiography scans. We achieve an AUC of 0.729, specificity of 52% at 80% sensitivity and 46% sensitivity at 80% specificity. Furthermore, we show that our ML system significantly outperforms a team of human experts tasked with predicting RV failure on independent clinical evaluation. Finally, the methods we describe are generalizable to any cardiac clinical decision support application where treatment or patient selection is guided by qualitative echocardiography assessments.


title: The Property of Frequency Shift in 2D-FRFT Domain with Application to Image Encryption

abstract: The Fractional Fourier Transform (FRFT) has been playing a unique and increasingly important role in signal and image processing. In this letter, we investigate the property of frequency shift in two-dimensional FRFT (2D-FRFT) domain. It is shown that the magnitude of image reconstruction from phase information is frequency shift-invariant in 2D-FRFT domain, enhancing the robustness of image encryption, an important multimedia security task. Experiments are conducted to demonstrate the effectiveness of this property against the frequency shift attack, improving the robustness of image encryption.


title: Confronting Machine Learning With Financial Research

abstract: This study aims to examine the challenges and applications of machine learning for financial research. Machine learning algorithms have been developed for certain data environments which substantially differ from the one we encounter in finance. Not only do difficulties arise due to some of the idiosyncrasies of financial markets, there is a fundamental tension between the underlying paradigm of machine learning and the research philosophy in financial economics. Given the peculiar features of financial markets and the empirical framework within social science, various adjustments have to be made to the conventional machine learning methodology. We discuss some of the main challenges of machine learning in finance and examine how these could be accounted for. Despite some of the challenges, we argue that machine learning could be unified with financial research to become a robust complement to the econometrician's toolbox. Moreover, we discuss the various applications of machine learning in the research process such as estimation, empirical discovery, testing, causal inference and prediction.


title: A Complete Discriminative Tensor Representation Learning for Two-Dimensional Correlation Analysis

abstract: As an effective tool for two-dimensional data analysis, two-dimensional canonical correlation analysis (2DCCA) is not only capable of preserving the intrinsic structural information of original two-dimensional (2D) data, but also reduces the computational complexity effectively. However, due to the unsupervised nature, 2DCCA is incapable of extracting sufficient discriminatory representations, resulting in an unsatisfying performance. In this letter, we propose a complete discriminative tensor representation learning (CDTRL) method based on linear correlation analysis for analyzing 2D signals (e.g. images). This letter shows that the introduction of the complete discriminatory tensor representation strategy provides an effective vehicle for revealing, and extracting the discriminant representations across the 2D data sets, leading to improved results. Experimental results show that the proposed CDTRL outperforms state-of-the-art methods on the evaluated data sets.


title: PairRank: Online Pairwise Learning to Rank by Divide-and-Conquer

abstract: Online Learning to Rank (OL2R) eliminates the need of explicit relevance annotation by directly optimizing the rankers from their interactions with users. However, the required exploration drives it away from successful practices in offline learning to rank, which limits OL2R's empirical performance and practical applicability. In this work, we propose to estimate a pairwise learning to rank model online. In each round, candidate documents are partitioned and ranked according to the model's confidence on the estimated pairwise rank order, and exploration is only performed on the uncertain pairs of documents, i.e., \emph{divide-and-conquer}. Regret directly defined on the number of mis-ordered pairs is proven, which connects the online solution's theoretical convergence with its expected ranking performance. Comparisons against an extensive list of OL2R baselines on two public learning to rank benchmark datasets demonstrate the effectiveness of the proposed solution.


title: Towards Continual, Online, Self-Supervised Depth

abstract: Although depth extraction with passive sensors has seen remarkable improvement with deep learning, these approaches may fail to obtain correct depth if they are exposed to environments not observed during training. Online adaptation, where the neural network trains while deployed, with self-supervised learning provides a convenient solution as the network can learn from the scene where it is deployed without external supervision. However, online adaptation causes a neural network to forget the past. Thus, past training is wasted and the network is not able to provide good results if it observes past scenes. This work deals with practical online-adaptation where the input is online and temporally-correlated, and training is completely self-supervised. Regularization and replay-based methods without task boundaries are proposed to avoid catastrophic forgetting while adapting to online data. Effort has been made to make the proposed approach suitable for practical use. We apply our method to both structure-from-motion and stereo depth estimation. We evaluate our method on diverse public datasets that include outdoor, indoor and synthetic scenes. Qualitative and quantitative results with both structure-from-motion and stereo show superior forgetting as well as adaptation performance compared to recent methods. Furthermore, the proposed method incurs negligible overhead compared to fine-tuning for online adaptation, proving to be an adequate choice in terms of plasticity, stability and applicability. The proposed approach is more inline with the artificial general intelligence paradigm as the neural network learns continually with no supervision. Source code is available at https://github.com/umarKarim/cou_sfm and https://github.com/umarKarim/cou_stereo.


title: Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning

abstract: Visual search, recommendation, and contrastive similarity learning power technologies that impact billions of users worldwide. Modern model architectures can be complex and difficult to interpret, and there are several competing techniques one can use to explain a search engine's behavior. We show that the theory of fair credit assignment provides a $\textit{unique}$ axiomatic solution that generalizes several existing recommendation- and metric-explainability techniques in the literature. Using this formalism, we show when existing approaches violate "fairness" and derive methods that sidestep these shortcomings and naturally handle counterfactual information. More specifically, we show existing approaches implicitly approximate second-order Shapley-Taylor indices and extend CAM, GradCAM, LIME, SHAP, SBSM, and other methods to search engines. These extensions can extract pairwise correspondences between images from trained $\textit{opaque-box}$ models. We also introduce a fast kernel-based method for estimating Shapley-Taylor indices that require orders of magnitude fewer function evaluations to converge. Finally, we show that these game-theoretic measures yield more consistent explanations for image similarity architectures.


title: Architectural Challenges in Migrating Plan-driven Projects to Agile

abstract: Software development has steadily embraced agile software development methodology/method (ASDM) and has been moving away from the plan driven software development methodology (PDM) approaches like waterfall. Given the iterative nature of agile development, the integration of software architecture into the agile way has become challenging. This research identifies the challenges of having a robust architecture in projects already executed by plan driven methods and new projects likewise by conducting a literature review and a case study analysis. The ensuing analysis finds that there are three major areas: people, process and technology, in which these challenges could be mapped.


title: Neural Network Approach to Construction of Classical Integrable Systems

abstract: Integrable systems have provided various insights into physical phenomena and mathematics. The way of constructing many-body integrable systems is limited to few ansatzes for the Lax pair, except for highly inventive findings of conserved quantities. Machine learning techniques have recently been applied to broad physics fields and proven powerful for building non-trivial transformations and potential functions. We here propose a machine learning approach to a systematic construction of classical integrable systems. Given the Hamiltonian or samples in latent space, our neural network simultaneously learns the corresponding natural Hamiltonian in real space and the canonical transformation between the latent space and the real space variables. We also propose a loss function for building integrable systems and demonstrate successful unsupervised learning for the Toda lattice. Our approach enables exploring new integrable systems without any prior knowledge about the canonical transformation or any ansatz for the Lax pair.


title: Communication-efficient Byzantine-robust distributed learning with statistical guarantee

abstract: Communication efficiency and robustness are two major issues in modern distributed learning framework. This is due to the practical situations where some computing nodes may have limited communication power or may behave adversarial behaviors. To address the two issues simultaneously, this paper develops two communication-efficient and robust distributed learning algorithms for convex problems. Our motivation is based on surrogate likelihood framework and the median and trimmed mean operations. Particularly, the proposed algorithms are provably robust against Byzantine failures, and also achieve optimal statistical rates for strong convex losses and convex (non-smooth) penalties. For typical statistical models such as generalized linear models, our results show that statistical errors dominate optimization errors in finite iterations. Simulated and real data experiments are conducted to demonstrate the numerical performance of our algorithms.


title: Multiscale Solar Wind Turbulence Properties inside and near Switchbacks measured by Parker Solar Probe

abstract: Parker Solar Probe (PSP) routinely observes magnetic field deflections in the solar wind at distances less than 0.3 au from the Sun. These deflections are related to structures commonly called 'switchbacks' (SBs), whose origins and characteristic properties are currently debated. Here, we use a database of visually selected SB intervals - and regions of solar wind plasma measured just before and after each SB - to examine plasma parameters, turbulent spectra from inertial to dissipation scales, and intermittency effects in these intervals. We find that many features, such as perpendicular stochastic heating rates and turbulence spectral slopes are fairly similar inside and outside of SBs. However, important kinetic properties, such as the characteristic break scale between the inertial to dissipation ranges differ inside and outside these intervals, as does the level of intermittency, which is notably enhanced inside SBs and in their close proximity, most likely due to magnetic field and velocity shears observed at the edges. We conclude that the plasma inside and outside of a SB, in most of the observed cases, belongs to the same stream, and that the evolution of these structures is most likely regulated by kinetic processes, which dominate small scale structures at the SB edges.


title: Generalization Through Hand-Eye Coordination: An Action Space for Learning Spatially-Invariant Visuomotor Control

abstract: Imitation Learning (IL) is an effective framework to learn visuomotor skills from offline demonstration data. However, IL methods often fail to generalize to new scene configurations not covered by training data. On the other hand, humans can manipulate objects in varying conditions. Key to such capability is hand-eye coordination, a cognitive ability that enables humans to adaptively direct their movements at task-relevant objects and be invariant to the objects' absolute spatial location. In this work, we present a learnable action space, Hand-eye Action Networks (HAN), that can approximate human's hand-eye coordination behaviors by learning from human teleoperated demonstrations. Through a set of challenging multi-stage manipulation tasks, we show that a visuomotor policy equipped with HAN is able to inherit the key spatial invariance property of hand-eye coordination and achieve zero-shot generalization to new scene configurations. Additional materials available at https://sites.google.com/stanford.edu/han


title: They'll Know It When They See It: Analyzing Post-Release Feedback from the Android Community

abstract: It is known that user involvement and user-centered design enhance system acceptance, particularly when end-users' views are considered early in the process. However, the increasingly common method of system deployment, through frequent releases via an online application distribution platform, relies more on post-release feedback from a virtual community. Such feedback may be received from large and diverse communities of users, posing challenges to developers in terms of extracting and identifying the most pressing requests to address. In seeking to tackle these challenges we have used natural language processing techniques to study enhancement requests logged by the Android community. We observe that features associated with a specific subset of topics were most frequently requested for improvement, and that end-users expressed particular discontent with the Jellybean release. End-users also tended to request improvements to specific issues together, potentially posing a prioritization challenge to Google.


title: Jordan decomposition for weights and the blockwise Alperin weight conjecture

abstract: The Alperin weight conjecture was reduced to simple groups by the work of Navarro, Tiep and Sp\"ath. To prove Alperin weight conjecture, it suffices to show that all finite non-abelian simple groups are BAW-good. We reduce the verification of the inductive conditons for groups of Lie type in non-defining characteristic to quasi-isolated blocks.


title: Towards Efficient Local Causal Structure Learning

abstract: Local causal structure learning aims to discover and distinguish direct causes (parents) and direct effects (children) of a variable of interest from data. While emerging successes have been made, existing methods need to search a large space to distinguish direct causes from direct effects of a target variable T. To tackle this issue, we propose a novel Efficient Local Causal Structure learning algorithm, named ELCS. Specifically, we first propose the concept of N-structures, then design an efficient Markov Blanket (MB) discovery subroutine to integrate MB learning with N-structures to learn the MB of T and simultaneously distinguish direct causes from direct effects of T. With the proposed MB subroutine, ELCS starts from the target variable, sequentially finds MBs of variables connected to the target variable and simultaneously constructs local causal structures over MBs until the direct causes and direct effects of the target variable have been distinguished. Using eight Bayesian networks the extensive experiments have validated that ELCS achieves better accuracy and efficiency than the state-of-the-art algorithms.


title: The description of giant dipole resonance key parameters with multitask neural networks

abstract: Giant dipole resonance (GDR) is one of the fundamental collective excitation modes in nucleus. Continuous efforts have been made to the evaluation of GDR key parameters in different nuclear data libraries. We introduced multitask learning (MTL) approach to learn and reproduce the evaluated experimental data of GDR key parameters, including both GDR energies and widths. Compared to the theoretical GDR parameters in RIPL-3 library, the accuracies of MTL approach are almost doubled for 129 nuclei with experimental data. The significant improvement is largely due to the right classification of unimodal nuclei and bimodal nuclei by the classification neural network. Based on the good performance of the neural network approach, an extrapolation to 79 nuclei around the $\beta$-stability line without experimental data is made, which provides an important reference to future experiments and data evaluations. The successful application of MTL approach in this work further proofs the feasibility of studying multi-output physical problems with multitask neural network in nuclear physics domain.


title: LRG at TREC 2020: Document Ranking with XLNet-Based Models

abstract: Establishing a good information retrieval system in popular mediums of entertainment is a quickly growing area of investigation for companies and researchers alike. We delve into the domain of information retrieval for podcasts. In Spotify's Podcast Challenge, we are given a user's query with a description to find the most relevant short segment from the given dataset having all the podcasts. Previous techniques that include solely classical Information Retrieval (IR) techniques, perform poorly when descriptive queries are presented. On the other hand, models which exclusively rely on large neural networks tend to perform better. The downside to this technique is that a considerable amount of time and computing power are required to infer the result. We experiment with two hybrid models which first filter out the best podcasts based on user's query with a classical IR technique, and then perform re-ranking on the shortlisted documents based on the detailed description using a transformer-based model.


title: Adversarial Information Bottleneck

abstract: The information bottleneck (IB) principle has been adopted to explain deep learning in terms of information compression and prediction, which are balanced by a trade-off hyperparameter. How to optimize the IB principle for better robustness and figure out the effects of compression through the trade-off hyperparameter are two challenging problems. Previous methods attempted to optimize the IB principle by introducing random noise into learning the representation and achieved state-of-the-art performance in the nuisance information compression and semantic information extraction. However, their performance on resisting adversarial perturbations is far less impressive. To this end, we propose an adversarial information bottleneck (AIB) method without any explicit assumptions about the underlying distribution of the representations, which can be optimized effectively by solving a Min-Max optimization problem. Numerical experiments on synthetic and real-world datasets demonstrate its effectiveness on learning more invariant representations and mitigating adversarial perturbations compared to several competing IB methods. In addition, we analyse the adversarial robustness of diverse IB methods contrasting with their IB curves, and reveal that IB models with the hyperparameter $\beta$ corresponding to the knee point in the IB curve achieve the best trade-off between compression and prediction, and has best robustness against various attacks.


title: Applications of the theory of Floer to symmetric spaces

abstract: We quantize the problem considered by Bott-Samelson who applied Morse theory to any compact symmetric space $G/K$ and the associated real flag manifold $G_{\mathbb{R}}/B$ which is a real locus of a complex partial flag variety $G_{\mathbb{C}}/P_{\sigma}$. We prove that the Pontryagin ring $H_{-*}(\Omega(G/K))$ of the based loop space $\Omega(G/K)$ is isomorphic to the Floer cohomology ring $HF^*(G_{\mathbb{R}}/B,G_{\mathbb{R}}/B)$ after localization. When $G/K$ is a Lie group, this is a conjecture of Peterson, proved combinatorially by Lam-Shimozono, in the context of quantum cohomologies of complex flag varieties. Our approach is geometric in nature: we construct a Lagrangian correspondence from $T^*(G/K)$ to $G_{\mathbb{C}}/P_{\sigma}$ which geometrically composes with a cotangent fiber to $G_{\mathbb{R}}/B$, and compute the linear part of the associated Ma'u-Wehrheim-Woodward's $A_{\infty}$ homomorphism from a Floer model of $\Omega(G/K)$ to $CF^*(G_{\mathbb{R}}/B,G_{\mathbb{R}}/B)$. The crux is to make use of the geometry of $G/K$ to construct specific perturbation data which enables us to reduce the computations to the case when $G/K$ is a torus.


title: Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition

abstract: In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded synchronously with aphasia, apraxia, and dysarthria speech. We demonstrate a significant decoding performance improvement by more than 50\% during test time for isolated speech recognition task and we also provide preliminary results indicating performance improvement for the more challenging continuous speech recognition task by utilizing EEG features. The results presented in this paper show the first step towards demonstrating the possibility of utilizing non-invasive neural signals to design a real-time robust speech prosthetic for stroke survivors recovering from aphasia, apraxia, and dysarthria. Our aphasia, apraxia, and dysarthria speech-EEG data set will be released to the public to help further advance this interesting and crucial research.


title: Adaptive Regularized Submodular Maximization

abstract: In this paper, we study the problem of maximizing the difference between an adaptive submodular (revenue) function and an non-negative modular (cost) function under the adaptive setting. The input of our problem is a set of $n$ items, where each item has a particular state drawn from some known prior distribution $p$. The revenue function $g$ is defined over items and states, and the cost function $c$ is defined over items, i.e., each item has a fixed cost. The state of each item is unknown initially, one must select an item in order to observe its realized state. A policy $\pi$ specifies which item to pick next based on the observations made so far. Denote by $g_{avg}(\pi)$ the expected revenue of $\pi$ and let $c_{avg}(\pi)$ denote the expected cost of $\pi$. Our objective is to identify the best policy $\pi^o\in \arg\max_{\pi}g_{avg}(\pi)-c_{avg}(\pi)$ under a $k$-cardinality constraint. Since our objective function can take on both negative and positive values, the existing results of submodular maximization may not be applicable. To overcome this challenge, we develop a series of effective solutions with performance grantees. Let $\pi^o$ denote the optimal policy. For the case when $g$ is adaptive monotone and adaptive submodular, we develop an effective policy $\pi^l$ such that $g_{avg}(\pi^l) - c_{avg}(\pi^l) \geq (1-\frac{1}{e}-\epsilon)g_{avg}(\pi^o) - c_{avg}(\pi^o)$, using only $O(n\epsilon^{-2}\log \epsilon^{-1})$ value oracle queries. For the case when $g$ is adaptive submodular, we present a randomized policy $\pi^r$ such that $g_{avg}(\pi^r) - c_{avg}(\pi^r) \geq \frac{1}{e}g_{avg}(\pi^o) - c_{avg}(\pi^o)$.


title: Millimeter Wave and sub-THz Indoor Radio Propagation Channel Measurements, Models, and Comparisons in an Office Environment

abstract: This letter provides a comparison of indoor radio propagation measurements and corresponding channel statistics at 28, 73, and 140 GHz, based on extensive measurements from 2014-2020 in an indoor office environment. Side-by-side comparisons of propagation characteristics (e.g., large-scale path loss and multipath time dispersion) across a wide range of frequencies from the low millimeter wave band of 28 GHz to the sub-THz band of 140 GHz illustrate the key similarities and differences in indoor wireless channels. The measurements and models show remarkably similar path loss exponents over frequencies in both line-of-sight (LOS) and non-LOS (NLOS) scenarios, when using a one meter free space reference distance, while the multipath time dispersion becomes smaller at higher frequencies. The 3GPP indoor channel model overestimates the large-scale path loss and has unrealistic large numbers of clusters and multipath components per cluster compared to the measured channel statistics in this letter.


title: On Problems Dual to Unification: The String-Rewriting Case

abstract: In this paper, we investigate problems which are dual to the unification problem, namely the Fixed Point (FP) problem, Common Term (CT) problem and the Common Equation (CE) problem for string rewriting systems. Our main motivation is computing fixed points in systems, such as loop invariants in programming languages. We show that the fixed point (FP) problem is reducible to the common term problem. Our new results are: (i) the fixed point problem is undecidable for finite convergent string rewriting systems whereas it is decidable in polynomial time for finite, convergent and dwindling string rewriting systems, (ii) the common term problem is undecidable for the class of dwindling string rewriting systems, and (iii) for the class of finite, monadic and convergent systems, the common equation problem is decidable in polynomial time but for the class of dwindling string rewriting systems, common equation problem is undecidable.


title: LQG Reference Tracking with Safety and Reachability Guarantees under Unknown False Data Injection Attacks

abstract: We investigate a linear quadratic Gaussian (LQG) tracking problem with safety and reachability constraints in the presence of an adversary who mounts an FDI attack on an unknown set of sensors. For each possible set of compromised sensors, we maintain a state estimator disregarding the sensors in that set, and calculate the optimal LQG control input at each time based on this estimate. We propose a control policy which constrains the control input to lie within a fixed distance of the optimal control input corresponding to each state estimate. The control input is obtained at each time step by solving a quadratically constrained quadratic program (QCQP). We prove that our policy can achieve a desired probability of safety and reachability using the barrier certificate method. Our control policy is evaluated via a numerical case study.


title: Structure-Preserving Galerkin POD-DEIM Reduced-Order Modeling of Hamiltonian Systems

abstract: A structure preserving proper orthogonal decomposition reduce-order modeling approach has been developed in [Gong et al. 2017] for the Hamiltonian system, which uses the traditional framework of Galerkin projection-based model reduction but modifies the reduced order model so that the appropriate Hamiltonian structure is preserved. However, its computational complexity for online simulations is still high if the Hamiltonian involves non-polynomial nonlinearities. In this paper, we apply the discrete empirical interpolation method to improve the online efficiency of the structure-preserving reduced order simulations. Since the reduced basis truncation can degrade the Hamiltonian approximation, we propose to use the basis obtained from shifted snapshots. A nonlinear wave equation is used as a test bed and the numerical results illustrate the efficacy of the proposed method.


title: Effect of symmetrical frequency chirp on pair production

abstract: By using Dirac-Heisenberg-Wigner formalism we study electron-positron pair production for linear, elliptic, nearly circular and circular polarizations of electric fields with symmetrical frequency chirp, and we obtain Momentum spectra and pair yield. The difference of results among polarized fields is obvious for the small chirp. When the chirp parameter increases, the momentum spectra tend to exhibit the multiphoton pair generation that is characterized by the multi-concentric ring structure. The increase of number density is also remarkable compared to the case of asymmetrical frequency chirp. Note that the dynamically assisted Schwinger Mechanism plays an important role for the enhanced pair production in the symmetrical frequency chirp.


title: High-order linearly implicit structure-preserving exponential integrators for the nonlinear Schr\"odinger equation

abstract: A novel class of high-order linearly implicit energy-preserving integrating factor Runge-Kutta methods are proposed for the nonlinear Schr\"odinger equation. Based on the idea of the scalar auxiliary variable approach, the original equation is first reformulated into an equivalent form which satisfies a quadratic energy. The spatial derivatives of the system are then approximated with the standard Fourier pseudo-spectral method. Subsequently, we apply the extrapolation technique/prediction-correction strategy to the nonlinear terms of the semi-discretized system and a linearized energy-conserving system is obtained. A fully discrete scheme is gained by further using the integrating factor Runge-Kutta method to the resulting system. We show that, under certain circumstances for the coefficients of a Runge-Kutta method, the proposed scheme can produce numerical solutions along which the modified energy is precisely conserved, as is the case with the analytical solution and is extremely efficient in the sense that only linear equations with constant coefficients need to be solved at every time step. Numerical results are addressed to demonstrate the remarkable superiority of the proposed schemes in comparison with other existing structure-preserving schemes.


title: Fair and Efficient Allocations with Limited Demands

abstract: We study the fair division problem of allocating multiple resources among a set of agents with Leontief preferences that are each required to complete a finite amount of work, which we term "limited demands". We examine the behavior of the classic Dominant Resource Fairness (DRF) mechanism in this setting and show it is fair but only weakly Pareto optimal and inefficient in many natural examples. We propose as an alternative the Least Cost Product (LCP) mechanism, a natural adaptation of Maximum Nash Welfare to this setting. We characterize the structure of allocations of the LCP mechanism in this setting, show that it is Pareto efficient, and that it satisfies the relatively weak fairness property of sharing incentives. While we prove it satisfies the stronger fairness property of (expected) envy freeness in some special cases, we provide a counterexample showing it does not do so in general, a striking contrast to the "unreasonable fairness" of Maximum Nash Welfare in other settings. Simulations suggest, however, that these violations of envy freeness are rare in randomly generated examples.


title: One-step synthesis of mesoporous Cobalt sulfides (CoSx) on the metal substrate as an efficient bifunctional electrode for overall water splitting

abstract: Electrocatalysts based on transition metal sulfides are drawing accelerating concerns in renewable energy research because of their intrinsically excellent activities towards both hydrogen evolution reaction and oxygen evolution reaction. To date, considerable efforts are made to improve the performance of these catalysts, but ignoring the improper synthesis strategy would incur additional cost to the catalyst. Herein, a convenient, one-step anodization method is developed for fast construction of cobalt sulfides. Without any high-temperature or long-time treatment, mesoporous CoSx is self-grown on the metal substrate in minutes. As a result, as-anodic CoSx requires overpotentials of 102 mV for HER and 284 mV for OER to achieve a current density of 10 mA m-2 in alkaline solution. Moreover, the tandem bifunctional as-anodic CoSx exhibits a required cell voltage of 1.64 V for overall water splitting in alkaline solution, exceeding most of the documented Co-based electrocatalysts.


title: Hierarchical Inducing Point Gaussian Process for Inter-domain Observations

abstract: We examine the general problem of inter-domain Gaussian Processes (GPs): problems where the GP realization and the noisy observations of that realization lie on different domains. When the mapping between those domains is linear, such as integration or differentiation, inference is still closed form. However, many of the scaling and approximation techniques that our community has developed do not apply to this setting. In this work, we introduce the hierarchical inducing point GP (HIP-GP), a scalable inter-domain GP inference method that enables us to improve the approximation accuracy by increasing the number of inducing points to the millions. HIP-GP, which relies on inducing points with grid structure and a stationary kernel assumption, is suitable for low-dimensional problems. In developing HIP-GP, we introduce (1) a fast whitening strategy, and (2) a novel preconditioner for conjugate gradients which can be helpful in general GP settings. Our code is available at https: //github.com/cunningham-lab/hipgp.


title: Convergence of Gaussian-smoothed optimal transport distance with sub-gamma distributions and dependent samples

abstract: The Gaussian-smoothed optimal transport (GOT) framework, recently proposed by Goldfeld et al., scales to high dimensions in estimation and provides an alternative to entropy regularization. This paper provides convergence guarantees for estimating the GOT distance under more general settings. For the Gaussian-smoothed $p$-Wasserstein distance in $d$ dimensions, our results require only the existence of a moment greater than $d + 2p$. For the special case of sub-gamma distributions, we quantify the dependence on the dimension $d$ and establish a phase transition with respect to the scale parameter. We also prove convergence for dependent samples, only requiring a condition on the pairwise dependence of the samples measured by the covariance of the feature map of a kernel space. A key step in our analysis is to show that the GOT distance is dominated by a family of kernel maximum mean discrepancy (MMD) distances with a kernel that depends on the cost function as well as the amount of Gaussian smoothing. This insight provides further interpretability for the GOT framework and also introduces a class of kernel MMD distances with desirable properties. The theoretical results are supported by numerical experiments.


title: Scale matters: The daily, weekly and monthly volatility and predictability of Bitcoin, Gold, and the S&P 500

abstract: A reputation of high volatility accompanies the emergence of Bitcoin as a financial asset. This paper intends to nuance this reputation and clarify our understanding of Bitcoin's volatility. Using daily, weekly, and monthly closing prices and log-returns data going from September 2014 to January 2021, we find that Bitcoin is a prime example of an asset for which the two conceptions of volatility diverge. We show that, historically, Bitcoin allies both high volatility (high Standard Deviation) and high predictability (low Approximate Entropy), relative to Gold and S&P 500. Moreover, using tools from Extreme Value Theory, we analyze the convergence of moments, and the mean excess functions of both the closing prices and the log-returns of the three assets. We find that the closing price of Bitcoin is consistent with a generalized Pareto distribution, when the closing prices of the two other assets (Gold and S&P 500) present thin-tailed distributions. However, returns for all three assets are heavy tailed and second moments (variance, standard deviation) non-convergent. In the case of Bitcoin, lower sampling frequencies (monthly vs weekly, weekly vs daily) drastically reduce the Kurtosis of log-returns and increase the convergence of empirical moments to their true value. The opposite effect is observed for Gold and S&P 500. These properties suggest that Bitcoin's volatility is essentially an intra-day and intra-week phenomenon that is strongly attenuated on a weekly time-scale, and make it an attractive store of value to investors and speculators, but its high standard deviation excludes its use a currency.


title: A Minimax Probability Machine for Non-Decomposable Performance Measures

abstract: Imbalanced classification tasks are widespread in many real-world applications. For such classification tasks, in comparison with the accuracy rate, it is usually much more appropriate to use non-decomposable performance measures such as the Area Under the receiver operating characteristic Curve (AUC) and the $F_\beta$ measure as the classification criterion since the label class is imbalanced. On the other hand, the minimax probability machine is a popular method for binary classification problems and aims at learning a linear classifier by maximizing the accuracy rate, which makes it unsuitable to deal with imbalanced classification tasks. The purpose of this paper is to develop a new minimax probability machine for the $F_\beta$ measure, called MPMF, which can be used to deal with imbalanced classification tasks. A brief discussion is also given on how to extend the MPMF model for several other non-decomposable performance measures listed in the paper. To solve the MPMF model effectively, we derive its equivalent form which can then be solved by an alternating descent method to learn a linear classifier. Further, the kernel trick is employed to derive a nonlinear MPMF model to learn a nonlinear classifier. Several experiments on real-world benchmark datasets demonstrate the effectiveness of our new model.


title: Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective

abstract: Training generative adversarial networks (GANs) with limited real image data generally results in deteriorated performance and collapsed models. To conquer this challenge, we are inspired by the latest observation, that one can discover independently trainable and highly sparse subnetworks (a.k.a., lottery tickets) from GANs. Treating this as an inductive prior, we suggest a brand-new angle towards data-efficient GAN training: by first identifying the lottery ticket from the original GAN using the small training set of real images; and then focusing on training that sparse subnetwork by re-using the same set. We find our coordinated framework to offer orthogonal gains to existing real image data augmentation methods, and we additionally present a new feature-level augmentation that can be applied together with them. Comprehensive experiments endorse the effectiveness of our proposed framework, across various GAN architectures (SNGAN, BigGAN, and StyleGAN-V2) and diverse datasets (CIFAR-10, CIFAR-100, Tiny-ImageNet, ImageNet, and multiple few-shot generation datasets). Codes are available at: https://github.com/VITA-Group/Ultra-Data-Efficient-GAN-Training.


title: Canonical subsheaves of torsionfree semistable sheaves

abstract: Let $F$ be a torsionfree semistable coherent sheaf on a polarized normal projective variety. We prove that $F$ has a unique maximal locally free subsheaf $V$ such that $F/V$ is torsionfree and $V$ admits a filtration of subbundles for which each successive quotient is stable whose slope is $\mu(F)$. We also prove that $F$ has a unique maximal reflexive subsheaf $W$ such that $F/W$ is torsionfree and $W$ admits a filtration of subsheaves for which each successive quotient is a stable reflexive sheaf whose slope is $\mu(F)$. We show that these canonical subsheaves behave well with respect to the pullback operation by \'etale Galois covering maps. Given a separable finite surjective map $\phi :Y \, \rightarrow X$ between normal projective varieties, we give a criterion for the induced homomorphism of \'etale fundamental groups $\phi_* : \pi^{\rm et}_{1}(Y) \rightarrow \pi^{\rm et}_{1}(X)$ to be surjective; this criterion is in terms of the above mentioned unique maximal locally free subsheaf associated to $\phi_*{\mathcal O}_Y$.


title: Hydrophobic interaction determines docking affinity of SARS CoV 2 variants with antibodies

abstract: Preliminary epidemiologic, phylogenetic and clinical findings suggest that several novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants have increased transmissibility and decreased efficacy of several existing vaccines. Four mutations in the receptor-binding domain (RBD) of the spike protein that are reported to contribute to increased transmission. Understanding physical mechanism responsible for the affinity enhancement between the SARS-CoV-2 variants and ACE2 is the "urgent challenge" for developing blockers, vaccines and therapeutic antibodies against the coronavirus disease 2019 (COVID-19) pandemic. Based on a hydrophobic-interaction-based protein docking mechanism, this study reveals that the mutation N501Y obviously increased the hydrophobic attraction and decrease hydrophilic repulsion between the RBD and ACE2 that most likely caused the transmissibility increment of the variants. By analyzing the mutation-induced hydrophobic surface changes in the attraction and repulsion at the binding site of the complexes of the SARS-CoV-2 variants and antibodies, we found out that all the mutations of N501Y, E484K, K417N and L452R can selectively decrease or increase their binding affinity with some antibodies.


title: Accuracy of spectral element method for wave, parabolic and Schr\"{o}dinger equations

abstract: The spectral element method constructed by the $Q^k$ ($k\geq 2$) continuous finite element method with $(k+1)$-point Gauss-Lobatto quadrature on rectangular meshes is a popular high order scheme for solving wave equations in various applications. It can also be regarded as a finite difference scheme on all Gauss-Lobatto points. We prove that this finite difference scheme is $(k+2)$-order accurate in discrete 2-norm for smooth solutions. The same proof can be extended to the spectral element method solving linear parabolic and Schr\"odinger equations. The main result also applies to the spectral element method on curvilinear meshes that can be smoothly mapped to rectangular meshes on the unit square.


title: Topological excitations in quasi two-dimensional quantum magnets with weak interlayer interactions

abstract: The study of topological magnetic excitations has attracted widespread attention in the past few years. In this thesis, I have studied some examples of novel topological magnonic phases/phenomena in low-dimensional quantum magnets. The first chapter motivates the research based on the research gap in this field of study. The second chapter is written to make the thesis self-sufficient and the concepts are explained through examples. In the second chapter, the following formalisms and physical observables are described: Holstein-Primakoff, bond operator, Schwinger boson, Bogoliubov-Valatin, Group theory, Berry-phase, Berry-curvature, Chern number, thermal Hall conductance, Nernst conductivity, dynamical spin structure factor, edge-current. The main results of the thesis are shown in the third, fourth, and fifth chapters. In the third chapter, I have shown that anti-chiral edge states (co-propagating edge states) arise in the ferromagnetic Heisenberg model on the honeycomb lattice with Dzyaloshinskii-Moriya (DM) interactions. My results suggest that such anti-chiral edge states may be induced in certain realistic models of quantum magnets. In the fourth chapter, I have found the emergence of many magnon band-topological phases in the flux state of the Shastry-Sutherland model. I have derived a simple analytical form of the temperature dependence of derivative of thermal Hall conductivity near the band topological transition point which I propose to be experimentally useful. In the fifth chapter, I have investigated the emergence of Weyl triplons due to inter-layer DM-interaction in a microscopic model of SrCu2(BO3)2, a widely studied frustrated quantum magnet. I have shown that the thermal magnon Hall conductivity has a quasi-linear dependence as a function of the magnetic field in a Weyl-triplon region.


title: Renormalization-Group Evolution of the None-local Matrix Element of $B$-meson In QCD and $B\to \pi$ transition form factor

abstract: We consider the renormalization-group evolution of the matrix element of $\langle 0| \bar{q}(z)_\beta [z,0]b(0)_\alpha| \bar{B}\rangle$, which can be used to define the distribution amplitudes for $B$ meson and widely applied in studies of $B$ meson decays. The contribution to the renormalization constant of the non-local operator $\bar{q}(z)_\beta [z,0]b(0)_\alpha$ is considered up to one-loop order in QCD. Since the quark fields in this operator are not directly coupled fields, momentum can not flow freely through this non-local operator. Momentum involved in this operator can be treated stringently in coordinate space. We find that the ultraviolet divergences regulated by dimensional parameter $\epsilon$ cancel with each other, and the evolution effect vanishes. The matrix element $\langle 0| \bar{q}(z)_\beta [z,0]b(0)_\alpha| \bar{B}\rangle$ escapes from the renormalization-group evolution. We then apply the matrix element in calculating $B\to\pi$ transition form factor, where the matrix element is obtained by using the $B$ meson wave function calculated in QCD-inspired potential model. By comparing with experimental data for the semileptonic decay of $B\to \pi \ell\nu$ and light-cone sum rule calculation, we analyse the perturbative and non-perturbative contributions to $B\to\pi$ transition form factor in the frame work of perturbative QCD approach. We find that the effectiveness of the suppression of Sudakov factor to soft contribution depends on the end-point behavior of $B$ meson wave function, and with the $B$-meson wave function used in this work, soft contribution can not be well suppressed. The hard contribution to the $B\to\pi$ transition form factor is about 59\%, and soft contribution can be as large as 41\% in the naive calculation. To make the perturbative calculation reliable, a soft momentum cutoff in the calculation and soft form factor have to be introduced.


title: Generalizing Cographs to 2-Cographs

abstract: A graph in which every connected induced subgraph has a disconnected complement is called a cograph. Such graphs are precisely the graphs that do not have the 4-vertex path as an induced subgraph. We define a $2$-cograph to be a graph in which the complement of every $2$-connected induced subgraph is not $2$-connected. We show that, like cographs, $2$-cographs can be recursively defined. But, unlike cographs, $2$-cographs are closed under induced minors. We characterize the class of non-$2$-cographs for which every proper induced minor is a $2$-cograph. We further find the finitely many members of this class whose complements are also induced-minor-minimal non-$2$-cographs.


title: Distributed Augmented Lagrangian Method for Link-Based Resource Sharing Problems of Multi-Agent Systems

abstract: A multi-agent optimization problem motivated by the management of energy systems is discussed. The associated cost function is separable and convex although not necessarily strongly convex and there exist edge-based coupling equality constraints. In this regard, we propose a distributed algorithm based on solving the dual of the augmented problem. Furthermore, we consider that the communication network might be time-varying and the algorithm might be carried out asynchronously. The time-varying nature and the asynchronicity are modeled as random processes. Then, we show the convergence and the convergence rate of the proposed algorithm under the aforementioned conditions.


title: Parallel implementations of random time algorithm for chemical network stochastic simulations

abstract: In this study, we have developed a parallel version of the random time simulation algorithm. Firstly, we gave a rigorous basis of the random time description of the stochastic process of chemical reaction network time evolution. And then we reviewed the random time simulation algorithm and gave the implementations for the parallel version of next reaction random time algorithm. The discussion of computational complexity suggested a factor of $M$ (which is the connection number of the network) folds time consuming reduction for random time simulation algorithm as compared to other exact stochastic simulation algorithms, such as the Gillespie algorithm. For large-scale system, such like the protein-protein interaction network, $M$ is on order of $10^8$. We further demonstrate the power of random time simulation with a GPGPU parallel implementation which achieved roughly 100 folds acceleration as compared with CPU implementations. Therefore the stochastic simulation method we developed here can be of great application value for simulating time evolution process of large-scale network.


title: Avoiding dynamic small obstacles with onboard sensing and computating on aerial robots

abstract: In practical applications, autonomous quadrotors are still facing significant challenges, such as the detection and avoidance of very small and even dynamic obstacles (e.g., tree branches, power lines). In this paper, we propose a compact, integrated, and fully autonomous quadrotor system, which can fly safely in cluttered environments while avoiding dynamic small obstacles. Our quadrotor platform is equipped with a forward-looking three-dimensional (3D) light detection and ranging (lidar) sensor to perceive the environment and an onboard embedded computer to perform all the estimation, mapping, and planning tasks. Specifically, the computer estimates the current pose of the UAV, maintains a local map (time-accumulated point clouds KD-Trees), and computes a safe trajectory using kinodynamic A* search to the goal point. The whole perception and planning system can run onboard at 50Hz with careful optimization. Various indoor and outdoor experiments show that the system can avoid dynamic small obstacles (down to 20mm diameter bar) while flying at 2m/s in cluttered environments. Our codes and hardware design are open-sourced on Github.


title: Near-Wake Dynamics of a Vertical-Axis Turbine

abstract: Cross-flow, or vertical-axis, turbines are a promising technology for capturing kinetic energy in wind or flowing water and their inherently unsteady fluid mechanics present unique opportunities for control optimization of individual rotors or arrays. To explore the potential for beneficial interactions between turbines in an array, coherent structures in the wake of a single two-bladed cross-flow turbine are examined using planar stereo particle image velocimetry in a water channel. First, the mean wake structure of this high chord-to-radius ratio rotor is described, compared to previous studies, and a simple explanation for observed wake deflection is presented. Second, the unsteady flow is then analyzed via the triple decomposition, with the periodic component extracted using a combination of traditional techniques and a novel implementation of the optimized dynamic mode decomposition. The latter method is shown to outperform conditional averaging and Fourier methods, as well as uncover frequencies suggesting a transition to bluff-body shedding in the far wake. Third, vorticity and finite-time Lyapunov exponents are then employed to further analyze the oscillatory wake component. Vortex streets on both sides of the wake are identified, and their formation mechanisms and effects on the mean flow are discussed. Strong axial (vertical) flow is observed in vortical structures shed on the retreating side of the rotor where the blades travel downstream. Time-resolved tracking of these vortices is performed, which demonstrates that vortex trajectories have significant rotation-to-rotation variation within one diameter downstream. This variability suggests it would be challenging to harness or avoid such structures at greater downstream distances.


title: Absolute quantification of real-time PCR data with stage signal difference analysis

abstract: Real-time PCR, or Real-time Quantitative PCR (qPCR) is an effective approach to quantify nucleic acid samples. Given the complicated reaction system along with thermal cycles, there has been long-term confusion on accurately calculating the initial nucleic acid amounts from the fluorescence signals. Although many improved algorithms had been proposed, the classical threshold method is still the primary choice in the routine application. In this study, we will first illustrate the origin of the linear relationship between the threshold value and logarithm of the initial nucleic acid amount by reconstructing the PCR reaction process with stochastic simulations. We then develop a new method for the absolute quantification of nucleic acid samples with qPCR. By monitoring the fluorescence signal changes in every stage of the thermal cycle, we are able to calculate a representation of the step-wise efficiency change. This is the first work calculated PCR efficiency change directly from the fluorescence signal, without fitting or sophisticated analysis. Our results revealed that the efficiency change during the PCR process is complicated and can not be modeled simply by monotone function model. Based on the calculated efficiency, we illustrate a new absolute qPCR analysis method for accurately determining nucleic acid amount. The efficiency problem is completely avoided in this new method.


title: Precise evaluation of $h\to c\bar{c}$ and axion-like particle production

abstract: We study the decay of the SM Higgs boson to a massive charm quark pair at the next-to-next-to-leading order QCD and next-to-leading order electroweak. At the second order of QCD coupling, we consider the exact calculation of flavour-singlet contributions where the Higgs boson couples to the internal top and bottom quark. Helpful information on the running mass effects related to Yukawa coupling may be obtained by analyzing this process. High precision production for $h\to c\bar{c}$ within the SM makes it possible to search for new physics that may induce relatively large interactions related to the charm quark. As an example, we evaluate the axion-like particle associate production with a charm quark pair in the Higgs decay and obtain some constraints for the corresponding parameters under some assumptions.


title: Sim-to-Real Transfer for Robotic Manipulation with Tactile Sensory

abstract: Reinforcement Learning (RL) methods have been widely applied for robotic manipulations via sim-to-real transfer, typically with proprioceptive and visual information. However, the incorporation of tactile sensing into RL for contact-rich tasks lacks investigation. In this paper, we model a tactile sensor in simulation and study the effects of its feedback in RL-based robotic control via a zero-shot sim-to-real approach with domain randomization. We demonstrate that learning and controlling with feedback from tactile sensor arrays at the gripper, both in simulation and reality, can enhance grasping stability, which leads to a significant improvement in robotic manipulation performance for a door opening task. In real-world experiments, the door open angle was increased by 45% on average for transferred policies with tactile sensing over those without it.


title: A weak Galerkin-mixed finite element method for the Stokes-Darcy problem

abstract: In this paper, we propose a new numerical scheme for the coupled Stokes-Darcy model with Beavers-Joseph-Saffman interface condition. We use the weak Galerkin method to discretize the Stokes equation and the mixed finite element method to the Darcy equation. A discrete inf-sup condition is proved and optimal error estimates are also derived. Numerical experiments validate the theoretical analysis.


title: Local continuity of weak solutions to the Stefan problem involving the singular $p$-Laplacian

abstract: We establish the local continuity of locally bounded weak solutions (temperatures) to the doubly singular parabolic equation modeling the phase transition of a material: \[ \partial_t \beta(u)-\Delta_p u\ni 0\quad\text{ for }\tfrac{2N}{N+1}<p<2, \] where $\beta$ is a maximal monotone graph with a jump at zero and $\Delta_p$ is the $p$-Laplacian. Moreover, a logarithmic type modulus of continuity is quantified, which has been conjectured to be optimal.


title: Strong Phonon Anharmonicity of Clathrate Compound at High Temperature

abstract: Effects of strong phonon anharmonicity of a type-I clathrate Ba$_{\rm 8}$Ga$_{\rm 16}$Sn$_{\rm 30}$ induced by quadruple-well potential of guest atoms were investigated. Phonon transport including coherent interbranch component was analyzed using a first-principles-based self-consistent phonon (SCP) theory that gives temperature-dependent harmonic interatomic force constants and by solving off-diagonal components of group velocity operator. Experimentally observed thermal conductivities have been reasonably reproduced by considering both lattice and electron contributions. Through the analysis with the SCP theory, we found that hardening of guest modes leads to an increase in lattice thermal conductivity at frequencies below those of framework-dominant flat modes (< 40 cm$^{\rm -1}$), which finally results in the slow decay and slight increase in the total lattice thermal conductivity with increasing temperature. Detailed analyses revealed that the increase in lattice thermal conductivity at low frequency is attributed to (a) the increase in group velocities of phonon modes located at frequencies below that of the flat guest modes and (b) abnormal increase in lifetimes of phonon modes located between frequencies of the flat guest and framework modes with increasing temperature. From an engineering point of view, this effect may lead to an intriguing phenomenon, a larger decrease in thermal conductivity due to nanostructuring at higher temperatures.


title: A recursive system-free single-step temporal discretization method for finite difference methods

abstract: Single-stage or single-step high-order temporal discretizations of partial differential equations (PDEs) have shown great promise in delivering high-order accuracy in time with efficient use of computational resources. There has been much success in developing such methods for finite volume method (FVM) discretizations of PDEs. The Picard Integral formulation (PIF) has recently made such single-stage temporal methods accessible for finite difference method (FDM) discretizations. PIF methods rely on the so-called Lax-Wendroff procedures to tightly couple spatial and temporal derivatives through the governing PDE system to construct high-order Taylor series expansions in time. Going to higher than third order in time requires the calculation of Jacobian-like derivative tensor-vector contractions of an increasingly larger degree, greatly adding to the complexity of such schemes. To that end, we present in this paper a method for calculating these tensor contractions through a recursive application of a discrete Jacobian operator that readily and efficiently computes the needed contractions entirely agnostic of the system of partial differential equations (PDEs) being solved.

categories: math.NA astro-ph.HE cs.NA physics.comp-ph


title: Balanced Partial Entanglement and the Entanglement Wedge Cross Section

abstract: In this article we define a new information theoretical quantity for any bipartite mixed state $\rho_{AB}$. We call it the \textit{balanced partial entanglement} (BPE). The BPE is the partial entanglement entropy, which is an integral of the entanglement contour in a subregion, that satisfies certain balance requirements. The BPE depends on the purification hence is not intrinsic. However, the BPE could be a useful way to classify the purifications. We discuss the entropy relations satisfied by BPE and find they are quite similar to those satisfied by the entanglement of purification. We show that in holographic CFT$_2$ the BPE equals to the area of the entanglement wedge cross section (EWCS) divided by 4G. More interestingly when we consider the canonical purification, the BPE is just half of the reflected entropy, which is also directly related to the EWCS. The BPE can be considered as an generalization of the reflected entropy for a generic purification of the mixed state $\rho_{AB}$. We interpret the correspondence between the BPE and EWCS using the holographic picture of the entanglement contour.


title: A Spontaneously Formed Plasmonic-MoTe2 Hybrid Platform for Ultrasensitive Raman Enhancement

abstract: To develop highly sensitive, stable and repeatable surface-enhanced Raman scattering (SERS) substrates is crucial for analytical detection, which is a challenge for traditional metallic structures. Herein, by taking advantage of the high surface activity of 1T' transition metal telluride, we have fabricated high-density gold nanoparticles (AuNPs) that are spontaneously in-situ prepared on the 1T' MoTe2 atomic layers via a facile method, forming a plasmonic-2D material hybrid SERS substrate. This AuNP formation is unique to the 1T' phase, which is repressed in 2H MoTe2 with less surface activity. The hybrid structure generates coupling effects of electromagnetic and chemical enhancements, as well as excellent molecule adsorption, leading to the ultrasensitive (4*10^-17 M) and reproducible detection. Additionally, the immense fluorescence and photobleaching phenomena are mostly avoided. Flexible SERS tapes have been demonstrated in practical applications. Our approach facilitates the ultrasensitive SERS detection by a facile method, as well as the better mechanistic understanding of SERS beyond plasmonic effects.

categories: physics.optics cond-mat.mtrl-sci physics.app-ph physics.chem-ph


title: Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localization

abstract: Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric approaches. In particular, recurrent architectures that incorporate temporal context into the estimation process seem to be well-suited for this task. This paper proposes a novel approach to sound event localization by utilizing an attention-based sequence-to-sequence model. These types of models have been successfully applied to problems in natural language processing and automatic speech recognition. In this work, a multi-channel audio signal is encoded to a latent representation, which is subsequently decoded to a sequence of estimated directions-of-arrival. Herein, attentions allow for capturing temporal dependencies in the audio signal by focusing on specific frames that are relevant for estimating the activity and direction-of-arrival of sound events at the current time-step. The framework is evaluated on three publicly available datasets for sound event localization. It yields superior localization performance compared to state-of-the-art methods in both anechoic and reverberant conditions.


title: Logic Embeddings for Complex Query Answering

abstract: Answering logical queries over incomplete knowledge bases is challenging because: 1) it calls for implicit link prediction, and 2) brute force answering of existential first-order logic queries is exponential in the number of existential variables. Recent work of query embeddings provides fast querying, but most approaches model set logic with closed regions, so lack negation. Query embeddings that do support negation use densities that suffer drawbacks: 1) only improvise logic, 2) use expensive distributions, and 3) poorly model answer uncertainty. In this paper, we propose Logic Embeddings, a new approach to embedding complex queries that uses Skolemisation to eliminate existential variables for efficient querying. It supports negation, but improves on density approaches: 1) integrates well-studied t-norm logic and directly evaluates satisfiability, 2) simplifies modeling with truth values, and 3) models uncertainty with truth bounds. Logic Embeddings are competitively fast and accurate in query answering over large, incomplete knowledge graphs, outperform on negation queries, and in particular, provide improved modeling of answer uncertainty as evidenced by a superior correlation between answer set size and embedding entropy.


title: A Multi-Scale Method for Distributed Convex Optimization with Constraints

abstract: This paper proposes a multi-scale method to design a continuous-time distributed algorithm for constrained convex optimization problems by using multi-agents with Markov switched network dynamics and noisy inter-agent communications. Unlike most previous work which mainly puts emphasis on dealing with fixed network topology, this paper tackles the challenging problem of investigating the joint effects of stochastic networks and the inter-agent communication noises on the distributed optimization dynamics, which has not been systemically studied in the past literature. Also, in sharp contrast to previous work in constrained optimization, we depart from the use of projected gradient flow which is non-smooth and hard to analyze; instead, we design a smooth optimization dynamics which leads to easier convergence analysis and more efficient numerical simulations. Moreover, the multi-scale method presented in this paper generalizes previously known distributed convex optimization algorithms from the fixed network topology to the switching case and the stochastic averaging obtained in this paper is a generalization of the existing deterministic averaging.


title: Asymptotic behavior of a quasilinear Keller--Segel system with signal-suppressed motility

abstract: This paper is concerned with the density-suppressed motility model: $u_{t}=\Delta (\displaystyle\frac{u^m}{v^\alpha}) +\beta uf(w), v_{t}=D\Delta v-v+u, w_{t}=\Delta w-uf(w)$ in a smoothly bounded convex domain $\Omega\subset {\mathbb{R}}^2$, where $m>1$, $\alpha>0, \beta>0$ and $D>0$ are parameters, the response function $f$ satisfies $f\in C^1([0,\infty)), f(0)=0, f(w)>0$ in $(0,\infty)$. This system describes the density-suppressed motility of Eeshcrichia coli cells in process of spatio-temporal pattern formation via so-called self-trapping mechanisms. Based on the duality argument, it is shown that for suitable large $D$ the problem admits at least one global weak solution $(u,v,w)$ which will asymptotically converge to the spatially uniform equilibrium $(\overline{u_0}+\beta \overline{w_0},\overline{u_0}+\beta \overline{w_0},0)$ with $\overline{u_0}=\frac1{|\Omega|}\int_{\Omega}u(x,0)dx $ and $\overline{w_0}=\frac1{|\Omega|}\int_{\Omega}w(x,0)dx $ in $L^\infty(\Omega)$.


title: SparkXD: A Framework for Resilient and Energy-Efficient Spiking Neural Network Inference using Approximate DRAM

abstract: Spiking Neural Networks (SNNs) have the potential for achieving low energy consumption due to their biologically sparse computation. Several studies have shown that the off-chip memory (DRAM) accesses are the most energy-consuming operations in SNN processing. However, state-of-the-art in SNN systems do not optimize the DRAM energy-per-access, thereby hindering achieving high energy-efficiency. To substantially minimize the DRAM energy-per-access, a key knob is to reduce the DRAM supply voltage but this may lead to DRAM errors (i.e., the so-called approximate DRAM). Towards this, we propose SparkXD, a novel framework that provides a comprehensive conjoint solution for resilient and energy-efficient SNN inference using low-power DRAMs subjected to voltage-induced errors. The key mechanisms of SparkXD are: (1) improving the SNN error tolerance through fault-aware training that considers bit errors from approximate DRAM, (2) analyzing the error tolerance of the improved SNN model to find the maximum tolerable bit error rate (BER) that meets the targeted accuracy constraint, and (3) energy-efficient DRAM data mapping for the resilient SNN model that maps the weights in the appropriate DRAM location to minimize the DRAM access energy. Through these mechanisms, SparkXD mitigates the negative impact of DRAM (approximation) errors, and provides the required accuracy. The experimental results show that, for a target accuracy within 1% of the baseline design (i.e., SNN without DRAM errors), SparkXD reduces the DRAM energy by ca. 40% on average across different network sizes.


title: Alignment Knowledge Distillation for Online Streaming Attention-based Speech Recognition

abstract: This article describes an efficient training method for online streaming attention-based encoder-decoder (AED) automatic speech recognition (ASR) systems. AED models have achieved competitive performance in offline scenarios by jointly optimizing all components. They have recently been extended to an online streaming framework via models such as monotonic chunkwise attention (MoChA). However, the elaborate attention calculation process is not robust for long-form speech utterances. Moreover, the sequence-level training objective and time-restricted streaming encoder cause a nonnegligible delay in token emission during inference. To address these problems, we propose CTC synchronous training (CTC-ST), in which CTC alignments are leveraged as a reference for token boundaries to enable a MoChA model to learn optimal monotonic input-output alignments. We formulate a purely end-to-end training objective to synchronize the boundaries of MoChA to those of CTC. The CTC model shares an encoder with the MoChA model to enhance the encoder representation. Moreover, the proposed method provides alignment information learned in the CTC branch to the attention-based decoder. Therefore, CTC-ST can be regarded as self-distillation of alignment knowledge from CTC to MoChA. Experimental evaluations on a variety of benchmark datasets show that the proposed method significantly reduces recognition errors and emission latency simultaneously. The robustness to long-form and noisy speech is also demonstrated. We compare CTC-ST with several methods that distill alignment knowledge from a hybrid ASR system and show that the CTC-ST can achieve a comparable tradeoff of accuracy and latency without relying on external alignment information. The best MoChA system shows recognition accuracy comparable to that of RNN-transducer (RNN-T) while achieving lower emission latency.


title: Validation of EDGES Low-Band Antenna Beam Model

abstract: The response of the antenna is a source of uncertainty in measurements with the Experiment to Detect the Global EoR Signature (EDGES). We aim to validate the beam model of the low-band (50-100 MHz) dipole antenna with comparisons between models and against data. We find that simulations of a simplified model of the antenna over an infinite perfectly conducting ground plane are, with one exception, robust to changes of numerical electromagnetic solver code or algorithm. For simulations of the antenna with the actual finite ground plane and realistic soil properties, we find that two out of three numerical solvers agree well. Applying our analysis pipeline to a simulated driftscan observation from an early EDGES low-band instrument that had a 10 m $\times$ 10 m ground plane, we find residual levels after fitting and removing a five-term foreground model to data binned in Local Sidereal Time (LST) average about 250 mK with $\pm$40 mK variation between numerical solvers. A similar analysis of the primary 30 m $\times$ 30 m sawtooth ground plane reduced the LST-averaged residuals to about 90 mK with $\pm$10 mK between the two viable solvers. More broadly we show that larger ground planes generally perform better than smaller ground planes. Simulated data have a power which is within 4$\%$ of real observations, a limitation of net accuracy of the sky and beam models. We observe that residual spectral structures after foreground model fits match qualitatively between simulated data and observations, suggesting that the frequency dependence of the beam is reasonably represented by the models. We find that soil conductivity of 0.02 Sm$^{-1}$ and relative permittivity of 3.5 yield good agreement between simulated spectra and observations. This is consistent with the soil properties reported by Sutinjo et al. (2015) for the Murchison Radio-astronomy Observatory, where EDGES is located.


title: SpikeDyn: A Framework for Energy-Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments

abstract: Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their energy-efficient design for resource-constrained scenarios (like embedded systems, IoT-Edge, etc.). We propose SpikeDyn, a comprehensive framework for energy-efficient SNNs with continual and unsupervised learning capabilities in dynamic environments, for both the training and inference phases. It is achieved through the following multiple diverse mechanisms: 1) reduction of neuronal operations, by replacing the inhibitory neurons with direct lateral inhibitions; 2) a memory- and energy-constrained SNN model search algorithm that employs analytical models to estimate the memory footprint and energy consumption of different candidate SNN models and selects a Pareto-optimal SNN model; and 3) a lightweight continual and unsupervised learning algorithm that employs adaptive learning rates, adaptive membrane threshold potential, weight decay, and reduction of spurious updates. Our experimental results show that, for a network with 400 excitatory neurons, our SpikeDyn reduces the energy consumption on average by 51% for training and by 37% for inference, as compared to the state-of-the-art. Due to the improved learning algorithm, SpikeDyn provides on avg. 21% accuracy improvement over the state-of-the-art, for classifying the most recently learned task, and by 8% on average for the previously learned tasks.


title: Frobenius Groups with Perfect Order Classes

abstract: The purpose of this paper is to investigate the finite Frobenius groups with "perfect order classes"; that is, those for which the number of elements of each order is a divisor of the order of the group. If a finite Frobenius group has perfect order classes then so too does its Frobenius complement, the Frobenius kernel is a homocyclic group of odd prime power order, and the Frobenius complement acts regularly on the elements of prime order in the Frobenius kernel. The converse is also true. Combined with elementary number-theoretic arguments, we use this to provide characterisations of several important classes of Frobenius groups. The insoluble Frobenius groups with perfect order classes are fully characterised. These turn out to be the perfect Frobenius groups whose Frobenius kernel is a homocyclic $11$-group of rank $2$. We also determine precisely which nilpotent Frobenius complements have perfect order classes, from which it follows that a Frobenius group with nilpotent complement has perfect order classes only if the Frobenius complement is a cyclic $\{2,3\}$-group of even order. Those Frobenius groups for which the Frobenius complement is a biprimary group are also described fully, and we show that no soluble Frobenius group whose Frobenius complement is a $\{2,3,5\}$-group with order divisible by $30$ has perfect order classes.


title: Unramified Cohomology of Quadrics in Characteristic Two

abstract: Let $F$ be a field of characteristic 2 and let $X$ be a smooth projective quadric of dimension $\ge 1$ over $F$. We study the unramified cohomology groups with 2-primary torsion coefficients of $X$ in degrees 2 and 3. We determine completely the kernel and the cokernel of the natural map from the cohomology of $F$ to the unramified cohomology of $X$. This extends the results in characteristic different from 2 obtained by Kahn, Rost and Sujatha in the nineteen-nineties.


title: Exotic dielectric behaviors induced by pseudo-spin texture in magnetic twisted bilayer

abstract: Twisted van der Waals bilayers provide an ideal platform to study the electron correlation in solids. Of particular interest is the 30 degree twisted bilayer honeycomb lattice system, which possesses an incommensurate moire pattern and uncommon electronic behaviors may appear due to the absence of phase coherence. Such system is extremely sensitive to further twist and many intriguing phenomena will occur. In this work, based on first-principles calculations we show that, for further twist near 30 degree, there could induce dramatically different dielectric behaviors of electron between left and right twisted cases. Specifically, it is found that the left and right twists show suppressed and amplified dielectric response under vertical electric field, respectively. Further analysis demonstrate that such exotic dielectric property can be attributed to the stacking dependent charge redistribution due to twist, which forms twist-dependent pseudospin textures. We will show that such pseudospin textures are robust under small electric field. As a result, for the right twisted case, there is almost no electric dipole formation exceeding the monolayer thickness when the electric field is applied. Whereas for the left case, the system could even demonstrate negative susceptibility, i.e. the induced polarization is opposite to the applied field, which is very rare in the nature. Such findings not only enrich our understanding on moire systems but also open an appealing route toward functional 2D materials design for electronic, optical and even energy storage devices.


title: Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment -- An Extended Multi-armed Bandit Approach

abstract: Caching high-frequency reuse contents at the edge servers in the mobile edge computing (MEC) network omits the part of backhaul transmission and further releases the pressure of data traffic. However, how to efficiently decide the caching contents for edge servers is still an open problem, which refers to the cache capacity of edge servers, the popularity of each content, and the wireless channel quality during transmission. In this paper, we discuss the influence of unknown user density and popularity of content on the cache placement solution at the edge server. Specifically, towards the implementation of the cache placement solution in the practical network, there are two problems needing to be solved. First, the estimation of unknown users' preference needs a huge amount of records of users' previous requests. Second, the overlapping serving regions among edge servers cause the wrong estimation of users' preference, which hinders the individual decision of caching placement. To address the first issue, we propose a learning-based solution to adaptively optimize the cache placement policy. We develop the extended multi-armed bandit (Extended MAB), which combines the generalized global bandit (GGB) and Standard Multi-armed bandit (MAB). For the second problem, a multi-agent Extended MAB-based solution is presented to avoid the mis-estimation of parameters and achieve the decentralized cache placement policy. The proposed solution determines the primary time slot and secondary time slot for each edge server. The proposed strategies are proven to achieve the bounded regret according to the mathematical analysis. Extensive simulations verify the optimality of the proposed strategies when comparing with baselines.


title: Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models

abstract: Despite the remarkable performance of deep learning methods on various tasks, most cutting-edge models rely heavily on large-scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling costs for medical images are very high, especially in medical image segmentation, which typically requires intensive pixel/voxel-wise labeling. Therefore, the strong capability of learning and generalizing from limited supervision, including a limited amount of annotations, sparse annotations, and inaccurate annotations, is crucial for the successful application of deep learning models in medical image segmentation. However, due to its intrinsic difficulty, segmentation with limited supervision is challenging and specific model design and/or learning strategies are needed. In this paper, we provide a systematic and up-to-date review of the solutions above, with summaries and comments about the methodologies. We also highlight several problems in this field, discussed future directions observing further investigations.


title: Training Generative Adversarial Networks in One Stage

abstract: Generative Adversarial Networks (GANs) have demonstrated unprecedented success in various image generation tasks. The encouraging results, however, come at the price of a cumbersome training process, during which the generator and discriminator are alternately updated in two stages. In this paper, we investigate a general training scheme that enables training GANs efficiently in only one stage. Based on the adversarial losses of the generator and discriminator, we categorize GANs into two classes, Symmetric GANs and Asymmetric GANs, and introduce a novel gradient decomposition method to unify the two, allowing us to train both classes in one stage and hence alleviate the training effort. We also computationally analyze the efficiency of the proposed method, and empirically demonstrate that, the proposed method yields a solid $1.5\times$ acceleration across various datasets and network architectures. Furthermore, we show that the proposed method is readily applicable to other adversarial-training scenarios, such as data-free knowledge distillation. The code is available at https://github.com/zju-vipa/OSGAN.


title: Quasi-simple modules and Loewy lengths in modular representations of reductive Lie algebras

abstract: Let $\frak g$ be a reductive Lie algebra over an algebraically closed field of characteristic $p>0$. In this paper, we study the representations of $\frak g$ with a $p$-character $\chi$ of standard Levi form associated with a given subset $I$ of the simple root system $\Pi$ of $\frak g$. Let $U_\chi({\frak g})$ be the reduced enveloping algebra of $\frak g$. A notion "quasi-simple module" (denoted by $\mathcal L_\chi(\lambda)$) is introduced. The properties of such a module turn out to be better than those of the corresponding simple module $\widehat L_\chi(\lambda)$. It enables us to investigate the $U_\chi({\frak g})$-modules from a new point of view, and correspondingly gives rise new consequences. First, we show that the first self extension of $\mathcal L_\chi(\lambda)$ is zero, and the projective dimension of $\mathcal L_\chi(\lambda)$ is finite when $\lambda$ is $p$-regular. These properties make it significant to rewrite the formula of Lusztig's Hope (Lusztig's conjecture on the irreducible characters in the category of $U_\chi({\frak g})$-modules) by replacing $\widehat L_\chi(\lambda)$ by $\mathcal L_\chi(\lambda)$. Second, with the aid of quasi-simple modules, we get a formula on the Loewy lengths of standard modules and proper standard modules over $U_\chi({\frak g})$. And by studying some examples, we formulate some conjectures on the Loewy lengths of indecomposable projective $\frak g$-modules, standard modules and proper standard modules.