title: Mobile Health Solution for College Student Mental Health: Interview Study and Design Requirement Analysis

abstract: Background: Mental health problems are prevalent in college students. The COVID-19 pandemic exacerbated the problems, and created a surge in the popularity of telehealth and mobile health solutions. Despite that mobile health is a promising approach to help students with mental health needs, few studies exist in investigating key features students need in a mental health self-management tool. Objective: The objective of our study was to identified key requirements and features for the design of a student-centered mental health self-management tool. Methods: An interview study was first conducted to understand college students' needs and preferences on a mental health self-management tool. Functional information requirement analysis was then conducted to translate the needs into design implications. Results: A total of 153 university students were recruited for the semi-structured interview. The participants mentioned several features including coping techniques, artificial intelligence, time management, tracking, and communication with others. Participant's preferences on usability and privacy settings were also collected. The desired functions were analyzed and turned into design-agnostic information requirements. Conclusions: This study documents findings from interviews with university students to understand their needs and preferences for a tool to help with self-management of mental health.


title: The $\phi p$ bound state in the unitary coupled-channel approximation

abstract: The strong attractive interaction of the $\phi$ meson and the proton is reported by ALICE collaboration recently. The corresponding scattering length $f_0$ is given as $Re(f_0)=0.85\pm0.34(stat)\pm0.14(syst)$fm and $Im(f_0)=0.16\pm0.10(stat)\pm0.09(syst)$fm. The fact that the real part is significant in contrast to the imaginary part indicates a dominate role of the elastic scattering, whereas the inelastic process is less important. In this work, such scattering processes are inspected based on a unitary coupled-channel approach inspired by Bethe-Salpeter equation. The $\phi p$ scattering length is calculated based on this approach, and it is found that the experimental value of the $\phi p$ scattering length can be obtained only if the attractive interaction of the $\phi$ meson and the proton is taken into account. A significant outcome of such attractive interaction is a two-pole structure in the $\phi p$ scattering amplitude. One of the pole, locating at $(1969-i283)$~MeV might correspond to $N(1895)1/2^-$ or $N(1875)3/2^-$ listed in the review of the Particle Data Group(PDG). The other one, locating at ${1949-i3}$~MeV should be a $\phi N$ bound state, which has no counterpart in the PDG data.


title: Confounder Analysis in Measuring Representation in Product Funnels

abstract: This paper discusses an application of Shapley values in the causal inference field, specifically on how to select the top confounder variables for coarsened exact matching method in a scalable way. We use a dataset from an observational experiment involving LinkedIn members as a use case to test its applicability, and show that Shapley values are highly informational and can be leveraged for its robust importance-ranking capability.


title: Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding

abstract: Knowledge Graph Embedding (KGE), which projects entities and relations into continuous vector spaces, have garnered significant attention. Although high-dimensional KGE methods offer better performance, they come at the expense of significant computation and memory overheads. Decreasing embedding dimensions significantly deteriorates model performance. While several recent efforts utilize knowledge distillation or non-Euclidean representation learning to augment the effectiveness of low-dimensional KGE, they either necessitate a pre-trained high-dimensional teacher model or involve complex non-Euclidean operations, thereby incurring considerable additional computational costs. To address this, this work proposes Confidence-aware Self-Knowledge Distillation (CSD) that learns from model itself to enhance KGE in a low-dimensional space. Specifically, CSD extracts knowledge from embeddings in previous iterations, which would be utilized to supervise the learning of the model in the next iterations. Moreover, a specific semantic module is developed to filter reliable knowledge by estimating the confidence of previously learned embeddings. This straightforward strategy bypasses the need for time-consuming pre-training of teacher models and can be integrated into various KGE methods to improve their performance. Our comprehensive experiments on six KGE backbones and four datasets underscore the effectiveness of the proposed CSD.


title: Search for extended Lyman-$\alpha$ emission around 9k quasars at z=2-3

abstract: Enormous Ly$\alpha$ nebulae (ELANe) around quasars have provided unique insights into the formation of massive galaxies and their associations with super-massive black holes since their discovery. However, their detection remains highly limited. This paper introduces a systematic search for extended Ly$\alpha$ emission around 8683 quasars at $z=$2.34-3.00 using a simple but very effective broad-band $gri$ selection based on the Third Public Data Release of the Hyper Suprime-Cam Subaru Strategic Program. Although the broad-band selection detects only bright Ly$\alpha$ emission ($\gtrsim1\times10^{-17}$ erg~s$^{-1}$cm$^{-2}$arcsec$^{-2}$) compared with narrow-band imaging and integral field spectroscopy, we can apply this method to far more sources than such common approaches. We first generated continuum $g$-band images without contributions from Ly$\alpha$ emission for host and satellite galaxies using $r$- and $i$-bands. Then, we established Ly$\alpha$ maps by subtracting them from observed $g$-band images with Ly$\alpha$ emissions. Consequently, we discovered extended Ly$\alpha$ emission (with masked area $>40$ arcsec$^2$) for 7 and 32 out of 366 and 8317 quasars in the Deep and Ultra-deep (35 deg$^2$) and Wide (890 deg$^2$) layers, parts of which may be potential candidates of ELANe. However, none of them seem to be equivalent to the largest ELANe ever found. We detected higher fractions of quasars with large nebulae around more luminous or radio-loud quasars, supporting previous results. Future applications to the forthcoming big data from the Vera C. Rubin Observatory will help us detect more promising candidates. The source catalogue and obtained Ly$\alpha$ properties for all the quasar targets are accessible as online material.


title: Towards a compact all optical terahertz-driven electron source at Tsinghua University

abstract: We propose a physical design of a compact all optical terahertz (THz)-driven electron source. The 300 mm accelerator beamline, powered by Joule level laser system, is easily to be integrated to tabletop scale. A dual-feed THz-driven electron gun with an exponential impedance, a tapered dielectric loaded cylindrical waveguide, THz-driven bunch compressors and permanent magnet solenoids (PMS) have been designed and optimized. Dynamics simulations show that the electron source can deliver a 19 fC, 3 MeV electron beams with a normalized transverse emittance of 0.079 {\pi}.mm.mrad. A minimum relative energy spread of 0.04% or a minimum root-mean-square bunch length of 6.1 fs can be achieved by adjusting the beam shaping line. Sensitivity analysis shows that the THz-driven electron source can effectively work under a 1.5% energy jitter of the THz power system. Simulated diffraction pattern up to the fourth order of an aluminum sample based on the beamline can be clearly distinguished. A prototype THz gun has beam fabricated and is now under testing, more results will be reported in future works.


title: Inverting Ray-Knight identities on trees

abstract: In this paper, we first introduce the Ray-Knight identity and percolation Ray-Knight identity related to loop soup with intensity $\alpha (\ge 0)$ on trees. Then we present the inversions of the above identities, which are expressed in terms of repelling jump processes. In particular, the inversion in the case of $\alpha=0$ gives the conditional law of a Markov jump process given its local time field. We further show that the fine mesh limits of these repelling jump processes are the self-repelling diffusions \cite{Aidekon} involved in the inversion of the Ray-Knight identity on the corresponding metric graph. This is a generalization of results in \cite{2016Inverting,lupu2019inverting,LupuEJP657}, where the authors explore the case of $\alpha=1/2$ on a general graph. Our construction is different from \cite{2016Inverting,lupu2019inverting} and based on the link between random networks and loop soups.


title: Masked Unsupervised Self-training for Label-free Image Classification

abstract: State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved impressive progress, it still requires a second stage of finetuning on labeled data. On the other hand, models pre-trained with large-scale text-image supervision (e.g., CLIP) have enabled zero-shot transfer to downstream image classification tasks. However, the zero-shot performance of CLIP-like models are often insufficient for real-world adoption. In this paper, we aim to leverage the abundant unlabeled data from a target domain to improve the performance of a pre-trained zero-shot classifier, by unsupervised finetuning of the pre-trained model. We propose Masked Unsupervised Self-Training (MUST), a new unsupervised adaptation method which leverages two different and complementary sources of training signals: pseudo-labels and raw images. MUST jointly optimizes three objectives to learn both class-level global feature and pixel-level local feature and enforces a regularization between the two. We demonstrate the efficacy of MUST on a variety of downstream tasks, where it improves upon CLIP by a large margin. MUST also outperforms supervised few-shot adaptation methods. It achieves a top-1 accuracy of 77.7% on ImageNet using ViT-B, +9.4% higher than CLIP, and +6.2% higher than 16-shot CLIP adaptation. Our code is available at https://github.com/salesforce/MUST.


title: Achievements and Lessons Learned from Successful Small Satellite Missions for Space Weather-Oriented Research

abstract: When the first CubeSats were launched nearly two decades ago, few people believed that the miniature satellites would likely prove to be a useful scientific tool. Skeptics abounded. However, the last decade has seen the highly successful implementation of space missions that make creative and innovative use of fast-advancing CubeSat and small satellite technology to carry out important science experiments and missions. Several projects now have used CubeSats to obtain first-of-their-kind observations and findings that have formed the basis for high-profile engineering and science publications, thereby establishing without doubt the scientific value and broad utility of CubeSats. In this paper, we describe recent achievements and lessons learned from a representative selection of successful CubeSat missions with a space weather focus. We conclude that these missions were successful in part because their limited resources promoted not only mission focus but also appropriate risk-taking for comparatively high science return. Quantitative analysis of refereed publications from these CubeSat missions and several larger missions reveals that mission outcome metrics compare favorably when publication number is normalized by mission cost or if expressed as a weighted net scientific impact of all mission publications.

categories: astro-ph.IM astro-ph.EP astro-ph.SR physics.space-ph


title: A Simple and Optimal Policy Design with Safety against Heavy-tailed Risk for Stochastic Bandits

abstract: We study the stochastic multi-armed bandit problem and design new policies that enjoy both worst-case optimality for expected regret and light-tailed risk for regret distribution. Starting from the two-armed bandit setting with time horizon $T$, we propose a simple policy and prove that the policy (i) enjoys the worst-case optimality for the expected regret at order $O(\sqrt{T\ln T})$ and (ii) has the worst-case tail probability of incurring a linear regret decay at an exponential rate $\exp(-\Omega(\sqrt{T}))$, a rate that we prove to be best achievable for all worst-case optimal policies. Briefly, our proposed policy achieves a delicate balance between doing more exploration at the beginning of the time horizon and doing more exploitation when approaching the end, compared to the standard Successive Elimination policy and Upper Confidence Bound policy. We then improve the policy design and analysis to work for the general $K$-armed bandit setting. Specifically, the worst-case probability of incurring a regret larger than any $x>0$ is upper bounded by $\exp(-\Omega(x/\sqrt{KT}))$. We then enhance the policy design to accommodate the "any-time" setting where $T$ is not known a priori, and prove equivalently desired policy performances as compared to the "fixed-time" setting with known $T$. A brief account of numerical experiments is conducted to illustrate the theoretical findings. We conclude by extending our proposed policy design to the general stochastic linear bandit setting and proving that the policy leads to both worst-case optimality in terms of expected regret order and light-tailed risk on the regret distribution.


title: Total controllability analysis discovers explainable drugs for Covid-19 treatment

abstract: Network medicine has been pursued for Covid-19 drug repurposing. One such approach adopts structural controllability, a theory for controlling a network (the cell). Motivated to protect the cell from viral infections, we extended this theory to total controllability and introduced a new concept of control hubs. Perturbation to any control hub renders the cell uncontrollable by exogenous stimuli, e.g., viral infections, so control hubs are ideal drug targets. We developed an efficient algorithm for finding all control hubs and applied it to the largest homogenous human protein-protein interaction network. Our new method outperforms several popular gene-selection methods, including that based on structural controllability. The final 65 druggable control hubs are enriched with functions of cell proliferation, regulation of apoptosis, and responses to cellular stress and nutrient levels, revealing critical pathways induced by SARS-CoV-2. These druggable control hubs led to drugs in 4 major categories: antiviral and anti-inflammatory agents, drugs on central nerve systems, and dietary supplements and hormones that boost immunity. Their functions also provided deep insights into the therapeutic mechanisms of the drugs for Covid-19 therapy, making the new approach an explainable drug repurposing method. A remarkable example is Fostamatinib that has been shown to lower mortality, shorten the length of ICU stay, and reduce disease severity of hospitalized Covid-19 patients. The drug targets 10 control hubs, 9 of which are kinases that play key roles in cell differentiation and programmed death. One such kinase is RIPK1 that directly interacts with viral protein nsp12, the RdRp of the virus. The study produced many control hubs that were not targets of existing drugs but were enriched with proteins on membranes and the NF-$\kappa$B pathway, so are excellent candidate targets for new drugs.


title: Human Trafficking in Mexico: Data sources, Network Analysis and the Limits of Dismantling Strategies

abstract: Human trafficking is a heartless crime that represents the second most profitable crime in the world. Mexico's geographical position makes it a country with high levels of human trafficking. Using the snowball sampling method, the major contribution of this paper is the abstraction of the human trafficking network on the southern border of Mexico. Based on a social network analysis, it is identified that the criminal network is moderately centralized (44.32%) and with medium density (0.401). Therefore, the network has minimal cohesiveness and members may find it difficult to share information, money, or products among themselves. To evaluate different dismantling strategies to tackle the criminal organization, three algorithms are evaluated. We found that the first actors to be removed are neither the most connected nor the most peripheral, but the actors who are moderately connected to people of their kind should be removed. In summary, this paper provides a significant step forward to understand quantitatively human trafficking networks and evaluate the limits of dismantling strategies.


title: Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

abstract: Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either low-dimensional projections of neural activity, or on learning dynamical systems that explicitly relate to the neural state over time. We discuss how these two approaches are interrelated by considering dynamical systems as representative of flows on a low-dimensional manifold. Building on this concept, we propose a new decomposed dynamical system model that represents complex non-stationary and nonlinear dynamics of time series data as a sparse combination of simpler, more interpretable components. Our model is trained through a dictionary learning procedure, where we leverage recent results in tracking sparse vectors over time. The decomposed nature of the dynamics is more expressive than previous switched approaches for a given number of parameters and enables modeling of overlapping and non-stationary dynamics. In both continuous-time and discrete-time instructional examples we demonstrate that our model can well approximate the original system, learn efficient representations, and capture smooth transitions between dynamical modes, focusing on intuitive low-dimensional non-stationary linear and nonlinear systems. Furthermore, we highlight our model's ability to efficiently capture and demix population dynamics generated from multiple independent subnetworks, a task that is computationally impractical for switched models. Finally, we apply our model to neural "full brain" recordings of C. elegans data, illustrating a diversity of dynamics that is obscured when classified into discrete states.


title: A Mass Dependent Density Profile from Dwarfs to Clusters

abstract: In this paper, we extend the work of Freundlich et al. 2020 who showed how to obtain a Dekel-Zhao density profile with mass dependent shape parameters in the case of galaxies. In the case of Freundlich et al. 2020, the baryonic dependence was obtained using the NIHAO set of simulations. In our case, we used simulations based on a model of ours. Following Freundlich et al. 2020, we obtained the dependence from baryon physics of the two shape parameters, obtaining in this way a mass dependent Dekel-Zhao profile describing the dark matter profiles from galaxies to clusters of galaxies. The extension to the Dekel-Zhao mass dependent profile to clusters of galaxies is the main result of the paper. In the paper, we show how the Dekel-Zhao mass dependent profile gives a good description of the density profiles of galaxies, already shown by Freundlich et al. 2020, but also to a set of clusters of galaxies.


title: A proof of the $C^r$ closing lemma and stability conjecture

abstract: It has long been conjectured that generic dynamical systems has finite periodic orbits, ever since the time of Poincar\'e. In this article, a perturbation method is proposed for the $C^r$ closing of periodic orbits. This method is applicable to both time-varying and time-invariant vector fields.


title: Measuring the tuning curve of spontaneous parameter down-conversion using a comet-tail-like pattern

abstract: The comet-tail-like interference patterns are observed using photons from the spontaneous parametric down-conversion (SPDC) process. The patterns are caused by the angular-spectrum-dependent interference and the diffraction of a blazed grating. We present the theoretical explanation and simulation results for these patterns, which are in good agreement with the experimental results. The most significant feature of the patterns is the bright parabolic contour profile, from which, one can deduce the parameter of the parabolic tuning curve of the SPDC process. This method could be helpful in designing experiments based on SPDC.


title: Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm

abstract: Pruning techniques have been successfully used in neural networks to trade accuracy for sparsity. However, the impact of network pruning is not uniform: prior work has shown that the recall for underrepresented classes in a dataset may be more negatively affected. In this work, we study such relative distortions in recall by hypothesizing an intensification effect that is inherent to the model. Namely, that pruning makes recall relatively worse for a class with recall below accuracy and, conversely, that it makes recall relatively better for a class with recall above accuracy. In addition, we propose a new pruning algorithm aimed at attenuating such effect. Through statistical analysis, we have observed that intensification is less severe with our algorithm but nevertheless more pronounced with relatively more difficult tasks, less complex models, and higher pruning ratios. More surprisingly, we conversely observe a de-intensification effect with lower pruning ratios, which indicates that moderate pruning may have a corrective effect to such distortions.


title: DETR++: Taming Your Multi-Scale Detection Transformer

abstract: Convolutional Neural Networks (CNN) have dominated the field of detection ever since the success of AlexNet in ImageNet classification [12]. With the sweeping reform of Transformers [27] in natural language processing, Carion et al. [2] introduce the Transformer-based detection method, i.e., DETR. However, due to the quadratic complexity in the self-attention mechanism in the Transformer, DETR is never able to incorporate multi-scale features as performed in existing CNN-based detectors, leading to inferior results in small object detection. To mitigate this issue and further improve performance of DETR, in this work, we investigate different methods to incorporate multi-scale features and find that a Bi-directional Feature Pyramid (BiFPN) works best with DETR in further raising the detection precision. With this discovery, we propose DETR++, a new architecture that improves detection results by 1.9% AP on MS COCO 2017, 11.5% AP on RICO icon detection, and 9.1% AP on RICO layout extraction over existing baselines.


title: Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval

abstract: Dual-Encoders is a promising mechanism for answer retrieval in question answering (QA) systems. Currently most conventional Dual-Encoders learn the semantic representations of questions and answers merely through matching score. Researchers proposed to introduce the QA interaction features in scoring function but at the cost of low efficiency in inference stage. To keep independent encoding of questions and answers during inference stage, variational auto-encoder is further introduced to reconstruct answers (questions) from question (answer) embeddings as an auxiliary task to enhance QA interaction in representation learning in training stage. However, the needs of text generation and answer retrieval are different, which leads to hardness in training. In this work, we propose a framework to enhance the Dual-Encoders model with question answer cross-embeddings and a novel Geometry Alignment Mechanism (GAM) to align the geometry of embeddings from Dual-Encoders with that from Cross-Encoders. Extensive experimental results show that our framework significantly improves Dual-Encoders model and outperforms the state-of-the-art method on multiple answer retrieval datasets.


title: Wireless Self-Powered Visual and NDE low-Cost Inspection System For Small Diameter Live Gas Distribution Mains

abstract: The arrangement of an in-pipe climbing robot that works using a sharp transmission part to explore complex relationship of lines. Standard wheeled/continued in-pipe climbing robots are leaned to slip and take while researching in pipe turns. The instrument helps in achieving the really unavoidable consequence of getting out slip and drag in the robot tracks during progression. The proposed transmission likes the useful uttermost scopes of the standard two-yield transmission, which is fostered the fundamental time for a transmission with three outcomes. The instrument decisively changes the track velocities of the robot considering the powers applied on each track inside the line relationship, by getting out the fundamental for any wonderful control. The entertainment of the robot crossing in the line network in different direction and in pipe-turns without slip shows the proposed course of action's ampleness.


title: The Canfranc Axion Detection Experiment (CADEx): Search for axions at 90 GHz with Kinetic Inductance Detectors

abstract: We propose a novel experiment, the Canfranc Axion Detection Experiment (CADEx), to probe dark matter axions with masses in the range 330-460 $\mu$eV, within the W-band (80-110 GHz), an unexplored parameter space in the well-motivated dark matter window of Quantum ChromoDynamics (QCD) axions. The experimental design consists of a microwave resonant cavity haloscope in a high static magnetic field coupled to a highly sensitive detecting system based on Kinetic Inductance Detectors via optimized quasi-optics (horns and mirrors). The experiment is in preparation and will be installed in the dilution refrigerator of the Canfranc Underground Laboratory. Sensitivity forecasts for axion detection with CADEx, together with the potential of the experiment to search for dark photons, are presented.

categories: hep-ex astro-ph.CO hep-ph physics.ins-det


title: Decentralized Aggregation for Energy-Efficient Federated Learning via Overlapped Clustering and D2D Communications

abstract: Federated learning (FL) has emerged as a distributed machine learning (ML) technique to train models without sharing users' private data. In this paper, we propose a decentralized FL scheme that is called \underline{f}ederated \underline{l}earning \underline{e}mpowered \underline{o}verlapped \underline{c}lustering for \underline{d}ecentralized aggregation (FL-EOCD). The introduced FL-EOCD leverages device-to-device (D2D) communications and overlapped clustering to enable decentralized aggregation, where a cluster is defined as a coverage zone of a typical device. The devices located on the overlapped clusters are called bridge devices (BDs). In the proposed FL-EOCD scheme, a clustering topology is envisioned where clusters are connected through BDs, so as the aggregated models of each cluster is disseminated to the other clusters in a decentralized manner without the need for a global aggregator or an additional hop of transmission. Unlike the star-based FL, the proposed FL-EOCD scheme involves a large number of local devices by reusing the RRBs in different non-adjacent clusters. To evaluate our proposed FL-EOCD scheme as opposed to baseline FL schemes, we consider minimizing the overall energy-consumption of devices while maintaining the convergence rate of FL subject to its time constraint. To this end, a joint optimization problem, considering scheduling the local devices/BDs to the CHs and computation frequency allocation, is formulated, where an iterative solution to this joint problem is devised. Extensive simulations are conducted to verify the effectiveness of the proposed FL-EOCD algorithm over FL conventional schemes in terms of energy consumption, latency, and convergence rate.


title: DynaMaR: Dynamic Prompt with Mask Token Representation

abstract: Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like a classification or regression task, we employ a fine-tuning paradigm in which the sentence representation from the language model is input to a task-specific head; the model is then fine-tuned end-to-end. However, with the emergence of models like GPT-3, prompt-based fine-tuning has been proven to be a successful approach for few-shot tasks. Inspired by this work, we study discrete prompt technologies in practice. There are two issues that arise with the standard prompt approach. First, it can overfit on the prompt template. Second, it requires manual effort to formulate the downstream task as a language model problem. In this paper, we propose an improvement to prompt-based fine-tuning that addresses these two issues. We refer to our approach as DynaMaR -- Dynamic Prompt with Mask Token Representation. Results show that DynaMaR can achieve an average improvement of 10% in few-shot settings and improvement of 3.7% in data-rich settings over the standard fine-tuning approach on four e-commerce applications.


title: Review on Multiple Plagiarism: A Performance Comparison Study

abstract: Plagiarism is the practice of claiming to be someone else content, thoughts or ideas as one own without any proper credit and citations. This paper is a survey paper that, represent the some of the great research paper and its comparison that is work done on plagiarism. Now a days, plagiarism became one of the most interesting and crucial research points in Natural Language Processing area. We review some old research paper based on different types of plagiarism detection and their models and algorithm, and comparison of the accuracy of those papers. There are many several ways which are available for plagiarism detection in different language. There are a few algorithms to detecting plagiarism. Like, corpus, CL-CNG, LSI, Levenshtein Distance etc. We analysis those papers, and learn that they used different types of algorithms for detecting plagiarism. After experiment those papers, we got that some of the algorithms give a better output and accuracy for detecting plagiarism. We are going to give a review on some papers about Plagiarism and will discuss about the pros and cons of their models. And we also show a propose method for plagiarism detection method which based on sentience separation, word separation and make sentence based on synonym and compare with any sources.


title: Lindbladian Many-Body Localization

abstract: We discover a novel localization transition that alters the dynamics of coherence in disordered many-body spin systems subject to Markovian dissipation. The transition occurs in the middle spectrum of the Lindbladian super-operator whose eigenstates obey the universality of non-Hermitian random-matrix theory for weak disorder and exhibit localization of off-diagonal degrees of freedom for strong disorder. This Lindbladian many-body localization prevents many-body decoherence due to interactions and is conducive to robustness of the coherent dynamics characterized by the rigidity of the decay rate of coherence.


title: Structured Context Transformer for Generic Event Boundary Detection

abstract: Generic Event Boundary Detection (GEBD) aims to detect moments where humans naturally perceive as event boundaries. In this paper, we present Structured Context Transformer (or SC-Transformer) to solve the GEBD task, which can be trained in an end-to-end fashion. Specifically, we use the backbone convolutional neural network (CNN) to extract the features of each video frame. To capture temporal context information of each frame, we design the structure context transformer (SC-Transformer) by re-partitioning input frame sequence. Note that, the overall computation complexity of SC-Transformer is linear to the video length. After that, the group similarities are computed to capture the differences between frames. Then, a lightweight fully convolutional network is used to determine the event boundaries based on the grouped similarity maps. To remedy the ambiguities of boundary annotations, the Gaussian kernel is adopted to preprocess the ground-truth event boundaries to further boost the accuracy. Extensive experiments conducted on the challenging Kinetics-GEBD and TAPOS datasets demonstrate the effectiveness of the proposed method compared to the state-of-the-art methods.


title: On a framework of data assimilation for neuronal networks

abstract: When handling real-world data modeled by a complex network dynamical system, the number of the parameters is always even much more than the size of the data. Therefore, in many cases, it is impossible to estimate these parameters and however, the exact value of each parameter is frequently less interesting than the distribution of the parameters may contain important information towards understanding the system and data. In this paper, we propose this question arising by employing a data assimilation approach to estimate the distribution of the parameters in the leakage-integrate-fire (LIF) neuronal network model from the experimental data, for example, the blood-oxygen-level-dependent (BOLD) signal. Herein, we assume that the parameters of the neurons and synapses are inhomogeneous but independently identical distributed following certain distribution with unknown hyperparameters. Thus, we estimate these hyperparameters of the distributions of the parameters, instead of estimating the parameters themselves. We formulate this problem under the framework of data assimilation and hierarchical Bayesian method, and present an efficient method named Hierarchical Data Assimilation (HDA) to conduct the statistical inference on the neuronal network model with the BOLD signal data simulated by the hemodynamic model. We consider the LIF neuronal networks with four synapses and show that the proposed algorithm can estimate the BOLD signals and the hyperparameters with good preciseness. In addition, we discuss the influence on the performance of the algorithm configuration and the LIF network model setup.


title: A Formalism of DNN Accelerator Flexibility

abstract: The high efficiency of domain-specific hardware accelerators for machine learning (ML) has come from specialization, with the trade-off of less configurability/ flexibility. There is growing interest in developing flexible ML accelerators to make them future-proof to the rapid evolution of Deep Neural Networks (DNNs). However, the notion of accelerator flexibility has always been used in an informal manner, restricting computer architects from conducting systematic apples-to-apples design-space exploration (DSE) across trillions of choices. In this work, we formally define accelerator flexibility and show how it can be integrated for DSE. Specifically, we capture DNN accelerator flexibility across four axes: tiling, ordering, parallelization, and array shape. We categorize existing accelerators into 16 classes based on their axes of flexibility support, and define a precise quantification of the degree of flexibility of an accelerator across each axis. We leverage these to develop a novel flexibility-aware DSE framework. We demonstrate how this can be used to perform first-of-their-kind evaluations, including an isolation study to identify the individual impact of the flexibility axes. We demonstrate that adding flexibility features to a hypothetical DNN accelerator designed in 2014 improves runtime on future (i.e., present-day) DNNs by 11.8x geomean.


title: The Computational Complexity of Classical Knot Recognition

abstract: The classical knot recognition problem is the problem of determining whether the virtual knot represented by a given diagram is classical. We prove that this problem is in NP, and we give an exponential time algorithm for the problem.


title: Singular support and Characteristic cycle of a rank one sheaf in codimension two

abstract: We compute the singular support and the characteristic cycle of a rank 1 sheaf on a smooth variety in codimension 2 using ramification theory, when the ramification of the sheaf is clean. We develop a general theory, called the partially logarithmic ramification theory, and define an algebraic cycle on a logarithmic cotangent bundle with partial logarithmic poles along the boundary. We prove that the inverse image of the support of the cycle and the pull-back of the cycle to the cotangent bundle are equal to the singular support and the characteristic cycle, respectively, outside a closed subset of the variety of codimension greater than 2 under a mild assumption.


title: Enhancing Distributional Stability among Sub-populations

abstract: Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict invariance with multiple training environments. Although intuitively reasonable, strong assumptions on the availability and quality of environments are made to learn the strict invariance property. In this work, we come up with the ``distributional stability" notion to mitigate such limitations. It quantifies the stability of prediction mechanisms among sub-populations down to a prescribed scale. Based on this, we propose the learnability assumption and derive the generalization error bound under distribution shifts. Inspired by theoretical analyses, we propose our novel stable risk minimization (SRM) algorithm to enhance the model's stability w.r.t. shifts in prediction mechanisms ($Y|X$-shifts). Experimental results are consistent with our intuition and validate the effectiveness of our algorithm. The code can be found at https://github.com/LJSthu/SRM.


title: Solving Stackelberg Prediction Game with Least Squares Loss via Spherically Constrained Least Squares Reformulation

abstract: The Stackelberg prediction game (SPG) is popular in characterizing strategic interactions between a learner and an attacker. As an important special case, the SPG with least squares loss (SPG-LS) has recently received much research attention. Although initially formulated as a difficult bi-level optimization problem, SPG-LS admits tractable reformulations which can be polynomially globally solved by semidefinite programming or second order cone programming. However, all the available approaches are not well-suited for handling large-scale datasets, especially those with huge numbers of features. In this paper, we explore an alternative reformulation of the SPG-LS. By a novel nonlinear change of variables, we rewrite the SPG-LS as a spherically constrained least squares (SCLS) problem. Theoretically, we show that an $\epsilon$ optimal solution to the SCLS (and the SPG-LS) can be achieved in $\tilde{O}(N/\sqrt{\epsilon})$ floating-point operations, where $N$ is the number of nonzero entries in the data matrix. Practically, we apply two well-known methods for solving this new reformulation, i.e., the Krylov subspace method and the Riemannian trust region method. Both algorithms are factorization free so that they are suitable for solving large scale problems. Numerical results on both synthetic and real-world datasets indicate that the SPG-LS, equipped with the SCLS reformulation, can be solved orders of magnitude faster than the state of the art.


title: SMT-Based Model Checking of Industrial Simulink Models

abstract: The development of embedded systems requires formal analysis of models such as those described with MATLAB/Simulink. However, the increasing complexity of industrial models makes analysis difficult. This paper proposes a model checking method for Simulink models using SMT solvers. The proposed method aims at (1) automated, efficient and comprehensible verification of complex models, (2) numerically accurate analysis of models, and (3) demonstrating the analysis of Simulink models using an SMT solver (we use Z3). It first encodes a target model into a predicate logic formula in the domain of mathematical arithmetic and bit vectors. We explore how to encode various Simulink blocks exactly. Then, the method verifies a given invariance property using the k-induction-based algorithm that extracts a subsystem involving the target block and unrolls the execution paths incrementally. In the experiment, we applied the proposed method and other tools to a set of models and properties. Our method successfully verified most of the properties including those unverified with other tools.


title: False Consensus, Information Theory, and Prediction Markets

abstract: We study a setting where Bayesian agents with a common prior have private information related to an event's outcome and sequentially make public announcements relating to their information. Our main result shows that when agents' private information is independent conditioning on the event's outcome whenever agents have similar beliefs about the outcome, their information is aggregated. That is, there is no false consensus. Our main result has a short proof based on a natural information theoretic framework. A key ingredient of the framework is the equivalence between the sign of the ``interaction information'' and a super/sub-additive property of the value of people's information. This provides an intuitive interpretation and an interesting application of the interaction information, which measures the amount of information shared by three random variables. We illustrate the power of this information theoretic framework by reproving two additional results within it: 1) that agents quickly agree when announcing (summaries of) beliefs in round robin fashion [Aaronson 2005]; and 2) results from [Chen et al 2010] on when prediction market agents should release information to maximize their payment. We also interpret the information theoretic framework and the above results in prediction markets by proving that the expected reward of revealing information is the conditional mutual information of the information revealed.


title: Regression in Tensor Product Spaces by the Method of Sieves

abstract: Estimation of a conditional mean (linking a set of features to an outcome of interest) is a fundamental statistical task. While there is an appeal to flexible nonparametric procedures, effective estimation in many classical nonparametric function spaces (e.g., multivariate Sobolev spaces) can be prohibitively difficult -- both statistically and computationally -- especially when the number of features is large. In this paper, we present (penalized) sieve estimators for regression in nonparametric tensor product spaces: These spaces are more amenable to multivariate regression, and allow us to, in-part, avoid the curse of dimensionality. Our estimators can be easily applied to multivariate nonparametric problems and have appealing statistical and computational properties. Moreover, they can effectively leverage additional structures such as feature sparsity. In this manuscript, we give theoretical guarantees, indicating that the predictive performance of our estimators scale favorably in dimension. In addition, we also present numerical examples to compare the finite-sample performance of the proposed estimators with several popular machine learning methods.


title: Strong cospectrality in trees

abstract: We prove that no tree contains a set of three vertices which are pairwise strongly cospectral. This answers a question raised by Godsil and Smith in 2017.


title: An Indoor Environment Sensing and Localization System via mmWave Phased Array

abstract: An indoor layout sensing and localization system in 60GHz millimeter wave (mmWave) band, named mmReality, is elaborated in this paper. The mmReality system consists of one transmitter and one mobile receiver, each with a phased array and a single radio frequency (RF) chain. To reconstruct the room layout, the pilot signal is delivered from the transmitter to the receiver via different pairs of transmission and receiving beams, so that the signals at all antenna elements can be resolved. Then, the spatial smoothing and two-dimensional multiple signal classification (MUSIC) algorithm is applied to detect the angle-of-arrival (AoAs) and angle-of-departure (AoDs) of the rays from the transmitter to the receiver. Moreover, the technique of multi-carrier ranging is adopted to measure the distance of each propagation path. Synthesizing the above geometrical parameters, the location of receiver relative to the transmitter can be pinpointed, both line-of-sight (LoS) and non-line-of-sight (NLoS) paths can also be determined. Therefore, the room layout can be reconstructed by moving the receiver and repeating the above measurement in different locations of the room. At the end, we show that the reconstructed room layout can be utilized to locate a mobile device according to its AoA spectrum, even with single access point.


title: TadML: A fast temporal action detection with Mechanics-MLP

abstract: Temporal Action Detection(TAD) is a crucial but challenging task in video understanding.It is aimed at detecting both the type and start-end frame for each action instance in a long, untrimmed video.Most current models adopt both RGB and Optical-Flow streams for the TAD task. Thus, original RGB frames must be converted manually into Optical-Flow frames with additional computation and time cost, which is an obstacle to achieve real-time processing. At present, many models adopt two-stage strategies, which would slow the inference speed down and complicatedly tuning on proposals generating.By comparison, we propose a one-stage anchor-free temporal localization method with RGB stream only, in which a novel Newtonian Mechanics-MLP architecture is established. It has comparable accuracy with all existing state-of-the-art models, while surpasses the inference speed of these methods by a large margin. The typical inference speed in this paper is astounding 4.44 video per second on THUMOS14. In applications, because there is no need to convert optical flow, the inference speed will be faster.It also proves that MLP has great potential in downstream tasks such as TAD. The source code is available at https://github.com/BonedDeng/TadML


title: Joint Geometric-Semantic Driven Character Line Drawing Generation

abstract: Character line drawing synthesis can be formulated as a special case of image-to-image translation problem that automatically manipulates the photo-to-line drawing style transformation. In this paper, we present the first generative adversarial network based end-to-end trainable translation architecture, dubbed P2LDGAN, for automatic generation of high-quality character drawings from input photos/images. The core component of our approach is the joint geometric-semantic driven generator, which uses our well-designed cross-scale dense skip connections framework to embed learned geometric and semantic information for generating delicate line drawings. In order to support the evaluation of our model, we release a new dataset including 1,532 well-matched pairs of freehand character line drawings as well as corresponding character images/photos, where these line drawings with diverse styles are manually drawn by skilled artists. Extensive experiments on our introduced dataset demonstrate the superior performance of our proposed models against the state-of-the-art approaches in terms of quantitative, qualitative and human evaluations. Our code, models and dataset will be available at Github.


title: DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine Translation

abstract: The computational benefits of iterative non-autoregressive transformers decrease as the number of decoding steps increases. As a remedy, we introduce Distill Multiple Steps (DiMS), a simple yet effective distillation technique to decrease the number of required steps to reach a certain translation quality. The distilled model enjoys the computational benefits of early iterations while preserving the enhancements from several iterative steps. DiMS relies on two models namely student and teacher. The student is optimized to predict the output of the teacher after multiple decoding steps while the teacher follows the student via a slow-moving average. The moving average keeps the teacher's knowledge updated and enhances the quality of the labels provided by the teacher. During inference, the student is used for translation and no additional computation is added. We verify the effectiveness of DiMS on various models obtaining 7.8 and 12.9 BLEU points improvements in single-step translation accuracy on distilled and raw versions of WMT'14 De-En.


title: A toy model for viscous liquid dynamics

abstract: A simple model for viscous liquid dynamics is introduced. Consider the surface of the union of hyper-spheres centered at random positions inside a hypercube with periodic boundary conditions. It is argued and demonstrated by numerical simulations that at high dimensions geodetic flows on this surface is a good model for viscous liquid dynamics. It is shown that this simple model exhibits viscous dynamics for densities above the percolation threshold in $8$, $12$ and $16$ dimensions. Thus the slowing down of the dynamics, measured by the mean-squared displacement, extends to several orders of magnitude similarly to what is observed in other models for viscous dynamics. Furthermore, the shape of the mean-squared displacement is to a very good approximation the same as for the standard model in simulations of viscous liquids: the Kob-Andersen binary Lennard Jones mixture.


title: PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR System

abstract: Optical character recognition (OCR) technology has been widely used in various scenes, as shown in Figure 1. Designing a practical OCR system is still a meaningful but challenging task. In previous work, considering the efficiency and accuracy, we proposed a practical ultra lightweight OCR system (PP-OCR), and an optimized version PP-OCRv2. In order to further improve the performance of PP-OCRv2, a more robust OCR system PP-OCRv3 is proposed in this paper. PP-OCRv3 upgrades the text detection model and text recognition model in 9 aspects based on PP-OCRv2. For text detector, we introduce a PAN module with large receptive field named LK-PAN, a FPN module with residual attention mechanism named RSE-FPN, and DML distillation strategy. For text recognizer, the base model is replaced from CRNN to SVTR, and we introduce lightweight text recognition network SVTR LCNet, guided training of CTC by attention, data augmentation strategy TextConAug, better pre-trained model by self-supervised TextRotNet, UDML, and UIM to accelerate the model and improve the effect. Experiments on real data show that the hmean of PP-OCRv3 is 5% higher than PP-OCRv2 under comparable inference speed. All the above mentioned models are open-sourced and the code is available in the GitHub repository PaddleOCR which is powered by PaddlePaddle.


title: Stationary states in two lane traffic: insights from kinetic theory

abstract: Kinetics of dilute heterogeneous traffic on a two lane road is formulated in the framework of the Ben-Naim Krapivsky model and stationary state properties are analytically derived in the asymptotic limit. The heterogeneity is introduced as a quenched disorder in desired speeds of vehicles. The model assumes that each vehicle/platoon in a lane moves ballistically until it approaches a slow moving vehicle/platoon and then joins it. Vehicles in a platoon are assumed to escape the platoon at a constant rate by changing lanes. Each lane is assumed to have a different escape rate. As the stationary state is approached, the platoon density in the two lanes become equal, whereas the vehicle densities and fluxes are higher in the lane with lower escape rate. A majority of the vehicles enjoy a free-flow if the harmonic mean of the escape rates of the lanes is comparable to average initial flux on the road. The average platoon size is close to unity in the free-flow regime. If the harmonic mean is lower than the average initial flux, then vehicles with desired speeds lower than a characteristic speed $v^*$ still enjoy free-flow while those vehicles with desired speeds that are greater than $v^*$ experience congestion and form platoons behind the slower vehicles. The characteristic speed depends on the mean of escape times $(R=(R_1+R_{-1})/2)$ of the two lanes (represented by 1 and -1) as $v^* \sim R^{-\frac{1}{\mu+2}}$, where $\mu$ is the exponent of the quenched disorder distribution for desired speed in the small speed limit. The average platoon size in a lane, when $v^* \ll 1$, is proportional to $R^{\frac{\mu+1}{\mu+2}}$ plus a lane dependent correction. Equations for the kinetics of platoon size distribution for two-lane traffic are also studied. It is shown that a stationary state with platoons as large as road length can occur only if the mean escape rate is independent of platoon size.


title: Transformer-based Personalized Attention Mechanism for Medical Images with Clinical Records

abstract: In medical image diagnosis, identifying the attention region, i.e., the region of interest for which the diagnosis is made, is an important task. Various methods have been developed to automatically identify target regions from given medical images. However, in actual medical practice, the diagnosis is made based not only on the images but also on a variety of clinical records. This means that pathologists examine medical images with some prior knowledge of the patients and that the attention regions may change depending on the clinical records. In this study, we propose a method called the Personalized Attention Mechanism (PersAM), by which the attention regions in medical images are adaptively changed according to the clinical records. The primary idea of the PersAM method is to encode the relationships between the medical images and clinical records using a variant of Transformer architecture. To demonstrate the effectiveness of the PersAM method, we applied it to a large-scale digital pathology problem of identifying the subtypes of 842 malignant lymphoma patients based on their gigapixel whole slide images and clinical records.


title: Driving in Real Life with Inverse Reinforcement Learning

abstract: In this paper, we introduce the first learning-based planner to drive a car in dense, urban traffic using Inverse Reinforcement Learning (IRL). Our planner, DriveIRL, generates a diverse set of trajectory proposals, filters these trajectories with a lightweight and interpretable safety filter, and then uses a learned model to score each remaining trajectory. The best trajectory is then tracked by the low-level controller of our self-driving vehicle. We train our trajectory scoring model on a 500+ hour real-world dataset of expert driving demonstrations in Las Vegas within the maximum entropy IRL framework. DriveIRL's benefits include: a simple design due to only learning the trajectory scoring function, relatively interpretable features, and strong real-world performance. We validated DriveIRL on the Las Vegas Strip and demonstrated fully autonomous driving in heavy traffic, including scenarios involving cut-ins, abrupt braking by the lead vehicle, and hotel pickup/dropoff zones. Our dataset will be made public to help further research in this area.


title: On an analogue of the Hurewicz theorem for mean dimension

abstract: The Hurewicz theorem is a fundamental result in classical dimension theory concerning continuous maps which lower topological dimension. We study whether or not its analogue holds for mean dimension of dynamical systems. Our first main result shows that an analogue of the Hurewicz theorem does not hold for mean dimension in general. Our second main result shows that it holds true if a base system has zero mean dimension.


title: Deep Learning Metric Detectors in General Relativity

abstract: We consider conceptual issues of deep learning (DL) for metric detectors using test particle geodesics in curved spacetimes. Advantages of DL metric detectors are emphasized from a view point of general coordinate transformations. Two given metrics (two spacetimes) are defined to be conneted by a DL isometry if their geodesic image data cannot be discriminated by any DL metric detector at any time. The fundamental question of when the DL isometry appears is extensively explored. If the two spacetimes connected by the DL isometry are in superposition of quantum gravity theory, the post-measurement state may be still in the same superposition even after DL metric detectors observe the superposed state. We also demonstrate metric-detection DL's in 2+1 dimensional anti-de Sitter (AdS) spacetimes to estimate the cosmological constants and Brown-Henneaux charges. In the AdS/CFT correspondence dictionary, it may be expected that such metric detectors in the AdS bulk region correspond to quantum measurement devices in the CFT at the AdS boundary.


title: On Binomial coefficients of real arguments

abstract: As is well-known, a generalization of the classical concept of the factorial $n!$ for a real number $x\in {\mathbb R}$ is the value of Euler's gamma function $\Gamma(1+x)$. In this connection, the notion of a binomial coefficient naturally arose for admissible values of the real arguments. By elementary means, it is proved a number of properties of binomial coefficients $\binom{r}{\alpha}$ of real arguments $r,\,\alpha\in {\mathbb R}$ such as analogs of unimodality, symmetry, Pascal's triangle, etc. for classical binomial coefficients. The asymptotic behavior of such generalized binomial coefficients of a special form is established.


title: Algorithms for bounding contribution for histogram estimation under user-level privacy

abstract: We study the problem of histogram estimation under user-level differential privacy, where the goal is to preserve the privacy of all entries of any single user. We consider the heterogeneous scenario where the quantity of data can be different for each user. In this scenario, the amount of noise injected into the histogram to obtain differential privacy is proportional to the maximum user contribution, which can be amplified by few outliers. One approach to circumvent this would be to bound (or limit) the contribution of each user to the histogram. However, if users are limited to small contributions, a significant amount of data will be discarded. In this work, we propose algorithms to choose the best user contribution bound for histogram estimation under both bounded and unbounded domain settings. When the size of the domain is bounded, we propose a user contribution bounding strategy that almost achieves a two-approximation with respect to the best contribution bound in hindsight. For unbounded domain histogram estimation, we propose an algorithm that is logarithmic-approximation with respect to the best contribution bound in hindsight. This result holds without any distribution assumptions on the data. Experiments on both real and synthetic datasets verify our theoretical findings and demonstrate the effectiveness of our algorithms. We also show that clipping bias introduced by bounding user contribution may be reduced under mild distribution assumptions, which can be of independent interest.


title: Self-Knowledge Distillation based Self-Supervised Learning for Covid-19 Detection from Chest X-Ray Images

abstract: The global outbreak of the Coronavirus 2019 (COVID-19) has overloaded worldwide healthcare systems. Computer-aided diagnosis for COVID-19 fast detection and patient triage is becoming critical. This paper proposes a novel self-knowledge distillation based self-supervised learning method for COVID-19 detection from chest X-ray images. Our method can use self-knowledge of images based on similarities of their visual features for self-supervised learning. Experimental results show that our method achieved an HM score of 0.988, an AUC of 0.999, and an accuracy of 0.957 on the largest open COVID-19 chest X-ray dataset.


title: MS-RNN: A Flexible Multi-Scale Framework for Spatiotemporal Predictive Learning

abstract: Spatiotemporal predictive learning, which predicts future frames through historical prior knowledge with the aid of deep learning, is widely used in many fields. Previous work essentially improves the model performance by widening or deepening the network, but it also brings surging memory overhead, which seriously hinders the development and application of this technology. In order to improve the performance without increasing memory consumption, we focus on scale, which is another dimension to improve model performance but with low memory requirement. The effectiveness has been widely demonstrated in many CNN-based tasks such as image classification and semantic segmentation, but it has not been fully explored in recent RNN models. In this paper, learning from the benefit of multi-scale, we propose a general framework named Multi-Scale RNN (MS-RNN) to boost recent RNN models for spatiotemporal predictive learning. We verify the MS-RNN framework by thorough theoretical analyses and exhaustive experiments, where the theory focuses on memory reduction and performance improvement while the experiments employ eight RNN models (ConvLSTM, TrajGRU, PredRNN, PredRNN++, MIM, MotionRNN, PredRNN-V2, and PrecipLSTM) and four datasets (Moving MNIST, TaxiBJ, KTH, and Germany). The results show the efficiency that RNN models incorporating our framework have much lower memory cost but better performance than before. Our code is released at \url{https://github.com/mazhf/MS-RNN}.


title: An extension to the applicability of adaptive bandwidth choice

abstract: In this paper, we extend the applicability of the bandwidth choice method of Politis (2003) by relaxing the conditions of his Theorem 2.3.


title: TriBYOL: Triplet BYOL for Self-Supervised Representation Learning

abstract: This paper proposes a novel self-supervised learning method for learning better representations with small batch sizes. Many self-supervised learning methods based on certain forms of the siamese network have emerged and received significant attention. However, these methods need to use large batch sizes to learn good representations and require heavy computational resources. We present a new triplet network combined with a triple-view loss to improve the performance of self-supervised representation learning with small batch sizes. Experimental results show that our method can drastically outperform state-of-the-art self-supervised learning methods on several datasets in small-batch cases. Our method provides a feasible solution for self-supervised learning with real-world high-resolution images that uses small batch sizes.


title: Instabilities in a current sheet with plasma jet

abstract: We study the stability problem of a magnetohydrodynamic current sheet with the presence of a plasma jet. The flow direction is perpendicular to the normal of the current sheet and we analyze two cases: (1) The flow is along the anti-parallel component of the magnetic field; (2) The flow is perpendicular to the anti-parallel component of the magnetic field. A generalized equation set with the condition of incompressibility is derived and solved as a boundary-value-problem. For the first case, we show that, the streaming kink mode is stabilized by the magnetic field at $V_0/B_0 \lesssim 2$, where $V_0$ and $B_0$ are the jet speed and upstream Alfv\'en speed, and it is not affected by resistivity significantly. The streaming sausage mode is stabilized at $V_0/B_0 \lesssim 1$, and it can transit to the streaming tearing mode with a finite resistivity. The streaming tearing mode has larger growth rate than the pure tearing mode, though the scaling relation between the maximum growth rate and the Lundquist number remains unchanged. When the jet is perpendicular to the anti-parallel component of the magnetic field, the most unstable sausage mode is usually perpendicular (wave vector along the jet) without a guide field. But with a finite guide field, the most unstable sausage mode can be oblique, depending on the jet speed and guide field strength.


title: The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generation

abstract: Unbiased SGG has achieved significant progress over recent years. However, almost all existing SGG models have overlooked the ground-truth annotation qualities of prevailing SGG datasets, i.e., they always assume: 1) all the manually annotated positive samples are equally correct; 2) all the un-annotated negative samples are absolutely background. In this paper, we argue that both assumptions are inapplicable to SGG: there are numerous "noisy" groundtruth predicate labels that break these two assumptions, and these noisy samples actually harm the training of unbiased SGG models. To this end, we propose a novel model-agnostic NoIsy label CorrEction strategy for SGG: NICE. NICE can not only detect noisy samples but also reassign more high-quality predicate labels to them. After the NICE training, we can obtain a cleaner version of SGG dataset for model training. Specifically, NICE consists of three components: negative Noisy Sample Detection (Neg-NSD), positive NSD (Pos-NSD), and Noisy Sample Correction (NSC). Firstly, in Neg-NSD, we formulate this task as an out-of-distribution detection problem, and assign pseudo labels to all detected noisy negative samples. Then, in Pos-NSD, we use a clustering-based algorithm to divide all positive samples into multiple sets, and treat the samples in the noisiest set as noisy positive samples. Lastly, in NSC, we use a simple but effective weighted KNN to reassign new predicate labels to noisy positive samples. Extensive results on different backbones and tasks have attested to the effectiveness and generalization abilities of each component of NICE.


title: Parallel Computation of Inverse Compton Scattering Radiation Spectra based on Li\'enard-Wiechert Potentials

abstract: Inverse Compton Scattering (ICS) has gained much attention recently because of its promise for the development of table-top-size X-ray light sources. Precise and fast simulation is an indispensable tool for predicting the radiation property of a given machine design and to optimize its parameters. Instead of the conventional approach to compute radiation spectra which directly evaluates the discretized Fourier integral of the Li\'enard-Wiechert field given analytically (referred to as the frequency-domain method), this article focuses on an approach where the field is recorded along the observer time on a uniform time grid which is then used to compute the radiation spectra after completion of the simulation, referred to as the time-domain method. Besides the derivation and implementation details of the proposed method, we analyze possible parallelization schemes and compare the parallel performance of the proposed time-domain method with the frequency-domain method. We will characterize scenarios/conditions under which one method is expected to outperform the other.


title: Stability of a tilted granular monolayer: How many spheres can we pick before the collapse?

abstract: The triggering of avalanches is investigated using discrete element simulations for a process of random extraction of spheres. A monolayer, formed by identical spheres in a hexagonal configuration, is placed on a tilted plane surrounded by a small fence that sustains the spheres, mimicking the disposal of fruits in the market. Then, a random continuous extraction process of spheres is imposed until the collapse. For this simple numerical experiment, a phase diagram was obtained to visualize the occurrence of avalanches triggered by vacancies as a function of the tilting angle, system size, and friction coefficient. More importantly, a sub-zone was found where we can predict the critical number of extractions until the avalanche takes place. The prediction is made from an evolution model of the average coordination number based on statistical considerations. The theoretical prediction also gives a constant critical void fraction of spheres, which implies the system collapses at a critical packing fraction.


title: Development of Automatic Endotracheal Tube and Carina Detection on Portable Supine Chest Radiographs using Artificial Intelligence

abstract: The image quality of portable supine chest radiographs is inherently poor due to low contrast and high noise. The endotracheal intubation detection requires the locations of the endotracheal tube (ETT) tip and carina. The goal is to find the distance between the ETT tip and the carina in chest radiography. To overcome such a problem, we propose a feature extraction method with Mask R-CNN. The Mask R-CNN predicts a tube and a tracheal bifurcation in an image. Then, the feature extraction method is used to find the feature point of the ETT tip and that of the carina. Therefore, the ETT-carina distance can be obtained. In our experiments, our results can exceed 96\% in terms of recall and precision. Moreover, the object error is less than $4.7751\pm 5.3420$ mm, and the ETT-carina distance errors are less than $5.5432\pm 6.3100$ mm. The external validation shows that the proposed method is a high-robustness system. According to the Pearson correlation coefficient, we have a strong correlation between the board-certified intensivists and our result in terms of ETT-carina distance.


title: What is the Metaverse? An Immersive Cyberspace and Open Challenges

abstract: The Metaverse refers to a virtual-physical blended space in which multiple users can concurrently interact with a unified computer-generated environment and other users, which can be regarded as the next significant milestone of the current cyberspace. This article primarily discusses the development and challenges of the Metaverse. We first briefly describe the development of cyberspace and the necessity of technology enablers. Accordingly, our bottom-up approach highlights three critical technology enablers for the Metaverse: networks, systems, and users. Also, we highlight a number of indispensable issues, under technological and ecosystem perspectives, that build and sustain the Metaverse.


title: The Survival Bandit Problem

abstract: We introduce and study a new variant of the multi-armed bandit problem (MAB), called the survival bandit problem (S-MAB). While in both problems, the objective is to maximize the so-called cumulative reward, in this new variant, the procedure is interrupted if the cumulative reward falls below a preset threshold. This simple yet unexplored extension of the MAB follows from many practical applications. For example, when testing two medicines against each other on voluntary patients, people's health are at stake, and it is necessary to be able to interrupt experiments if serious side effects occur or if the disease syndromes are not dissipated by the treatment. From a theoretical perspective, the S-MAB is the first variant of the MAB where the procedure may or may not be interrupted. We start by formalizing the S-MAB and we define its objective as the minimization of the so-called survival regret, which naturally generalizes the regret of the MAB. Then, we show that the objective of the S-MAB is considerably more difficult than the MAB, in the sense that contrary to the MAB, no policy can achieve a reasonably small (i.e., sublinear) survival regret. Instead, we minimize the survival regret in the sense of Pareto, i.e., we seek a policy whose cumulative reward cannot be improved for some problem instance without being sacrificed for another one. For that purpose, we identify two key components in the survival regret: the regret given no ruin (which corresponds to the regret in the MAB), and the probability that the procedure is interrupted, called the probability of ruin. We derive a lower bound on the probability of ruin, as well as policies whose probability of ruin matches the lower bound. Finally, based on a doubling trick on those policies, we derive a policy which minimizes the survival regret in the sense of Pareto, giving an answer to an open problem by Perotto et al. (COLT 2019).


title: Adaptive Weighted Nonnegative Matrix Factorization for Robust Feature Representation

abstract: Nonnegative matrix factorization (NMF) has been widely used to dimensionality reduction in machine learning. However, the traditional NMF does not properly handle outliers, so that it is sensitive to noise. In order to improve the robustness of NMF, this paper proposes an adaptive weighted NMF, which introduces weights to emphasize the different importance of each data point, thus the algorithmic sensitivity to noisy data is decreased. It is very different from the existing robust NMFs that use a slow growth similarity measure. Specifically, two strategies are proposed to achieve this: fuzzier weighted technique and entropy weighted regularized technique, and both of them lead to an iterative solution with a simple form. Experimental results showed that new methods have more robust feature representation on several real datasets with noise than exsiting methods.


title: Plot Writing From Pre-Trained Language Models

abstract: Pre-trained language models (PLMs) fail to generate long-form narrative text because they do not consider global structure. As a result, the generated texts are often incohesive, repetitive, or lack content. Recent work in story generation reintroduced explicit content planning in the form of prompts, keywords, or semantic frames. Trained on large parallel corpora, these models can generate more logical event sequences and thus more contentful stories. However, these intermediate representations are often not in natural language and cannot be utilized by PLMs without fine-tuning. We propose generating story plots using off-the-shelf PLMs while maintaining the benefit of content planning to generate cohesive and contentful stories. Our proposed method, ScratchPlot, first prompts a PLM to compose a content plan. Then, we generate the story's body and ending conditioned on the content plan. Furthermore, we take a generate-and-rank approach by using additional PLMs to rank the generated (story, ending) pairs. We benchmark our method with various baselines and achieved superior results in both human and automatic evaluation.


title: Radiative heat transfer in low-symmetry Bravais crystal

abstract: Over the last few years, broken symmetry within crystals has attracted extensive attention since it can improve the control of light propagation. In particular, low-symmetry Bravais crystal can support shear polaritons which has great potential in thermal photonics. In this work, we report a twist-induced near-field thermal control system based on the low-symmetry Bravais crystal medium (\b{eta}-Ga2O3). The near-field thermal radiation (NFTR) between such crystal slabs is nearly four orders of magnitude larger than the blackbody limit, exceeding the NFTR from other traditional dielectric materials. Moreover, we show that this crystal can serve as an excellent platform for twist-induced near-field thermal control. Due to the intrinsic shear effect, the twist-induced modulation supported by low-symmetry Bravais crystal exceeds that by high-symmetry crystal. We further clarify how the shear effect affects the twist-induced thermal-radiation modulation supported by hyperbolic and elliptical polaritons and show that the shear effect significantly enhances the twist-induced thermal control induced by the elliptical polariton mode. These results open new directions for thermal-radiation control in low-symmetry materials, including geological minerals, common oxides, and organic crystals.


title: How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via $f$-Advantage Regression

abstract: Offline goal-conditioned reinforcement learning (GCRL) promises general-purpose skill learning in the form of reaching diverse goals from purely offline datasets. We propose $\textbf{Go}$al-conditioned $f$-$\textbf{A}$dvantage $\textbf{R}$egression (GoFAR), a novel regression-based offline GCRL algorithm derived from a state-occupancy matching perspective; the key intuition is that the goal-reaching task can be formulated as a state-occupancy matching problem between a dynamics-abiding imitator agent and an expert agent that directly teleports to the goal. In contrast to prior approaches, GoFAR does not require any hindsight relabeling and enjoys uninterleaved optimization for its value and policy networks. These distinct features confer GoFAR with much better offline performance and stability as well as statistical performance guarantee that is unattainable for prior methods. Furthermore, we demonstrate that GoFAR's training objectives can be re-purposed to learn an agent-independent goal-conditioned planner from purely offline source-domain data, which enables zero-shot transfer to new target domains. Through extensive experiments, we validate GoFAR's effectiveness in various problem settings and tasks, significantly outperforming prior state-of-art. Notably, on a real robotic dexterous manipulation task, while no other method makes meaningful progress, GoFAR acquires complex manipulation behavior that successfully accomplishes diverse goals.


title: On a twisted Jacquet module of GL(2n) over a finite field

abstract: Let F be a finite field and G=GL(2n,F). In this paper, we explicitly describe a certain twisted Jacquet module of an irreducible cuspidal representation of G.


title: OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection

abstract: We propose a multilingual adversarial training model for determining whether a sentence contains an idiomatic expression. Given that a key challenge with this task is the limited size of annotated data, our model relies on pre-trained contextual representations from different multi-lingual state-of-the-art transformer-based language models (i.e., multilingual BERT and XLM-RoBERTa), and on adversarial training, a training method for further enhancing model generalization and robustness. Without relying on any human-crafted features, knowledge bases, or additional datasets other than the target datasets, our model achieved competitive results and ranked 6th place in SubTask A (zero-shot) setting and 15th place in SubTask A (one-shot) setting.


title: ATP-Dependent Mismatch Recognition in DNA Replication Mismatch Repair

abstract: Mismatch repair is a critical step in DNA replication that occurs after base selection and proofreading, significantly increasing fidelity. However, the mechanism of mismatch recognition has not been established for any repair enzyme. Speculations in this area mainly focus on exploiting thermodynamic equilibrium and free energy. Nevertheless, non-equilibrium processes may play a more significant role in enhancing mismatch recognition accuracy by utilizing adenosine triphosphate (ATP). This study aimed to investigate this possibility. Considering our limited knowledge of actual mismatch repair enzymes, we proposed a hypothetical enzyme that operates as a quantum system with three discrete energy levels. When the enzyme is raised to its highest energy level, a quantum transition occurs, leading to one of two low-energy levels representing potential recognition outcomes: a correct match or a mismatch. The probabilities of the two outcomes are exponentially different, determined by the energy gap between the two low energy levels. By flipping the energy gap, discrimination between mismatches and correct matches can be achieved. Within a framework that combines quantum mechanics with thermodynamics, we established a relationship between energy cost and the recognition error.

categories: physics.bio-ph cond-mat.stat-mech q-bio.BM quant-ph


title: Learning Symbolic Operators: A Neurosymbolic Solution for Autonomous Disassembly of Electric Vehicle Battery

abstract: The booming of electric vehicles demands efficient battery disassembly for recycling to be environment-friendly. Currently, battery disassembly is still primarily done by humans, probably assisted by robots, due to the unstructured environment and high uncertainties. It is highly desirable to design autonomous solutions to improve work efficiency and lower human risks in high voltage and toxic environments. This paper proposes a novel neurosymbolic method, which augments the traditional Variational Autoencoder (VAE) model to learn symbolic operators based on raw sensory inputs and their relationships. The symbolic operators include a probabilistic state symbol grounding model and a state transition matrix for predicting states after each execution to enable autonomous task and motion planning. At last, the method's feasibility is verified through test results.


title: Mirror Symmetry for Quiver Algebroid Stacks

abstract: In this paper, we construct noncommutative algebroid stacks and the associated mirror functors for a symplectic manifold. First, we formulate a version of stack that is well adapted for gluing quiver algebras with different numbers of vertices. Second, we develop a representation theory of $A_\infty$ categories by quiver stacks. A key step is constructing an extension of the $A_\infty$ category over a quiver stack of a collection of nc-deformed objects. The extension involves non-trivial gerbe terms, which play an important role in quiver algebroid stacks. Third, we develop a general construction of mirror quiver stacks. As an important example, we apply the constrution to nc local projective plane, whose compact divisor gives rise to interesting monodromy and homotopy terms. This employs a pair-of-pants decomposition of the mirror curve as proposed by Seidel \cite{Sei-spec}. Geometrically, we find a new method of mirror construction by gluing SYZ-type Lagrangians with a Lagrangian that serves as a `middle agent' using Floer theory. The method makes crucial use of the extension of Fukaya category over quiver stacks.


title: Liouville quantum gravity from random matrix dynamics

abstract: We establish the first connection between $2d$ Liouville quantum gravity and natural dynamics of random matrices. In particular, we show that if $(U_t)$ is a Brownian motion on the unitary group at equilibrium, then the measures $$ |\det(U_t - e^{i \theta})|^{\gamma} dt d\theta $$ converge in the limit of large dimension to the $2d$ LQG measure, a properly normalized exponential of the $2d$ Gaussian free field. Gaussian free field type fluctuations associated with these dynamics were first established by Spohn (1998) and convergence to the LQG measure in $2d$ settings was conjectured since the work of Webb (2014), who proved the convergence of related one dimensional measures by using inputs from Riemann-Hilbert theory. The convergence follows from the first multi-time extension of the result by Widom (1973) on Fisher-Hartwig asymptotics of Toeplitz determinants with real symbols. To prove these, we develop a general surgery argument and combine determinantal point processes estimates with stochastic analysis on Lie group, providing in passing a probabilistic proof of Webb's $1d$ result. We believe the techniques will be more broadly applicable to matrix dynamics out of equilibrium, joint moments of determinants for classes of correlated random matrices, and the characteristic polynomial of non-Hermitian random matrices.


title: Triaxiality induced monopole-quadrupole-hexadecupole coupling in the isoscalar giant resonances for $^{86}\textrm{Ge}$

abstract: The isoscalar giant resonances for $^{86}\textrm{Ge}$ are studied by the quasiparticle finite amplitude method based on the covariant density functional theory. In addition to the well-known monopole-quadrupole coupling that splits the isoscalar giant monopole resonance in axially deformed nuclei, a monopole-quadrupole-hexadecupole coupling is identified in the triaxially deformed nucleus $^{86}\textrm{Ge}$, leading to the emergence of a distinct resonance peak at the low energy side of the isoscalar monopole strength function. The transition density of the triaxiality induced resonance peak shows a strong interplay among monopole, quadrupole, and hexadecupole vibrations. The resonance peak responses to monopole, quadrupole, and hexadecupole perturbations simultaneously, which could be regarded as a fingerprint of the triaxiality in $^{86}\textrm{Ge}$.


title: Explainability in Mechanism Design: Recent Advances and the Road Ahead

abstract: Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as machine learning and deep learning has occupied most of the limelight, systems that attempt to explain decisions (even simple ones) in the context of social choice are steadily catching up. In this paper, we provide a comprehensive survey of explainability in mechanism design, a domain characterized by economically motivated agents and often having no single choice that maximizes all individual utility functions. We discuss the main properties and goals of explainability in mechanism design, distinguishing them from those of Explainable AI in general. This discussion is followed by a thorough review of the challenges one may face when working on Explainable Mechanism Design and propose a few solution concepts to those.


title: Intelligent Circuit Design and Implementation with Machine Learning

abstract: The stagnation of EDA technologies roots from insufficient knowledge reuse. In practice, very similar simulation or optimization results may need to be repeatedly constructed from scratch. This motivates my research on introducing more 'intelligence' to EDA with machine learning (ML), which explores complex correlations in design flows based on prior data. Besides design time, I also propose ML solutions to boost IC performance by assisting the circuit management at runtime. In this dissertation, I present multiple fast yet accurate ML models covering a wide range of chip design stages from the register-transfer level (RTL) to sign-off, solving primary chip-design problems about power, timing, interconnect, IR drop, routability, and design flow tuning. Targeting the RTL stage, I present APOLLO, a fully automated power modeling framework. It constructs an accurate per-cycle power model by extracting the most power-correlated signals. The model can be further implemented on chip for runtime power management with unprecedented low hardware costs. Targeting gate-level netlist, I present Net2 for early estimations on post-placement wirelength. It further enables more accurate timing analysis without actual physical design information. Targeting circuit layout, I present RouteNet for early routability prediction. As the first deep learning-based routability estimator, some feature-extraction and model-design principles proposed in it are widely adopted by later works. I also present PowerNet for fast IR drop estimation. It captures spatial and temporal information about power distribution with a customized CNN architecture. Last, besides targeting a single design step, I present FIST to efficiently tune design flow parameters during both logic synthesis and physical design.


title: Deep Learning Techniques for Visual Counting

abstract: In this dissertation, we investigated and enhanced Deep Learning (DL) techniques for counting objects, like pedestrians, cells or vehicles, in still images or video frames. In particular, we tackled the challenge related to the lack of data needed for training current DL-based solutions. Given that the budget for labeling is limited, data scarcity still represents an open problem that prevents the scalability of existing solutions based on the supervised learning of neural networks and that is responsible for a significant drop in performance at inference time when new scenarios are presented to these algorithms. We introduced solutions addressing this issue from several complementary sides, collecting datasets gathered from virtual environments automatically labeled, proposing Domain Adaptation strategies aiming at mitigating the domain gap existing between the training and test data distributions, and presenting a counting strategy in a weakly labeled data scenario, i.e., in the presence of non-negligible disagreement between multiple annotators. Moreover, we tackled the non-trivial engineering challenges coming out of the adoption of Convolutional Neural Network-based techniques in environments with limited power resources, introducing solutions for counting vehicles and pedestrians directly onboard embedded vision systems, i.e., devices equipped with constrained computational capabilities that can capture images and elaborate them.


title: Relaxed Gaussian process interpolation: a goal-oriented approach to Bayesian optimization

abstract: This work presents a new procedure for obtaining predictive distributions in the context of Gaussian process (GP) modeling, with a relaxation of the interpolation constraints outside some ranges of interest: the mean of the predictive distributions no longer necessarily interpolates the observed values when they are outside ranges of interest, but are simply constrained to remain outside. This method called relaxed Gaussian process (reGP) interpolation provides better predictive distributions in ranges of interest, especially in cases where a stationarity assumption for the GP model is not appropriate. It can be viewed as a goal-oriented method and becomes particularly interesting in Bayesian optimization, for example, for the minimization of an objective function, where good predictive distributions for low function values are important. When the expected improvement criterion and reGP are used for sequentially choosing evaluation points, the convergence of the resulting optimization algorithm is theoretically guaranteed (provided that the function to be optimized lies in the reproducing kernel Hilbert spaces attached to the known covariance of the underlying Gaussian process). Experiments indicate that using reGP instead of stationary GP models in Bayesian optimization is beneficial.


title: Semiclassical Gravity from Averaged Boundaries in two-dimensional BCFTs

abstract: The interpretation of semiclassical gravity as an ensemble-average of CFTs has provided much progress in understanding the factorization problem and the information paradox. In this article, we consider an averaging over boundary conditions in two-dimensional boundary conformal field theories (BCFTs). We show that the boundary averaging plays an important role not only in producing wormhole contributions but also in resolving the following problem. In general setups in AdS/BCFT, one can find unphysical solutions where branes have (self-)intersections. We show that the averaging nicely resolves this intersection problem. This provides another piece of evidence that averaging plays an important role in reproducing Einstein gravity. We also propose that the averaging provides a BCFT dual of the island model.


title: Hybrid simplification rules for boundaries of quantum circuits

abstract: We describe rules to simplify quantum circuits at their boundaries, i.e. at state preparation and measurement. There, any strictly incoherent operation may be pushed into a pre- or post-processing of classical data. The rules can greatly simplify the implementation of quantum circuits and are particularly useful for hybrid algorithms on noisy intermediate-scale quantum hardware, e.g. in the context of quantum simulation. Finally we illustrate how circuit cutting can enable the rules to be applied to more locations.


title: Spectrally resolved imaging with the solar gravitational lens

abstract: We consider the optical properties of the solar gravitational lens (SGL) treating the Sun as a massive compact body. Using our previously developed wave-optical treatment of the SGL, we convolve it with a thin-lens representing an optical telescope, and estimate the power spectral density and associated photon flux at individual pixel locations on the image sensor at the focal plane of the telescope. We also consider the solar corona, which is the dominant noise source when imaging faint objects with the SGL. We evaluate the signal-to-noise ratio at individual pixels as a function of wavelength. To block out the solar light, we contrast the use of a conventional internal coronagraph with a Lyot-stop to an external occulter (i.e., starshade). An external occulter, not being a subject to the diffraction limit of the observing telescope, makes it possible to use small telescopes (e.g., $\sim 40$~cm) for spatially and spectrally resolved imaging with the SGL in a broad range of wavelengths from optical to mid-infrared (IR) and without the substantial loss of optical throughput that is characteristic to internal devices. Mid-IR observations are especially interesting as planets are self-luminous at these wavelengths, producing a strong signal, while there is significantly less noise from the solar corona. This part of the spectrum contains numerous features of interest for exobiology and biosignature detection. We develop tools that may be used to estimate instrument requirements and devise optimal observing strategies to use the SGL for high-resolution, spectrally resolved imaging, ultimately improving our ability to confirm and study the presence of life on a distant world.

categories: astro-ph.IM astro-ph.EP astro-ph.SR gr-qc


title: Asymptotic Distribution-free Change-point Detection for Modern Data Based on a New Ranking Scheme

abstract: Change-point detection (CPD) involves identifying distributional changes in a sequence of independent observations. Among nonparametric methods, rank-based methods are attractive due to their robustness and effectiveness and have been extensively studied for univariate data. However, they are not well explored for high-dimensional or non-Euclidean data. This paper proposes a new method, Rank INduced by Graph Change-Point Detection (RING-CPD), which utilizes graph-induced ranks to handle high-dimensional and non-Euclidean data. The new method is asymptotically distribution-free under the null hypothesis, and an analytic $p$-value approximation is provided for easy type-I error control. Simulation studies show that RING-CPD effectively detects change-points across a wide range of alternatives and is also robust to heavy-tailed distribution and outliers. The new method is illustrated by the detection of seizures in a functional connectivity network dataset and travel pattern changes in the New York City Taxi dataset.


title: The Origin of Deformation Induced Topological Anisotropy in Silica Glass

abstract: Oxide glasses with a network structure are omnipresent in daily life. Often, they are regarded as isotropic materials; however, structural anisotropy can be induced through processing in mechanical fields and leads to unique materials properties. Unfortunately, due to the lack of local, atomic-scale analysis methods, the microscopic mechanisms leading to anisotropy remained elusive. Using novel analysis methods on glasses generated by molecular dynamics simulations, this paper provides a microscopic understanding of topological anisotropy in silica (SiO$_2$) glass under mechanical loads. The anisotropy observed in silica glass originates from a preferred orientation of SiO$_4$ tetrahedra at both short- and medium-range levels that can be controlled via the mode of mechanical loading. The findings elucidate the relation between the deformation protocol and the resulting anisotropic structure of the silica network (involving both persistent and transient effects), and thus provide important insight for the design of oxide glasses with tailored materials properties.


title: Learning Backward Compatible Embeddings

abstract: Embeddings, low-dimensional vector representation of objects, are fundamental in building modern machine learning systems. In industrial settings, there is usually an embedding team that trains an embedding model to solve intended tasks (e.g., product recommendation). The produced embeddings are then widely consumed by consumer teams to solve their unintended tasks (e.g., fraud detection). However, as the embedding model gets updated and retrained to improve performance on the intended task, the newly-generated embeddings are no longer compatible with the existing consumer models. This means that historical versions of the embeddings can never be retired or all consumer teams have to retrain their models to make them compatible with the latest version of the embeddings, both of which are extremely costly in practice. Here we study the problem of embedding version updates and their backward compatibility. We formalize the problem where the goal is for the embedding team to keep updating the embedding version, while the consumer teams do not have to retrain their models. We develop a solution based on learning backward compatible embeddings, which allows the embedding model version to be updated frequently, while also allowing the latest version of the embedding to be quickly transformed into any backward compatible historical version of it, so that consumer teams do not have to retrain their models. Under our framework, we explore six methods and systematically evaluate them on a real-world recommender system application. We show that the best method, which we call BC-Aligner, maintains backward compatibility with existing unintended tasks even after multiple model version updates. Simultaneously, BC-Aligner achieves the intended task performance similar to the embedding model that is solely optimized for the intended task.


title: Quadratic error bound of the smoothed gap and the restarted averaged primal-dual hybrid gradient

abstract: We study the linear convergence of the primal-dual hybrid gradient method. After a review of current analyses, we show that they do not explain properly the behavior of the algorithm, even on the most simple problems. We thus introduce the quadratic error bound of the smoothed gap, a new regularity assumption that holds for a wide class of optimization problems. Equipped with this tool, we manage to prove tighter convergence rates. Then, we show that averaging and restarting the primal-dual hybrid gradient allows us to leverage better the regularity constant. Numerical experiments on linear and quadratic programs, ridge regression and image denoising illustrate the findings of the paper.