title: Q-learning with online random forests

abstract: $Q$-learning is the most fundamental model-free reinforcement learning algorithm. Deployment of $Q$-learning requires approximation of the state-action value function (also known as the $Q$-function). In this work, we provide online random forests as $Q$-function approximators and propose a novel method wherein the random forest is grown as learning proceeds (through expanding forests). We demonstrate improved performance of our methods over state-of-the-art Deep $Q$-Networks in two OpenAI gyms (`blackjack' and `inverted pendulum') but not in the `lunar lander' gym. We suspect that the resilience to overfitting enjoyed by random forests recommends our method for common tasks that do not require a strong representation of the problem domain. We show that expanding forests (in which the number of trees increases as data comes in) improve performance, suggesting that expanding forests are viable for other applications of online random forests beyond the reinforcement learning setting.


title: Multi-objective optimization determines when, which and how to fuse deep networks: an application to predict COVID-19 outcomes

abstract: The COVID-19 pandemic has caused millions of cases and deaths and the AI-related scientific community, after being involved with detecting COVID-19 signs in medical images, has been now directing the efforts towards the development of methods that can predict the progression of the disease. This task is multimodal by its very nature and, recently, baseline results achieved on the publicly available AIforCOVID dataset have shown that chest X-ray scans and clinical information are useful to identify patients at risk of severe outcomes. While deep learning has shown superior performance in several medical fields, in most of the cases it considers unimodal data only. In this respect, when, which and how to fuse the different modalities is an open challenge in multimodal deep learning. To cope with these three questions here we present a novel approach optimizing the setup of a multimodal end-to-end model. It exploits Pareto multi-objective optimization working with a performance metric and the diversity score of multiple candidate unimodal neural networks to be fused. We test our method on the AIforCOVID dataset, attaining state-of-the-art results, not only outperforming the baseline performance but also being robust to external validation. Moreover, exploiting XAI algorithms we figure out a hierarchy among the modalities and we extract the features' intra-modality importance, enriching the trust on the predictions made by the model.


title: Permanence via invasion graphs: Incorporating community assembly into Modern Coexistence Theory

abstract: To understand the mechanisms underlying species coexistence, ecologists often study invasion growth rates of theoretical and data-driven models. These growth rates correspond to average per-capita growth rates of one species with respect to an ergodic measure supporting other species. In the ecological literature, coexistence often is equated with the invasion growth rates being positive. Intuitively, positive invasion growth rates ensure that species recover from being rare. To provide a mathematically rigorous framework for this approach, we prove theorems that answer two questions: (i) When do the signs of the invasion growth rates determine coexistence? (ii) When signs are sufficient, which invasion growth rates need to be positive? We focus on deterministic models and equate coexistence with permanence, i.e., a global attractor bounded away from extinction. For models satisfying certain technical assumptions, we introduce invasion graphs where vertices correspond to proper subsets of species (communities) supporting an ergodic measure and directed edges correspond to potential transitions between communities due to invasions by missing species. These directed edges are determined by the signs of invasion growth rates. When the invasion graph is acyclic (i.e. there is no sequence of invasions starting and ending at the same community), we show that permanence is determined by the signs of the invasion growth rates. In this case, permanence is characterized by the invasibility of all -i communities, i.e., communities without species i where all other missing species having negative invasion growth rates. We show that dissipative Lotka-Volterra models satisfy our technical assumptions and computing their invasion graphs reduces to solving systems of linear equations. We provide additional applications of the results and discuss open problems.


title: Taking models seriously and being a linguistic realist

abstract: Carnap's conception of linguistic frameworks is widespread; however, it is not entirely clear nor consensual to pinpoint what is the influence in his stance within the traditional realist/anti-realist debate. In this paper, we place Carnap as a proponent of a scientific realist stance, by presenting what he called "linguistic realism". Some possible criticisms are considered, and a case study is offered with wave function realism, a popular position in the philosophy of quantum mechanics.


title: Massively scalable stencil algorithm

abstract: Stencil computations lie at the heart of many scientific and industrial applications. Unfortunately, stencil algorithms perform poorly on machines with cache based memory hierarchy, due to low re-use of memory accesses. This work shows that for stencil computation a novel algorithm that leverages a localized communication strategy effectively exploits the Cerebras WSE-2, which has no cache hierarchy. This study focuses on a 25-point stencil finite-difference method for the 3D wave equation, a kernel frequently used in earth modeling as numerical simulation. In essence, the algorithm trades memory accesses for data communication and takes advantage of the fast communication fabric provided by the architecture. The algorithm -- historically memory bound -- becomes compute bound. This allows the implementation to achieve near perfect weak scaling, reaching up to 503 TFLOPs on WSE-2, a figure that only full clusters can eventually yield.


title: TorMentor: Deterministic dynamic-path, data augmentations with fractals

abstract: We propose the use of fractals as a means of efficient data augmentation. Specifically, we employ plasma fractals for adapting global image augmentation transformations into continuous local transforms. We formulate the diamond square algorithm as a cascade of simple convolution operations allowing efficient computation of plasma fractals on the GPU. We present the TorMentor image augmentation framework that is totally modular and deterministic across images and point-clouds. All image augmentation operations can be combined through pipelining and random branching to form flow networks of arbitrary width and depth. We demonstrate the efficiency of the proposed approach with experiments on document image segmentation (binarization) with the DIBCO datasets. The proposed approach demonstrates superior performance to traditional image augmentation techniques. Finally, we use extended synthetic binary text images in a self-supervision regiment and outperform the same model when trained with limited data and simple extensions.


title: Predicting electrical conductivity in Cu/Nb composites: a combined model-experiment study

abstract: The generation of high magnetic fields requires materials with high electric conductivity and good strength properties. Cu/Nb composites are considered to be good candidates for this purpose. In this work we aim to predict, from theory, the dependence of electric conductivity on the microstructure, most notably on the layer thickness and grain sizes. We also conducted experiments to calibrate and validate our simulations. Bimetal interfaces and grain boundaries are confirmed to have the largest impact on conductivity in this composite material. In this approach, a distribution of the layer thickness is accounted for in order to better model the experimentally observed microstructure. Because layer thicknesses below the mean free path of Cu significantly degrade the conductivity, an average layer thickness larger than expected may be needed to meet conductivity requirements in order to minimize these smaller layers in the distribution. We also investigate the effect of variations in volume fraction of Nb and temperature on the material's conductivity.


title: Mitigating Mismatch Compression in Differential Local Field Potentials

abstract: Bidirectional deep brain stimulation (bdDBS) devices capable of recording differential local field potentials (dLFP) enable neural recordings alongside clinical therapy. Efforts to identify objective signals of various brain disorders, or disease readouts, are challenging in dLFP, especially during active DBS. In this report we identified, characterized, and mitigated a major source of distortion in dLFP that we introduce as mismatch compression (MC). MC occurs secondary to impedance mismatches across the dLFP channel resulting in incomplete rejection of artifacts and downstream amplifier gain compression. Using in silico and in vitro models we demonstrate that MC accounts for impedance-related distortions sensitive to DBS amplitude. We then use these models to develop and validate a mitigation strategy for MC that is provided as an opensource library for more reliable oscillatory disease readouts.


title: Autoencoder-based Unsupervised Intrusion Detection using Multi-Scale Convolutional Recurrent Networks

abstract: The massive growth of network traffic data leads to a large volume of datasets. Labeling these datasets for identifying intrusion attacks is very laborious and error-prone. Furthermore, network traffic data have complex time-varying non-linear relationships. The existing state-of-the-art intrusion detection solutions use a combination of various supervised approaches along with fused features subsets based on correlations in traffic data. These solutions often require high computational cost, manual support in fine-tuning intrusion detection models, and labeling of data that limit real-time processing of network traffic. Unsupervised solutions do reduce computational complexities and manual support for labeling data but current unsupervised solutions do not consider spatio-temporal correlations in traffic data. To address this, we propose a unified Autoencoder based on combining multi-scale convolutional neural network and long short-term memory (MSCNN-LSTM-AE) for anomaly detection in network traffic. The model first employs Multiscale Convolutional Neural Network Autoencoder (MSCNN-AE) to analyze the spatial features of the dataset, and then latent space features learned from MSCNN-AE employs Long Short-Term Memory (LSTM) based Autoencoder Network to process the temporal features. Our model further employs two Isolation Forest algorithms as error correction mechanisms to detect false positives and false negatives to improve detection accuracy. %Additionally, covariance matrices forms a Riemannian manifold that is naturally embedded with distance metrices that facilitates descriminative patterns for detecting malicious network traffic. We evaluated our model NSL-KDD, UNSW-NB15, and CICDDoS2019 dataset and showed our proposed method significantly outperforms the conventional unsupervised methods and other existing studies on the dataset.


title: On implicitly oscillatory quadrilinear integrals

abstract: For quadrilinear functionals $\int_B \prod_{j=1}^4 (f_j\circ\varphi_j)$, where $B\subset{\mathbb R}^2$ is a ball, $\varphi_j:B\to{\mathbb R}^1$ are real analytic submersions, and $f_j\in L^\infty({\mathbb R}^1)$ are bounded and measurable, we seek a majorization of the integral by a product of negative order Sobolev norms of the factors $f_j$. An obvious necessary condition is that any smooth solution of $\sum_j (g_j\circ\varphi_j)\equiv 0$, in any connected open set, must be constant. Assuming this condition and certain auxiliary hypotheses, we establish an upper bound of the desired type. The proof relies in part on a three term sublevel set inequality established in a companion paper.


title: Color My World: Deterministic Tagging for Memory Safety

abstract: Hardware-assisted memory protection features are increasingly being deployed in COTS processors. ARMv8.5 Memory Tagging Extensions (MTE) is a recent example, which has been used to provide probabilistic checks for memory safety. This use of MTE is not secure against the standard adversary with arbitrary read/write access to memory. Consequently MTE is used as a software development tool. In this paper we present the first design for deterministic memory protection using MTE that can resist the standard adversary, and hence is suitable for post-deployment memory safety. We describe our compiler extensions for LLVM Clang implementing static analysis and subsequent MTE instrumentation. Via a comprehensive evaluation we show that our scheme is effective.


title: Testing Positive Semidefiniteness Using Linear Measurements

abstract: We study the problem of testing whether a symmetric $d \times d$ input matrix $A$ is symmetric positive semidefinite (PSD), or is $\epsilon$-far from the PSD cone, meaning that $\lambda_{\min}(A) \leq - \epsilon \|A\|_p$, where $\|A\|_p$ is the Schatten-$p$ norm of $A$. In applications one often needs to quickly tell if an input matrix is PSD, and a small distance from the PSD cone may be tolerable. We consider two well-studied query models for measuring efficiency, namely, the matrix-vector and vector-matrix-vector query models. We first consider one-sided testers, which are testers that correctly classify any PSD input, but may fail on a non-PSD input with a tiny failure probability. Up to logarithmic factors, in the matrix-vector query model we show a tight $\widetilde{\Theta}(1/\epsilon^{p/(2p+1)})$ bound, while in the vector-matrix-vector query model we show a tight $\widetilde{\Theta}(d^{1-1/p}/\epsilon)$ bound, for every $p \geq 1$. We also show a strong separation between one-sided and two-sided testers in the vector-matrix-vector model, where a two-sided tester can fail on both PSD and non-PSD inputs with a tiny failure probability. In particular, for the important case of the Frobenius norm, we show that any one-sided tester requires $\widetilde{\Omega}(\sqrt{d}/\epsilon)$ queries. However we introduce a bilinear sketch for two-sided testing from which we construct a Frobenius norm tester achieving the optimal $\widetilde{O}(1/\epsilon^2)$ queries. We also give a number of additional separations between adaptive and non-adaptive testers. Our techniques have implications beyond testing, providing new methods to approximate the spectrum of a matrix with Frobenius norm error using dimensionality reduction in a way that preserves the signs of eigenvalues.


title: Does Simultaneous Speech Translation need Simultaneous Models?

abstract: In simultaneous speech translation (SimulST), finding the best trade-off between high translation quality and low latency is a challenging task. To meet the latency constraints posed by the different application scenarios, multiple dedicated SimulST models are usually trained and maintained, generating high computational costs. In this paper, motivated by the increased social and environmental impact caused by these costs, we investigate whether a single model trained offline can serve not only the offline but also the simultaneous task without the need for any additional training or adaptation. Experiments on en->{de, es} indicate that, aside from facilitating the adoption of well-established offline techniques and architectures without affecting latency, the offline solution achieves similar or better translation quality compared to the same model trained in simultaneous settings, as well as being competitive with the SimulST state of the art.


title: Free Energy Evaluation Using Marginalized Annealed Importance Sampling

abstract: The evaluation of the free energy of a stochastic model is considered a significant issue in various fields of physics and machine learning. However, the exact free energy evaluation is computationally infeasible because the free energy expression includes an intractable partition function. Annealed importance sampling (AIS) is a type of importance sampling based on the Markov chain Monte Carlo method that is similar to a simulated annealing and can effectively approximate the free energy. This study proposes an AIS-based approach, which is referred to as marginalized AIS (mAIS). The statistical efficiency of mAIS is investigated in detail based on theoretical and numerical perspectives. Based on the investigation, it is proved that mAIS is more effective than AIS under a certain condition.

categories: stat.ML cond-mat.dis-nn cond-mat.stat-mech cs.LG math.ST stat.TH


title: Computational Understandings of the Cation Configuration Dependent Redox Activities and Oxygen Dimerizations in Li$_{1.22}$Ni$_{0.22}$Mn$_{0.56}$O$_2$ Cathode

abstract: Understanding the lattice oxygen dimerization is quite essential for the optimal design for the Li-rich Mn-based cathode materials. In this work, based on the density functional theory (DFT) calculations, a Ni-honeycomb Li-Ni-Mn cation configuration for Li$_{1.22}$Ni$_{0.22}$Mn$_{0.56}$O$_2$ cathode was carefully proposed and examined, which can coexist with the well-known Li-honeycomb structure in the experimentally synthesized Li$_{1.2}$Ni$_{0.2}$Mn$_{0.6}$O$_2$ samples. Li-Ni-Mn cation configurations have significant impacts on oxygen redox activities and oxygen dimerizations in the delithiated Li$_x$Ni$_{0.22}$Mn$_{0.56}$O$_2$. There is no necessary consistency between the high lattice oxygen redox activity and easy oxygen dimerization, such as the Li-honeycomb structures showing higher redox activities and higher activation energy barriers to prohibit oxygen dimerizations than Ni-honeycomb structures. Avoiding the Ni-honeycomb structures with more favorable lattice oxygen dimerization and making full use of the Li-honeycomb structures with better redox activities is important to optimally design the high-performance Li-rich Mn-based cathode materials.


title: Perlustration on Mobile Forensics Tools

abstract: Nowadays many people store more information in cellphones rather than do on their computer which leads to the increase of crimes taking place in mobile. This is also because of extensive use of mobile devices. People refer to store more information in mobile than in computer. Therefore,scope of forensics in mobile has increased in last few years as compared to computers. In this paper , we have carried out a survey on tools and techniques which are in practice for mobile forensics. The survey is the amalgamation of the in practice technical methods and discussion of some of the tools for specific operating systems. Some challenges faced by practitioners while performing forensics has also been enlisted.


title: The generalized reciprocal distance matrix of graphs

abstract: Let $G$ be a simple undirected connected graph with the Harary matrix $RD(G)$, which is also called the reciprocal distance matrix of $G$. The reciprocal distance signless Laplacian matrix of $G$ is $RQ(G)=RT(G)+RD(G)$, where $RT(G)$ denotes the diagonal matrix of the vertex reciprocal transmissions of graph $G$. This paper intends to introduce a new matrix $RD_{\alpha}(G)=\alpha RT(G)+(1-\alpha)RD(G)$, $\alpha\in [0,1]$, to track the gradual change from $RD(G)$ to $RQ(G)$. First, we describe completely the eigenvalues of $RD_{\alpha}(G)$ of some special graphs. Then we obtain serval basic properties of $RD_{\alpha}(G)$ including inequalities that involve the spectral radii of the reciprocal distance matrix, reciprocal distance signless Laplacian matrix and $RD_{\alpha}$-matrix of $G$. We also provide some lower and upper bounds of the spectral radius of $RD_{\alpha}$-matrix. Finally, we depict the extremal graphs with maximal spectral radius of the $RD_{\alpha}$-matrix among all connected graphs of fixed order and precise vertex connectivity, edge connectivity, chromatic number and independence number, respectively.


title: Role of inflexible minorities in the evolution of alcohol consumption

abstract: In this work we study a simple contagion model for drinking behavior evolution, but including the presence of inflexible or zealot agents, i.e., individuals that never change their behavior (never drink or always drink a lot). We analyze the impact of such special agents in the evolution of drinking behavior in the population. Our analytical and numerical results indicate that the presence of only one class of inflexible agents destroys one of the two possible absorbing phases that are observed in the model without such inflexibles. In the presence of the both kinds of inflexible agents simultaneously, there are no absorbing states anymore. Since absorbing states are collective macroscopic states with the presence of only one kind of individuals in the population, we argue that the inclusion of inflexible agents in the population makes the model more realistic. Furthermore, the presence of inflexible agents are similar to the introduction of quenched disorder in the model, and here we observe the suppression of a nonequilibrium phase transition to absorbing states, which had not been reported before.


title: Broadening AI Ethics Narratives: An Indic Art View

abstract: Incorporating interdisciplinary perspectives is seen as an essential step towards enhancing artificial intelligence (AI) ethics. In this regard, the field of arts is perceived to play a key role in elucidating diverse historical and cultural narratives, serving as a bridge across research communities. Most of the works that examine the interplay between the field of arts and AI ethics concern digital artworks, largely exploring the potential of computational tools in being able to surface biases in AI systems. In this paper, we investigate a complementary direction--that of uncovering the unique socio-cultural perspectives embedded in human-made art, which in turn, can be valuable in expanding the horizon of AI ethics. Through semi-structured interviews across sixteen artists, art scholars, and researchers of diverse Indian art forms like music, sculpture, painting, floor drawings, dance, etc., we explore how {\it non-Western} ethical abstractions, methods of learning, and participatory practices observed in Indian arts, one of the most ancient yet perpetual and influential art traditions, can shed light on aspects related to ethical AI systems. Through a case study concerning the Indian dance system (i.e. the {\it `Natyashastra'}), we analyze potential pathways towards enhancing ethics in AI systems. Insights from our study outline the need for (1) incorporating empathy in ethical AI algorithms, (2) integrating multimodal data formats for ethical AI system design and development, (3) viewing AI ethics as a dynamic, diverse, cumulative, and shared process rather than as a static, self-contained framework to facilitate adaptability without annihilation of values (4) consistent life-long learning to enhance AI accountability


title: High-Dimensional Geometric Streaming in Polynomial Space

abstract: Many existing algorithms for streaming geometric data analysis have been plagued by exponential dependencies in the space complexity, which are undesirable for processing high-dimensional data sets. In particular, once $d\geq\log n$, there are no known non-trivial streaming algorithms for problems such as maintaining convex hulls and L\"owner-John ellipsoids of $n$ points, despite a long line of work in streaming computational geometry since [AHV04]. We simultaneously improve these results to $\mathrm{poly}(d,\log n)$ bits of space by trading off with a $\mathrm{poly}(d,\log n)$ factor distortion. We achieve these results in a unified manner, by designing the first streaming algorithm for maintaining a coreset for $\ell_\infty$ subspace embeddings with $\mathrm{poly}(d,\log n)$ space and $\mathrm{poly}(d,\log n)$ distortion. Our algorithm also gives similar guarantees in the \emph{online coreset} model. Along the way, we sharpen results for online numerical linear algebra by replacing a log condition number dependence with a $\log n$ dependence, answering a question of [BDM+20]. Our techniques provide a novel connection between leverage scores, a fundamental object in numerical linear algebra, and computational geometry. For $\ell_p$ subspace embeddings, we give nearly optimal trade-offs between space and distortion for one-pass streaming algorithms. For instance, we give a deterministic coreset using $O(d^2\log n)$ space and $O((d\log n)^{1/2-1/p})$ distortion for $p>2$, whereas previous deterministic algorithms incurred a $\mathrm{poly}(n)$ factor in the space or the distortion [CDW18]. Our techniques have implications in the offline setting, where we give optimal trade-offs between the space complexity and distortion of subspace sketch data structures. To do this, we give an elementary proof of a "change of density" theorem of [LT80] and make it algorithmic.


title: Quantifying the entanglement of quantum states under the geometry method

abstract: Quantifying entanglement is an important issue in quantum information theory. Here we consider the entanglement measures through the trace norm in terms of two methods, the modified measure and the extended measure for bipartite states. We present the analytical formula for the pure states in terms of the modified measure and the mixed states of two-qubit systems for the extended measure. We also generalize the modified measure from bipartite states to tripartite states.


title: Deep water wave cloaking using a multi-layered buoyant plate

abstract: Trajectory of surface gravity waves in potential flow regime is affected by the gravitational acceleration, water density, and seabed depth. While the gravitational acceleration and water density are approximately constant, the effect of water depth on surface gravity waves exponentially decreases as the water depth increases. In shallow water, cloaking an object from surface waves by varying the seabed topography is possible, however, as the water depth increases, cloaking becomes a challenge since there is no physical parameter to be engineered and subsequently affects the wave propagation. In order to create an omnidirectional cylindrical cloaking device for finite-depth/deep-water waves, we propose a multi-layered elastic plate that floats on the surface around a to-be-cloaked cylinder. The buoyant elastic plate is made of axisymmetric, homogeneous, and isotropic layers which provides adjustable degrees of freedom to engineer and affect the wave propagation. We first develop a pseudo-spectral method to efficiently determine the wave solution for a multi-layered buoyant plate. Next, we optimize the physical parameters of the buoyant plate (i.e. elasticity and mass of every layer) using a real-coded evolutionary algorithm to minimize the energy of scattered-waves from the object. We show that the optimized cloak reduces the energy of scattered-waves as high as 99.2% for the target wave number. We also quantify the wave drift force exerted on the structures and show that the buoyant plate reduces the exerted force by 99.9%.


title: Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognition

abstract: Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile devices and smart home speakers. In this work, we present Personal VAD 2.0, a personalized voice activity detector that detects the voice activity of a target speaker, as part of a streaming on-device ASR system. Although previous proof-of-concept studies have validated the effectiveness of Personal VAD, there are still several critical challenges to address before this model can be used in production: first, the quality must be satisfactory in both enrollment and enrollment-less scenarios; second, it should operate in a streaming fashion; and finally, the model size should be small enough to fit a limited latency and CPU/Memory budget. To meet the multi-faceted requirements, we propose a series of novel designs: 1) advanced speaker embedding modulation methods; 2) a new training paradigm to generalize to enrollment-less conditions; 3) architecture and runtime optimizations for latency and resource restrictions. Extensive experiments on a realistic speech recognition system demonstrated the state-of-the-art performance of our proposed method.


title: On the Importance of Performing App Analysis Within Peer Groups

abstract: The competing nature of the app market motivates us to shift our focus on apps that provide similar functionalities and directly compete with each other (i.e., peer apps). In this work, we study the ratings and the review text of 100 Android apps across 10 peer app groups. We highlight the importance of performing peer-app analysis by showing that it can provide a unique perspective over performing a global analysis of apps (i.e., mixing apps from multiple categories). First, we observe that comparing user ratings within peer groups can provide very different results from comparing user ratings from a global perspective. Then, we show that peer-app analysis provides a different perspective to spot the dominant topics in the user reviews, and to understand the impact of the topics on user ratings. Our findings suggest that future efforts may pay more attention to performing and supporting app analysis from a peer group context. For example, app store owners may consider an additional rating mechanism that normalizes app ratings within peer groups, and future research may help developers understand the characteristics of specific peer groups and prioritize their efforts.


title: Semantic Representation and Dependency Learning for Multi-Label Image Recognition

abstract: Recently many multi-label image recognition (MLR) works have made significant progress by introducing pre-trained object detection models to generate lots of proposals or utilizing statistical label co-occurrence enhance the correlation among different categories. However, these works have some limitations: (1) the effectiveness of the network significantly depends on pre-trained object detection models that bring expensive and unaffordable computation; (2) the network performance degrades when there exist occasional co-occurrence objects in images, especially for the rare categories. To address these problems, we propose a novel and effective semantic representation and dependency learning (SRDL) framework to learn category-specific semantic representation for each category and capture semantic dependency among all categories. Specifically, we design a category-specific attentional regions (CAR) module to generate channel/spatial-wise attention matrices to guide model to focus on semantic-aware regions. We also design an object erasing (OE) module to implicitly learn semantic dependency among categories by erasing semantic-aware regions to regularize the network training. Extensive experiments and comparisons on two popular MLR benchmark datasets (i.e., MS-COCO and Pascal VOC 2007) demonstrate the effectiveness of the proposed framework over current state-of-the-art algorithms.


title: Electroweak Precision Fit and New Physics in light of $W$ Boson Mass

abstract: The $W$ boson mass is one of the most important electroweak precision observables for testing the Standard Model or its extensions. The very recent measured $W$ boson mass at CDF shows about $7\sigma$ deviations from the SM prediction, which may challenge the internal consistency of the SM. By performing the global electroweak fit with the new $W$-boson, we present the new values of the oblique parameters: $S = 0.06 \pm 0.10$, $T= 0.11 \pm 0.12$, $U=0.13 \pm 0.09$, or $S=0.14 \pm 0.08$, $T= 0.26 \pm 0.06$ with $U =0$ and the corresponding correlation matrices, which strongly indicates the need for the non-degenerate multiplets beyond the SM. As a proof-of-concept, we show that the new results can be accommodated in the two-Higgs doublet model, where the charged Higgs boson has to be either heavier or lighter than both two heavy neutral Higgs bosons. Therefore, searching for these non-SM Higgs bosons will provide a complementary way to test the new physics for the $W$ boson mass anomaly.


title: On the $KU_G$-local equivariant sphere

abstract: Equivariant complex $K$-theory and the equivariant sphere spectrum are two of the most fundamental equivariant spectra. For an odd $p$-group, we calculate the zeroth homotopy Green functor of the localization of the equivariant sphere spectrum with respect to equivariant complex $K$-theory. Further, we calculate the zeroth homotopy Tambara functor structure in the case of odd cyclic $p$-groups.


title: Log-optimal portfolio after a random time: Existence, description and sensitivity analysis

abstract: In this paper, we consider an informational market model with two flows of informations. The smallest flow F, which is available to all agents, is the filtration of the initial market model(S,F,P), where S is the assets' prices and P is a probability measure. The largest flow G contains additional information about the occurrence of a random time T. This setting covers credit risk theory where T models the default time of a firm, and life insurance where T represents the death time of an insured. For the model (S-S^T,G,P), we address the log-optimal portfolio problem in many aspects. In particular, we answer the following questions and beyond: 1) What are the necessary and sufficient conditions for the existence of log-optimal portfolio of the model under consideration? 2) what are the various type of risks induced by T that affect this portfolio and how? 3) What are the factors that completely describe the sensitivity of the log-portfolio to the parameters of T? The answers to these questions and other related discussions definitely complement the work of Choulli and Yansori [12] which deals with the stopped model (S^T,G).


title: Optimal allocations to heterogeneous agents with an application to stimulus checks

abstract: A planner allocates discrete transfers of size $D_g$ to $N$ heterogeneous groups labeled $g$ and has CES preferences over the resulting outcomes, $H_g(D_g)$. We derive a closed-form solution for optimally allocating a fixed budget subject to group-specific inequality constraints under the assumption that increments in the $H_g$ functions are non-increasing. We illustrate our method by studying allocations of "support checks" from the U.S. government to households during both the Great Recession and the COVID-19 pandemic. We compare the actual allocations to optimal ones under alternative constraints, assuming the government focused on stimulating aggregate consumption during the 2008--2009 crisis and focused on welfare during the 2020--2021 crisis. The inputs for this analysis are obtained from versions of a life-cycle model with heterogeneous households, which predicts household-type-specific consumption and welfare responses to tax rebates and cash transfers.


title: End-of-Life of Software How is it Defined and Managed?

abstract: The rapid development of new software and algorithms, fueled by the immense amount of data available, has made the shelf life of software products a lot shorter. With a rough estimate of more than 40,000 new software projects developed every day, it is becoming quicker and cheaper to abandon old software and acquire new software that meets rapidly changing needs and demands. What happens to software that is abandoned and what consequences may arise from 'throwaway' culture (Cooper, 2005) are still open questions. This paper will explore the systems engineering concept of end-of-life for software, it will highlight the gaps in existing software engineering practices, it will bring forward examples of software that has been abandoned in an attempt to decommission and it will explore the repercussions of abandoned software artefacts. A proposed way forward for addressing the identified research gaps is also detailed.


title: Barrier Bayesian Linear Regression: Online Learning of Control Barrier Conditions for Safety-Critical Control of Uncertain Systems

abstract: In this work, we consider the problem of designing a safety filter for a nonlinear uncertain control system. Our goal is to augment an arbitrary controller with a safety filter such that the overall closed-loop system is guaranteed to stay within a given state constraint set, referred to as being safe. For systems with known dynamics, control barrier functions (CBFs) provide a scalar condition for determining if a system is safe. For uncertain systems, robust or adaptive CBF certification approaches have been proposed. However, these approaches can be conservative or require the system to have a particular parametric structure. For more generic uncertain systems, machine learning approaches have been used to approximate the CBF condition. These works typically assume that the learning module is sufficiently trained prior to deployment. Safety during learning is not guaranteed. We propose a barrier Bayesian linear regression (BBLR) approach that guarantees safe online learning of the CBF condition for the true, uncertain system. We assume that the error between the nominal system and the true system is bounded and exploit the structure of the CBF condition. We show that our approach can safely expand the set of certifiable control inputs despite system and learning uncertainties. The effectiveness of our approach is demonstrated in simulation using a two-dimensional pendulum stabilization task.


title: Stochastic Geometry-Based Low Latency Routing in Massive LEO Satellite Networks

abstract: In this paper, the routing in massive low earth orbit (LEO) satellite networks is studied. When the satellite-to-satellite communication distance is limited, we choose different relay satellites to minimize the latency in a constellation at a constant altitude. Firstly, the global optimum solution is obtained in the ideal scenario when there are available satellites at all the ideal locations. Next, we propose a nearest neighbor search algorithm for realistic (non-ideal) scenarios with a limited number of satellites. The proposed algorithm can approach the global optimum solution under an ideal scenario through a finite number of iterations and a tiny range of searches. Compared with other routing strategies, the proposed algorithm shows significant advantages in terms of latency. Furthermore, we provide two approximation techniques that can give tight lower and upper bounds for the latency of the proposed algorithm, respectively. Finally, the relationships between latency and constellation height, satellites' number, and communication distance are investigated.


title: On Maximum Weighted Nash Welfare for Binary Valuations

abstract: We consider the problem of fairly allocating indivisible goods to agents with weights representing their entitlements. A natural rule in this setting is the maximum weighted Nash welfare (MWNW) rule, which selects an allocation maximizing the weighted product of the agents' utilities. We show that when agents have binary valuations, a specific version of MWNW is resource- and population-monotone, satisfies group-strategyproofness, and can be implemented in polynomial time.


title: A Learnable Variational Model for Joint Multimodal MRI Reconstruction and Synthesis

abstract: Generating multi-contrasts/modal MRI of the same anatomy enriches diagnostic information but is limited in practice due to excessive data acquisition time. In this paper, we propose a novel deep-learning model for joint reconstruction and synthesis of multi-modal MRI using incomplete k-space data of several source modalities as inputs. The output of our model includes reconstructed images of the source modalities and high-quality image synthesized in the target modality. Our proposed model is formulated as a variational problem that leverages several learnable modality-specific feature extractors and a multimodal synthesis module. We propose a learnable optimization algorithm to solve this model, which induces a multi-phase network whose parameters can be trained using multi-modal MRI data. Moreover, a bilevel-optimization framework is employed for robust parameter training. We demonstrate the effectiveness of our approach using extensive numerical experiments.


title: The essential spectrum, norm, and spectral radius of abstract multiplication operators

abstract: Let $E$ be a complex Banach lattice and $T$ is an operator in the centrum $Z(E)=\{T: |T|\le \lambda I \mbox{ for some } \lambda\}$ of $E$. Then the essential norm $\|T\|_{e}$ of $T$ equals the essential spectral radius $r_{e}(T)$ of $T$. We also prove $r_{e}(T)=\max\{\|T_{A^{d}}\|, r_{e}(T_{A})\}$, where $T_{A}$ is the atomic part of $T$ and $T_{A^{d}}$ is the non-atomic part of $T$. Moreover $r_{e}(T_{A})=\limsup_{\mathcal F}\lambda_{a}$, where $\mathcal F$ is the Fr\'echet filter on the set $A$ of all positive atoms in $E$ of norm one and $\lambda_{a}$ is given by $T_{A}a=\lambda_{a}a$ for all $a\in A$.


title: Silicon nanophotonic chips featuring Sagnac loop reflectors as a basis for advanced optical spectral filters

abstract: We present and investigate theoretically photonic integrated filters based on 2 Sagnac coupled loop reflectors (SLRs) that are arranged in a self-coupled optical waveguide. We recently presented photonic integrated filters based on coupled and cascaded SLRs. In this paper, we advance this field by investigating a unique approach of employing coupled SLRs formed by self-coupled waveguides. This allows us to achieve high performance filter functions including Fano-like resonances and wavelength interleaving with a simpler design and a higher fabrication tolerance by tailoring coherent mode interference in the device. Our design takes into account the device fabrication issues as well as the requirements for practical applications. As a guide for practical device fabrication, an analysis of the impact of the structural parameters and fabrication tolerance on each filter function is also provided. The Fano-like resonances show a low insertion loss (IL) of 1.1 dB, a high extinction ratio of 30.2 dB, and a high slope rate (SR) of 747.64 dB/nm. The combination of low IL and high SR promises this device for Fano resonance applications. Our device also can achieve wavelength de-interleaving function with high fabrication tolerance which is advantageous for applications such as optical interleavers that require a symmetric flat-top filter shape. Optical de-interleavers and interleavers are key components for optical signal multiplexing and demultiplexing for wavelength division multiplexing optical communication systems. Versatile spectral responses with a simple design, compact device footprint, and high fabrication tolerance make this approach highly promising for flexible response shaping for many applications.


title: Revisiting quantum relativistic effects from phase transition by catastrophe theory

abstract: In this paper we start from the Schr\"odinger equation to revisit some classical quantum mechanics from the perspective of phase transition process. Here the relativistic effect of particles moving at high speed can be regarded as the phase transition process when the velocity variable increases. Considering that the catastrophe models could describe qualitatively any phase transition process, we adopt the simplest folding catastrophe type as the potential function in the Schr\"odinger equation to obtain a revised Schr\"odinger relativistic equation through the dimensionless analysis first, and then further to derive out the steady-state Klein-Gordon equation and Dirac relativistic equation gradually. These results reveal that the quantum relativistic effect could be considered as the phase transition process, which could be described by adopting the catastrophe models as the potential function in the classical Schr\"odinger equation.


title: On the equilateral pentagonal central configurations

abstract: An equilateral pentagon is a polygon in the plane with five sides of equal length. In this paper we classify the central configurations of the $5$-body problem having the five bodies at the vertices of an equilateral pentagon with an axis of symmetry. We prove that there are two unique classes of such equilateral pentagons providing central configurations, one concave equilateral pentagon and one convex equilateral pentagon, the regular one. A key point of our proof is the use of rational parameterizations to transform the corresponding equations, which involve square roots, into polynomial equations.


title: Federated Learning with Partial Model Personalization

abstract: We consider two federated learning algorithms for training partially personalized models, where the shared and personal parameters are updated either simultaneously or alternately on the devices. Both algorithms have been proposed in the literature, but their convergence properties are not fully understood, especially for the alternating variant. We provide convergence analyses of both algorithms in the general nonconvex setting with partial participation and delineate the regime where one dominates the other. Our experiments on real-world image, text, and speech datasets demonstrate that (a) partial personalization can obtain most of the benefits of full model personalization with a small fraction of personal parameters, and, (b) the alternating update algorithm often outperforms the simultaneous update algorithm by a small but consistent margin.


title: Ligand Additivity and Divergent Trends in Two Types of Delocalization Errors from Approximate Density Functional Theory

abstract: Despite its widespread use, the predictive accuracy of density functional theory (DFT) is hampered by delocalization errors, especially for correlated systems such as transition-metal complexes. Two complementary tuning strategies have been developed to reduce delocalization error: eliminating the global curvature with respect to charge addition or removal, and computing a linear response Hubbard U as a measure of local curvature at the metal center at fixed charge and applying it to the transition-metal complex in a DFT+U framework. We investigate the relationship between the two measures of delocalization error as we manipulate the ligand field strength by varying the number of strong-field ligands in a series of heteroleptic complexes or by geometrically constraining the metal-ligand bond length in homoleptic octahedral complexes. We show that across these sets of complexes with varying ligand fields, an inverse relationship generally exists between global and local curvatures. We find that effects of ligand substitution on both measures of delocalization are typically additive, but the two quantities seldom coincide. The observation of ligand additivity suggests opportunities for evaluating errors on homoleptic complexes to infer corrections for lower-symmetry complexes.


title: Observation of Mesoscopic Clathrate Structures in Ethanol-Water Mixtures

abstract: Water-alcohol mixtures exhibit many abnormal physicochemical properties, the origins of which remain controversial. Here we use transmission electron microscopy (TEM), nanoparticle tracking analysis (NTA), and atomic force microscopy (AFM) to study ethanol-water mixtures. TEM reveals mesoscopic clathrate structures with water molecules forming a crystalline matrix hosting a high density of tiny cells. The presence of these mesoscopic clathrate structures is further supported by a refractive index of 1.27+-0.02 at 405 nm measured via NTA and the hydrophilic nature of the mesoscopic structures implied by AFM observations, explaining many long-standing puzzles related to water-alcohol mixtures.


title: Exploring the Universality of Hadronic Jet Classification

abstract: The modeling of jet substructure significantly differs between Parton Shower Monte Carlo (PSMC) programs. Despite this, we observe that machine learning classifiers trained on different PSMCs learn nearly the same function. This means that when these classifiers are applied to the same PSMC for testing, they result in nearly the same performance. This classifier universality indicates that a machine learning model trained on one simulation and tested on another simulation (or data) will likely be optimal. Our observations are based on detailed studies of shallow and deep neural networks applied to simulated Lorentz boosted Higgs jet tagging at the LHC.


title: C^0 estimates for Hessian quotient equations on HKT manifolds

abstract: We show the $C^0$ estimate for solutions to Hessian quotient equations on hyperK\"ahler with torsion manifolds without any additional assumption on its hypercomplex structure by a clever use of the cone condition directly.


title: Distinguishing between dark-matter interactions with gravitational-wave detectors

abstract: Ground-based gravitational-wave interferometers could directly probe the existence of ultralight dark matter ($\mathcal{O}(10^{-14}-10^{-11})$ eV/$c^2$) that couples to standard-model particles in the detectors. Recently, many techniques have been developed to extract a variety of potential dark-matter signals from noisy gravitational-wave data; however, little effort has gone into ways to distinguish between types of dark matter that could directly interact with the interferometers. In this work, we employ the Wiener filter to follow-up candidate dark-matter interaction signals. The filter captures the stochastic nature of these signals, and, in simulations, successfully identifies which type of dark matter interacts with the interferometers. We apply the Wiener filter to outliers that remained in the LIGO/Virgo/KAGRA search for dark photons in data from the most recent observing (O3), and show that they are consistent with noise disturbances. Our proof-of-concept analysis demonstrates that the Wiener filter can be a powerful technique to confirm or deny the presence of dark-matter interaction signals in gravitational-wave data, and distinguish between scalar and vector dark-matter interactions.


title: Canonical Mean Filter for Almost Zero-Shot Multi-Task classification

abstract: The support set is a key to providing conditional prior for fast adaption of the model in few-shot tasks. But the strict form of support set makes its construction actually difficult in practical application. Motivated by ANIL, we rethink the role of adaption in the feature extractor of CNAPs, which is a state-of-the-art representative few-shot method. To investigate the role, Almost Zero-Shot (AZS) task is designed by fixing the support set to replace the common scheme, which provides corresponding support sets for the different conditional prior of different tasks. The AZS experiment results infer that the adaptation works little in the feature extractor. However, CNAPs cannot be robust to randomly selected support sets and perform poorly on some datasets of Meta-Dataset because of its scattered mean embeddings responded by the simple mean operator. To enhance the robustness of CNAPs, Canonical Mean Filter (CMF) module is proposed to make the mean embeddings intensive and stable in feature space by mapping the support sets into a canonical form. CMFs make CNAPs robust to any fixed support sets even if they are random matrices. This attribution makes CNAPs be able to remove the mean encoder and the parameter adaptation network at the test stage, while CNAP-CMF on AZS tasks keeps the performance with one-shot tasks. It leads to a big parameter reduction. Precisely, 40.48\% parameters are dropped at the test stage. Also, CNAP-CMF outperforms CNAPs in one-shot tasks because it addresses inner-task unstable performance problems. Classification performance, visualized and clustering results verify that CMFs make CNAPs better and simpler.


title: Emergent phenomena from centre vortices

abstract: Quark confinement is perhaps the most important emergent property of the theory of quantum chromodynamics. Herein we review some key aspects of centre vortices in SU(3) lattice gauge theory. Starting from the original Monte Carlo gauge fields, a vortex identification procedure yields vortex-removed and vortex-only backgrounds. The comparison between the original `untouched' Monte Carlo gauge fields and these so called vortex-modified ensembles has provided a variety of results that support the notion that centre vortices are fundamental to confinement in pure gauge theory. For the first time we perform direct numerical tests of the response of centre vortices to the presence of dynamical quarks in SU(3).


title: Dark matter halos of luminous AGNs from galaxy-galaxy lensing with the HSC Subaru Strategic Program

abstract: We assess the dark matter halo masses of luminous AGNs over the redshift range 0.2 to 1.2 using galaxy-galaxy lensing based on imaging data from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). We measure the weak lensing signal of a sample of 8882 AGNs constructed using HSC and WISE photometry. The lensing detection around AGNs has a signal-to-noise ratio of 15. As expected, we find that the lensing mass profile is consistent with that of massive galaxies ($M_{*}\sim 10.8~M_\odot$). Surprisingly, the lensing signal remains unchanged when the AGN sample is split into low and high stellar mass hosts. Specifically, we find that the excess surface density (ESD) of AGNs, residing in galaxies with high stellar masses, significantly differs from that of the control sample. We further fit a halo occupation distribution model to the data to infer the posterior distribution of parameters including the average halo mass. We find that the characteristic halo mass of the full AGN population lies near the knee ($\rm log(M_h/h^{-1}M_{\odot})=12.0$) of the stellar-to-halo mass relation (SHMR). Illustrative of the results given above, the halo masses of AGNs residing in host galaxies with high stellar masses (i.e., above the knee of the SHMR) falls below the calibrated SHMR while the halo mass of the low stellar mass sample is more consistent with the established SHMR. These results indicate that massive halos with higher clustering bias tend to suppress AGN activity, probably due to the lack of available gas.


title: Search for 70 \mu eV Dark Photon Dark Matter with a Dielectrically-Loaded Multi-Wavelength Microwave Cavity

abstract: Microwave cavities have been deployed to search for bosonic dark matter candidates with masses of a few $\mu$eV. However, the sensitivity of these cavity detectors is limited by their volume, and the traditionally-employed half-wavelength cavities suffer from a significant volume reduction at higher masses. ADMX-Orpheus mitigates this issue by operating a tunable, dielectrically-loaded cavity at a higher-order mode, which allows the detection volume to remain large. The ADMX-Orpheus inaugural run excludes dark photon dark matter with kinetic mixing angle $\chi > 10^{-13}$ between 65.5 $\mu$eV (15.8 GHz) and 69.3 $\mu$eV (16.8GHz), marking the highest-frequency tunable microwave cavity dark matter search to date.


title: Testing the seesaw mechanisms via displaced right-handed neutrinos from a light scalar at the HL-LHC

abstract: We investigate the pair production of right-handed neutrinos from the decay of a light $B-L$ scalar in the $U(1)_{B-L}$ model. The $B-L$ scalar mixes to the SM Higgs, and the physical scalar is required to be lighter than the observed Higgs. The produced right-handed neutrinos are predicted to be long-lived according to the type-I seesaw mechanism, and yield potentially distinct signatures such as displaced vertex and time-delayed leptons at the CMS/ATLAS/LHCb, as well as signatures at the far detectors including the CODEX-b, FACET, FASER, MoEDAL-MAPP and MATHUSLA. We analyze the sensitivity reach at the HL-LHC for the right-handed neutrinos with masses of 2.5 $\sim$ 30 GeV, showing that the active-sterile mixing to muons can be probed to $V_{\mu N} \sim 10^{-5}$ at the CMS/ATLAS/LHCb using the displaced vertex searches, and one magnitude lower at the MATHUSLA/CMS using time-delayed leptons searches, reaching the parameter space interesting for type-I seesaw mechanisms.


title: Investigating the stability of mass transfer in neutron star-helium white dwarf binaries

abstract: Neutron star-helium white dwarf (NS+He WD) binaries are important evolutionary products of close-orbit binary star systems. They are often observed as millisecond pulsars and may continue evolving into ultra-compact X-ray binaries (UCXBs) and continuous gravitational wave (GW) sources that will be detected by space-borne GW observatories, such as LISA, TianQin and Taiji. Nevertheless, the stability of NS+He WD binaries undergoing mass transfer is not well studied and still under debate. In this paper, we model the evolution of NS+He WD binaries with WD masses ranging from 0.17-0.45 $M_{\odot}$, applying the detailed stellar evolution code mesa. Contrary to previous studies based on hydrodynamics, we find that apparently all NS+He WD binaries undergo stable mass transfer. We find for such UCXBs that the larger the WD mass, the larger the maximum mass-transfer rate and the smaller the minimum orbital period during their evolution. Finally, we demonstrate numerically and analytically that there is a tight correlation between WD mass and GW frequency for UCXBs, independent of NS mass.


title: Sum of the Hurwitz-Lerch Zeta Function over Prime Numbers: Derivation and Evaluation

abstract: For the function $f(m,p,q,n)$, where $k,s,a$ general complex numbers and $q$ any positive integer, we establish the sum of values of the Hurwitz-Lerch zeta function $\Phi(f(m,p,q,n),k,a)$ taken at prime numbers $n$. Special cases of this sum are evaluated in terms of products of trigonometric functions and Catalan's constant $K$.


title: DiversiTree: A New Method to Efficiently Compute Diverse Sets of Near-Optimal Solutions to Mixed-Integer Optimization Problems

abstract: While most methods for solving mixed-integer optimization problems compute a single optimal solution, a diverse set of near-optimal solutions can often lead to improved outcomes. We present a new method for finding a set of diverse solutions by emphasizing diversity within the search for near-optimal solutions. Specifically, within a branch-and-bound framework, we investigated parameterized node selection rules that explicitly consider diversity. Our results indicate that our approach significantly increases the diversity of the final solution set. When compared with two existing methods, our method runs with similar runtime as regular node selection methods and gives a diversity improvement between 12% and 190%. In contrast, popular node selection rules, such as best-first search, in some instances performed worse than state-of-the-art methods by more than 35% and gave an improvement of no more than 130%. Further, we find that our method is most effective when diversity in node selection is continuously emphasized after reaching a minimal depth in the tree and when the solution set has grown sufficiently large. Our method can be easily incorporated into integer programming solvers and has the potential to significantly increase the diversity of solution sets.


title: Gravitationally Lensed Orphan Afterglows of Gamma-Ray Bursts

abstract: The cosmological nature of gamma-ray bursts (GRBs) implies that a small portion of them could be gravitationally lensed by foreground objects during their propagation. The gravitational lensing effect on the GRB prompt emission and on-axis afterglows has been discussed, and some candidates have been found in the literature. In this work, considering the high detection rate of GRB orphan afterglows in future wide-field survey era, we investigate the gravitationally lensed orphan afterglows in view of three lens models, i.e., the point-mass model, the singular isothermal sphere model, and the Chang-Refsdal model. The structure of the GRB jet itself is also incorporated in calculating the lensed afterglow light curves. It is found that lensed optical/X-ray orphan afterglows in principle could be diagnosed through their temporal characteristics, and the optical band is the best band to observe the galaxy-lensed orphan afterglows. Moreover, the event rate for galaxy-lensed orphan afterglows is estimated to be $\lesssim$ 1.8 $\text{yr}^{-1}$ for the whole sky. If most orphan afterglows could be identified (from other transients in the survey data), the optimistic detection rates of the 2.5m Wide Field Survey Telescope of China and 8.4m Vera Rubin Observatory Legacy Survey of Space and Time for galaxy-lensed orphan afterglows in the optical band are $\lesssim$ 0.01$\sim$0.02 $\text{yr}^{-1}$ and $\lesssim$ 0.04$\sim$0.08 $\text{yr}^{-1}$, respectively.


title: Stability of Multi-dimensional Nonlinear Piezoelectric Beam with Viscoelastic Infinite Memory

abstract: The long time behavior of a kind of fully magnetic effected nonlinear piezoelectric beam with viscoelastic infinite memory is considered. The well-posedness of this nonlinear coupled PDEs system is showed by mean of the semigroup theories and Banach fixed point theorem. Based on frequency domain analysis, it is proved that the corresponding coupled linear system can be indirectly stabilized exponentially by only one viscoelastic infinite memory term, which is located on one equation of these strongly coupled PDEs. Then the exponential decay of the solution to the nonlinear coupled PDEs' system is established by the energy estimation method under certain condition.


title: Global stability of discretized Anosov flows

abstract: The goal of this article is to establish several general properties of a somewhat large class of partially hyperbolic diffeomorphisms called \emph{discretized Anosov flows}. A general definition for these systems is presented and is proven to be equivalent with the definition introduced in [BFFP19], as well as with the notion of flow type partially hyperbolic diffeomorphisms introduced in [BFT20]. The set of discretized Anosov flows is shown to be $C^1$ open and closed inside the set of partially hyperbolic diffeomorphisms. Every discretized Anosov flow is proven to be dynamically coherent and plaque expansive. Unique integrability of the center bundle is shown to happen for whole connected components, notably the ones containing the time 1 map of an Anosov flow. For general connected components, a result on uniqueness of invariant foliation is obtained. Similar results are seen to happen for partially hyperbolic systems admitting a uniformly compact center foliation extending the studies initiated in [BB16].


title: Matrix multiplication via matrix groups

abstract: In 2003, Cohn and Umans proposed a group-theoretic approach to bounding the exponent of matrix multiplication. Previous work within this approach ruled out certain families of groups as a route to obtaining $\omega = 2$, while other families of groups remain potentially viable. In this paper we turn our attention to matrix groups, whose usefulness within this framework was relatively unexplored. We first show that groups of Lie type cannot prove $\omega=2$ within the group-theoretic approach. This is based on a representation-theoretic argument that identifies the second-smallest dimension of an irreducible representation of a group as a key parameter that determines its viability in this framework. Our proof builds on Gowers' result concerning product-free sets in quasirandom groups. We then give another barrier that rules out certain natural matrix group constructions that make use of subgroups that are far from being self-normalizing. Our barrier results leave open several natural paths to obtain $\omega = 2$ via matrix groups. To explore these routes we propose working in the continuous setting of Lie groups, in which we develop an analogous theory. Obtaining the analogue of $\omega=2$ in this potentially easier setting is a key challenge that represents an intermediate goal short of actually proving $\omega = 2$. We give two constructions in the continuous setting, each of which evades one of our two barriers.


title: IA-GCN: Interactive Graph Convolutional Network for Recommendation

abstract: Recently, Graph Convolutional Network (GCN) has become a novel state-of-art for Collaborative Filtering (CF) based Recommender Systems (RS). It is a common practice to learn informative user and item representations by performing embedding propagation on a user-item bipartite graph, and then provide the users with personalized item suggestions based on the representations. Despite effectiveness, existing algorithms neglect precious interactive features between user-item pairs in the embedding process. When predicting a user's preference for different items, they still aggregate the user tree in the same way, without emphasizing target-related information in the user neighborhood. Such a uniform aggregation scheme easily leads to suboptimal user and item representations, limiting the model expressiveness to some extent. In this work, we address this problem by building bilateral interactive guidance between each user-item pair and proposing a new model named IA-GCN (short for InterActive GCN). Specifically, when learning the user representation from its neighborhood, we assign higher attention weights to those neighbors similar to the target item. Correspondingly, when learning the item representation, we pay more attention to those neighbors resembling the target user. This leads to interactive and interpretable features, effectively distilling target-specific information through each graph convolutional operation. Our model is built on top of LightGCN, a state-of-the-art GCN model for CF, and can be combined with various GCN-based CF architectures in an end-to-end fashion. Extensive experiments on three benchmark datasets demonstrate the effectiveness and robustness of IA-GCN.


title: From PHY to QoE: A Parameterized Framework Design

abstract: The rapid development of 5G communication technology has given birth to various real-time broadband communication services, such as augmented reality (AR), virtual reality (VR) and cloud games. Compared with traditional services, consumers tend to focus more on their subjective experience when utilizing these services. In the meantime, the problem of power consumption is particularly prominent in 5G and beyond. The traditional design of physical layer (PHY) receiver is based on maximizing spectrum efficiency or minimizing error, but this will no longer be the best after considering energy efficiency and these new-coming services. Therefore, this paper uses quality of experience (QoE) as the optimization criterion of the PHY algorithm. In order to establish the relationship between PHY and QoE, this paper models the end-to-end transmission from UE perspective and proposes a five-layer framework based on hierarchical analysis method, which includes system-level model, bitstream model, packet model, service quality model and experience quality model. Real data in 5G network is used to train the parameters of the involved models for each type of services, respectively. The results show that the PHY algorithms can be simplified in perspective of QoE.


title: Does the Market of Citations Reward Reproducible Work?

abstract: The field of bibliometrics, studying citations and behavior, is critical to the discussion of reproducibility. Citations are one of the primary incentive and reward systems for academic work, and so we desire to know if this incentive rewards reproducible work. Yet to the best of our knowledge, only one work has attempted to look at this combined space, concluding that non-reproducible work is more highly cited. We show that answering this question is more challenging than first proposed, and subtle issues can inhibit a robust conclusion. To make inferences with more robust behavior, we propose a hierarchical Bayesian model that incorporates the citation rate over time, rather than the total number of citations after a fixed amount of time. In doing so we show that, under current evidence the answer is more likely that certain fields of study such as Medicine and Machine Learning (ML) do correlate reproducible works with more citations, but other fields appear to have no relationship. Further, we find that making code available and thoroughly referencing prior works appear to also positively correlate with increased citations. Our code and data can be found at https://github.com/EdwardRaff/ReproducibleCitations .


title: PharmMT: A Neural Machine Translation Approach to Simplify Prescription Directions

abstract: The language used by physicians and health professionals in prescription directions includes medical jargon and implicit directives and causes much confusion among patients. Human intervention to simplify the language at the pharmacies may introduce additional errors that can lead to potentially severe health outcomes. We propose a novel machine translation-based approach, PharmMT, to automatically and reliably simplify prescription directions into patient-friendly language, thereby significantly reducing pharmacist workload. We evaluate the proposed approach over a dataset consisting of over 530K prescriptions obtained from a large mail-order pharmacy. The end-to-end system achieves a BLEU score of 60.27 against the reference directions generated by pharmacists, a 39.6% relative improvement over the rule-based normalization. Pharmacists judged 94.3% of the simplified directions as usable as-is or with minimal changes. This work demonstrates the feasibility of a machine translation-based tool for simplifying prescription directions in real-life.


title: Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning

abstract: As for multilingual language models, it is important to select languages for training because of the curse of multilinguality. It is known that using languages with similar language structures is effective for cross lingual transfer learning. However, we demonstrate that using agglutinative languages such as Korean is more effective in cross lingual transfer learning. This is a great discovery that will change the training strategy of cross lingual transfer learning.


title: Scaling Bockchain with Adaptivity

abstract: This paper presents Balloon, a scalable blockchain consensus protocol which could dynamically adapt its performance to the overall computation power change. Balloon is based on a parallel chain architecture combined with a greedy heaviest sub-chain selection strategy. It adopts an inovative block sampling approach to assess the change of block generation rate in the network. By introducing view change mechanism, Balllon is able to dynamically adjust the number of parallel sub-chains. Balloon redefines the concept of block subtree weight with view change in consideration, so that a total order of blocks could be obtained safely. To deal with rapidly increasing block generation rate in the blockchain network, participants of previous Nakamoto-style protocols are required to continuously increase their mining difficulty so as to maintain an expected security gurantee. Balloon, however, could accomadate a fixed difficulty setup and assign superfluous block processing capability to new sub-chains, which makes it more open and also economical.


title: A no-go theorem for scalar fields with couplings from Ginzburg-Landau models

abstract: Recently Hod proved a no-go theorem that static scalar fields cannot form spherically symmetric boson stars in the asymptotically flat background. On the other side, scalar fields can be coupled to the gradient according to next-to-leading order Ginzburg-Landau models. In the present work, we extend Hod's discussions by considering couplings between static scalar fields and the field gradient. For a non-negative coupling parameter, we show that there is no asymptotically flat spherically symmetric boson stars made of coupled static scalar fields.


title: Correspondence of topological classification between quantum graph extra dimension and topological matter

abstract: In this paper, we study five-dimensional Dirac fermions of which extra-dimension is compactified on quantum graphs. We find that there is a non-trivial correspondence between matrices specifying boundary conditions at the vertex of the quantum graphs and zero-dimensional Hamiltonians in gapped free-fermion systems. Based on the correspondence, we provide a complete topological classification of the boundary conditions in terms of non-interacting fermionic topological phases. The ten symmetry classes of topological phases are fully identified in the language of five-dimensional Dirac fermions, and topological numbers of the boundary conditions are given. In analogy with the bulk-boundary correspondence in non-interacting fermionic topological phases, the boundary condition topological numbers predict four-dimensional massless fermions localized at the vertex of the quantum graphs and thus govern the low energy physics in four dimensions.


title: LoCI: An Analysis of the Impact of Optical Loss and Crosstalk Noise in Integrated Silicon-Photonic Neural Networks

abstract: Compared to electronic accelerators, integrated silicon-photonic neural networks (SP-NNs) promise higher speed and energy efficiency for emerging artificial-intelligence applications. However, a hitherto overlooked problem in SP-NNs is that the underlying silicon photonic devices suffer from intrinsic optical loss and crosstalk noise, the impact of which accumulates as the network scales up. Leveraging precise device-level models, this paper presents the first comprehensive and systematic optical loss and crosstalk modeling framework for SP-NNs. For an SP-NN case study with two hidden layers and 1380 tunable parameters, we show a catastrophic 84% drop in inferencing accuracy due to optical loss and crosstalk noise.


title: Solvable Leibniz superalgebras whose nilradical has the characteristic sequence $(n-1, 1 \mid m)$ and nilindex $n+m$

abstract: Leibniz superalgebras with nilindex $n + m$ and characteristic sequence $(n-1, 1 \ | \ m)$ divided into four parametric classes that contain a set of non-isomorphic superalgebras. In this paper, we give a complete classification of solvable Leibniz superalgebras whose nilradical is a nilpotent Leibniz superalgebra with nilindex $n + m$ and characteristic sequence $(n-1, 1 \ | \ m)$. We obtain a condition for the value of parameters of the classes of such nilpotent superalgebras for which they have a solvable extension. Moreover, the classification of solvable Leibniz superalgebras whose nilradical is a Lie superalgebra with the maximal nilindex is given.


title: Electrically tunable moir\'e magnetism in twisted double bilayer antiferromagnets

abstract: The introduction of moir\'e superlattices to electronic materials can dramatically alter electronic properties, promising emergent correlated and topological phenomena. Its first demonstration in van der Waals magnets exhibited noncollinear states and domain structures with, however, limited manipulation. Here, we fabricated twisted double antiferromagnetic bilayer CrI3, and by magneto-optical Kerr effect microscopy demonstrate the coexistence of antiferromagnetic and ferromagnetic orders with nonzero net magnetization, which is the hallmark of moir\'e magnetism. Such magnetic state exhibits nonmonotonic temperature dependence and extends over a wide range of twist angles with transitions at ~0{\deg} and above 20{\deg}. We further demonstrate voltage-assisted magnetic switching and the linear magnetoelectric effect. The observed nontrivial magnetic states and unprecedented control by twist angle, temperature and electrical gating are supported by the simulated phase diagram of the moir\'e magnetism. Our results illustrate the rich behaviors of twisted antiferromagnets and the control over them.


title: Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptation

abstract: Adversarial learning has achieved remarkable performances for unsupervised domain adaptation (UDA). Existing adversarial UDA methods typically adopt an additional discriminator to play the min-max game with a feature extractor. However, most of these methods failed to effectively leverage the predicted discriminative information, and thus cause mode collapse for generator. In this work, we address this problem from a different perspective and design a simple yet effective adversarial paradigm in the form of a discriminator-free adversarial learning network (DALN), wherein the category classifier is reused as a discriminator, which achieves explicit domain alignment and category distinguishment through a unified objective, enabling the DALN to leverage the predicted discriminative information for sufficient feature alignment. Basically, we introduce a Nuclear-norm Wasserstein discrepancy (NWD) that has definite guidance meaning for performing discrimination. Such NWD can be coupled with the classifier to serve as a discriminator satisfying the K-Lipschitz constraint without the requirements of additional weight clipping or gradient penalty strategy. Without bells and whistles, DALN compares favorably against the existing state-of-the-art (SOTA) methods on a variety of public datasets. Moreover, as a plug-and-play technique, NWD can be directly used as a generic regularizer to benefit existing UDA algorithms. Code is available at https://github.com/xiaoachen98/DALN.


title: Infusing Knowledge from Wikipedia to Enhance Stance Detection

abstract: Stance detection infers a text author's attitude towards a target. This is challenging when the model lacks background knowledge about the target. Here, we show how background knowledge from Wikipedia can help enhance the performance on stance detection. We introduce Wikipedia Stance Detection BERT (WS-BERT) that infuses the knowledge into stance encoding. Extensive results on three benchmark datasets covering social media discussions and online debates indicate that our model significantly outperforms the state-of-the-art methods on target-specific stance detection, cross-target stance detection, and zero/few-shot stance detection.


title: Data-Driven Evaluation of Training Action Space for Reinforcement Learning

abstract: Training action space selection for reinforcement learning (RL) is conflict-prone due to complex state-action relationships. To address this challenge, this paper proposes a Shapley-inspired methodology for training action space categorization and ranking. To reduce exponential-time shapley computations, the methodology includes a Monte Carlo simulation to avoid unnecessary explorations. The effectiveness of the methodology is illustrated using a cloud infrastructure resource tuning case study. It reduces the search space by 80\% and categorizes the training action sets into dispensable and indispensable groups. Additionally, it ranks different training actions to facilitate high-performance yet cost-efficient RL model design. The proposed data-driven methodology is extensible to different domains, use cases, and reinforcement learning algorithms.


title: Latent Trait Item Response Models for Continuous Responses

abstract: A general framework of latent trait item response models for continuous responses is given. In contrast to classical test theory models, which traditionally distinguish between true scores and error scores, the responses are clearly linked to latent traits. It is shown that classical test theory models can be derived as special cases but the model class is much wider. It provides, in particular, appropriate modelling of responses that are restricted in some way, for example, if responses are positive or are restricted to an interval. Restrictions of this sort are easily incorporated in the modeling framework. Restriction to an interval is typically ignored in common models yielding inappropriate models, for example, when modeling Likert-type data. The model also extends common response time models, which can be treated as special cases. Properties of the model class are derived and the role of the total score is investigated, which leads to a modified total score. Several applications illustrate the use of the model including an example, in which covariates that may modify the response are taken into account.


title: From 2D Images to 3D Model:Weakly Supervised Multi-View Face Reconstruction with Deep Fusion

abstract: While weakly supervised multi-view face reconstruction (MVR) is garnering increased attention, one critical issue still remains open: how to effectively fuse multiple image information to reconstruct high-precision 3D models. In this regard, we propose a novel model called Deep Fusion MVR (DF-MVR) to reconstruct high-precision 3D facial shapes from multi-view images. Specifically, we introduce MulEn-Unet, a multi-view encoding to single decoding framework with skip connections and attention. This design allows for the extraction, integration, and compensation of deep features with attention from multi-view images. Furthermore, we adopt the involution kernel to enrich deep fusion features with channel features. In addition, we develop the face parse network to learn, identify, and emphasize the critical common face area within multi-view images. Experiments on Pixel-Face and Bosphorus datasets indicate the superiority of our model. Without 3D annotation, DF-MVR achieves 5.2% and 3.0% RMSE improvement over the existing weakly supervised MVRs respectively on Pixel-Face and Bosphorus dataset. Code will be available publicly at https://github.com/weiguangzhao/DF_MVR.


title: CFL: Cluster Federated Learning in Large-scale Peer-to-Peer Networks

abstract: Federated learning (FL) has sparked extensive interest in exploiting the private data on clients' local devices. However, the parameter server setting of FL not only has high bandwidth requirements, but also poses data privacy issues and a single point of failure. In this paper, we propose an efficient and privacy-preserving protocol, dubbed CFL, which is the first fine-grained global model training for FL in large-scale peer-to-peer (P2P) networks. Unlike previous FL in P2P networks, CFL aggregates local model update parameters hierarchically, which improves the communication efficiency facing large amounts of clients. Also, the aggregation in CFL is performed in a secure manner by introducing the authenticated encryption scheme, whose key is established through a random pairwise key scheme enhanced by a proposed voting-based key revocation mechanism. Rigorous analyses show that CFL guarantees the privacy and data integrity and authenticity of local model update parameters under two widespread threat models. More importantly, the proposed key revocation mechanism can effectively resist hijack attacks, thereby ensuring the confidentiality of the communication keys. Ingenious experiments on the Trec06p and Trec07 datasets show that the global model trained by CFL has good classification accuracy, model generalization, and rapid convergence rate, and the dropout-robustness of the system is achieved. Compared to the first global model training protocol for FL in P2P networks, PPT, CFL improves communication efficiency by 43.25%. Also, CFL outperforms PPT in terms of computational efficiency.


title: Monads on multiprojective spaces and associated vector bundles

abstract: In this paper we establish the existence of monads on Cartesian products of projective spaces. We construct vector bundles associated to monads on $\mathbb{P}^{a_1}\times\mathbb{P}^{a_1}\times\mathbb{P}^{a_2}\times\mathbb{P}^{a_2}\times\cdots\times\mathbb{P}^{a_n}\times\mathbb{P}^{a_n}$. Once the monad on $X$ exists the next natural question is if the cohomology vector bundle associated to these monads are simple or not. We study these vector bundles associated to monads on $X$ and prove their stability and simplicity.


title: Decompositional Generation Process for Instance-Dependent Partial Label Learning

abstract: Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect labels in each training example are randomly picked as the candidate labels and model the generation process of the candidate labels in a simple way. However, these approaches usually do not perform as well as expected due to the fact that the generation process of the candidate labels is always instance-dependent. Therefore, it deserves to be modeled in a refined way. In this paper, we consider instance-dependent PLL and assume that the generation process of the candidate labels could decompose into two sequential parts, where the correct label emerges first in the mind of the annotator but then the incorrect labels related to the feature are also selected with the correct label as candidate labels due to uncertainty of labeling. Motivated by this consideration, we propose a novel PLL method that performs Maximum A Posterior (MAP) based on an explicitly modeled generation process of candidate labels via decomposed probability distribution models. Extensive experiments on manually corrupted benchmark datasets and real-world datasets validate the effectiveness of the proposed method. Source code is available at https://github.com/palm-ml/idgp.


title: A new condition on the Jones polynomial of a fibered positive link

abstract: We give a new upper bound on the maximum degree of the Jones polynomial of a fibered positive link. In particular, we prove that the maximum degree of the Jones polynomial of a fibered positive knot is at most four times the minimum degree. Using this result, we can complete the classification of all knots of crossing number $\leq 12$ as positive or not positive, by showing that the seven remaining knots for which positivity was unknown are not positive. That classification was also done independently at around the same time by Stoimenow.


title: Enhanced exemplar autoencoder with cycle consistency loss in any-to-one voice conversion

abstract: Recent research showed that an autoencoder trained with speech of a single speaker, called exemplar autoencoder (eAE), can be used for any-to-one voice conversion (VC). Compared to large-scale many-to-many models such as AutoVC, the eAE model is easy and fast in training, and may recover more details of the target speaker. To ensure VC quality, the latent code should represent and only represent content information. However, this is not easy to attain for eAE as it is unaware of any speaker variation in model training. To tackle the problem, we propose a simple yet effective approach based on a cycle consistency loss. Specifically, we train eAEs of multiple speakers with a shared encoder, and meanwhile encourage the speech reconstructed from any speaker-specific decoder to get a consistent latent code as the original speech when cycled back and encoded again. Experiments conducted on the AISHELL-3 corpus showed that this new approach improved the baseline eAE consistently. The source code and examples are available at the project page: http://project.cslt.org/.


title: AdvEst: Adversarial Perturbation Estimation to Classify and Detect Adversarial Attacks against Speaker Identification

abstract: Adversarial attacks pose a severe security threat to the state-of-the-art speaker identification systems, thereby making it vital to propose countermeasures against them. Building on our previous work that used representation learning to classify and detect adversarial attacks, we propose an improvement to it using AdvEst, a method to estimate adversarial perturbation. First, we prove our claim that training the representation learning network using adversarial perturbations as opposed to adversarial examples (consisting of the combination of clean signal and adversarial perturbation) is beneficial because it eliminates nuisance information. At inference time, we use a time-domain denoiser to estimate the adversarial perturbations from adversarial examples. Using our improved representation learning approach to obtain attack embeddings (signatures), we evaluate their performance for three applications: known attack classification, attack verification, and unknown attack detection. We show that common attacks in the literature (Fast Gradient Sign Method (FGSM), Projected Gradient Descent (PGD), Carlini-Wagner (CW) with different Lp threat models) can be classified with an accuracy of ~96%. We also detect unknown attacks with an equal error rate (EER) of ~9%, which is absolute improvement of ~12% from our previous work.


title: Prediction of COVID-19 using chest X-ray images

abstract: COVID-19, also known as Novel Coronavirus Disease, is a highly contagious disease that first surfaced in China in late 2019. SARS-CoV-2 is a coronavirus that belongs to the vast family of coronaviruses that causes this disease. The sickness originally appeared in Wuhan, China in December 2019 and quickly spread to over 213 nations, becoming a global pandemic. Fever, dry cough, and tiredness are the most typical COVID-19 symptoms. Aches, pains, and difficulty breathing are some of the other symptoms that patients may face. The majority of these symptoms are indicators of respiratory infections and lung abnormalities, which radiologists can identify. Chest x-rays of COVID-19 patients seem similar, with patchy and hazy lungs rather than clear and healthy lungs. On x-rays, however, pneumonia and other chronic lung disorders can resemble COVID-19. Trained radiologists must be able to distinguish between COVID-19 and an illness that is less contagious. Our AI algorithm seeks to give doctors a quantitative estimate of the risk of deterioration. So that patients at high risk of deterioration can be triaged and treated efficiently. The method could be particularly useful in pandemic hotspots when screening upon admission is important for allocating limited resources like hospital beds.


title: Resource Consumption for Supporting Federated Learning in Wireless Networks

abstract: Federated learning (FL) has recently become one of the hottest focuses in wireless edge networks with the ever-increasing computing capability of user equipment (UE). In FL, UEs train local machine learning models and transmit them to an aggregator, where a global model is formed and then sent back to UEs. In wireless networks, local training and model transmission can be unsuccessful due to constrained computing resources, wireless channel impairments, bandwidth limitations, etc., which degrades FL performance in model accuracy and/or training time. Moreover, we need to quantify the benefits and cost of deploying edge intelligence, as model training and transmission consume certain amount of resources. Therefore, it is imperative to deeply understand the relationship between FL performance and multiple-dimensional resources. In this paper, we construct an analytical model to investigate the relationship between the FL model accuracy and consumed resources in FL empowered wireless edge networks. Based on the analytical model, we explicitly quantify the model accuracy, available computing resources and communication resources. Numerical results validate the effectiveness of our theoretical modeling and analysis, and demonstrate the trade-off between the communication and computing resources for achieving a certain model accuracy.


title: Defense against Adversarial Attacks on Hybrid Speech Recognition using Joint Adversarial Fine-tuning with Denoiser

abstract: Adversarial attacks are a threat to automatic speech recognition (ASR) systems, and it becomes imperative to propose defenses to protect them. In this paper, we perform experiments to show that K2 conformer hybrid ASR is strongly affected by white-box adversarial attacks. We propose three defenses--denoiser pre-processor, adversarially fine-tuning ASR model, and adversarially fine-tuning joint model of ASR and denoiser. Our evaluation shows denoiser pre-processor (trained on offline adversarial examples) fails to defend against adaptive white-box attacks. However, adversarially fine-tuning the denoiser using a tandem model of denoiser and ASR offers more robustness. We evaluate two variants of this defense--one updating parameters of both models and the second keeping ASR frozen. The joint model offers a mean absolute decrease of 19.3\% ground truth (GT) WER with reference to baseline against fast gradient sign method (FGSM) attacks with different $L_\infty$ norms. The joint model with frozen ASR parameters gives the best defense against projected gradient descent (PGD) with 7 iterations, yielding a mean absolute increase of 22.3\% GT WER with reference to baseline; and against PGD with 500 iterations, yielding a mean absolute decrease of 45.08\% GT WER and an increase of 68.05\% adversarial target WER.


title: Reliable Visualization for Deep Speaker Recognition

abstract: In spite of the impressive success of convolutional neural networks (CNNs) in speaker recognition, our understanding to CNNs' internal functions is still limited. A major obstacle is that some popular visualization tools are difficult to apply, for example those producing saliency maps. The reason is that speaker information does not show clear spatial patterns in the temporal-frequency space, which makes it hard to interpret the visualization results, and hence hard to confirm the reliability of a visualization tool. In this paper, we conduct an extensive analysis on three popular visualization methods based on CAM: Grad-CAM, Score-CAM and Layer-CAM, to investigate their reliability for speaker recognition tasks. Experiments conducted on a state-of-the-art ResNet34SE model show that the Layer-CAM algorithm can produce reliable visualization, and thus can be used as a promising tool to explain CNN-based speaker models. The source code and examples are available in our project page: http://project.cslt.org/.


title: Lightweight starshade position sensing with convolutional neural networks and simulation-based inference

abstract: Starshades are a leading technology to enable the direct detection and spectroscopic characterization of Earth-like exoplanets. To keep the starshade and telescope aligned over large separations, reliable sensing of the peak of the diffracted light of the occluded star is required. Current techniques rely on image matching or model fitting, both of which put substantial computational burdens on resource-limited spacecraft computers. We present a lightweight image processing method based on a convolutional neural network paired with a simulation-based inference technique to estimate the position of the spot of Arago and its uncertainty. The method achieves an accuracy of a few centimeters across the entire pupil plane, while only requiring 1.6 MB in stored data structures and 5.3 MFLOPs (million floating point operations) per image at test time. By deploying our method at the Princeton Starshade Testbed, we demonstrate that the neural network can be trained on simulated images and used on real images, and that it can successfully be integrated in the control system for closed-loop formation flying.


title: Durable and Recoverable Hydrophilicity of Polyethylene Terephthalate Fabric Prepared with Plasma Selective Etching

abstract: Durable delustered PET (PET-TiO2) fabrics super hydrophilic surface has been obtained by plasma selecting etching. The aging effect of their hydrophilicity after plasma treatment has been investigated with storage time. After Ar/O2 radio frequency (RF) plasma treatment for only 7 min, PET-TiO2 fabric showed water contact angle of 0o. After 10 month storage time, it keeps its water contact angle below 75.7o. Further more, with Xenon light irradiation for 10 min, it is firstly found that it has well-recovered water contact angle to 5{\deg}. While the contact angle of PET fabric for 7 min returns to 123.0{\deg} and its hydrophilicity disappeared almost completely and showed no response to Xenon light irradiation. The water absorption rate of 7 min plasma treated PET-TiO2 fabric increased by 57.54%. By field emission scanning electron microscopy (FE-SEM), X-ray photoelectron spectroscopy (XPS) and X-ray diffraction analysis(XRD) measurement, waviness structure of humps and ridges with irregular particles or pits were found on the plasma treated PET-TiO2 fabric surface and increased Ti atomic percentage was observed. It is verified that TiO2 particles inside PET-TiO2 fiber have been exposed to its surface by plasma selective etching of its organic component. It suppresses the aging effect and is characterized with durable and recoverable hydrophilicity. This one step, quick, green and cost-resonable manufacture method has a pratical application for durable superhydrophilic surfaces.


title: Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognition

abstract: Low-resource speech recognition has been long-suffering from insufficient training data. In this paper, we propose an approach that leverages neighboring languages to improve low-resource scenario performance, founded on the hypothesis that similar linguistic units in neighboring languages exhibit comparable term frequency distributions, which enables us to construct a Huffman tree for performing multilingual hierarchical Softmax decoding. This hierarchical structure enables cross-lingual knowledge sharing among similar tokens, thereby enhancing low-resource training outcomes. Empirical analyses demonstrate that our method is effective in improving the accuracy and efficiency of low-resource speech recognition.


title: Definition and evolution of transverse momentum dependent distribution of twist-three

abstract: We present an in-depth analysis of transverse momentum dependent (TMD) distributions of twist-three. In particular, we focus on evolution equations, symmetry relations, parameterization, interpretation, small-b asymptotic behaviour and the structure of singularities. The starting point of discussion are the correlators with the definite TMD-twist. By considering suitable combinations of these correlators, we introduce physical TMD distribution of twist-three that can be used for practical applications. We also establish relations with generic TMD distribution of twist-three, and demonstrate that their evolution equations are autonomous in the large-$N_c$ limit.