title: A GNN Based Approach to LTL Model Checking

abstract: Model Checking is widely applied in verifying complicated and especially concurrent systems. Despite of its popularity, model checking suffers from the state space explosion problem that restricts it from being applied to certain systems, or specifications. Many works have been proposed in the past to address the state space explosion problem, and they have achieved some success, but the inherent complexity still remains an obstacle for purely symbolic approaches. In this paper, we propose a Graph Neural Network (GNN) based approach for model checking, where the model is expressed using a B{\"u}chi automaton and the property to be verified is expressed using Linear Temporal Logic (LTL). We express the model as a GNN, and propose a novel node embedding framework that encodes the LTL property and characteristics of the model. We reduce the LTL model checking problem to a graph classification problem, where there are two classes, 1 (if the model satisfies the specification) and 0 (if the model does not satisfy the specification). The experimental results show that our framework is up to 17 times faster than state-of-the-art tools. Our approach is particularly useful when dealing with very large LTL formulae and small to moderate sized models.


title: Normality-Calibrated Autoencoder for Unsupervised Anomaly Detection on Data Contamination

abstract: In this paper, we propose Normality-Calibrated Autoencoder (NCAE), which can boost anomaly detection performance on the contaminated datasets without any prior information or explicit abnormal samples in the training phase. The NCAE adversarially generates high confident normal samples from a latent space having low entropy and leverages them to predict abnormal samples in a training dataset. NCAE is trained to minimise reconstruction errors in uncontaminated samples and maximise reconstruction errors in contaminated samples. The experimental results demonstrate that our method outperforms shallow, hybrid, and deep methods for unsupervised anomaly detection and achieves comparable performance compared with semi-supervised methods using labelled anomaly samples in the training phase. The source code is publicly available on `https://github.com/andreYoo/NCAE_UAD.git'.


title: Effects of beta function on mass and melting temperature for scalar glueballs in AdS/QCD models at finite temperature

abstract: We consider an extension to finite temperature in an AdS/ QCD model, which regards anomalous dimension contributions to get a bulk mass depending on beta function. We study the effect of beta function on mass as a function of temperature and melting temperature for scalar glueballs.


title: Indications of a Cosmic Ray Source in the Perseus-Pisces Supercluster

abstract: The Telescope Array Collaboration has observed an excess of events with $E \ge 10^{19.4} ~{\rm eV}$ in the data which is centered at (RA, dec) = ($19^\circ$, $35^\circ$). This is near the center of the Perseus-Pisces supercluster (PPSC). The PPSC is about $70 ~{\rm Mpc}$ distant and is the closest supercluster in the Northern Hemisphere (other than the Virgo supercluster of which we are a part). A Li-Ma oversampling analysis with $20^\circ$-radius circles indicates an excess in the arrival direction of events with a local significance of about 4 standard deviations. The probability of having such excess close to the PPSC by chance is estimated to be 3.5 standard deviations. This result indicates that a cosmic ray source likely exists in that supercluster.


title: Differential models for the Anderson dual to bordism theories and invertible QFT's, II

abstract: This is the second part of the work on differential models of the Anderson duals to the stable tangential $G$-bordism theories $I\Omega^G$, motivated by classifications of invertible QFT's. Using the model constructed in the first part \cite{YamashitaYonekura2021}, in this paper we show that pushforwards in generalized differential cohomology theories induces transformations between differential cohomology theories which refine the Anderson duals to multiplicative genera. This gives us a unified understanding of an important class of elements in the Anderson duals with physical origins.

categories: math.AT cond-mat.str-el hep-th math-ph math.MP


title: Effective Methods for Diophantine Finiteness

abstract: Let $K \subset \mathbb{C}$ be a number field, and let $\mathcal{O}_{K,N} = \mathcal{O}_{K}[N^{-1}]$ be its ring of $N$-integers. Recently, Lawrence and Venkatesh proposed a general strategy for proving the Shafarevich conjecture for the fibres of a smooth projective family $f : X \to S$ defined over $\mathcal{O}_{K,N}$. To carry out their strategy, one needs to be able to decide whether the algebraic monodromy group $\mathbf{H}_{Z}$ of any positive-dimensional geometrically irreducible subvariety $Z \subset S_{\mathbb{C}}$ is "large enough", in the sense that a certain orbit of $\mathbf{H}_{Z}$ in a variety of Hodge flags has dimension bounded from below by a certain quantity. In this article we give an effective method for deciding this question. Combined with the effective methods of Lawrence-Venkatesh for understanding semisimplifications of global Galois representations using $p$-adic Hodge theory, this gives a fully effective strategy for solving Shafarevich-type problems for arbitrary families $f$.


title: ODMTCNet: An Interpretable Multi-view Deep Neural Network Architecture for Image Feature Representation

abstract: This work proposes an interpretable multi-view deep neural network architecture, namely optimal discriminant multi-view tensor convolutional network (ODMTCNet), by integrating statistical machine learning (SML) principles with the deep neural network (DNN) architecture.


title: The Balancing Act in Causal Inference

abstract: The idea of covariate balance is at the core of causal inference. Inverse propensity weights play a central role because they are the unique set of weights that balance the covariate distributions of different treatment groups. We discuss two broad approaches to estimating these weights: the more traditional one, which fits a propensity score model and then uses the reciprocal of the estimated propensity score to construct weights, and the balancing approach, which estimates the inverse propensity weights essentially by the method of moments, finding weights that achieve balance in the sample. We review ideas from the causal inference, sample surveys, and semiparametric estimation literatures, with particular attention to the role of balance as a sufficient condition for robust inference. We focus on the inverse propensity weighting and augmented inverse propensity weighting estimators for the average treatment effect given strong ignorability and consider generalizations for a broader class of problems including policy evaluation and the estimation of individualized treatment effects.


title: Boosting engine performance with Bose-Einstein condensation

abstract: At low-temperatures a gas of bosons will undergo a phase transition into a quantum state of matter known as a Bose-Einstein condensate (BEC), in which a large fraction of the particles will occupy the ground state simultaneously. Here we explore the performance of an endoreversible Otto cycle operating with a harmonically confined Bose gas as the working medium. We analyze the engine operation in three regimes, with the working medium in the BEC phase, in the gas phase, and driven across the BEC transition during each cycle. We find that the unique properties of the BEC phase allow for enhanced engine performance, including increased power output and higher efficiency at maximum power.


title: Modeling 3D geometry using 1D laser distance measurements with application to cylinder for visualization and evaluating surface quality

abstract: Geometric metrology includes one or two-dimensional (1D or 2D) distance or plane measurements, as well as the three-dimensional (3D) scanning. The 1D or 2D measuring system is unable to obtain advanced 3D feature, while the 3D scanning system is relatively costly and time-consuming. Accordingly, in this study I developed a 3D geometry and surface prediction method by using 1D laser distance measurements to achieve 3D features while saving cost and time. The model is based on the natural neighbor function for data interpolation and linear model for extrapolation. I implemented the model to the cylinder body for evaluating 3D circularity and surface quality. Results show that the model could achieve reasonable accuracy in constructing the 3D geometry and surface deviation using limited distance measurement (e.g. only 100 data points). It accurately predicts the shape of a curved dent (30.48 mm) and identified minor dents (less than 0.18mm in depth) which are unable to be detected by eyes and finger touch. It also detects the surface corrugation (1.59 mm) and small local features (6.35 mm) using a measurement resolution of 21.34 mm by 15.49 mm. The predicted 3D circularity is higher than the measured 2D circularity as expected. The 3D model may be extended to other continuous geometry shapes for the future study.


title: The BNS invariants of the generalized solvable Baumslag-Solitar groups and of their finite index subgroups

abstract: We compute the Bieri-Neumann-Strebel invariants $\Sigma^1$ for the generalized solvable Baumslag-Solitar groups $\Gamma_n$ and their finite index subgroups. Using $\Sigma^1$, we show that certain finite index subgroups of $\Gamma_n$ cannot be isomorphic to $\Gamma_{k}$ for any $k$. In addition, we use the BNS-invariants to give a new proof of property $R_\infty$ for the groups $\Gamma_n$ and their finite index subgroups.


title: SIM-ECG: A Signal Importance Mask-driven ECGClassification System

abstract: Heart disease is the number one killer, and ECGs can assist in the early diagnosis and prevention of deadly outcomes. Accurate ECG interpretation is critical in detecting heart diseases; however, they are often misinterpreted due to a lack of training or insufficient time spent to detect minute anomalies. Subsequently, researchers turned to machine learning to assist in the analysis. However, existing systems are not as accurate as skilled ECG readers, and black-box approaches to providing diagnosis result in a lack of trust by medical personnel in a given diagnosis. To address these issues, we propose a signal importance mask feedback-based machine learning system that continuously accepts feedback, improves accuracy, and ex-plains the resulting diagnosis. This allows medical personnel to quickly glance at the output and either accept the results, validate the explanation and diagnosis, or quickly correct areas of misinterpretation, giving feedback to the system for improvement. We have tested our system on a publicly available dataset consisting of healthy and disease-indicating samples. We empirically show that our algorithm is better in terms of standard performance measures such as F-score and MacroAUC compared to normal training baseline (without feedback); we also show that our model generates better interpretability maps.


title: Quantum-Classical Computational Molecular Design of Deuterated High-Efficiency OLED Emitters

abstract: This study describes a hybrid quantum-classical computational approach for designing synthesizable deuterated $Alq_3$ emitters possessing desirable emission quantum efficiencies (QEs). This design process has been performed on the tris(8-hydroxyquinolinato) ligands typically bound to aluminum in $Alq_3$. It involves a multi-pronged approach which first utilizes classical quantum chemistry to predict the emission QEs of the $Alq_3$ ligands. These initial results were then used as a machine learning dataset for a factorization machine-based model which was applied to construct an Ising Hamiltonian to predict emission quantum efficiencies on a classical computer. We show that such a factorization machine-based approach can yield accurate property predictions for all 64 deuterated $Alq_3$ emitters with 13 training values. Moreover, another Ising Hamiltonian could be constructed by including synthetic constraints which could be used to perform optimizations on a quantum simulator and device using the variational quantum eigensolver (VQE) and quantum approximate optimization algorithm (QAOA) to discover a molecule possessing the optimal QE and synthetic cost. We observe that both VQE and QAOA calculations can predict the optimal molecule with greater than 0.95 probability on quantum simulators. These probabilities decrease to 0.83 and 0.075 for simulations with VQE and QAOA, respectively, on a quantum device, but these can be improved to 0.90 and 0.084 by mitigating readout error. Application of a binary search routine on quantum devices improves these results to a probability of 0.97 for simulations involving VQE and QAOA.


title: Minimizing optimal transport for functions with fixed-size nodal sets

abstract: Consider the class of zero-mean functions with fixed $L^{\infty}$ and $L^1$ norms and exactly $N\in \mathbb{N}$ nodal points. Which functions $f$ minimize $W_p(f_+,f_-)$, the Wasserstein distance between the measures whose densities are the positive and negative parts? We provide a complete solution to this minimization problem on the line and the circle, which provides sharp constants for previously proven ``uncertainty principle''-type inequalities, i.e., lower bounds on $N\cdot W_p (f_+, f_-)$. We further show that, while such inequalities hold in many metric measure spaces, they are no longer sharp when the non-branching assumption is violated; indeed, for metric star-graphs, the optimal lower bound on $W_p(f_+,f_-)$ is not inversely proportional to the size of the nodal set, $N$. Based on similar reductions, we make connections between the analogous problem of minimizing $W_p(f_+,f_-)$ for $f$ defined on $\Omega\subset\mathbb{R}^d$ with an equivalent optimal domain partition problem.


title: Continuous Speech Separation with Recurrent Selective Attention Network

abstract: While permutation invariant training (PIT) based continuous speech separation (CSS) significantly improves the conversation transcription accuracy, it often suffers from speech leakages and failures in separation at "hot spot" regions because it has a fixed number of output channels. In this paper, we propose to apply recurrent selective attention network (RSAN) to CSS, which generates a variable number of output channels based on active speaker counting. In addition, we propose a novel block-wise dependency extension of RSAN by introducing dependencies between adjacent processing blocks in the CSS framework. It enables the network to utilize the separation results from the previous blocks to facilitate the current block processing. Experimental results on the LibriCSS dataset show that the RSAN-based CSS (RSAN-CSS) network consistently improves the speech recognition accuracy over PIT-based models. The proposed block-wise dependency modeling further boosts the performance of RSAN-CSS.


title: Hate Speech Classifiers Learn Human-Like Social Stereotypes

abstract: Social stereotypes negatively impact individuals' judgements about different groups and may have a critical role in how people understand language directed toward minority social groups. Here, we assess the role of social stereotypes in the automated detection of hateful language by examining the relation between individual annotator biases and erroneous classification of texts by hate speech classifiers. Specifically, in Study 1 we investigate the impact of novice annotators' stereotypes on their hate-speech-annotation behavior. In Study 2 we examine the effect of language-embedded stereotypes on expert annotators' aggregated judgements in a large annotated corpus. Finally, in Study 3 we demonstrate how language-embedded stereotypes are associated with systematic prediction errors in a neural-network hate speech classifier. Our results demonstrate that hate speech classifiers learn human-like biases which can further perpetuate social inequalities when propagated at scale. This framework, combining social psychological and computational linguistic methods, provides insights into additional sources of bias in hate speech moderation, informing ongoing debates regarding fairness in machine learning.


title: Standardizing Dainotti-correlated gamma-ray bursts, and using them with standardized Amati-correlated gamma-ray bursts to constrain cosmological model parameters

abstract: We show that each of the three Dainotti-correlated gamma-ray burst (GRB) data sets recently compiled by Wang et al. and Hu et al., that together probe the redshift range $0.35 \leq z \leq 5.91$, obey cosmological-model-independent Dainotti correlation relations and so are standardizable. We use these GRB data in conjunction with the best currently-available Amati-correlated GRB data, that probe $0.3399 \leq z \leq 8.2$, to constrain cosmological model parameters. The resulting cosmological constraints are weak, providing lower limits on the non-relativistic matter density parameter, mildly favoring non-zero spatial curvature, and largely consistent with currently accelerated cosmological expansion as well as with constraints determined from better-established data.


title: Magnetic suppression of non-Hermitian skin effects

abstract: Skin effect, where macroscopically many bulk states are aggregated towards the system boundary, is one of the most important and distinguishing phenomena in non-Hermitian quantum systems. We discuss a new aspect of this effect whereby, despite its topological origin, applying magnetic field can largely suppress it. Skin states are pushed back into the bulk and the skin topological area, which we define, is sharply reduced. As seen from exact solutions of representative models this is fundamentally rooted in the fact that the applied magnetic field restores the validity of the low-energy description that is rendered inapplicable in the presence of non-Bloch skin states. We further study this phenomenon using rational gauge fluxes, which reveals a unique irrelevance of the generalized Brillouin zone in the standard non-Bloch band theory of non-Hermitian systems.


title: Towards the ultimate limits of quantum channel discrimination

abstract: This note studies the difficulty of discriminating quantum channels under operational regimes. First, we make a conjecture on the exponentially strong converse of quantum channel hypothesis testing under coherent strategies, meaning that any strategy to make the Type II error decays with an exponent larger than the regularized channel relative entropy will unavoidably result in the Type I error converging to one exponentially fast in the asymptotic limit. This conjecture will imply the desirable quantum channel Stein's Lemma and the continuity of the regularized (amortized) Sandwiched R\'{e}nyi channel divergence at $\alpha=1$. We also remark that there was a gap in the proof of the above conjecture in our previous arXiv version. Such gap exists since a lemma basically comes from [Brandao and Plenio, 2010] was found to be false. Second, we develop a framework to show the interplay between the strategies of channel discrimination, the operational regimes, and variants of channel divergences. This framework systematically underlies the operational meaning of quantum channel divergences in quantum channel discrimination. Our work makes an attempt towards understanding the ultimate limit of quantum channel discrimination, as well as its connection to quantum channel divergences in the asymptotic regime.

categories: quant-ph cs.IT math-ph math.IT math.MP math.ST stat.TH


title: A Sequence to Sequence Model for Extracting Multiple Product Name Entities from Dialog

abstract: E-commerce voice ordering systems need to recognize multiple product name entities from ordering utterances. Existing voice ordering systems such as Amazon Alexa can capture only a single product name entity. This restrains users from ordering multiple items with one utterance. In recent years, pre-trained language models, e.g., BERT and GPT-2, have shown promising results on NLP benchmarks like Super-GLUE. However, they can't perfectly generalize to this Multiple Product Name Entity Recognition (MPNER) task due to the ambiguity in voice ordering utterances. To fill this research gap, we propose Entity Transformer (ET) neural network architectures which recognize up to 10 items in an utterance. In our evaluation, the best ET model (conveRT + ngram + ET) has a performance improvement of 12% on our test set compared to the non-neural model, and outperforms BERT with ET as well. This helps customers finalize their shopping cart via voice dialog, which improves shopping efficiency and experience.


title: From Intrinsic to Counterfactual: On the Explainability of Contextualized Recommender Systems

abstract: With the prevalence of deep learning based embedding approaches, recommender systems have become a proven and indispensable tool in various information filtering applications. However, many of them remain difficult to diagnose what aspects of the deep models' input drive the final ranking decision, thus, they cannot often be understood by human stakeholders. In this paper, we investigate the dilemma between recommendation and explainability, and show that by utilizing the contextual features (e.g., item reviews from users), we can design a series of explainable recommender systems without sacrificing their performance. In particular, we propose three types of explainable recommendation strategies with gradual change of model transparency: whitebox, graybox, and blackbox. Each strategy explains its ranking decisions via different mechanisms: attention weights, adversarial perturbations, and counterfactual perturbations. We apply these explainable models on five real-world data sets under the contextualized setting where users and items have explicit interactions. The empirical results show that our model achieves highly competitive ranking performance, and generates accurate and effective explanations in terms of numerous quantitative metrics and qualitative visualizations.


title: Clinical Brain-Computer Interface Challenge 2020 (CBCIC at WCCI2020): Overview, methods and results

abstract: In the field of brain-computer interface (BCI) research, the availability of high-quality open-access datasets is essential to benchmark the performance of emerging algorithms. The existing open-access datasets from past competitions mostly deal with healthy individuals' data, while the major application area of BCI is in the clinical domain. Thus the newly proposed algorithms to enhance the performance of BCI technology are very often tested against the healthy subjects' datasets only, which doesn't guarantee their success on patients' datasets which are more challenging due to the presence of more nonstationarity and altered neurodynamics. In order to partially mitigate this scarcity, Clinical BCI Challenge aimed to provide an open-access rich dataset of stroke patients recorded similar to a neurorehabilitation paradigm. Another key feature of this challenge is that unlike many competitions in the past, it was designed for algorithms in both with-in subject and cross-subject categories as a major thrust area of current BCI technology is to realize calibration-free BCI designs. In this paper, we have discussed the winning algorithms and their performances across both competition categories which may help develop advanced algorithms for reliable BCIs for real-world practical applications.


title: How Well Does Kohn-Sham Regularizer Work for Weakly Correlated Systems?

abstract: Kohn-Sham regularizer (KSR) is a differentiable machine learning approach to finding the exchange-correlation functional in Kohn-Sham density functional theory (DFT) that works for strongly correlated systems. Here we test KSR for weak correlation. We propose spin-adapted KSR (sKSR) with trainable local, semilocal, and nonlocal approximations found by minimizing density and total energy loss. We assess the atoms-to-molecules generalizability by training on one-dimensional (1D) H, He, Li, Be, Be$^{++}$ and testing on 1D hydrogen chains, LiH, BeH$_2$, and helium hydride complexes. The generalization error from our semilocal approximation is comparable to other differentiable approaches, but our nonlocal functional outperforms any existing machine learning functionals, predicting ground-state energies of test systems with a mean absolute error of 2.7 milli-Hartrees.


title: The ratio of homology rank to hyperbolic volume, I

abstract: We show that for every finite-volume hyperbolic $3$-manifold $M$ and every prime $p$ we have $\text{dim}\ H_1(M;\mathbf{F}_p)< 168.602\cdot\text{vol}\ M$. There are slightly stronger estimates if $p = 2$ or if $M$ is non-compact. This improves on a result proved by Agol, Leininger and Margalit, which gave the same inequality with a coefficient of $334.08$ in place of $168.602$. It also improves on the analogous result with a coefficient of about $260$, which could have been obtained by combining the arguments due to Agol, Leininger and Margalit with a result due to B\"or\"oczky. Our inequality involving homology rank is deduced from a result about the rank of the fundamental group: if $M$ is a finite-volume orientable hyperbolic $3$-manifold such that $\pi_1(M)$ is $2$-semifree, then $\text{rank}\ \pi_1(M)<1+\lambda_{0}\cdot\text{vol}\ M$, where $\lambda_{0}$ is a certain constant less than $167.79$


title: V2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing

abstract: Given the significant amount of time people spend in vehicles, health issues under driving condition have become a major concern. Such issues may vary from fatigue, asthma, stroke, to even heart attack, yet they can be adequately indicated by vital signs and abnormal activities. Therefore, in-vehicle vital sign monitoring can help us predict and hence prevent these issues. Whereas existing sensor-based (including camera) methods could be used to detect these indicators, privacy concern and system complexity both call for a convenient yet effective and robust alternative. This paper aims to develop V2iFi, an intelligent system performing monitoring tasks using a COTS impulse radio mounted on the windshield. V2iFi is capable of reliably detecting driver's vital signs under driving condition and with the presence of passengers, thus allowing for potentially inferring corresponding health issues. Compared with prior work based on Wi-Fi CSI, V2iFi is able to distinguish reflected signals from multiple users, and hence provide finer-grained measurements under more realistic settings. We evaluate V2iFi both in lab environments and during real-life road tests; the results demonstrate that respiratory rate, heart rate, and heart rate variability can all be estimated accurately. Based on these estimation results, we further discuss how machine learning models can be applied on top of V2iFi so as to improve both physiological and psychological wellbeing in driving environments.


title: Enhancing RF Sensing with Deep Learning: A Layered Approach

abstract: In recent years, radio frequency (RF) sensing has gained increasing popularity due to its pervasiveness, low cost, non-intrusiveness, and privacy preservation. However, realizing the promises of RF sensing is highly nontrivial, given typical challenges such as multipath and interference. One potential solution leverages deep learning to build direct mappings from the RF domain to target domains, hence avoiding complex RF physical modeling. While earlier solutions exploit only simple feature extraction and classification modules, an emerging trend adds functional layers on top of elementary modules for more powerful generalizability and flexible applicability. To better understand this potential, this article takes a layered approach to summarize RF sensing enabled by deep learning. Essentially, we present a four-layer framework: physical, backbone, generalization, and application. While this layered framework provides readers a systematic methodology for designing deep interpreted RF sensing, it also facilitates making improvement proposals and hints at future research opportunities.


title: Optical dynamic nuclear polarization of $^{13}$C spins in diamond at a low field with multi-tone microwave irradiation

abstract: Most of dynamic nuclear polarization (DNP) has been requiring helium cryogenics and strong magnetic fields for a high degree of polarization. In this work, we instead demonstrate an optical hyperpolarization of naturally abundant $^{13}$C nuclei in a diamond crystal at a low magnetic field and an ambient temperature. It exploits continuous irradiations of pump laser for polarizing electron spins of nitrogen vacancy centers and microwave for transferring the induced polarization to $^{13}$C nuclear spins. Triplet structures corresponding to $^{14}$N hyperfine splitting were clearly observed in the spectrum of $^{13}$C polarization. The powers of microwave irradiation and pump laser were optimized. By simultaneously irradiating three microwave frequencies matching to the peaks of the triplet, we achieved a $^{13}$C bulk polarization of 0.113 %, leading to an enhancement of about a factor of 90,000 over the thermal polarization at 17.6 mT. We believe that the multi-tone irradiation can be universally adopted to further enhance the $^{13}$C polarization at a low magnetic field.


title: Behavior of Spiral Wave Spectra with a Rank-Deficient Diffusion Matrix

abstract: Spiral waves emerge in numerous pattern forming systems and are commonly modeled with reaction-diffusion systems. Some systems used to model biological processes, such as ion-channel models, fall under the reaction-diffusion category and often have one or more non-diffusing species which results in a rank-deficient diffusion matrix. Previous theoretical research focused on spiral spectra for strictly positive diffusion matrices. In this paper, we use a general two-variable reaction-diffusion system to compare the essential and absolute spectra of spiral waves for strictly positive and rank-deficient diffusion matrices. We show that the essential spectrum is not continuous in the limit of vanishing diffusion in one component. Moreover, we predict locations for the absolute spectrum in the case of a non-diffusing slow variable. Predictions are confirmed numerically for the Barkley and Karma models.


title: The Bou\'e--Dupuis formula and the exponential hypercontractivity in the Gaussian space

abstract: This paper concerns a variational representation formula for Wiener functionals. Let $B=\{ B_{t}\} _{t\ge 0}$ be a standard $d$-dimensional Brownian motion. Bou\'e and Dupuis (1998) showed that, for any bounded measurable functional $F(B)$ of $B$ up to time $1$, the expectation $\mathbb{E}\!\left[ e^{F(B)}\right] $ admits a variational representation in terms of drifted Brownian motions. In this paper, with a slight modification of insightful reasoning by Lehec (2013) allowing also $F(B)$ to be a functional of $B$ over the whole time interval, we prove that the Bou\'e--Dupuis formula holds true provided that both $e^{F(B)}$ and $F(B)$ are integrable, relaxing conditions in earlier works. We also show that the formula implies the exponential hypercontractivity of the Ornstein--Uhlenbeck semigroup in $\mathbb{R}^{d}$, and hence, due to their equivalence, implies the logarithmic Sobolev inequality in the $d$-dimensional Gaussian space.


title: Targeted Neural Dynamical Modeling

abstract: Latent dynamics models have emerged as powerful tools for modeling and interpreting neural population activity. Recently, there has been a focus on incorporating simultaneously measured behaviour into these models to further disentangle sources of neural variability in their latent space. These approaches, however, are limited in their ability to capture the underlying neural dynamics (e.g. linear) and in their ability to relate the learned dynamics back to the observed behaviour (e.g. no time lag). To this end, we introduce Targeted Neural Dynamical Modeling (TNDM), a nonlinear state-space model that jointly models the neural activity and external behavioural variables. TNDM decomposes neural dynamics into behaviourally relevant and behaviourally irrelevant dynamics; the relevant dynamics are used to reconstruct the behaviour through a flexible linear decoder and both sets of dynamics are used to reconstruct the neural activity through a linear decoder with no time lag. We implement TNDM as a sequential variational autoencoder and validate it on simulated recordings and recordings taken from the premotor and motor cortex of a monkey performing a center-out reaching task. We show that TNDM is able to learn low-dimensional latent dynamics that are highly predictive of behaviour without sacrificing its fit to the neural data.


title: RIM: Reliable Influence-based Active Learning on Graphs

abstract: Message passing is the core of most graph models such as Graph Convolutional Network (GCN) and Label Propagation (LP), which usually require a large number of clean labeled data to smooth out the neighborhood over the graph. However, the labeling process can be tedious, costly, and error-prone in practice. In this paper, we propose to unify active learning (AL) and message passing towards minimizing labeling costs, e.g., making use of few and unreliable labels that can be obtained cheaply. We make two contributions towards that end. First, we open up a perspective by drawing a connection between AL enforcing message passing and social influence maximization, ensuring that the selected samples effectively improve the model performance. Second, we propose an extension to the influence model that incorporates an explicit quality factor to model label noise. In this way, we derive a fundamentally new AL selection criterion for GCN and LP--reliable influence maximization (RIM)--by considering quantity and quality of influence simultaneously. Empirical studies on public datasets show that RIM significantly outperforms current AL methods in terms of accuracy and efficiency.


title: CAP: Co-Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networks

abstract: Despite the recent advances of graph neural networks (GNNs) in modeling graph data, the training of GNNs on large datasets is notoriously hard due to the overfitting. Adversarial training, which augments data with the worst-case adversarial examples, has been widely demonstrated to improve model's robustness against adversarial attacks and generalization ability. However, while the previous adversarial training generally focuses on protecting GNNs from spiteful attacks, it remains unclear how the adversarial training could improve the generalization abilities of GNNs in the graph analytics problem. In this paper, we investigate GNNs from the lens of weight and feature loss landscapes, i.e., the loss changes with respect to model weights and node features, respectively. We draw the conclusion that GNNs are prone to falling into sharp local minima in these two loss landscapes, where GNNs possess poor generalization performances. To tackle this problem, we construct the co-adversarial perturbation (CAP) optimization problem in terms of weights and features, and design the alternating adversarial perturbation algorithm to flatten the weight and feature loss landscapes alternately. Furthermore, we divide the training process into two stages: one conducting the standard cross-entropy minimization to ensure the quick convergence of GNN models, the other applying our alternating adversarial training to avoid falling into locally sharp minima. The extensive experiments demonstrate our CAP can generally improve the generalization performance of GNNs on a variety of benchmark graph datasets.


title: An Operator Theoretic View on Pruning Deep Neural Networks

abstract: The discovery of sparse subnetworks that are able to perform as well as full models has found broad applied and theoretical interest. While many pruning methods have been developed to this end, the na\"ive approach of removing parameters based on their magnitude has been found to be as robust as more complex, state-of-the-art algorithms. The lack of theory behind magnitude pruning's success, especially pre-convergence, and its relation to other pruning methods, such as gradient based pruning, are outstanding open questions in the field that are in need of being addressed. We make use of recent advances in dynamical systems theory, namely Koopman operator theory, to define a new class of theoretically motivated pruning algorithms. We show that these algorithms can be equivalent to magnitude and gradient based pruning, unifying these seemingly disparate methods, and find that they can be used to shed light on magnitude pruning's performance during the early part of training.


title: Cohomologies and crossed modules for pre-Lie Rinehart algebras

abstract: A pre-Lie-Rinehart algebra is an algebraic generalization of the notion of a left-symmetric algebroid. We construct pre-Lie-Rinehart algebras from r-matrices through Lie algebra actions. We study cohomologies of pre-Lie-Rinehart algebras and show that abelian extensions of pre-Lie-Rinehart algebras are classified by the second cohomology groups. We introduce the notion of crossed modules for pre-Lie-Rinehart algebras and show that they are classified by the third cohomology groups of pre-Lie-Rinehart algebras. At last, we use (pre-)Lie-Rinehart 2-algebras to characterize the crossed modules for (pre-)Lie Rinehart algebras.


title: Counting Subwords in Circular Words and Their Parikh Matrices

abstract: The word inference problem is to determine languages such that the information on the number of occurrences of those subwords in the language can uniquely identify a word. A considerable amount of work has been done on this problem, but the same cannot be said for circular words despite growing interests on the latter due to their applications -- for example, in splicing systems. Meanwhile, Parikh matrices are useful tools and well established in the study of subword occurrences. In this work, we propose two ways of counting subword occurrences in circular words. We then extend the idea of Parikh matrices to the context of circular words and investigate this extension. Motivated by the word inference problem, we study ambiguity in the identification of a circular word by its Parikh matrix. Accordingly, two rewriting rules are developed to generate ternary circular words which share the same Parikh matrix.


title: Approximate Decomposable Submodular Function Minimization for Cardinality-Based Components

abstract: Minimizing a sum of simple submodular functions of limited support is a special case of general submodular function minimization that has seen numerous applications in machine learning. We develop fast techniques for instances where components in the sum are cardinality-based, meaning they depend only on the size of the input set. This variant is one of the most widely applied in practice, encompassing, e.g., common energy functions arising in image segmentation and recent generalized hypergraph cut functions. We develop the first approximation algorithms for this problem, where the approximations can be quickly computed via reduction to a sparse graph cut problem, with graph sparsity controlled by the desired approximation factor. Our method relies on a new connection between sparse graph reduction techniques and piecewise linear approximations to concave functions. Our sparse reduction technique leads to significant improvements in theoretical runtimes, as well as substantial practical gains in problems ranging from benchmark image segmentation tasks to hypergraph clustering problems.


title: A lightweight two-layer blockchain mechanism for reliable crossing-domain communication in smart cities

abstract: The smart city is an emerging notion that is leveraging the Internet of Things (IoT) technique to achieve more comfortable, smart and controllable cities. The communications crossing domains between smart cities is indispensable to enhance collaborations. However, crossing-domain communications are more vulnerable since there are in different domains. Moreover, there are huge different devices with different computation capabilities, from sensors to the cloud servers. In this paper, we propose a lightweight two-layer blockchain mechanism for reliable crossing-domain communication in smart cities. Our mechanism provides a reliable communication mechanism for data sharing and communication between smart cities. We defined a two-layer blockchain structure for the communications inner and between smart cities to achieve reliable communications. We present a new block structure for the lightweight IoT devices. Moreover, we present a reputation-based multi-weight consensus protocol in order to achieve efficient communication while resistant to the nodes collusion attack for the proposed blockchain system. We also conduct a secure analysis to demonstrate the security of the proposed scheme. Finally, performance evaluation shows that our scheme is efficient and practical.


title: Effects of counter-rotating-wave terms on the noisy frequency estimation

abstract: We investigate the problem of estimating the tunneling frequency of a two-level atomic system embedded in a dissipative environment by employing a numerically rigorous hierarchical equations of motion method. The effect of counter-rotating-wave terms on the attainable precision of the noisy quantum metrology is systematically studied beyond the usual framework of perturbative treatments. We find the counter-rotating-wave terms are able to boost the noisy quantum metrological performance in the intermediate and strong coupling regimes, whether the dissipative environment is composed of bosons or fermions. The result presented in this paper may pave a guideline to design a high-precision quantum estimation scenario under practical decoherence.


title: Audio-visual Representation Learning for Anomaly Events Detection in Crowds

abstract: In recent years, anomaly events detection in crowd scenes attracts many researchers' attention, because of its importance to public safety. Existing methods usually exploit visual information to analyze whether any abnormal events have occurred due to only visual sensors are generally equipped in public places. However, when an abnormal event in crowds occurs, sound information may be discriminative to assist the crowd analysis system to determine whether there is an abnormality. Compare with vision information that is easily occluded, audio signals have a certain degree of penetration. Thus, this paper attempt to exploit multi-modal learning for modeling the audio and visual signals simultaneously. To be specific, we design a two-branch network to model different types of information. The first is a typical 3D CNN model to extract temporal appearance features from video clips. The second is an audio CNN for encoding Log Mel-Spectrogram of audio signals. Finally, by fusing the above features, a more accurate prediction will be produced. We conduct the experiments on SHADE dataset, a synthetic audio-visual dataset in surveillance scenes, and find introducing audio signals effectively improves the performance of anomaly events detection and outperforms other state-of-the-art methods. Furthermore, we will release the code and the pre-trained models as soon as possible.


title: Graph Communal Contrastive Learning

abstract: Graph representation learning is crucial for many real-world applications (e.g. social relation analysis). A fundamental problem for graph representation learning is how to effectively learn representations without human labeling, which is usually costly and time-consuming. Graph contrastive learning (GCL) addresses this problem by pulling the positive node pairs (or similar nodes) closer while pushing the negative node pairs (or dissimilar nodes) apart in the representation space. Despite the success of the existing GCL methods, they primarily sample node pairs based on the node-level proximity yet the community structures have rarely been taken into consideration. As a result, two nodes from the same community might be sampled as a negative pair. We argue that the community information should be considered to identify node pairs in the same communities, where the nodes insides are semantically similar. To address this issue, we propose a novel Graph Communal Contrastive Learning (gCooL) framework to jointly learn the community partition and learn node representations in an end-to-end fashion. Specifically, the proposed gCooL consists of two components: a Dense Community Aggregation (DeCA) algorithm for community detection and a Reweighted Self-supervised Cross-contrastive (ReSC) training scheme to utilize the community information. Additionally, the real-world graphs are complex and often consist of multiple views. In this paper, we demonstrate that the proposed gCooL can also be naturally adapted to multiplex graphs. Finally, we comprehensively evaluate the proposed gCooL on a variety of real-world graphs. The experimental results show that the gCooL outperforms the state-of-the-art methods.


title: Selective Sampling for Online Best-arm Identification

abstract: This work considers the problem of selective-sampling for best-arm identification. Given a set of potential options $\mathcal{Z}\subset\mathbb{R}^d$, a learner aims to compute with probability greater than $1-\delta$, $\arg\max_{z\in \mathcal{Z}} z^{\top}\theta_{\ast}$ where $\theta_{\ast}$ is unknown. At each time step, a potential measurement $x_t\in \mathcal{X}\subset\mathbb{R}^d$ is drawn IID and the learner can either choose to take the measurement, in which case they observe a noisy measurement of $x^{\top}\theta_{\ast}$, or to abstain from taking the measurement and wait for a potentially more informative point to arrive in the stream. Hence the learner faces a fundamental trade-off between the number of labeled samples they take and when they have collected enough evidence to declare the best arm and stop sampling. The main results of this work precisely characterize this trade-off between labeled samples and stopping time and provide an algorithm that nearly-optimally achieves the minimal label complexity given a desired stopping time. In addition, we show that the optimal decision rule has a simple geometric form based on deciding whether a point is in an ellipse or not. Finally, our framework is general enough to capture binary classification improving upon previous works.


title: Counterbalancing Learning and Strategic Incentives in Allocation Markets

abstract: This paper considers the problem of offering a scarce object with a common unobserved quality to strategic agents in a priority queue. Each agent has a private signal over the quality of the object and observes the decisions made by other agents. We first show that, under the widely-used first-come-first-served sequential offering mechanism, herding behavior emerges: initial rejections create an information cascade resulting in inefficient waste. To address this issue, we then introduce a class of batching mechanisms. Agents in each batch report whether they would be willing to accept or reject the object based on their private signals and prior information. If the majority opts to accept, the object is randomly allocated within that batch. We prove that suitable batching mechanisms are incentive-compatible and improve efficiency. A key property of the mechanism is the gradual increase of the batch size after each failed allocation; the size is chosen so that it elicits as much information as possible without distorting the incentives of agents to report truthfully. Additionally, from a healthcare policy perspective, our results can shed light on the large wastage in organ allocation. In particular, wastage that arises due to herding may be reduced by applying adaptive simultaneous offering mechanisms.


title: Quantum Steering Ellipsoid and Unruh Effect

abstract: Quantum steering is a perplexing feature at the heart of quantum mechanics that provides profound implications in understanding the nature of physical reality. On the other hand, the effect of relativistic features on quantum systems is vital in understanding the underlying foundations of physics. In this work, we study the effects of Unruh acceleration on the quantum steering of a two-qubit system. In particular, we consider the so-called quantum steering ellipsoid and the maximally-steered coherence in a non-inertial frame and find closed-form analytic expressions for the role of the Unruh acceleration in these quantities. Analyzing the conditions for the steerability of the system, we develop a geometric description for the effect of Unruh acceleration on the quantum steering of a two-qubit system.


title: Modeling, simulation, and optimization of a monopod hopping on yielding terrain

abstract: Legged locomotion on deformable terrain is a challenging and open robo-physics problem since the uncertainty in terrain dynamics introduced by ground deformation complicates the dynamical modelling and control methods. Moreover, learning how (e.g. what controls and mechanisms) to move efficiently and stably on soft ground is a bigger issue. This work seeks to control a 1D monopod hopper to jump to desired height. To achieve this goal, I first set up and validate a discrete element method (DEM) based soft ground simulation environment of a spherical granular material. With this simulation environment, I generate resistive force theory (RFT) based models of the ground reaction force. Then I use the RFT model to develop a feedforward force control for this robot. In the DEM simulation, I use feedback control to compensate for variations in the ground reaction force from the RFT model predictions. With the feedback control, the robot tracks the desired trajectories well and reaches the desired height after five hops. It reduces the apex position errors a lot more than a pure feedforward control. I also change the area of the robots square foot from 1cm^2 to 49cm^2. The feedback controller is able to deal with the ground reaction force fluctuations even when the foot dimensions are on the order of a grain diameter.


title: An Asymptotic Test for Conditional Independence using Analytic Kernel Embeddings

abstract: We propose a new conditional dependence measure and a statistical test for conditional independence. The measure is based on the difference between analytic kernel embeddings of two well-suited distributions evaluated at a finite set of locations. We obtain its asymptotic distribution under the null hypothesis of conditional independence and design a consistent statistical test from it. We conduct a series of experiments showing that our new test outperforms state-of-the-art methods both in terms of type-I and type-II errors even in the high dimensional setting.


title: Eclipse Timing Modeling of Three Post-Common Envelope Binaries: Hybrid Solutions

abstract: We report 90 new observations of three post common envelope binaries at primary eclipse spanning between December 2018 to February 2022. We combine recent primary eclipse timing observations with previously published values to search for substellar circumbinary components consistent with timing variations from a linear ephemeris. We used a least-squares minimization fitting algorithm weighted by a Hill orbit stability function, followed by Bayesian inference, to determine best-fit orbital parameters and associated uncertainties. For HS2231+2441, we find that the timing data are consistent with a constant period and that there is no evidence to suggest orbiting components. For HS0705+6700, we find both one and two-component solutions stable for at least 10 Myr. For HW Vir, we find three and four-component solutions that fit the timing data reasonably well, but are unstable on short timescales, and therefore highly improbable. Conversely, solutions calculated using a Bayesian orbit stability prior result in a poor fit. The stable solutions significantly deviate from the ensemble timing data in both systems. We speculate that the observed timing variations for these systems, and very possibly other sdB binaries, may result from a combination of substellar component perturbations and an Applegate-Lanza mechanism.


title: A Scenario-Based Platform for Testing Autonomous Vehicle Behavior Prediction Models in Simulation

abstract: Behavior prediction remains one of the most challenging tasks in the autonomous vehicle (AV) software stack. Forecasting the future trajectories of nearby agents plays a critical role in ensuring road safety, as it equips AVs with the necessary information to plan safe routes of travel. However, these prediction models are data-driven and trained on data collected in real life that may not represent the full range of scenarios an AV can encounter. Hence, it is important that these prediction models are extensively tested in various test scenarios involving interactive behaviors prior to deployment. To support this need, we present a simulation-based testing platform which supports (1) intuitive scenario modeling with a probabilistic programming language called Scenic, (2) specifying a multi-objective evaluation metric with a partial priority ordering, (3) falsification of the provided metric, and (4) parallelization of simulations for scalable testing. As a part of the platform, we provide a library of 25 Scenic programs that model challenging test scenarios involving interactive traffic participant behaviors. We demonstrate the effectiveness and the scalability of our platform by testing a trained behavior prediction model and searching for failure scenarios.


title: Generalized Depthwise-Separable Convolutions for Adversarially Robust and Efficient Neural Networks

abstract: Despite their tremendous successes, convolutional neural networks (CNNs) incur high computational/storage costs and are vulnerable to adversarial perturbations. Recent works on robust model compression address these challenges by combining model compression techniques with adversarial training. But these methods are unable to improve throughput (frames-per-second) on real-life hardware while simultaneously preserving robustness to adversarial perturbations. To overcome this problem, we propose the method of Generalized Depthwise-Separable (GDWS) convolution -- an efficient, universal, post-training approximation of a standard 2D convolution. GDWS dramatically improves the throughput of a standard pre-trained network on real-life hardware while preserving its robustness. Lastly, GDWS is scalable to large problem sizes since it operates on pre-trained models and doesn't require any additional training. We establish the optimality of GDWS as a 2D convolution approximator and present exact algorithms for constructing optimal GDWS convolutions under complexity and error constraints. We demonstrate the effectiveness of GDWS via extensive experiments on CIFAR-10, SVHN, and ImageNet datasets. Our code can be found at https://github.com/hsndbk4/GDWS.


title: Some observations on the FGH theorem

abstract: We investigate the Friedman--Goldfarb--Harrington theorem from two perspectives. Firstly, in the frameworks of classical and modal propositional logics, we study the forms of sentences whose existence is guaranteed by the FGH theorem. Secondly, we prove some variations of the FGH theorem with respect to Rosser provability predicates.


title: Optimal Stochastic Coded Computation Offloading in Unmanned Aerial Vehicles Network

abstract: Today, modern unmanned aerial vehicles (UAVs) are equipped with increasingly advanced capabilities that can run applications enabled by machine learning techniques, which require computationally intensive operations such as matrix multiplications. Due to computation constraints, the UAVs can offload their computation tasks to edge servers. To mitigate stragglers, coded distributed computing (CDC) based offloading can be adopted. In this paper, we propose an Optimal Task Allocation Scheme (OTAS) based on Stochastic Integer Programming with the objective to minimize energy consumption during computation offloading. The simulation results show that amid uncertainty of task completion, the energy consumption in the UAV network is minimized.


title: Sayer: Using Implicit Feedback to Optimize System Policies

abstract: We observe that many system policies that make threshold decisions involving a resource (e.g., time, memory, cores) naturally reveal additional, or implicit feedback. For example, if a system waits X min for an event to occur, then it automatically learns what would have happened if it waited <X min, because time has a cumulative property. This feedback tells us about alternative decisions, and can be used to improve the system policy. However, leveraging implicit feedback is difficult because it tends to be one-sided or incomplete, and may depend on the outcome of the event. As a result, existing practices for using feedback, such as simply incorporating it into a data-driven model, suffer from bias. We develop a methodology, called Sayer, that leverages implicit feedback to evaluate and train new system policies. Sayer builds on two ideas from reinforcement learning -- randomized exploration and unbiased counterfactual estimators -- to leverage data collected by an existing policy to estimate the performance of new candidate policies, without actually deploying those policies. Sayer uses implicit exploration and implicit data augmentation to generate implicit feedback in an unbiased form, which is then used by an implicit counterfactual estimator to evaluate and train new policies. The key idea underlying these techniques is to assign implicit probabilities to decisions that are not actually taken but whose feedback can be inferred; these probabilities are carefully calculated to ensure statistical unbiasedness. We apply Sayer to two production scenarios in Azure, and show that it can evaluate arbitrary policies accurately, and train new policies that outperform the production policies.


title: Finding a Concise, Precise, and Exhaustive Set of Near Bi-Cliques in Dynamic Graphs

abstract: A variety of tasks on dynamic graphs, including anomaly detection, community detection, compression, and graph understanding, have been formulated as problems of identifying constituent (near) bi-cliques (i.e., complete bipartite graphs). Even when we restrict our attention to maximal ones, there can be exponentially many near bi-cliques, and thus finding all of them is practically impossible for large graphs. Then, two questions naturally arise: (Q1) What is a "good" set of near bi-cliques? That is, given a set of near bi-cliques in the input dynamic graph, how should we evaluate its quality? (Q2) Given a large dynamic graph, how can we rapidly identify a high-quality set of near bi-cliques in it? Regarding Q1, we measure how concisely, precisely, and exhaustively a given set of near bi-cliques describes the input dynamic graph. We combine these three perspectives systematically on the Minimum Description Length principle. Regarding Q2, we propose CutNPeel, a fast search algorithm for a high-quality set of near bi-cliques. By adaptively re-partitioning the input graph, CutNPeel reduces the search space and at the same time improves the search quality. Our experiments using six real-world dynamic graphs demonstrate that CutNPeel is (a) High-quality: providing near bi-cliques of up to 51.2% better quality than its state-of-the-art competitors, (b) Fast: up to 68.8x faster than the next-best competitor, and (c) Scalable: scaling to graphs with 134 million edges. We also show successful applications of CutNPeel to graph compression and pattern discovery.


title: Rigidity of the sharp Bezout estimate on nonnegatively curved Riemann surfaces

abstract: In this short note, by using a general three circle theorem, we show the rigidity of the sharp Bezout estimate first found by Gang Liu on nonnegatively curved Riemann surface.


title: Stable distributions and domains of attraction for unitarily invariant Hermitian random matrix ensembles

abstract: We consider random matrix ensembles on the Hermitian matrices that are heavy tailed, in particular not all moments exist, and that are invariant under the conjugate action of the unitary group. The latter property entails that the eigenvectors are Haar distributed and, therefore, factorise from the eigenvalue statistics. We prove a classification for stable matrix ensembles of this kind of matrices represented in terms of matrices, their eigenvalues and their diagonal entries with the help of the classification of the multivariate stable distributions and the harmonic analysis on symmetric matrix spaces. Moreover, we identify sufficient and necessary conditions for their domains of attraction. To illustrate our findings we discuss for instance elliptical invariant random matrix ensembles and P\'olya ensembles. As a byproduct we generalise the derivative principle on the Hermitian matrices to general tempered distributions.

categories: math.PR cond-mat.stat-mech math-ph math.MP math.ST stat.TH


title: A novel measurement of initial-state gluon radiation in hadron collisions using Drell-Yan events

abstract: A study of initial-state gluon radiation (ISR) in hadron collisions is presented using Drell-Yan (DY) events produced in proton-antiproton collisions by the Tevatron collider at a center-of-mass energy of 1.96 TeV. This paper adopts a novel approach which uses the mean value of the Z/$\gamma^*$ transverse momentum $<p_T^{DY}>$ in DY events as a powerful observable to characterize the effect of ISR. In a data sample corresponding to an integrated luminosity of 9.4 fb$^{-1}$ collected with the CDF Run II detector, $<p_T^{DY}>$ is measured as a function of the Z/$\gamma^*$ invariant mass. It is found that these two observables have a dependence, $<p_T^{DY}> = -8 + 2.2 \ln m_{DY}^2$ [GeV/c], where $m_{DY}$ is the value of the Z/$\gamma^*$ mass measured in units of GeV/$c^2$. This linear dependence is observed for the first time in this analysis. It may be exploited to model the effect of ISR and constrain its impact in other processes.


title: Pilot Optimization and Channel Estimation for Two-way Relaying Network Aided by IRS with Finite Discrete Phase Shifters

abstract: In this paper, we investigate the problem of pilot optimization and channel estimation of two-way relaying network (TWRN) aided by an intelligent reflecting surface (IRS) with finite discrete phase shifters. In a TWRN, there exists a challenging problem that the two cascading channels from source-to-IRS-to-Relay and destination-to-IRS-to-relay interfere with each other. Via designing the initial phase shifts of IRS and pilot pattern, the two cascading channels are separated by using simple arithmetic operations like addition and subtraction. Then, the least-squares estimator is adopted to estimate the two cascading channels and two direct channels from source to relay and destination to relay. The corresponding mean square errors (MSE) of channel estimators are derived. By minimizing MSE, the optimal phase shift matrix of IRS is proved. Then, two special matrices Hadamard and discrete Fourier transform (DFT) matrix is shown to be two optimal training matrices for IRS. Furthermore, the IRS with discrete finite phase shifters is taken into account. Using theoretical derivation and numerical simulations, we find that 3-4 bits phase shifters are sufficient for IRS to achieve a negligible MSE performance loss. More importantly, the Hadamard matrix requires only one-bit phase shifters to achieve the optimal MSE performance while the DFT matrix requires at least three or four bits to achieve the same performance. Thus, the Hadamard matrix is a perfect choice for channel estimation using low-resolution phase-shifting IRS.


title: AEVA: Black-box Backdoor Detection Using Adversarial Extreme Value Analysis

abstract: Deep neural networks (DNNs) are proved to be vulnerable against backdoor attacks. A backdoor is often embedded in the target DNNs through injecting a backdoor trigger into training examples, which can cause the target DNNs misclassify an input attached with the backdoor trigger. Existing backdoor detection methods often require the access to the original poisoned training data, the parameters of the target DNNs, or the predictive confidence for each given input, which are impractical in many real-world applications, e.g., on-device deployed DNNs. We address the black-box hard-label backdoor detection problem where the DNN is fully black-box and only its final output label is accessible. We approach this problem from the optimization perspective and show that the objective of backdoor detection is bounded by an adversarial objective. Further theoretical and empirical studies reveal that this adversarial objective leads to a solution with highly skewed distribution; a singularity is often observed in the adversarial map of a backdoor-infected example, which we call the adversarial singularity phenomenon. Based on this observation, we propose the adversarial extreme value analysis(AEVA) to detect backdoors in black-box neural networks. AEVA is based on an extreme value analysis of the adversarial map, computed from the monte-carlo gradient estimation. Evidenced by extensive experiments across multiple popular tasks and backdoor attacks, our approach is shown effective in detecting backdoor attacks under the black-box hard-label scenarios.


title: Convergence of Conditional Entropy for Long Range Dependent Markov Chains

abstract: In this paper we consider the convergence of the conditional entropy to the entropy rate for Markov chains. Convergence of certain statistics of long range dependent processes, such as the sample mean, is slow. It has been shown in Carpio and Daley \cite{carpio2007long} that the convergence of the $n$-step transition probabilities to the stationary distribution is slow, without quantifying the convergence rate. We prove that the slow convergence also applies to convergence to an information-theoretic measure, the entropy rate, by showing that the convergence rate is equivalent to the convergence rate of the $n$-step transition probabilities to the stationary distribution, which is equivalent to the Markov chain mixing time problem. Then we quantify this convergence rate, and show that it is $O(n^{2H-2})$, where $n$ is the number of steps of the Markov chain and $H$ is the Hurst parameter. Finally, we show that due to this slow convergence, the mutual information between past and future is infinite if and only if the Markov chain is long range dependent. This is a discrete analogue of characterisations which have been shown for other long range dependent processes.


title: Effects of Varying Mass Inflows on Star Formation in Nuclear Rings of Barred Galaxies

abstract: Observations indicate that the star formation rate (SFR) of nuclear rings varies considerably with time and is sometimes asymmetric rather than being uniform across a ring. To understand what controls temporal and spatial distributions of ring star formation, we run semi-global, hydrodynamic simulations of nuclear rings subject to time-varying and/or asymmetric mass inflow rates. These controlled variations in the inflow lead to variations in the star formation, while the ring orbital period ($18\,{\rm Myr}$) and radius ($600\,{\rm pc}$) remain approximately constant. We find that both the mass inflow rate and supernova feedback affect the ring SFR. An oscillating inflow rate with period $\Delta \tau_\text{in}$ and amplitude 20 causes large-amplitude (a factor of $\gtrsim 5$), quasi-periodic variations of the SFR, when $\Delta \tau_\text{in} \gtrsim 50\,{\rm Myr}$. We find that the time-varying ISM weight and midplane pressure track each other closely, establishing an instantaneous vertical equilibrium. The measured time-varying depletion time is consistent with the prediction from self-regulation theory provided the time delay between star formation and supernova feedback is taken into account. The supernova feedback is responsible only for small-amplitude (a factor of $\sim 2$) fluctuations of the SFR with a timescale $\lesssim 40\,{\rm Myr}$. Asymmetry in the inflow rate does not necessarily lead to asymmetric star formation in nuclear rings. Only when the inflow rate from one dust lane is suddenly increased by a large factor, the rings undergo a transient period of lopsided star formation.


title: Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

abstract: The success of Transformer models has pushed the deep learning model scale to billions of parameters. Due to the limited memory resource of a single GPU, However, the best practice for choosing the optimal parallel strategy is still lacking, since it requires domain expertise in both deep learning and parallel computing. The Colossal-AI system addressed the above challenge by introducing a unified interface to scale your sequential code of model training to distributed environments. It supports parallel training methods such as data, pipeline, tensor, and sequence parallelism, as well as heterogeneous training methods integrated with zero redundancy optimizer. Compared to the baseline system, Colossal-AI can achieve up to 2.76 times training speedup on large-scale models.


title: Compact extended formulations for low-rank functions with indicator variables

abstract: We study the mixed-integer epigraph of a special class of convex functions with non-convex indicator constraints, which are often used to impose logical constraints on the support of the solutions. The class of functions we consider are defined as compositions of low-dimensional nonlinear functions with affine functions Extended formulations describing the convex hull of such sets can easily be constructed via disjunctive programming, although a direct application of this method often yields prohibitively large formulations, whose size is exponential in the number of variables. In this paper, we propose a new disjunctive representation of the sets under study, which leads to compact formulations with size exponential in the dimension of the nonlinear function, but polynomial in the number of variables. Moreover, we show how to project out the additional variables for the case of dimension one, recovering or generalizing known results for the convex hulls of such sets (in the original space of variables). Our computational results indicate that the proposed approach can significantly improve the performance of solvers in structured problems.


title: Multimode optomechanical cooling via general dark-mode control

abstract: The dark-mode effect is a stubborn obstacle for ground-state cooling of multiple degenerate mechanical modes optomechanically coupled to a common cavity-field mode. Here we propose an auxiliary-cavity-mode method for simultaneous ground-state cooling of two degenerate or near-degenerate mechanical modes by breaking the dark mode. We find that the introduction of the auxiliary cavity mode not only breaks the dark-mode effect, but also provides a new cooling channel to extract the thermal excitations stored in the dark mode. Moreover, we study the general physical-coupling configurations for breaking the dark mode in a generalized networkcoupled four-mode optomechanical system consisting of two cavity modes and two mechanical modes. We find the analytical dark-mode-breaking condition in this system. This method is general and it can be generalized to break the dark-mode effect and to realize the simultaneous ground-state cooling in a multiple-mechanicalmode optomechanical system. We also demonstrate the physical mechanism behind the dark-mode breaking by studying the breaking of dark-state effect in the N-type four-level atomic system. Our results not only provide a general method to control various dark-mode and dark-state effects in physics, but also present an opportunity to the study of macroscopic quantum phenomena and applications in multiple-mechanical-resonator systems.


title: An X-ray selected catalog of extended galaxy clusters from the ROSAT All-Sky Survey (RXGCC)

abstract: There is a known tension between cosmological parameter constraints obtained from the primary CMB and those from galaxy cluster samples. One possible explanation could be certain types of groups or clusters of galaxy have been missed in the past. We aim to search for galaxy groups and clusters with particularly extended surface brightness distributions, by creating a new X-ray selected catalog of extended galaxy clusters from the ROSAT All-Sky Survey, using a dedicated algorithm optimized for extended sources. Through extensive simulations, the detection efficiency and sample purity are investigated. Previous cluster catalogs in X-ray and other wave-bands, as well as spectroscopic and photometric redshifts of galaxies are used for the cluster identification. We report a catalog of galaxy clusters at high galactic latitude based on the ROSAT All-sky Survey, named as RXGCC, which includes 944 groups and clusters. Out of it, 641 clusters have been identified through ICM emission previously (Bronze), 154 known optical and infrared clusters are detected as X-ray clusters for the first time (Silver), and 149 identified as clusters for the first time (Gold). Based on 200 simulations, the contamination ratio of the detections which were identified as clusters by ICM emission, and the detections which were identified as optical and infrared clusters in previous work is 0.008 and 0.100, respectively. Compared with Bronze sample, the Gold+Silver sample is less luminous, less massive, and has a flatter surface brightness profile. Specifically, the median flux in [0.1-2.4]keV band for Gold+Silver and Bronze sample is 2.496e-12 erg/s/cm^2 and 4.955e-12 erg/s/cm^2, respectively. The median slope of cluster profile is 0.76 and 0.83 for Gold+Silver and Bronze sample, respectively. This whole sample is available at https://github.com/wwxu/rxgcc.github.io/blob/master/table_rxgcc.fits (Abridged)


title: Construction of exact solutions to the Ruijsenaars-Toda lattice via generalized invariant manifolds

abstract: The article discusses a new method for constructing algebro-geometric solutions of nonlinear integrable lattices, based on the concept of a generalized invariant manifold (GIM). In contrast to the finite-gap integration method, instead of the eigenfunctions of the Lax operators, we use a joint solution of the linearized equation and GIM. This makes it possible to derive Dubrovin type equations not only in the time variable $t$, but also in the spatial discrete variable $n$. We illustrate the efficiency of the method using the Ruijsenaars-Toda lattice as an example, for which we have derived a real and bounded particular solution in the form of a kink, a periodic solution expressed in terms of Jacobi elliptic functions and a solution expressed through Weierstrass $\wp$-function.


title: Teaching an Active Learner with Contrastive Examples

abstract: We study the problem of active learning with the added twist that the learner is assisted by a helpful teacher. We consider the following natural interaction protocol: At each round, the learner proposes a query asking for the label of an instance $x^q$, the teacher provides the requested label $\{x^q, y^q\}$ along with explanatory information to guide the learning process. In this paper, we view this information in the form of an additional contrastive example ($\{x^c, y^c\}$) where $x^c$ is picked from a set constrained by $x^q$ (e.g., dissimilar instances with the same label). Our focus is to design a teaching algorithm that can provide an informative sequence of contrastive examples to the learner to speed up the learning process. We show that this leads to a challenging sequence optimization problem where the algorithm's choices at a given round depend on the history of interactions. We investigate an efficient teaching algorithm that adaptively picks these contrastive examples. We derive strong performance guarantees for our algorithm based on two problem-dependent parameters and further show that for specific types of active learners (e.g., a generalized binary search learner), the proposed teaching algorithm exhibits strong approximation guarantees. Finally, we illustrate our bounds and demonstrate the effectiveness of our teaching framework via two numerical case studies.


title: The Kakeya Set Conjecture for $\mathbb{Z}/N\mathbb{Z}$ for general $N$

abstract: We prove the Kakeya set conjecture for $\mathbb{Z}/N\mathbb{Z}$ for general $N$ as stated by Hickman and Wright [HW18]. This entails extending and combining the techniques of Arsovski [Ars21a] for $N=p^k$ and the author and Dvir [DD21] for the case of square-free $N$. We also prove stronger lower bounds for the size of $(m,\epsilon)$-Kakeya sets over $\mathbb{Z}/p^k\mathbb{Z}$ by extending the techniques of [Ars21a] using multiplicities as was done in [SS08, DKSS13]. In addition, we show our bounds are almost sharp by providing a new construction for Kakeya sets over $\mathbb{Z}/p^k\mathbb{Z}$ and $\mathbb{Z}/N\mathbb{Z}$.


title: SMORE: Knowledge Graph Completion and Multi-hop Reasoning in Massive Knowledge Graphs

abstract: Knowledge graphs (KGs) capture knowledge in the form of head--relation--tail triples and are a crucial component in many AI systems. There are two important reasoning tasks on KGs: (1) single-hop knowledge graph completion, which involves predicting individual links in the KG; and (2), multi-hop reasoning, where the goal is to predict which KG entities satisfy a given logical query. Embedding-based methods solve both tasks by first computing an embedding for each entity and relation, then using them to form predictions. However, existing scalable KG embedding frameworks only support single-hop knowledge graph completion and cannot be applied to the more challenging multi-hop reasoning task. Here we present Scalable Multi-hOp REasoning (SMORE), the first general framework for both single-hop and multi-hop reasoning in KGs. Using a single machine SMORE can perform multi-hop reasoning in Freebase KG (86M entities, 338M edges), which is 1,500x larger than previously considered KGs. The key to SMORE's runtime performance is a novel bidirectional rejection sampling that achieves a square root reduction of the complexity of online training data generation. Furthermore, SMORE exploits asynchronous scheduling, overlapping CPU-based data sampling, GPU-based embedding computation, and frequent CPU--GPU IO. SMORE increases throughput (i.e., training speed) over prior multi-hop KG frameworks by 2.2x with minimal GPU memory requirements (2GB for training 400-dim embeddings on 86M-node Freebase) and achieves near linear speed-up with the number of GPUs. Moreover, on the simpler single-hop knowledge graph completion task SMORE achieves comparable or even better runtime performance to state-of-the-art frameworks on both single GPU and multi-GPU settings.


title: Integrated Task Assignment and Path Planning for Capacitated Multi-Agent Pickup and Delivery

abstract: Multi-agent Pickup and Delivery (MAPD) is a challenging industrial problem where a team of robots is tasked with transporting a set of tasks, each from an initial location and each to a specified target location. Appearing in the context of automated warehouse logistics and automated mail sortation, MAPD requires first deciding which robot is assigned what task (i.e., Task Assignment or TA) followed by a subsequent coordination problem where each robot must be assigned collision-free paths so as to successfully complete its assignment (i.e., Multi-Agent Path Finding or MAPF). Leading methods in this area solve MAPD sequentially: first assigning tasks, then assigning paths. In this work we propose a new coupled method where task assignment choices are informed by actual delivery costs instead of by lower-bound estimates. The main ingredients of our approach are a marginal-cost assignment heuristic and a meta-heuristic improvement strategy based on Large Neighbourhood Search. As a further contribution, we also consider a variant of the MAPD problem where each robot can carry multiple tasks instead of just one. Numerical simulations show that our approach yields efficient and timely solutions and we report significant improvement compared with other recent methods from the literature.


title: Analysis of COVID-19 in Japan with Extended SEIR model and ensemble Kalman filter

abstract: We introduce an extended SEIR infectious disease model with data assimilation for the study of the spread of COVID-19. In this framework, undetected asymptomatic and pre-symptomatic cases are taken into account, and the impact of their uncertain proportion is fully investigated. The standard SEIR model does not consider these populations, while their role in the propagation of the disease is acknowledged. An ensemble Kalman filter is implemented to assimilate reliable observations of three compartments in the model. The system tracks the evolution of the effective reproduction number and estimates the unobservable subpopulations. The analysis is carried out for three main prefectures of Japan and for the entire population of Japan. For these four populations, our estimated effective reproduction numbers are more stable than the corresponding ones estimated by a different method (Toyokeizai). We also perform sensitivity tests for different values of some uncertain medical parameters, like the relative infectivity of symptomatic / asymptomatic cases. The regional analysis results suggest the decreasing efficiency of the states of emergency.


title: Ground-state cooling of multiple near-degenerate mechanical modes

abstract: We propose a general and experimentally feasible approach to realize simultaneous ground-state cooling of arbitrary number of near-degenerate, or even fully degenerate mechanical modes, overcoming the limit imposed by the formation of mechanical dark modes. Multiple optical modes are employed to provide different dissipation channels that prevent complete destructive interference of the cooling pathway, and thus eliminating the dark modes. The cooling rate and limit are explicitly specified, in which the distinguishability of the optical modes to the mechanical modes is found to be critical for an efficient cooling process. In a realistic multi-mode optomechanical system, ground-state cooling of all mechanical modes is demonstrated by sequentially introducing optical drives, proving the feasibility and scalability of the proposed scheme. The work may provide new insights in preparing and manipulating multiple quantum states in macroscopic systems.


title: Covariant higher order perturbations of branes in curved spacetime

abstract: The treatment of higher order perturbations of branes is considered using a covariant variational approach. This covariant variational approach brings to the forefront the geometric structure of the underlying perturbation theory, as opposed to a more commonly used `direct approach', that ignores the variational origin. In addition, it offers a clear calculational advantage with respect to so called `gauge fixed' treatments that distinguish tangential and normal modes, as it emphasizes the symmetries of the geometric models that describe the brane dynamics. We restrict our attention to a brane action that depends at most on first derivatives of the embedding functions of the worldvolume spanned by the brane in its evolution. We consider first and second variations of the action that describes the brane dynamics. The first variation produces the equations of motion, as is well known. In the second variation we derive the Jacobi equations for these kind of models, and we emphasize the role of the Hessian matrix. This is extended to third order in variations, first in a flat and then in a curved spacetime background. Further, we specialize to the relevant case of the Dirac-Nambu-Goto action that describes extremal branes. The proper setting of a covariant variational approach allows to go in principle to geometric models that depend on higher derivatives of the embedding functions, and higher order perturbations, with the due complications involved, but with a solid framework in place.


title: Pipeline Parallelism for Inference on Heterogeneous Edge Computing

abstract: Deep neural networks with large model sizes achieve state-of-the-art results for tasks in computer vision (CV) and natural language processing (NLP). However, these large-scale models are too compute- or memory-intensive for resource-constrained edge devices. Prior works on parallel and distributed execution primarily focus on training -- rather than inference -- using homogeneous accelerators in data centers. We propose EdgePipe, a distributed framework for edge systems that uses pipeline parallelism to both speed up inference and enable running larger (and more accurate) models that otherwise cannot fit on single edge devices. EdgePipe achieves these results by using an optimal partition strategy that considers heterogeneity in compute, memory, and network bandwidth. Our empirical evaluation demonstrates that EdgePipe achieves $10.59\times$ and $11.88\times$ speedup using 16 edge devices for the ViT-Large and ViT-Huge models, respectively, with no accuracy loss. Similarly, EdgePipe improves ViT-Huge throughput by $3.93\times$ over a 4-node baseline using 16 edge devices, which independently cannot fit the model in memory. Finally, we show up to $4.16\times$ throughput improvement over the state-of-the-art PipeDream when using a heterogeneous set of devices.


title: Large and massive neutron stars: Implications for the sound speed in dense QCD

abstract: The NASA telescope NICER has recently measured x-ray emissions from the heaviest of the precisely known two-solar mass neutron stars, PSR J0740+6620. Analysis of the data [Miller et al., Astrophys. J. Lett. 918, L28 (2021); Riley et al., Astrophys. J. Lett. 918, L27 (2021)] suggests that PSR J0740+6620 has a radius in the range of $R_{2.0} \approx (11.4-16.1)$ km at the $68\%$ credibility level. In this article, we study the implications of this analysis for the sound speed in the high-density inner cores by using recent chiral effective field theory ($\chi$EFT) calculations of the equation of state at next-to-next-to-next-to-leading order to describe outer regions of the star at modest density. We find that the lower bound on the maximum speed of sound in the inner core, $\textbf{min}\{c^2_{s, {\rm max}}\}$, increases rapidly with the radius of massive neutron stars. If $\chi$EFT remains an efficient expansion for nuclear interactions up to about twice the nuclear saturation density, $R_{2.0}\geqslant 13$ km requires $\textbf{min}\{c^2_{s, {\rm max}}\} \geqslant 0.562$ and $0.442$ at the $68\%$ and $95\%$ credibility level, respectively.


title: Holographic index calculation for Argyres-Douglas and Minahan-Nemeschansky theories

abstract: We calculate the superconformal indices of the $\mathcal N=2$ superconformal field theories realized on $N$ coincident D3-branes in 7-brane backgrounds with constant axiodilaton via the AdS/CFT correspondence. We include the finite-$N$ corrections as the contribution of D3-branes wrapped around 3-cycles in the internal space. We take only single-wrapping contributions into account for simplicity. We also determine the orders of the next-to-leading corrections which we do not calculate. The orders are relatively high, and we obtain many trustable terms. We give the results for $N=1,2,3$ explicitly, and find nice agreement with known results.


title: The dynamic chirality flips of Skyrmion bubbles

abstract: Magnetic skyrmion, a topological magnetic domain with complex non-coplanar spin texture, appears a disk-like structure in two dimensions. Exploring three-dimensional spin texture and related chirality switching has drawn enormous interests from the perspective of fundamental research. Here, the three-dimensional magnetic moment of the skyrmion bubbles in centrosymmetric Mn-Ni-Ga were reconstructed with the vector field tomography approach via Lorentz transmission electron microscopy. The type of the bubbles was determined from investigating the magnetic vectors in entire space. We found that the bubbles switched their chirality easily but still keep the polarity to remain the singularity of the bubbles within the material. Our results offer valuable insights into the fundamental mechanisms underlying the spin chirality flips dynamics of skyrmion bubbles.


title: Degraded Reference Image Quality Assessment

abstract: In practical media distribution systems, visual content usually undergoes multiple stages of quality degradation along the delivery chain, but the pristine source content is rarely available at most quality monitoring points along the chain to serve as a reference for quality assessment. As a result, full-reference (FR) and reduced-reference (RR) image quality assessment (IQA) methods are generally infeasible. Although no-reference (NR) methods are readily applicable, their performance is often not reliable. On the other hand, intermediate references of degraded quality are often available, e.g., at the input of video transcoders, but how to make the best use of them in proper ways has not been deeply investigated. Here we make one of the first attempts to establish a new paradigm named degraded-reference IQA (DR IQA). Specifically, we lay out the architectures of DR IQA and introduce a 6-bit code to denote the choices of configurations. We construct the first large-scale databases dedicated to DR IQA and will make them publicly available. We make novel observations on distortion behavior in multi-stage distortion pipelines by comprehensively analyzing five multiple distortion combinations. Based on these observations, we develop novel DR IQA models and make extensive comparisons with a series of baseline models derived from top-performing FR and NR models. The results suggest that DR IQA may offer significant performance improvement in multiple distortion environments, thereby establishing DR IQA as a valid IQA paradigm that is worth further exploration.


title: Distinguishing thermal from non-thermal ("hot") carries in illuminated molecular junctions

abstract: The search for the signature of non-thermal (so-called ``hot'') electrons in illuminated plasmonic nanostructures requires a detailed understanding of the non-equilibrium electron distribution under illumination, as well as a careful design of the experimental system employed to distinguish non-thermal electrons from thermal ones. Here, we provide a theory for using plasmonic molecular junctions to achieve this goal. We show how non-thermal electrons can be measured directly and separately from the unavoidable thermal response, and discuss the relevance of our theory to recent experiments.


title: Ultrafast Internal Conversion Dynamics Through the on-the-fly Simulation of Transient Absorption Pump-Probe Spectra with Different Electronic Structure Methods

abstract: The ultrafast nonadiabatic internal conversion in azomethane is explored by the on-the-fly trajectory surface-hopping simulations of photoinduced dynamics and femtosecond transient absorption (TA) pump-probe (PP) spectra at three electronic-structure theory levels, OM2/MRCI, SA-CASSCF, and XMS-CASPT2. All these dynamics simulations predict ultrafast internal conversion. On the one hand, the OM2/MRCI and SA-CASSCF methods yield similar excited-state dynamics, while the XMS-CASPT2 method predicts a much slower population decay. On the other hand, the TA PP signals simulated at the SA-CASSCF and XMS-CASPT2 levels show the similar spectral features, particularly for the similar stimulated emission contributions, while the OM2/MRCI signals are quite different. This demonstrates that the nonadiabatic population dynamics and time-resolved stimulated emission signals may reflect different aspects of photoinduced processes. The combination of the dynamical and spectral simulations definitely provides more accurate and detailed information which sheds light on the microscopic mechanisms of photophysical and photochemical processes.


title: NetDAM: Network Direct Attached Memory with Programmable In-Memory Computing ISA

abstract: Data-intensive applications like distributed AI-training may require multi-terabytes memory capacity with multi-terabits bandwidth. We directly attach the memory to the ethernet controller with some programable logic to design an efficient hardware "template" for Memory pooling and in-memory / in-network computing. We built an FPGA prototype of the NetDAM, andwe demonstrate MPI-Allreduce communication case, the NetDAM can be used as a software and hardware friendly programmable architeture with high performance alternative for RDMA.


title: Ultralow Thermal Conductivity and Thermoelectric Properties of Bi4GeTe7 with an Intrinsic van der Waal Heterostructure

abstract: Ternary chalcogenides, having large crystalline unit cell and van der Waal stacking of layers, are expected to be poor thermal conductors and good thermoelectric (TE) materials. We are reporting that layered Bi4GeTe7, with alternating quintuplet-septuplet layers of Bi2Te3 and Bi2GeTe4, has an ultralow thermal conductivity, \k{appa}total 0.42 Wm-1K-1 because of high degree of anharmonicity as estimated from large Gruneisen parameter ({\gamma} 4.07) and low Debye temperature ({\theta}d 135 K). The electron dominated charge transport has been realized from the Seebeck coefficient, S - 82 uV/K, at 380 K, and Hall carrier concentration of ne ~ 9.8 x 1019 cm-3 at 300 K. Observation of weak antilocalization (WAL), due to spin-orbit coupling (SOC) of heavy Bi and Te, advocate Bi4GeTe7 to be a topological quantum material also. The cross-sectional transmission electron microscopy images show the inherent stacking of hetero-layers, which are leading to a large anharmonicity for poor phonon propagation. Thus, being a poor thermal conductor with a TE figure of merit, ZT ~ 0.24, at 380 K, the Bi4GeTe7 is a good material for TE applications.


title: MERCURY: Accelerating DNN Training By Exploiting Input Similarity

abstract: Deep Neural Networks (DNN) are computationally intensive to train. It consists of a large number of multidimensional dot products between many weights and input vectors. However, there can be significant similarity among input vectors. If one input vector is similar to another, its computations with the weights are similar to those of the other and, therefore, can be skipped by reusing the already-computed results. We propose a novel scheme, called MERCURY, to exploit input similarity during DNN training in a hardware accelerator. MERCURY uses Random Projection with Quantization (RPQ) to convert an input vector to a bit sequence, called Signature. A cache (MCACHE) stores signatures of recent input vectors along with the computed results. If the Signature of a new input vector matches that of an already existing vector in the MCACHE, the two vectors are found to have similarities. Therefore, the already-computed result is reused for the new vector. To the best of our knowledge, MERCURY is the first work that exploits input similarity using RPQ for accelerating DNN training in hardware. The paper presents a detailed design, workflow, and implementation of the MERCURY. Our experimental evaluation with twelve different deep learning models shows that MERCURY saves a significant number of computations and speeds up the model training by an average of 1.97X with an accuracy similar to the baseline system.


title: The $h$-polynomial and the rook polynomial of some polyominoes

abstract: Let $X$ be a convex polyomino such that its vertex set is a sublattice of $\mathbb{N}^2$. Let $\Bbbk[X]$ be the toric ring (over a field $\Bbbk$) associated to $X$ in the sense of Qureshi, \emph{J. Algebra}, 2012. Write the Hilbert series of $\Bbbk[X]$ as $(1 + h_1 t + h_2 t^2 + \cdots )/(1-t)^{\dim(\Bbbk[X])}$. For $k \in \mathbb{N}$, let $r_k$ be the number of configurations in $X$ with $k$ pairwise non-attacking rooks. We show that $h_2 < r_2$ if $X$ is not a thin polyomino. This partially confirms a conjectured characterization of thin polyominoes by Rinaldo and Romeo, \emph{J. Algebraic Combin.}, 2021.


title: Distributed Joint Multi-cell Optimization of IRS Parameters with Linear Precoders

abstract: We present distributed methods for jointly optimizing Intelligent Reflecting Surface (IRS) phase-shifts and beamformers in a cellular network. The proposed schemes require knowledge of only the intra-cell training sequences and corresponding received signals without explicit channel estimation. Instead, an SINR objective is estimated via sample means and maximized directly. This automatically includes and mitigates both intra- and inter-cell interference provided that the uplink training is synchronized across cells. Different schemes are considered that limit the set of known training sequences from interferers. With MIMO links an iterative synchronous bi-directional training scheme jointly optimizes the IRS parameters with the beamformers and combiners. Simulation results show that the proposed distributed methods show a modest performance degradation compared to centralized channel estimation schemes, which estimate and exchange all cross-channels between cells, and perform significantly better than channel estimation schemes which ignore the inter-cell interference.


title: Hybrid improper dipolar density wave in NaLaCoWO$_6$

abstract: Hybrid Improper Ferroelectricity (HIF) allows the generation of an electrical polarization in the AA'BB'O$_6$ double perovskite materials thanks to the combination of two non-polar octahedral distortions. Nevertheless, for selected combination of the A/A' cations a non-polar incommensurate phase is observed with average symmetry $C2/m$. Thanks to a detailed crystallographic description of the incommensurate phase, based on electron, neutron and x-ray diffraction data, we show that the incommensurate modulation is related to an abrupt change of the out-of-phase tilting along the a- and c-axis whereas the tilting along the b-axis remain constant across the structure. By using group theory and symmetry analysis we show that we observe an incommensurate analog of HIF which induces a hybrid improper dipolar density wave in NaLaCoWO$_6$. The dipolar ordering is due also in this case to a trilinear invariant involving the commensurate and incommensurate octahedra tilting's.