title: Natural and magnetically induced entanglement of hyperfine-structure states in atomic hydrogen

abstract: The spectrum of atomic hydrogen has long been viewed as a Rosetta stone that bears the key to decode the writings of quantum mechanics in a vast variety of physical, chemical, and biological systems. Here, we show that, in addition to its role as a basic model of quantum mechanics, the hydrogen atom provides a fundamental building block of quantum information. Through its electron and nuclear spin degrees of freedom, the hydrogen atom is shown to lend a physically meaningful frame and a suitable Hilbert space for bipartite entanglement, whose two-qubit concurrence and quantum coherence can be expressed in terms of the fundamental physical constants -- the Planck and Boltzmann constants, electron and proton masses, the fine-structure constant, as well as the Bohr radius and the Bohr magneton. The intrinsic, natural entanglement that the hyperfine-structure (HFS) states of the H atom store at low temperatures rapidly decreases with a growth in temperature, vanishing above a $\tau_c$ $\approx$ 5.35 $\mu$eV threshold. An external magnetic field, however, can overcome this thermal loss of HFS entanglement. As one of the central findings of this work, we show that an external magnetic field can induce and sustain an HFS entanglement, against all the odds of thermal effects, at temperatures well above the $\tau_c$ threshold, thus enabling magnetic-field-assisted entanglement engineering in low-temperature gases and solids.


title: Polarization purity for active stabilization of diode laser injection lock

abstract: Injection locking of diode lasers is commonly used to amplify low power laser light, but is extremely sensitive to perturbations in the laser current and temperature. To counter such perturbations, active stabilization is often applied to the current of the injection locked diode. We observe that the diode laser's polarization extinction ratio (PER) greatly increases when injection locked, and therefore the PER provides a measure of injection lock quality. We report robust active stabilization of a diode laser injection lock based on the PER, demonstrating the technique at 399 nm wavelength where injection locking is typically less stable than at longer wavelengths. The PER provides a feedback error signal that is compatible with standard PID servo controllers, requires no additional optical components beyond the optical isolator typically used in injection locking, and enables a large feedback bandwidth.


title: Cauchy Formulas and Billey's Formulas for Generalized Grothendieck polynomials

abstract: We study the generalized double $\beta$-Grothendieck polynomials for all types. We study the Cauchy formulas for them. Using this, we deduce the K-theoretic version of the comodule structure map $\alpha^*: K(G/B)\to K(G)\otimes K(G/B)$ induced by the group action map for reductive group $G$ and its flag variety $G/B$. Furthermore, we give a combinatorial formula to compute the localization of Schubert classes as a generalization of Billey's formula.


title: Robust Graph Meta-learning for Weakly-supervised Few-shot Node Classification

abstract: Graphs are widely used to model the relational structure of data, and the research of graph machine learning (ML) has a wide spectrum of applications ranging from drug design in molecular graphs to friendship recommendation in social networks. Prevailing approaches for graph ML typically require abundant labeled instances in achieving satisfactory results, which is commonly infeasible in real-world scenarios since labeled data for newly emerged concepts (e.g., new categorizations of nodes) on graphs is limited. Though meta-learning has been applied to different few-shot graph learning problems, most existing efforts predominately assume that all the data from those seen classes is gold-labeled, while those methods may lose their efficacy when the seen data is weakly-labeled with severe label noise. As such, we aim to investigate a novel problem of weakly-supervised graph meta-learning for improving the model robustness in terms of knowledge transfer. To achieve this goal, we propose a new graph meta-learning framework -- Graph Hallucination Networks (Meta-GHN) in this paper. Based on a new robustness-enhanced episodic training, Meta-GHN is meta-learned to hallucinate clean node representations from weakly-labeled data and extracts highly transferable meta-knowledge, which enables the model to quickly adapt to unseen tasks with few labeled instances. Extensive experiments demonstrate the superiority of Meta-GHN over existing graph meta-learning studies on the task of weakly-supervised few-shot node classification.


title: A study of integrable form factors in massless relativistic AdS_3

abstract: We show that the massless integrable sector of the AdS_3 \times S^3 \times T^4 superstring theory, which admits a non-trivial relativistic limit, provides a setting where it is possible to determine exact minimal solutions to the form factor axioms, in integral form, based on analiticity considerations, along the same lines of ordinary relativistic integrable models. We construct in full detail the formulas for the two- and three-particle case, and show the similarities as well as the differences with respect to the off-shell Bethe ansatz procedure of Babujian et al. We show that our expressions pass a series of non-trivial consistency checks which are substantially more involved than in the traditional case. We speculate on the problems concerned in a possible generalisation to an arbitrary number of particles, and on a possible connection with the hexagon programme.


title: Don't Rule Out Monolingual Speakers: A Method For Crowdsourcing Machine Translation Data

abstract: High-performing machine translation (MT) systems can help overcome language barriers while making it possible for everyone to communicate and use language technologies in the language of their choice. However, such systems require large amounts of parallel sentences for training, and translators can be difficult to find and expensive. Here, we present a data collection strategy for MT which, in contrast, is cheap and simple, as it does not require bilingual speakers. Based on the insight that humans pay specific attention to movements, we use graphics interchange formats (GIFs) as a pivot to collect parallel sentences from monolingual annotators. We use our strategy to collect data in Hindi, Tamil and English. As a baseline, we also collect data using images as a pivot. We perform an intrinsic evaluation by manually evaluating a subset of the sentence pairs and an extrinsic evaluation by finetuning mBART on the collected data. We find that sentences collected via GIFs are indeed of higher quality.


title: Affine OneMax

abstract: A new class of test functions for black box optimization is introduced. Affine OneMax (AOM) functions are defined as compositions of OneMax and invertible affine maps on bit vectors. The black box complexity of the class is upper bounded by a polynomial of large degree in the dimension. The proof relies on discrete Fourier analysis and the Kushilevitz-Mansour algorithm. Tunable complexity is achieved by expressing invertible linear maps as finite products of transvections. The black box complexity of sub-classes of AOM functions is studied. Finally, experimental results are given to illustrate the performance of search algorithms on AOM functions.


title: GPA-Tree: Statistical Approach for Functional-Annotation-Tree-Guided Prioritization of GWAS Results

abstract: Motivation: In spite of great success of genome-wide association studies (GWAS), multiple challenges still remain. First, complex traits are often associated with many single nucleotide polymorphisms (SNPs), each with small or moderate effect sizes. Second, our understanding of the functional mechanisms through which genetic variants are associated with complex traits is still limited. To address these challenges, we propose GPA-Tree and it simultaneously implements association mapping and identifies key combinations of functional annotations related to risk-associated SNPs by combining a decision tree algorithm with a hierarchical modeling framework. Results: First, we implemented simulation studies to evaluate the proposed GPA-Tree method and compared its performance with existing statistical approaches. The results indicate that GPA-Tree outperforms existing statistical approaches in detecting risk-associated SNPs and identifying the true combinations of functional annotations with high accuracy. Second, we applied GPA-Tree to a systemic lupus erythematosus (SLE) GWAS and functional annotation data including GenoSkyline and GenoSkylinePlus. The results from GPA-Tree highlight the dysregulation of blood immune cells, including but not limited to primary B, memory helper T, regulatory T, neutrophils and CD8+ memory T cells in SLE. These results demonstrate that GPA-Tree can be a powerful tool that improves association mapping while facilitating understanding of the underlying genetic architecture of complex traits and potential mechanisms linking risk-associated SNPs with complex traits.


title: Probabilistic Group Testing with a Linear Number of Tests

abstract: In probabilistic nonadaptive group testing (PGT), we aim to characterize the number of pooled tests necessary to identify a random $k$-sparse vector of defectives with high probability. Recent work has shown that $n$ tests are necessary when $k =\omega(n/\log n)$. It is also known that $O(k \log n)$ tests are necessary and sufficient in other regimes. This leaves open the important sparsity regime where the probability of a defective item is $\sim 1/\log n$ (or $k = \Theta(n/\log n)$) where the number of tests required is linear in $n$. In this work we aim to exactly characterize the number of tests in this sparsity regime. In particular, we seek to determine the number of defectives $\lambda(\alpha)n / \log n$ that can be identified if the number of tests is $\alpha n$. In the process, we give upper and lower bounds on the exact point at which individual testing becomes suboptimal, and the use of a carefully constructed pooled test design is beneficial.


title: Spectrum of the tight-binding model on Cayley Trees and comparison with Bethe Lattices

abstract: There are few exactly solvable lattice models and even fewer solvable quantum lattice models. Here we address the problem of finding the spectrum of the tight-binding model (equivalently, the spectrum of the adjacency matrix) on Cayley trees. Recent approaches to the problem have relied on the similarity between Cayley tree and the Bethe lattice. Here, we avoid to make any ansatz related to the Bethe lattice due to fundamental differences between the two lattices that persist even when taking the thermodynamic limit. Instead, we show that one can use a recursive procedure that starts from the boundary and then use the canonical basis to derive the complete spectrum of the tight-binding model on Cayley Trees. Our resulting algorithm is extremely efficient, as witnessed with remarkable large trees having hundred of shells. We also shows that, in the thermodynamic limit, the density of states is dramatically different from that of the Bethe lattice.


title: Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems

abstract: Recently, there has been much interest in studying the convergence rates of without-replacement SGD, and proving that it is faster than with-replacement SGD in the worst case. However, known lower bounds ignore the problem's geometry, including its condition number, whereas the upper bounds explicitly depend on it. Perhaps surprisingly, we prove that when the condition number is taken into account, without-replacement SGD \emph{does not} significantly improve on with-replacement SGD in terms of worst-case bounds, unless the number of epochs (passes over the data) is larger than the condition number. Since many problems in machine learning and other areas are both ill-conditioned and involve large datasets, this indicates that without-replacement does not necessarily improve over with-replacement sampling for realistic iteration budgets. We show this by providing new lower and upper bounds which are tight (up to log factors), for quadratic problems with commuting quadratic terms, precisely quantifying the dependence on the problem parameters.


title: A public transit network optimization model for equitable access to social services

abstract: We present a flexible public transit network design model which optimizes a social access objective while guaranteeing that the system's costs and transit times remain within a preset margin of their current levels. The purpose of the model is to find a set of minor, immediate modifications to an existing bus network that can give more communities access to the chosen services while having a minimal impact on the current network's operator costs and user costs. Design decisions consist of reallocation of existing resources in order to adjust line frequencies and capacities. We present a hybrid tabu search/simulated annealing algorithm for the solution of this optimization-based model. As a case study we apply the model to the problem of improving equity of access to primary health care facilities in the Chicago metropolitan area. The results of the model suggest that it is possible to achieve better primary care access equity through reassignment of existing buses and implementation of express runs, while leaving overall service levels relatively unaffected.


title: Sparse PointPillars: Maintaining and Exploiting Input Sparsity to Improve Runtime on Embedded Systems

abstract: Bird's Eye View (BEV) is a popular representation for processing 3D point clouds, and by its nature is fundamentally sparse. Motivated by the computational limitations of mobile robot platforms, we create a fast, high-performance BEV 3D object detector that maintains and exploits this input sparsity to decrease runtimes over non-sparse baselines and avoids the tradeoff between pseudoimage area and runtime. We present results on KITTI, a canonical 3D detection dataset, and Matterport-Chair, a novel Matterport3D-derived chair detection dataset from scenes in real furnished homes. We evaluate runtime characteristics using a desktop GPU, an embedded ML accelerator, and a robot CPU, demonstrating that our method results in significant detection speedups (2X or more) for embedded systems with only a modest decrease in detection quality. Our work represents a new approach for practitioners to optimize models for embedded systems by maintaining and exploiting input sparsity throughout their entire pipeline to reduce runtime and resource usage while preserving detection performance.


title: Axial meson contribution to proton form factors

abstract: The effect of axial meson exchange on extraction of proton electromagnetic form factors in $ep$ scattering is calculated. Taking as an example $f_1(1285)$ meson exchange, it is quantitatively shown how it affects Rosenbluth and polarization transfer methods. The contribution of an axial meson is negligible in comparison with the traditional box-type two photon exchange and could not be responsible for difference of form factors extracted by different techniques. However, results support the idea that meson exchange could explain deviation of individual polarizations.


title: Stereographic Geometry of Coherence and Which-path Information

abstract: Recently, it was shown that quantum entanglement is an indispensable part of the duality behavior of light. Here, we report a surprisingly intimate connection between the stereographic projection and the duality--entanglement nature of a single photon. We show that, the duality--entanglement relation [Optica \textbf{5}, 942 (2018)], naturally emerges from the stereographic projection geometry. We demonstrate that this geometry is complementarity sensitive; in the sense that, it is sensitive to the particle nature, wave nature, and entanglement nature of a single photon.


title: Online Learning with Optimism and Delay

abstract: Inspired by the demands of real-time climate and weather forecasting, we develop optimistic online learning algorithms that require no parameter tuning and have optimal regret guarantees under delayed feedback. Our algorithms -- DORM, DORM+, and AdaHedgeD -- arise from a novel reduction of delayed online learning to optimistic online learning that reveals how optimistic hints can mitigate the regret penalty caused by delay. We pair this delay-as-optimism perspective with a new analysis of optimistic learning that exposes its robustness to hinting errors and a new meta-algorithm for learning effective hinting strategies in the presence of delay. We conclude by benchmarking our algorithms on four subseasonal climate forecasting tasks, demonstrating low regret relative to state-of-the-art forecasting models.


title: Energy harvesting coil for circularly polarized fields in magnetic resonance imaging

abstract: Specialized radio-frequency coils and sensors placed inside the magnetic resonance imaging (MRI) scanner considerably extend its functionality. However, since cable connected in-bore devices have several disadvantages compared to wireless ones, the latter currently undergo active development. One of the promising concepts in wireless MRI coils is energy harvesting that relies on converting the energy carried by the radio-frequency MRI field without the need for additional transmitters as in common wireless power transfer realizations. In this Article, we propose a compact harvesting coil design based on the combination of the loop and butterfly coils that allows energy harvesting of a circularly polarized field. By performing numerical simulations and experiments with commonly used Siemens Espree and Avanto 1.5 Tesla MRI scanners, we demonstrate that the proposed approach is safe, efficient, does not decrease the quality of MRI images, and allows doubling the harvested voltage compared to linearly polarized setups.


title: The Spatio-Temporal Poisson Point Process: A Simple Model for the Alignment of Event Camera Data

abstract: Event cameras, inspired by biological vision systems, provide a natural and data efficient representation of visual information. Visual information is acquired in the form of events that are triggered by local brightness changes. Each pixel location of the camera's sensor records events asynchronously and independently with very high temporal resolution. However, because most brightness changes are triggered by relative motion of the camera and the scene, the events recorded at a single sensor location seldom correspond to the same world point. To extract meaningful information from event cameras, it is helpful to register events that were triggered by the same underlying world point. In this work we propose a new model of event data that captures its natural spatio-temporal structure. We start by developing a model for aligned event data. That is, we develop a model for the data as though it has been perfectly registered already. In particular, we model the aligned data as a spatio-temporal Poisson point process. Based on this model, we develop a maximum likelihood approach to registering events that are not yet aligned. That is, we find transformations of the observed events that make them as likely as possible under our model. In particular we extract the camera rotation that leads to the best event alignment. We show new state of the art accuracy for rotational velocity estimation on the DAVIS 240C dataset. In addition, our method is also faster and has lower computational complexity than several competing methods.


title: Serre-Lusztig relations for $\imath$quantum groups III

abstract: let $\widetilde{\bf U}^\imath$ be a quasi-split universal $\imath$quantum group associated to a quantum symmetric pair $(\widetilde{\bf U}, \widetilde{\bf U}^\imath)$ of Kac-Moody type with a diagram involution $\tau$. We establish the Serre-Lusztig relations for $\widetilde{\bf U}^\imath$ associated to a simple root $i$ such that $i \neq \tau i$, complementary to the Serre-Lusztig relations associated to $i=\tau i$ which we obtained earlier. A conjecture on braid group symmetries on $\widetilde{\bf U}^\imath$ associated to $i$ disjoint from $\tau i$ is formulated.


title: G-TADOC: Enabling Efficient GPU-Based Text Analytics without Decompression

abstract: Text analytics directly on compression (TADOC) has proven to be a promising technology for big data analytics. GPUs are extremely popular accelerators for data analytics systems. Unfortunately, no work so far shows how to utilize GPUs to accelerate TADOC. We describe G-TADOC, the first framework that provides GPU-based text analytics directly on compression, effectively enabling efficient text analytics on GPUs without decompressing the input data. G-TADOC solves three major challenges. First, TADOC involves a large amount of dependencies, which makes it difficult to exploit massive parallelism on a GPU. We develop a novel fine-grained thread-level workload scheduling strategy for GPU threads, which partitions heavily-dependent loads adaptively in a fine-grained manner. Second, in developing G-TADOC, thousands of GPU threads writing to the same result buffer leads to inconsistency while directly using locks and atomic operations lead to large synchronization overheads. We develop a memory pool with thread-safe data structures on GPUs to handle such difficulties. Third, maintaining the sequence information among words is essential for lossless compression. We design a sequence-support strategy, which maintains high GPU parallelism while ensuring sequence information. Our experimental evaluations show that G-TADOC provides 31.1x average speedup compared to state-of-the-art TADOC.


title: Measurements of 10 Scarcely Observed Pairs

abstract: Separation ($\rho$) and Position Angle (PA) measurements are reported of 10 pairs which measures where last reported in the WDS +20 years from epoch of observation 2021.066. Measurements were obtained by direct imaging and are presented with associated measurement uncertainties, as well as, comparisons to measurements determined from Gaia DR2 & EDR3 and historic data extrapolation at epoch of J2000.0.


title: Stochastic Alternating Direction Method of Multipliers for Byzantine-Robust Distributed Learning

abstract: This paper aims to solve a distributed learning problem under Byzantine attacks. In the underlying distributed system, a number of unknown but malicious workers (termed as Byzantine workers) can send arbitrary messages to the master and bias the learning process, due to data corruptions, computation errors or malicious attacks. Prior work has considered a total variation (TV) norm-penalized approximation formulation to handle the Byzantine attacks, where the TV norm penalty forces the regular workers' local variables to be close, and meanwhile, tolerates the outliers sent by the Byzantine workers. To solve the TV norm-penalized approximation formulation, we propose a Byzantine-robust stochastic alternating direction method of multipliers (ADMM) that fully utilizes the separable problem structure. Theoretically, we prove that the proposed method converges to a bounded neighborhood of the optimal solution at a rate of O(1/k) under mild assumptions, where k is the number of iterations and the size of neighborhood is determined by the number of Byzantine workers. Numerical experiments on the MNIST and COVERTYPE datasets demonstrate the effectiveness of the proposed method to various Byzantine attacks.


title: Improved Guarantees for Offline Stochastic Matching via new Ordered Contention Resolution Schemes

abstract: Matching is one of the most fundamental and broadly applicable problems across many domains. In these diverse real-world applications, there is often a degree of uncertainty in the input which has led to the study of stochastic matching models. Here, each edge in the graph has a known, independent probability of existing derived from some prediction. Algorithms must probe edges to determine existence and match them irrevocably if they exist. Further, each vertex may have a patience constraint denoting how many of its neighboring edges can be probed. We present new ordered contention resolution schemes yielding improved approximation guarantees for some of the foundational problems studied in this area. For stochastic matching with patience constraints in general graphs, we provide a 0.382-approximate algorithm, significantly improving over the previous best 0.31-approximation of Baveja et al. (2018). When the vertices do not have patience constraints, we describe a 0.432-approximate random order probing algorithm with several corollaries such as an improved guarantee for the Prophet Secretary problem under Edge Arrivals. Finally, for the special case of bipartite graphs with unit patience constraints on one of the partitions, we show a 0.632-approximate algorithm that improves on the recent $1/3$-guarantee of Hikima et al. (2021).


title: Boundary Singularities in Mean Curvature Flow and Total Curvature of Minimal Surface Boundaries

abstract: For hypersurfaces moving by standard mean curvature flow with boundary, we show that if a tangent flow at a boundary singularity is given by a smoothly embedded shrinker, then the shrinker must be non-orientable. We also show that there is an initially smooth surface in 3-space that develops a boundary singularity for which the shrinker is smoothly embedded (and therefore non-orientable). Indeed, we show that there is a nonempty open set of such initial surfaces. Let k be the largest number with the following property: if M is a minimal surface in 3-space bounded by a smooth simple closed curve of total curvature less than k, then M is a disk. Examples show that $k<4\pi$. In this paper, we use mean curvature flow to show that $k >3\pi$. We get a slightly larger lower bound for orientable surfaces.


title: Large Deviation Asymptotics and Bayesian Posterior Consistency on Stochastic Processes and Dynamical Systems

abstract: We consider generalized Bayesian inference on stochastic processes and dynamical systems with potentially long-range dependency. Given a sequence of observations, a class of parametrized model processes with a prior distribution, and a loss function, we specify the generalized posterior distribution. The problem of frequentist posterior consistency is concerned with whether as more and more samples are observed, the posterior distribution on parameters will asymptotically concentrate on the "right" parameters. We show that posterior consistency can be derived using a combination of classical large deviation techniques, such as Varadhan's lemma, conditional/quenched large deviations, annealed large deviations, and exponential approximations. We show that the posterior distribution will asymptotically concentrate on parameters that minimize the expected loss and a divergence term, and we identify the divergence term as the Donsker-Varadhan relative entropy rate from process-level large deviations. As an application, we prove new quenched and annealed large deviation asymptotics and new Bayesian posterior consistency results for a class of mixing stochastic processes. In the case of Markov processes, one can obtain explicit conditions for posterior consistency, whenever estimates for log-Sobolev constants are available, which makes our framework essentially a black box. We also recover state-of-the-art posterior consistency on classical dynamical systems with a simple proof. Our approach has the potential of proving posterior consistency for a wide range of Bayesian procedures in a unified way.


title: FeSHI: Feature Map Based Stealthy Hardware Intrinsic Attack

abstract: To reduce the time-to-market and access to state-of-the-art techniques, CNN hardware mapping and deployment on embedded accelerators are often outsourced to untrusted third parties, which is going to be more prevalent in futuristic artificial intelligence of things (AIoT) systems. These AIoT systems anticipate horizontal collaboration among different resource-constrained AIoT node devices, where CNN layers are partitioned and these devices collaboratively compute complex CNN tasks. This horizontal collaboration opens another attack surface to the CNN-based application, like inserting the hardware Trojans (HT) into the embedded accelerators designed for the CNN. Therefore, there is a dire need to explore this attack surface for designing secure embedded hardware accelerators for CNNs. Towards this goal, in this paper, we exploited this attack surface to propose an HT-based attack called FeSHI. Since in horizontal collaboration of RC AIoT devices different sections of CNN architectures are outsourced to different untrusted third parties, the attacker may not know the input image, but it has access to the layer-by-layer output feature maps information for the assigned sections of the CNN architecture. This attack exploits the statistical distribution, i.e., Gaussian distribution, of the layer-by-layer feature maps of the CNN to design two triggers for stealthy HT with a very low probability of triggering. Also, three different novel, stealthy and effective trigger designs are proposed.


title: SAR Image Change Detection Based on Multiscale Capsule Network

abstract: Traditional change detection methods based on convolutional neural networks (CNNs) face the challenges of speckle noise and deformation sensitivity for synthetic aperture radar images. To mitigate these issues, we proposed a Multiscale Capsule Network (Ms-CapsNet) to extract the discriminative information between the changed and unchanged pixels. On the one hand, the capsule module is employed to exploit the spatial relationship of features. Therefore, equivariant properties can be achieved by aggregating the features from different positions. On the other hand, an adaptive fusion convolution (AFC) module is designed for the proposed Ms-CapsNet. Higher semantic features can be captured for the primary capsules. Feature extracted by the AFC module significantly improves the robustness to speckle noise. The effectiveness of the proposed Ms-CapsNet is verified on three real SAR datasets. The comparison experiments with four state-of-the-art methods demonstrated the efficiency of the proposed method. Our codes are available at https://github.com/summitgao/SAR_CD_MS_CapsNet.


title: The Gravity Collective: A Search for the Electromagnetic Counterpart to the Neutron Star-Black Hole Merger GW190814

abstract: We present optical follow-up imaging obtained with the Katzman Automatic Imaging Telescope, Las Cumbres Observatory Global Telescope Network, Nickel Telescope, Swope Telescope, and Thacher Telescope of the LIGO/Virgo gravitational wave (GW) signal from the neutron star-black hole (NSBH) merger GW190814. We searched the GW190814 localization region (19 deg$^{2}$ for the 90th percentile best localization), covering a total of 51 deg$^{2}$ and 94.6% of the two-dimensional localization region. Analyzing the properties of 189 transients that we consider as candidate counterparts to the NSBH merger, including their localizations, discovery times from merger, optical spectra, likely host-galaxy redshifts, and photometric evolution, we conclude that none of these objects are likely to be associated with GW190814. Based on this finding, we consider the likely optical properties of an electromagnetic counterpart to GW190814, including possible kilonovae and short gamma-ray burst afterglows. Using the joint limits from our follow-up imaging, we conclude that a counterpart with an $r$-band decline rate of 0.68 mag day$^{-1}$, similar to the kilonova AT 2017gfo, could peak at an absolute magnitude of at most $-17.8$ mag (50% confidence). Our data are not constraining for ''red'' kilonovae and rule out ''blue'' kilonovae with $M>0.5 M_{\odot}$ (30% confidence). We strongly rule out all known types of short gamma-ray burst afterglows with viewing angles $<$17$^{\circ}$ assuming an initial jet opening angle of $\sim$$5.2^{\circ}$ and explosion energies and circumburst densities similar to afterglows explored in the literature. Finally, we explore the possibility that GW190814 merged in the disk of an active galactic nucleus, of which we find four in the localization region, but we do not find any candidate counterparts among these sources.


title: Learning Dissipative Dynamics in Chaotic Systems

abstract: Chaotic systems are notoriously challenging to predict because of their sensitivity to perturbations and errors due to time stepping. Despite this unpredictable behavior, for many dissipative systems the statistics of the long term trajectories are governed by an invariant measure supported on a set, known as the global attractor; for many problems this set is finite dimensional, even if the state space is infinite dimensional. For Markovian systems, the statistical properties of long-term trajectories are uniquely determined by the solution operator that maps the evolution of the system over arbitrary positive time increments. In this work, we propose a machine learning framework to learn the underlying solution operator for dissipative chaotic systems, showing that the resulting learned operator accurately captures short-time trajectories and long-time statistical behavior. Using this framework, we are able to predict various statistics of the invariant measure for the turbulent Kolmogorov Flow dynamics with Reynolds numbers up to 5000.


title: Memory-efficient Transformers via Top-$k$ Attention

abstract: Following the success of dot-product attention in Transformers, numerous approximations have been recently proposed to address its quadratic complexity with respect to the input length. While these variants are memory and compute efficient, it is not possible to directly use them with popular pre-trained language models trained using vanilla attention, without an expensive corrective pre-training stage. In this work, we propose a simple yet highly accurate approximation for vanilla attention. We process the queries in chunks, and for each query, compute the top-$k$ scores with respect to the keys. Our approach offers several advantages: (a) its memory usage is linear in the input size, similar to linear attention variants, such as Performer and RFA (b) it is a drop-in replacement for vanilla attention that does not require any corrective pre-training, and (c) it can also lead to significant memory savings in the feed-forward layers after casting them into the familiar query-key-value framework. We evaluate the quality of top-$k$ approximation for multi-head attention layers on the Long Range Arena Benchmark, and for feed-forward layers of T5 and UnifiedQA on multiple QA datasets. We show our approach leads to accuracy that is nearly-identical to vanilla attention in multiple setups including training from scratch, fine-tuning, and zero-shot inference.


title: Deep Reinforcement Learning based Group Recommender System

abstract: Group recommender systems are widely used in current web applications. In this paper, we propose a novel group recommender system based on the deep reinforcement learning. We introduce the MovieLens data at first and generate one random group dataset, MovieLens-Rand, from it. This randomly generated dataset is described and analyzed. We also present experimental settings and two state-of-art baselines, AGREE and GroupIM. The framework of our novel model, the Deep Reinforcement learning based Group Recommender system (DRGR), is proposed. Actor-critic networks are implemented with the deep deterministic policy gradient algorithm. The DRGR model is applied on the MovieLens-Rand dataset with two baselines. Compared with baselines, we conclude that DRGR performs better than GroupIM due to long interaction histories but worse than AGREE because of the self-attention mechanism. We express advantages and shortcomings of DRGR and also give future improvement directions at the end.


title: Multi-User Communication with Extremely Large-Scale MIMO

abstract: Extremely large-scale multiple-input multiple-output (XL-MIMO) communication aims to further boost the antenna size significantly than current massive MIMO systems, for which conventional far-field assumption with uniform plane wave (UPW) model may become invalid. This paper studies the modelling and performance analysis for multi-user XL-MIMO communication. With the spherical wavefront phase modelling, and also by taking into account the variations of signal amplitude and projected aperture across array elements, the performance of the three typical beamforming schemes are analyzed, namely the maximal-ratio combining (MRC), zero-forcing (ZF), and minimum mean-square error (MMSE) beamforming. For the special case of two-users, we analytically show that the signal-to-interference-plus-noise ratio (SINR) of all the three beamforming schemes increases as the channels' correlation coefficient decreases. Furthermore, compared to existing UPW model where inter-user interference (IUI) can only be suppressed in angular domain, XL-MIMO enables a new degree-of-freedom (DoF) for IUI suppression by distance separation, even for users along the same direction. Simulation results are provided to validate the modelling and performance analysis of multi-user XL-MIMO communications.


title: Adaptation of the Tuning Parameter in General Bayesian Inference with Robust Divergence

abstract: We introduce a methodology for robust Bayesian estimation with robust divergence (e.g., density power divergence or {\gamma}-divergence), indexed by a single tuning parameter. It is well known that the posterior density induced by robust divergence gives highly robust estimators against outliers if the tuning parameter is appropriately and carefully chosen. In a Bayesian framework, one way to find the optimal tuning parameter would be using evidence (marginal likelihood). However, we numerically illustrate that evidence induced by the density power divergence does not work to select the optimal tuning parameter since robust divergence is not regarded as a statistical model. To overcome the problems, we treat the exponential of robust divergence as an unnormalized statistical model, and we estimate the tuning parameter via minimizing the Hyvarinen score. We also provide adaptive computational methods based on sequential Monte Carlo (SMC) samplers, which enables us to obtain the optimal tuning parameter and samples from posterior distributions simultaneously. The empirical performance of the proposed method through simulations and an application to real data are also provided.


title: Equivariant solutions to modular Schwarzian equations

abstract: For every positive integer $r$, we solve the modular Schwarzian differential equation $\{h,\tau\}=2\pi^2r^2E_4$, where $E_4$ is the weight 4 Eisenstein series, by means of equivariant functions on the upper half-plane. This paper supplements previous works \cite{forum, ramanujan}, where the same equation has been solved for infinite families of rational values of $r$. This also leads to the solutions to the modular differential equation $y''+r^2\pi^2E_4\,y=0$ for every positive integer $r$. These solutions are quasi-modular forms for $\mbox{SL}_2(\mathbb Z)$ if $r$ is even or for the subgroup of index 2, $\mbox{SL}_2(\mathbb Z)^2$, if $r$ is odd.


title: Ancient Ricci flows with asymptotic solitons

abstract: We study ancient Ricci flows which admit asymptotic solitons in the sense of Perelman. We prove that the asymptotic solitons must coincide with Bamler's tangent flows at infinity. Furthermore, we show that Perelman's $\nu$-functional is uniformly bounded on such ancient solutions; this fact leads to logarithmic Sobolev inequalities and Sobolev inequalities. Lastly, as an important tool for the proofs of the above results, we also show that, for a complete Ricci flow with bounded curvature, the bound of the Nash entropy depends only on the local geometry around an $H_n$-center of its base point.


title: InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping

abstract: E-commerce companies have to face abnormal sellers who sell potentially-risky products. Typically, the risk can be identified by jointly considering product content (e.g., title and image) and seller behavior. This work focuses on behavior feature extraction as behavior sequences can provide valuable clues for the risk discovery by reflecting the sellers' operation habits. Traditional feature extraction techniques heavily depend on domain experts and adapt poorly to new tasks. In this paper, we propose a self-supervised method InfoBehavior to automatically extract meaningful representations from ultra-long raw behavior sequences instead of the costly feature selection procedure. InfoBehavior utilizes Bidirectional Transformer as feature encoder due to its excellent capability in modeling long-term dependency. However, it is intractable for commodity GPUs because the time and memory required by Transformer grow quadratically with the increase of sequence length. Thus, we propose a hierarchical grouping strategy to aggregate ultra-long raw behavior sequences to length-processable high-level embedding sequences. Moreover, we introduce two types of pretext tasks. Sequence-related pretext task defines a contrastive-based training objective to correctly select the masked-out coarse-grained/fine-grained behavior sequences against other "distractor" behavior sequences; Domain-related pretext task designs a classification training objective to correctly predict the domain-specific statistical results of anomalous behavior. We show that behavior representations from the pre-trained InfoBehavior can be directly used or integrated with features from other side information to support a wide range of downstream tasks. Experimental results demonstrate that InfoBehavior significantly improves the performance of Product Risk Management and Intellectual Property Protection.


title: Optimal Sensor Precision for Multi-Rate Sensing for Bounded Estimation Error

abstract: We address the problem of determining optimal sensor precisions for estimating the states of linear time-varying discrete-time stochastic dynamical systems, with guaranteed bounds on the estimation errors. This is performed in the Kalman filtering framework, where the sensor precisions are treated as variables. They are determined by solving a constrained convex optimization problem, which guarantees the specified upper bound on the posterior error variance. Optimal sensor precisions are determined by minimizing the l1 norm, which promotes sparseness in the solution and indirectly addresses the sensor selection problem. The theory is applied to realistic flight mechanics and astrodynamics problems to highlight its engineering value. These examples demonstrate the application of the presented theory to a) determine redundant sensing architectures for linear time invariant systems, b) accurately estimate states with low-cost sensors, and c) optimally schedule sensors for linear time-varying systems.


title: ADVERT: An Adaptive and Data-Driven Attention Enhancement Mechanism for Phishing Prevention

abstract: Attacks exploiting the innate and the acquired vulnerabilities of human users have posed severe threats to cybersecurity. This work proposes ADVERT, a human-technical solution that generates adaptive visual aids in real-time to prevent users from inadvertence and reduce their susceptibility to phishing attacks. Based on the eye-tracking data, we extract visual states and attention states as system-level sufficient statistics to characterize the user's visual behaviors and attention status. By adopting a data-driven approach and two learning feedback of different time scales, this work lays out a theoretical foundation to analyze, evaluate, and particularly modify humans' attention processes while they vet and recognize phishing emails. We corroborate the effectiveness, efficiency, and robustness of ADVERT through a case study based on the data set collected from human subject experiments conducted at New York University. The results show that the visual aids can statistically increase the attention level and improve the accuracy of phishing recognition from 74.6% to a minimum of 86%. The meta-adaptation can further improve the accuracy to 91.5% (resp. 93.7%) in less than 3 (resp. 50) tuning stages.


title: Domain Generalization on Medical Imaging Classification using Episodic Training with Task Augmentation

abstract: Medical imaging datasets usually exhibit domain shift due to the variations of scanner vendors, imaging protocols, etc. This raises the concern about the generalization capacity of machine learning models. Domain generalization (DG), which aims to learn a model from multiple source domains such that it can be directly generalized to unseen test domains, seems particularly promising to medical imaging community. To address DG, recent model-agnostic meta-learning (MAML) has been introduced, which transfers the knowledge from previous training tasks to facilitate the learning of novel testing tasks. However, in clinical practice, there are usually only a few annotated source domains available, which decreases the capacity of training task generation and thus increases the risk of overfitting to training tasks in the paradigm. In this paper, we propose a novel DG scheme of episodic training with task augmentation on medical imaging classification. Based on meta-learning, we develop the paradigm of episodic training to construct the knowledge transfer from episodic training-task simulation to the real testing task of DG. Motivated by the limited number of source domains in real-world medical deployment, we consider the unique task-level overfitting and we propose task augmentation to enhance the variety during training task generation to alleviate it. With the established learning framework, we further exploit a novel meta-objective to regularize the deep embedding of training domains. To validate the effectiveness of the proposed method, we perform experiments on histopathological images and abdominal CT images.


title: GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio

abstract: This paper introduces GigaSpeech, an evolving, multi-domain English speech recognition corpus with 10,000 hours of high quality labeled audio suitable for supervised training, and 40,000 hours of total audio suitable for semi-supervised and unsupervised training. Around 40,000 hours of transcribed audio is first collected from audiobooks, podcasts and YouTube, covering both read and spontaneous speaking styles, and a variety of topics, such as arts, science, sports, etc. A new forced alignment and segmentation pipeline is proposed to create sentence segments suitable for speech recognition training, and to filter out segments with low-quality transcription. For system training, GigaSpeech provides five subsets of different sizes, 10h, 250h, 1000h, 2500h, and 10000h. For our 10,000-hour XL training subset, we cap the word error rate at 4% during the filtering/validation stage, and for all our other smaller training subsets, we cap it at 0%. The DEV and TEST evaluation sets, on the other hand, are re-processed by professional human transcribers to ensure high transcription quality. Baseline systems are provided for popular speech recognition toolkits, namely Athena, ESPnet, Kaldi and Pika.


title: Sentiment Analysis of Covid-19 Tweets using Evolutionary Classification-Based LSTM Model

abstract: As the Covid-19 outbreaks rapidly all over the world day by day and also affects the lives of million, a number of countries declared complete lock-down to check its intensity. During this lockdown period, social media plat-forms have played an important role to spread information about this pandemic across the world, as people used to express their feelings through the social networks. Considering this catastrophic situation, we developed an experimental approach to analyze the reactions of people on Twitter taking into ac-count the popular words either directly or indirectly based on this pandemic. This paper represents the sentiment analysis on collected large number of tweets on Coronavirus or Covid-19. At first, we analyze the trend of public sentiment on the topics related to Covid-19 epidemic using an evolutionary classification followed by the n-gram analysis. Then we calculated the sentiment ratings on collected tweet based on their class. Finally, we trained the long-short term network using two types of rated tweets to predict sentiment on Covid-19 data and obtained an overall accuracy of 84.46%.


title: An Interaction-based Convolutional Neural Network (ICNN) Towards Better Understanding of COVID-19 X-ray Images

abstract: The field of Explainable Artificial Intelligence (XAI) aims to build explainable and interpretable machine learning (or deep learning) methods without sacrificing prediction performance. Convolutional Neural Networks (CNNs) have been successful in making predictions, especially in image classification. However, these famous deep learning models use tens of millions of parameters based on a large number of pre-trained filters which have been repurposed from previous data sets. We propose a novel Interaction-based Convolutional Neural Network (ICNN) that does not make assumptions about the relevance of local information. Instead, we use a model-free Influence Score (I-score) to directly extract the influential information from images to form important variable modules. We demonstrate that the proposed method produces state-of-the-art prediction performance of 99.8% on a real-world data set classifying COVID-19 Chest X-ray images without sacrificing the explanatory power of the model. This proposed design can efficiently screen COVID-19 patients before human diagnosis, and will be the benchmark for addressing future XAI problems in large-scale data sets.


title: Asymptotic Dynamics of Dispersive, Collisionless Plasmas

abstract: A multispecies, collisionless plasma is modeled by the Vlasov-Poisson system. Assuming that the electric field decays with sufficient rapidity as $t \to\infty$, we show that the velocity characteristics and spatial averages of the particle distributions converge as time grows large. Using these limits we establish the precise asymptotic profile of the electric field and its derivatives, as well as, the charge and current densities. Modified spatial characteristics are then shown to converge using the limiting electric field. Finally, we establish a modified $L^\infty$ scattering result for each particle distribution function, namely we show that they converge as $t \to \infty$ along the modified spatial characteristics. When the plasma is non-neutral, the estimates of these quantities are sharp, while in the neutral case they may imply faster rates of decay.


title: When the geodesic becomes rigid in the directed landscape

abstract: When the value $L$ of the directed landscape at a point $(\mathbf{p};\mathbf{q})$ is sufficiently large, the geodesic from $\mathbf{p}$ to $\mathbf{q}$ is rigid and its location fluctuates of order $L^{-1/4}$ around its expectation. We further show that at a midpoint of the geodesic, the location of the geodesic and the value of the directed landscape after appropriate scaling converge to two independent Gaussians.


title: Understanding the L-shell ionization mechanism through osmium atoms bombarded by 4-6 MeV/u fluorine ions

abstract: The L-subshell ionization mechanism is studied in an ultra-thin osmium target bombarded by 4-6 MeV/u fluorine ions. Multiple ionization effects in the collisions are considered through the change of fluorescence and Coster-Kronig yields while determining L-subshell ionization cross sections from L-line x-ray production cross sections. The L-subshell ionization, as well as L-shell x-ray production cross sections so obtained, are compared with various theoretical approximations. The Coulomb direct ionization contributions is studied by (i) the relativistic semi-classical approximations (RSCA), (ii) the shellwise local plasma approximation (SLPA), and (iii) the ECUSAR theory, along with the inclusion of the vacancy sharing among the subshells by the coupled-states model (CSM) and the electron capture (EC) by a standard formalism. We find that the ECUSAR-CSM-EC describes the measured excitation function curves the best. However, the theoretical calculations are still about a factor of two smaller than the measured values. Such differences are resolved by re-evaluating the fluorescence and the Coster-Kronig yields. This work demonstrates that, in the present energy range, the heavy-ion induced inner-shell ionization of heavy atoms can be understood by combining the basic mechanisms of the direct Coulomb ionization, the electron capture, the multiple ionization, and the vacancy sharing among subshells, together with optimized atomic parameters.


title: The inverse Riemann zeta function

abstract: In this article, we develop a formula for an inverse Riemann zeta function such that for $w=\zeta(s)$ we have $s=\zeta^{-1}(w)$ for real and complex domains $s$ and $w$. The presented work is based on extending the analytical recurrence formulas for trivial and non-trivial zeros as to solve an equation $\zeta(s)-w=0$ for a given $w$-domain using logarithmic differentiation and zeta recursive root extraction methods. We further explore formulas for trivial and non-trivial zeros of the Riemann zeta function in greater detail, and next, we also explore an expansion of the inverse zeta function by an attractor of its branch singularities, and develop some identities that emerge from them. In the last part, we extend the presented results as a general method for finding zeros and inverses of many other functions, such as the gamma function, the Bessel function of the first kind, or finite/infinite degree polynomials and rational functions, etc. We further compute all the presented formulas numerically to high precision and show that these formulas do indeed converge to the inverse of the Riemann zeta function and the related results. We also develop a fast algorithm to compute $\zeta^{-1}(w)$ for complex $w$.


title: Non-Transferable Learning: A New Approach for Model Ownership Verification and Applicability Authorization

abstract: As Artificial Intelligence as a Service gains popularity, protecting well-trained models as intellectual property is becoming increasingly important. There are two common types of protection methods: ownership verification and usage authorization. In this paper, we propose Non-Transferable Learning (NTL), a novel approach that captures the exclusive data representation in the learned model and restricts the model generalization ability to certain domains. This approach provides effective solutions to both model verification and authorization. Specifically: 1) For ownership verification, watermarking techniques are commonly used but are often vulnerable to sophisticated watermark removal methods. By comparison, our NTL-based ownership verification provides robust resistance to state-of-the-art watermark removal methods, as shown in extensive experiments with 6 removal approaches over the digits, CIFAR10 & STL10, and VisDA datasets. 2) For usage authorization, prior solutions focus on authorizing specific users to access the model, but authorized users can still apply the model to any data without restriction. Our NTL-based authorization approach instead provides data-centric protection, which we call applicability authorization, by significantly degrading the performance of the model on unauthorized data. Its effectiveness is also shown through experiments on the aforementioned datasets.


title: ATRAS: Adversarially Trained Robust Architecture Search

abstract: In this paper, we explore the effect of architecture completeness on adversarial robustness. We train models with different architectures on CIFAR-10 and MNIST dataset. For each model, we vary different number of layers and different number of nodes in the layer. For every architecture candidate, we use Fast Gradient Sign Method (FGSM) to generate untargeted adversarial attacks and use adversarial training to defend against those attacks. For each architecture candidate, we report pre-attack, post-attack and post-defense accuracy for the model as well as the architecture parameters and the impact of completeness to the model accuracies.


title: A Phylogenetic Trees Analysis of SARS-CoV-2

abstract: One regards spaces of trees as stratified spaces, to study distributions of phylogenetic trees. Stratified spaces with may have cycles, however spaces of trees with a fixed number of leafs are contractible. Spaces of trees with three leafs, in particular, are spiders with three legs. One gives an elementary proof of the stickiness of intrinsic sample means on spiders. One also represents four leafs tree data in terms of an associated Petersen graph. One applies such ideas to analyze RNA sequences of SARS-CoV-2 from multiple sources, by building samples of trees and running nonparametric statistics for intrinsic means on tree spaces with three and four leafs. SARS-CoV-2 are also used to built trees with leaves consisting in addition to other related coronaviruses.


title: Equilibrium Properties of E. coli Lactose Permease Symport -- A Random-walk Model Approach

abstract: The symport of lactose and H+ is an important physiological process in E. coli, for it is closely related to cellular energy supply. In this paper, the symport of H+ and lactose by E. coli LacY protein is computationally simulated using a newly proposed cotransport model that takes the "leakage" phenomenon (uncoupled sugar translocation) into account and also satisfies the static head equilibrium condition. Then, we study the equilibrium properties of this cotransport process including equilibrium solution and the time required to reach equilibrium state, when varying the parameters of the initial state of cotransport system. It can be found that in the presence of leakage, H+ and lactose will reach their equilibrium state separately, but the intensity of "leakage" has almost no effect on the equilibrium solution, while the stronger leakage is, the shorter the time required for H+ and lactose to reach equilibrium. For E. coli cells with different periplasm and cytoplasm volumes, when cotransport is performed at constant initial particle concentration, the time for cytoplasm pH to be stabilized increases monotonically with the periplasm to cytoplasm volume ratio. For a certain E. coli cell, as it continues to lose water and contract, the time for cytoplasm pH to be stabilized by cotransport also increases monotonically when the cell survives. The above phenomena and other findings in this paper may help us to not only further validate or improve the model, but also deepen our understanding of the cotransport process of E. coli LacY protein.


title: Multi-modal Scene-compliant User Intention Estimation in Navigation

abstract: A multi-modal framework to generate user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual surroundings to produce a set of future trajectories, suitable to be directly embedded into a perception-action shared control strategy on a mobile agent, or as a safety layer to supervise the prudent operation of the vehicle. We base our solution on a conditional Generative Adversarial Network with Long-Short Term Memory cells to capture trajectory distributions conditioned on past trajectories, further fused with traversability probabilities derived from visual segmentation with a Convolutional Neural Network. The proposed data-driven framework results in a significant reduction in error of the predicted trajectories (versus the ground truth) from comparable strategies in the literature (e.g. Social-GAN) that fail to account for information other than the agent's past history. Experiments were conducted on a dataset collected with a custom wheelchair model built onto the open-source urban driving simulator CARLA, proving also that the proposed framework can be used with a small, un-annotated dataset.


title: Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient

abstract: Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use cases for FL. However, Non-identical independent distributed~(non-IID) data in edge devices easily leads to training failures. Especially, over-parameterized machine learning models can easily be over-fitted on such data, hence, resulting in inefficient federated learning and poor model performance. To overcome the over-fitting issue, we proposed an adaptive dynamic pruning approach for FL, which can dynamically slim the model by dropping out unimportant parameters, hence, preventing over-fittings. Since the machine learning model's parameters react differently for different training samples, adaptive dynamic pruning will evaluate the salience of the model's parameter according to the input training sample, and only retain the salient parameter's gradients when doing back-propagation. We performed comprehensive experiments to evaluate our approach. The results show that our approach by removing the redundant parameters in neural networks can significantly reduce the over-fitting issue and greatly improves the training efficiency. In particular, when training the ResNet-32 on CIFAR-10, our approach reduces the communication cost by 57\%. We further demonstrate the inference acceleration capability of the proposed algorithm. Our approach reduces up to 50\% FLOPs inference of DNNs on edge devices while maintaining the model's quality.


title: Cross-utterance Reranking Models with BERT and Graph Convolutional Networks for Conversational Speech Recognition

abstract: How to effectively incorporate cross-utterance information cues into a neural language model (LM) has emerged as one of the intriguing issues for automatic speech recognition (ASR). Existing research efforts on improving contextualization of an LM typically regard previous utterances as a sequence of additional input and may fail to capture complex global structural dependencies among these utterances. In view of this, we in this paper seek to represent the historical context information of an utterance as graph-structured data so as to distill cross-utterances, global word interaction relationships. To this end, we apply a graph convolutional network (GCN) on the resulting graph to obtain the corresponding GCN embeddings of historical words. GCN has recently found its versatile applications on social-network analysis, text summarization, and among others due mainly to its ability of effectively capturing rich relational information among elements. However, GCN remains largely underexplored in the context of ASR, especially for dealing with conversational speech. In addition, we frame ASR N-best reranking as a prediction problem, leveraging bidirectional encoder representations from transformers (BERT) as the vehicle to not only seize the local intrinsic word regularity patterns inherent in a candidate hypothesis but also incorporate the cross-utterance, historical word interaction cues distilled by GCN for promoting performance. Extensive experiments conducted on the AMI benchmark dataset seem to confirm the pragmatic utility of our methods, in relation to some current top-of-the-line methods.


title: How fast do microdroplets generated during liquid-liquid phase separation move in a confined 2D space?

abstract: How liquid transport occurs in confined spaces is relevant to many industrial and lab-scale processes, ranging from enhanced oil recovery to drug delivery systems. In this work, we investigate propelling microdroplets that form from liquid-liquid phase separation in a quasi-2D chamber, focusing on the direction and speed of microdroplets in response to local composition gradients. The confined ternary solution in our experiments comprises a model oil, a good solvent (ethanol) and a poor solvent (water). Depending on the initial solution composition, water-rich or oil-rich microdroplets, form and move spontaneously as the ternary solution mixes with and is displaced by water diffusing from a deep side channel. Microdroplet movement is followed in situ using high-speed bright-field imaging or fluorescence imaging when the solution is doped with a dye. Local ethanol composition gradients are estimated from the variation of fluorescence intensity in the local continuous liquid surrounding the mobile microdroplets. From phase separation of the ternary solution with high oil concentration, mobile oil-rich microdroplets form in a water-rich zone, accompanying the formation of water-rich microdroplets in an oil-rich zone. The fast movement of oil-rich microdroplets induces directional flow transport that mobilizes water-rich microdroplets close to the water-rich zone. The average microdroplet speed increases with the initial oil concentration in the ternary solution. The fastest speed of oil-rich microdroplets observed in our experiments is ~150 ${\mu}$m/s along the surface of a hydrophobic wall. The presence of a sharp ethanol composition gradient is the primary driving force for the fast movement of oil-rich microdroplets in confinement. Our results demonstrate the potential of enhancing liquid transport in confinement through composition gradients arising from phase separation.


title: Deep Learning for Predictive Analytics in Reversible Steganography

abstract: Deep learning is regarded as a promising solution for reversible steganography. There is an accelerating trend of representing a reversible steo-system by monolithic neural networks, which bypass intermediate operations in traditional pipelines of reversible steganography. This end-to-end paradigm, however, suffers from imperfect reversibility. By contrast, the modular paradigm that incorporates neural networks into modules of traditional pipelines can stably guarantee reversibility with mathematical explainability. Prediction-error modulation is a well-established reversible steganography pipeline for digital images. It consists of a predictive analytics module and a reversible coding module. Given that reversibility is governed independently by the coding module, we narrow our focus to the incorporation of neural networks into the analytics module, which serves the purpose of predicting pixel intensities and a pivotal role in determining capacity and imperceptibility. The objective of this study is to evaluate the impacts of different training configurations upon predictive accuracy of neural networks and provide practical insights. In particular, we investigate how different initialisation strategies for input images may affect the learning process and how different training strategies for dual-layer prediction respond to the problem of distributional shift. Furthermore, we compare steganographic performance of various model architectures with different loss functions.


title: On the Complexity of Fair House Allocation

abstract: We study fairness in house allocation, where $m$ houses are to be allocated among $n$ agents so that every agent receives one house. We show that maximizing the number of envy-free agents is hard to approximate to within a factor of $n^{1-\gamma}$ for any constant $\gamma>0$, and that the exact version is NP-hard even for binary utilities. Moreover, we prove that deciding whether a proportional allocation exists is computationally hard, whereas the corresponding problem for equitability can be solved efficiently.


title: Bellman-consistent Pessimism for Offline Reinforcement Learning

abstract: The use of pessimism, when reasoning about datasets lacking exhaustive exploration has recently gained prominence in offline reinforcement learning. Despite the robustness it adds to the algorithm, overly pessimistic reasoning can be equally damaging in precluding the discovery of good policies, which is an issue for the popular bonus-based pessimism. In this paper, we introduce the notion of Bellman-consistent pessimism for general function approximation: instead of calculating a point-wise lower bound for the value function, we implement pessimism at the initial state over the set of functions consistent with the Bellman equations. Our theoretical guarantees only require Bellman closedness as standard in the exploratory setting, in which case bonus-based pessimism fails to provide guarantees. Even in the special case of linear function approximation where stronger expressivity assumptions hold, our result improves upon a recent bonus-based approach by $\mathcal{O}(d)$ in its sample complexity when the action space is finite. Remarkably, our algorithms automatically adapt to the best bias-variance tradeoff in the hindsight, whereas most prior approaches require tuning extra hyperparameters a priori.


title: Inverting Adversarially Robust Networks for Image Synthesis

abstract: Despite unconditional feature inversion being the foundation of many image synthesis applications, training an inverter demands a high computational budget, large decoding capacity and imposing conditions such as autoregressive priors. To address these limitations, we propose the use of adversarially robust representations as a perceptual primitive for feature inversion. We train an adversarially robust encoder to extract disentangled and perceptually-aligned image representations, making them easily invertible. By training a simple generator with the mirror architecture of the encoder, we achieve superior reconstruction quality and generalization over standard models. Based on this, we propose an adversarially robust autoencoder and demonstrate its improved performance on style transfer, image denoising and anomaly detection tasks. Compared to recent ImageNet feature inversion methods, our model attains improved performance with significantly less complexity.


title: Fragile topology in nodal-line semimetal superconductors

abstract: We study the band topology of the superconducting nodal-line semimetal (SC-NLSM) protected by the inversion symmetry with and without the spin-orbital coupling. Without the spin-orbital coupling, both the $s$-wave SC-NLSM and the chiral $p$-wave SC-NLSM are topologically nontrivial and can be described by the nonzero winding number. Based on the Wilson loop method, we verify that they are both the fragile topological superconductors, namely, their nontrivial band topologies can be moved off by coupling to additional topologically trivial bands. The fragile topological phase persists in spinful system with the time-reversal symmetry when a spin-orbital coupling term is added. For the spinful system, both the $p$-wave SC-NLSM and the $s$-wave SC-NLSM are second-order fragile topological superconductors. We propose that the fragile topology in the SC-NLSM system depends strongly on the degeneracy of the Majorana zero modes and the parity of the superconducting gap function. Interestingly, in presence of a vortex line, the spinful $s$-wave SC-NLSM system hosts two pairs of stable Majorana zero modes in the vortex core.


title: Dynamics and Sensitivity of Signaling Pathways

abstract: Signaling pathways serve to communicate information about extracellular conditions into the cell, to both the nucleus and cytoplasmic processes to control cell responses. Genetic mutations in signaling network components are frequently associated with cancer and can result in cells acquiring an ability to divide and grow uncontrollably. Because signaling pathways play such a significant role in cancer initiation and advancement, their constituent proteins are attractive therapeutic targets. In this review, we discuss how signaling pathway modeling can assist with identifying effective drugs for treating diseases, such as cancer. An achievement that would facilitate the use of such models is their ability to identify controlling biochemical parameters in signaling pathways, such as molecular abundances and chemical reaction rates, because this would help determine effective points of attack by therapeutics.


title: Deciphering capacitance frequency technique for performance limiting defect state parameters in energy harvesting perovskites

abstract: With emerging thin film PIN based optoelectronics devices, a significant research thrust is focused on the passivation of trap states for performance enhancement. Among various methods, capacitance frequency technique (CFT) is often employed to quantify trap state parameters, however, the trapped charge induced electrostatic effect on the same is not yet established for such devices. Herein, we present a theoretical methodology to incorporate such effects in the CF characteristics of well-established carrier selective perovskite-based PIN devices. We show that the electrostatic effect of trapped charges leads to non-linear energy bands in perovskite layer which results in the underestimation of trap density from existing models of CFT. Consequently, a parabolic band approximation with effective length PBAEL model is developed which accurately predicts the trap density for shallow or deep states from CFT analysis. In addition, we demonstrate that the attempt to escape frequency, crucial for trapped charge dynamics with continuum energy bands, can be well extracted by eliminating non-linear effects at reduced perovskite thickness. We believe that our work provides a unified theoretical platform for CFT to extract trap state parameters for a broad class of organic and hybrid materials-based thin film devices for energy conversion applications such as solar cells, LEDs, etc.


title: Learning on Abstract Domains: A New Approach for Verifiable Guarantee in Reinforcement Learning

abstract: Formally verifying Deep Reinforcement Learning (DRL) systems is a challenging task due to the dynamic continuity of system behaviors and the black-box feature of embedded neural networks. In this paper, we propose a novel abstraction-based approach to train DRL systems on finite abstract domains instead of concrete system states. It yields neural networks whose input states are finite, making hosting DRL systems directly verifiable using model checking techniques. Our approach is orthogonal to existing DRL algorithms and off-the-shelf model checkers. We implement a resulting prototype training and verification framework and conduct extensive experiments on the state-of-the-art benchmark. The results show that the systems trained in our approach can be verified more efficiently while they retain comparable performance against those that are trained without abstraction.


title: Characterizing the Gap Between Actor-Critic and Policy Gradient

abstract: Actor-critic (AC) methods are ubiquitous in reinforcement learning. Although it is understood that AC methods are closely related to policy gradient (PG), their precise connection has not been fully characterized previously. In this paper, we explain the gap between AC and PG methods by identifying the exact adjustment to the AC objective/gradient that recovers the true policy gradient of the cumulative reward objective (PG). Furthermore, by viewing the AC method as a two-player Stackelberg game between the actor and critic, we show that the Stackelberg policy gradient can be recovered as a special case of our more general analysis. Based on these results, we develop practical algorithms, Residual Actor-Critic and Stackelberg Actor-Critic, for estimating the correction between AC and PG and use these to modify the standard AC algorithm. Experiments on popular tabular and continuous environments show the proposed corrections can improve both the sample efficiency and final performance of existing AC methods.


title: Active Learning for Network Traffic Classification: A Technical Study

abstract: Network Traffic Classification (NTC) has become an important feature in various network management operations, e.g., Quality of Service (QoS) provisioning and security services. Machine Learning (ML) algorithms as a popular approach for NTC can promise reasonable accuracy in classification and deal with encrypted traffic. However, ML-based NTC techniques suffer from the shortage of labeled traffic data which is the case in many real-world applications. This study investigates the applicability of an active form of ML, called Active Learning (AL), in NTC. AL reduces the need for a large number of labeled examples by actively choosing the instances that should be labeled. The study first provides an overview of NTC and its fundamental challenges along with surveying the literature on ML-based NTC methods. Then, it introduces the concepts of AL, discusses it in the context of NTC, and review the literature in this field. Further, challenges and open issues in AL-based classification of network traffic are discussed. Moreover, as a technical survey, some experiments are conducted to show the broad applicability of AL in NTC. The simulation results show that AL can achieve high accuracy with a small amount of data.


title: Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Task Scheduling

abstract: With the development of federated learning (FL), mobile devices (MDs) are able to train their local models with private data and sends them to a central server for aggregation, thereby preventing sensitive raw data leakage. In this paper, we aim to improve the training performance of FL systems in the context of wireless channels and stochastic energy arrivals of MDs. To this purpose, we dynamically optimize MDs' transmission power and training task scheduling. We first model this dynamic programming problem as a constrained Markov decision process (CMDP). Due to high dimensions rooted from our CMDP problem, we propose online stochastic learning methods to simplify the CMDP and design online algorithms to obtain an efficient policy for all MDs. Since there are long-term constraints in our CMDP, we utilize Lagrange multipliers approach to tackle this issue. Furthermore, we prove the convergence of the proposed online stochastic learning algorithm. Numerical results indicate that the proposed algorithms can achieve better performance than the benchmark algorithms.


title: Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction

abstract: Link prediction is a very fundamental task on graphs. Inspired by traditional path-based methods, in this paper we propose a general and flexible representation learning framework based on paths for link prediction. Specifically, we define the representation of a pair of nodes as the generalized sum of all path representations, with each path representation as the generalized product of the edge representations in the path. Motivated by the Bellman-Ford algorithm for solving the shortest path problem, we show that the proposed path formulation can be efficiently solved by the generalized Bellman-Ford algorithm. To further improve the capacity of the path formulation, we propose the Neural Bellman-Ford Network (NBFNet), a general graph neural network framework that solves the path formulation with learned operators in the generalized Bellman-Ford algorithm. The NBFNet parameterizes the generalized Bellman-Ford algorithm with 3 neural components, namely INDICATOR, MESSAGE and AGGREGATE functions, which corresponds to the boundary condition, multiplication operator, and summation operator respectively. The NBFNet is very general, covers many traditional path-based methods, and can be applied to both homogeneous graphs and multi-relational graphs (e.g., knowledge graphs) in both transductive and inductive settings. Experiments on both homogeneous graphs and knowledge graphs show that the proposed NBFNet outperforms existing methods by a large margin in both transductive and inductive settings, achieving new state-of-the-art results.


title: Advantages of a semi-implicit scheme over a fully implicit scheme for Landau-Lifshitz-Gilbert equation

abstract: Magnetization dynamics in magnetic materials is modeled by the Landau-Lifshitz-Gilbert (LLG) equation. In the LLG equation, the length of magnetization is conserved and the system energy is dissipative. Implicit and semi-implicit schemes have been used in micromagnetics simulations due to their unconditional numerical stability. In more details, implicit schemes preserve the properties of the LLG equation, but solve a nonlinear system of equations per time step. In contrast, semi-implicit schemes only solve a linear system of equations, while additional operations are needed to preserve the length of magnetization. It still remains unclear which one shall be used if both implicit and semi-implicit schemes are available. In this work, using the implicit Crank-Nicolson (ICN) scheme as a benchmark, we propose to make this implicit scheme semi-implicit. It can be proved that both schemes are second-order accurate in space and time. For the unique solvability of nonlinear systems of equations in the ICN scheme, we require that the temporal step size scales quadratically with the spatial mesh size. It is numerically verified that the convergence of the nonlinear solver becomes slower for larger temporal step size and multiple magnetization profiles are obtained for different initial guesses. The linear systems of equations in the semi-implicit CN (SICN) scheme are unconditionally uniquely solvable, and the condition that the temporal step size scales linearly with the spatial mesh size is needed in the convergence of the SICN scheme. In terms of numerical efficiency, the SICN scheme achieves the same accuracy as the ICN scheme with less computational time. Based on these results, we conclude that a semi-implicit scheme is superior to its implicit analog both theoretically and numerically, and we recommend the semi-implicit scheme in micromagnetics simulations if both methods are available.


title: Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning

abstract: Commonsense reasoning research has so far been limited to English. We aim to evaluate and improve popular multilingual language models (ML-LMs) to help advance commonsense reasoning (CSR) beyond English. We collect the Mickey Corpus, consisting of 561k sentences in 11 different languages, which can be used for analyzing and improving ML-LMs. We propose Mickey Probe, a language-agnostic probing task for fairly evaluating the common sense of popular ML-LMs across different languages. In addition, we also create two new datasets, X-CSQA and X-CODAH, by translating their English versions to 15 other languages, so that we can evaluate popular ML-LMs for cross-lingual commonsense reasoning. To improve the performance beyond English, we propose a simple yet effective method -- multilingual contrastive pre-training (MCP). It significantly enhances sentence representations, yielding a large performance gain on both benchmarks.


title: Stability enhancement of ITO-free non-inverted PTB7:PC71BM solar cell using two-step post-treated PEDOT:PSS

abstract: The conductivity and stability of specially treated PEDOT:PSS thin films are investigated. Based on the proposed treatment method, ITO-free PTB7:PC71BM organic solar cells are fabricated and the electrical properties of the cells are analyzed. It is shown that by applying a two-step post-treatment method using methanol and ethylene glycol, the conductivity of the PEDOT:PSS thin film increases from 0.9 to 1448 S/cm, and at the same time, a significant improvement of the stability of the layer over time is achieved. It is shown that after 30 days of aging under high humidity condition, the conductivity remains above 70% of its initial value, which is a remarkable result compared with the results reported in the literature. In this paper, important factors affecting the conductivity and stability of the treated layer are studied in detail. In addition, the effect of immersion time in methanol on the conductivity of the layer is also investigated and it is found that dipping times less than 3 min have no appreciable effects on the improvement of the conductivity. An ITO-free non-inverted PTB7:PC71BM solar cell is also fabricated using the proposed post-treated PEDOT:PSS thin films as the transparent anode. The power conversion efficiency of the resulting cell is 5.8%. The stability of the fabricated ITO-free cells is considerably better than the stability of the non-treated ITO-free cells or the cells made using ITO as anode.


title: Cross-Modal Attention Consistency for Video-Audio Unsupervised Learning

abstract: Cross-modal correlation provides an inherent supervision for video unsupervised representation learning. Existing methods focus on distinguishing different video clips by visual and audio representations. We human visual perception could attend to regions where sounds are made, and our auditory perception could also ground their frequencies of sounding objects, which we call bidirectional local correspondence. Such supervision is intuitive but not well explored in the contrastive learning framework. This paper introduces a pretext task, Cross-Modal Attention Consistency (CMAC), for exploring the bidirectional local correspondence property. The CMAC approach aims to align the regional attention generated purely from the visual signal with the target attention generated under the guidance of acoustic signal, and do a similar alignment for frequency grounding on the acoustic attention. Accompanied by a remoulded cross-modal contrastive loss where we consider additional within-modal interactions, the CMAC approach works effectively for enforcing the bidirectional alignment. Extensive experiments on six downstream benchmarks demonstrate that CMAC can improve the state-of-the-art performance on both visual and audio modalities.


title: Multi-spectral programmable absorbers

abstract: We designed and demonstrated a multi-spectral programmable perfect absorber that exploits two different phase-change materials. This programmability is possible by resonantly coupling two phase change materials, a Ge2Sb2Te5 layer to vanadium dioxide nanoparticles (VO2 NPs). The perfect absorption is attributed to the coalescence of gap plasmon modes excited between the NPs and waveguide cavity-like modes excited between the film and the NPs. The absorptance peak (>90%) can be tuned to four different infrared (IR) wavelengths from 1906 to 2960 nm by heating the structure to different temperatures. The perfect absorber is reconfigurable, lithography-free, large-scale, polarization-insensitive omnidirectional. Our strategy opens a new path for programmable infrared photonics.


title: Investigation of physical dose enhancement in core-shell magnetic gold nanoparticles with TOPAS simulation

abstract: The application of metal nanoparticles as sensitization materials is a common strategy that is used to study dose enhancement in radiotherapy. Recent in vitro tests have revealed that magnetic gold nanoparticles can be used in cancer therapy under a magnetic field to enhance the synergistic efficiency in radiotherapy and photothermal therapy. However, magnetic gold nanoparticles have rarely been studied as sensitization materials. In this study, we obtained further results of the sensitization properties of magnetic gold nanoparticles using the Monte Carlo method TOPAS and TOPAS-nBio. We analyzed the properties of magnetic gold nanoparticles in monoenergetic photons and brachytherapy, and we investigated whether the magnetic field contributes to the sensitization process. Our results demonstrated that the dose enhancement factor of the magnetic gold nanoparticles was 16.7% lower than that of gold nanoparticles in a single particle irradiated by monoenergetic photons. In the cell model, the difference was less than 8.1% in the cytoplasm. We revealed that the magnetic field has no detrimental effect on radiosensitization. Moreover, the sensitization properties of magnetic gold nanoparticles in a clinical brachytherapy source have been revealed for the first time.


title: A Stronger Baseline for Ego-Centric Action Detection

abstract: This technical report analyzes an egocentric video action detection method we used in the 2021 EPIC-KITCHENS-100 competition hosted in CVPR2021 Workshop. The goal of our task is to locate the start time and the end time of the action in the long untrimmed video, and predict action category. We adopt sliding window strategy to generate proposals, which can better adapt to short-duration actions. In addition, we show that classification and proposals are conflict in the same network. The separation of the two tasks boost the detection performance with high efficiency. By simply employing these strategy, we achieved 16.10\% performance on the test set of EPIC-KITCHENS-100 Action Detection challenge using a single model, surpassing the baseline method by 11.7\% in terms of average mAP.


title: Design of a passively mode-locking whispering gallery mode microaser

abstract: Ultrahigh repetition rate lasers will become vital light sources for many future technologies; however, their realization is challenging because the cavity size must be minimized. Whispering-gallery-mode (WGM) microresonators are attractive for this purpose since they allow the strong light-matter interaction usually needed to enable mode-locking. However, the optimum parameter ranges are entirely unknown since no experiments have yet been conducted. Here, we numerically investigate pulsed operation in a toroidal WGM microresonator with gain and saturable absorption (SA) to study the experimental feasibility. We show that dispersion is the key parameter for achieving passive mode-locking in this system. Moreover, the design guideline provided in this work can apply to any small resonators with gain and SA and is not limited to a specific cavity system.


title: SASICM A Multi-Task Benchmark For Subtext Recognition

abstract: Subtext is a kind of deep semantics which can be acquired after one or more rounds of expression transformation. As a popular way of expressing one's intentions, it is well worth studying. In this paper, we try to make computers understand whether there is a subtext by means of machine learning. We build a Chinese dataset whose source data comes from the popular social media (e.g. Weibo, Netease Music, Zhihu, and Bilibili). In addition, we also build a baseline model called SASICM to deal with subtext recognition. The F1 score of SASICMg, whose pretrained model is GloVe, is as high as 64.37%, which is 3.97% higher than that of BERT based model, 12.7% higher than that of traditional methods on average, including support vector machine, logistic regression classifier, maximum entropy classifier, naive bayes classifier and decision tree and 2.39% higher than that of the state-of-the-art, including MARIN and BTM. The F1 score of SASICMBERT, whose pretrained model is BERT, is 65.12%, which is 0.75% higher than that of SASICMg. The accuracy rates of SASICMg and SASICMBERT are 71.16% and 70.76%, respectively, which can compete with those of other methods which are mentioned before.


title: Optimal Status Update for Caching Enabled IoT Networks: A Dueling Deep R-Network Approach

abstract: In the Internet of Things (IoT) networks, caching is a promising technique to alleviate energy consumption of sensors by responding to users' data requests with the data packets cached in the edge caching node (ECN). However, without an efficient status update strategy, the information obtained by users may be stale, which in return would inevitably deteriorate the accuracy and reliability of derived decisions for real-time applications. In this paper, we focus on striking the balance between the information freshness, in terms of age of information (AoI), experienced by users and energy consumed by sensors, by appropriately activating sensors to update their current status. Particularly, we first depict the evolutions of the AoI with each sensor from different users' perspective with time steps of non-uniform duration, which are determined by both the users' data requests and the ECN's status update decision. Then, we formulate a non-uniform time step based dynamic status update optimization problem to minimize the long-term average cost, jointly considering the average AoI and energy consumption. To this end, a Markov Decision Process is formulated and further, a dueling deep R-network based dynamic status update algorithm is devised by combining dueling deep Q-network and tabular R-learning, with which challenges from the curse of dimensionality and unknown of the environmental dynamics can be addressed. Finally, extensive simulations are conducted to validate the effectiveness of our proposed algorithm by comparing it with five baseline deep reinforcement learning algorithms and policies.


title: Boosting Randomized Smoothing with Variance Reduced Classifiers

abstract: Randomized Smoothing (RS) is a promising method for obtaining robustness certificates by evaluating a base model under noise. In this work, we: (i) theoretically motivate why ensembles are a particularly suitable choice as base models for RS, and (ii) empirically confirm this choice, obtaining state-of-the-art results in multiple settings. The key insight of our work is that the reduced variance of ensembles over the perturbations introduced in RS leads to significantly more consistent classifications for a given input. This, in turn, leads to substantially increased certifiable radii for samples close to the decision boundary. Additionally, we introduce key optimizations which enable an up to 55-fold decrease in sample complexity of RS for predetermined radii, thus drastically reducing its computational overhead. Experimentally, we show that ensembles of only 3 to 10 classifiers consistently improve on their strongest constituting model with respect to their average certified radius (ACR) by 5% to 21% on both CIFAR10 and ImageNet, achieving a new state-of-the-art ACR of 0.86 and 1.11, respectively. We release all code and models required to reproduce our results at https://github.com/eth-sri/smoothing-ensembles.


title: Graph Neural Network-Based Anomaly Detection in Multivariate Time Series

abstract: Given high-dimensional time series data (e.g., sensor data), how can we detect anomalous events, such as system faults and attacks? More challengingly, how can we do this in a way that captures complex inter-sensor relationships, and detects and explains anomalies which deviate from these relationships? Recently, deep learning approaches have enabled improvements in anomaly detection in high-dimensional datasets; however, existing methods do not explicitly learn the structure of existing relationships between variables, or use them to predict the expected behavior of time series. Our approach combines a structure learning approach with graph neural networks, additionally using attention weights to provide explainability for the detected anomalies. Experiments on two real-world sensor datasets with ground truth anomalies show that our method detects anomalies more accurately than baseline approaches, accurately captures correlations between sensors, and allows users to deduce the root cause of a detected anomaly.


title: Two-Dimensional Superconductivity at the Titanium Sesquioxide Heterointerface

abstract: The study of exotic superconductivity in two dimensions has been a central theme in solid state and materials research communities. Experimentally exploring and identifying new fascinating interface superconductors with a high transition temperature ($T_c$) is challenging. Here, we report an experimental observation of intriguing two-dimensional superconductivity with a $T_c$ up to 3.8 K at the interface between Mott insulator Ti$_2$O$_3$ and polar semiconductor GaN. At the verge of superconductivity, we also observe a striking quantum metallic-like state, demonstrating that it is a precursor to the two-dimensional superconductivity as the temperature is decreased. Our work is the first time finding this intriguing superconducting state at the heterointerface, which not only brings a new broad of perspective on the emergent quantum phenomena at the heterointerfaces but also sheds new light on exploiting the novel heterointerface superconductivity with high-$T_c$ via heterostructure engineering.


title: How Crucial Is It for 6G Networks to Be Autonomous?

abstract: The sixth generation (6G), unlike any of the previous generations, is envisioned by 2030 to connect everything. Moreover, in addition to the new use cases, 6G is expected to support, it will need to provide a superior performance over 5G. The global connectivity, large network dimensions, users heterogeneity, extremely low-power consumption, high throughput, ultrahigh reliability, efficient network operation and maintenance, and low-latency requirements to be met by future networks inevitably necessitate the autonomy of 6G. Intelligence, facilitated mainly by the advancement of artificial intelligence (AI) techniques, is a key to achieve autonomy. In this paper, we provide a bird's-eye view of 6G, its vision, progress, and objectives. Furthermore, we present some technologies that would be mainly enabling intelligent globally connected world. In addition to discussing the role of AI for future wireless communications, we, unlike any other review papers, provide our original results which give early evidence for the viability of achieving 6G networks autonomy through leveraging AI advances. Furthermore, we, very importantly, identify 6G implementation challenges and key innovative techniques that promise to solve them. This article serves as a starting point for learners to acquire more knowledge about 6G and also for researchers to promote more development to the field.


title: An efficient way to manage ranges of data with Wise Red-Black Trees

abstract: This paper describes the most efficient way to manage operations on ranges of elements within an ordered set. The goal is to improve existing solutions, by optimizing the average-case time complexity and getting rid of heavy multiplicative constants in the worst-case, without sacrificing space complexity. This is a high-impact operation in practical applications, performed by introducing a new data structure called Wise Red-Black Tree, an augmented version of the Red-Black Tree.