title: Performance Analysis and Optimization for RIS-Assisted Multi-User Massive MIMO Systems with Imperfect Hardware

abstract: The paper studies a reconfigurable intelligent surface (RIS)-assisted multi-user uplink massive multiple-input multiple-output (MIMO) system with imperfect hardware. At the RIS, the paper considers phase noise, while at the base station, the paper takes into consideration the radio frequency impairments and low-resolution analog-to-digital converters. The paper derives approximate expressions for the ergodic achievable rate in closed forms under Rician fading channels. For the cases of infinite numbers of antennas and infinite numbers of reflecting elements, asymptotic data rates are derived to provide new design insights. The derived power scaling laws indicate that while guaranteeing a required system performance, the transmit power of the users can be scaled down at most by the factor 1/M when M goes infinite, or by the factor 1/(MN) when M and N go infinite, where M is the number of antennas and N is the number of the reflecting units. Furthermore, an optimization algorithm is proposed based on the genetic algorithm to solve the phase shift optimization problem with the aim of maximizing the sum rate of the system. Additionally, the optimization problem with discrete phase shifts is considered. Finally, numerical results are provided to validate the correctness of the analytical results.


title: Sampling Through the Lens of Sequential Decision Making

abstract: Sampling is ubiquitous in machine learning methodologies. Due to the growth of large datasets and model complexity, we want to learn and adapt the sampling process while training a representation. Towards achieving this grand goal, a variety of sampling techniques have been proposed. However, most of them either use a fixed sampling scheme or adjust the sampling scheme based on simple heuristics. They cannot choose the best sample for model training in different stages. Inspired by "Think, Fast and Slow" (System 1 and System 2) in cognitive science, we propose a reward-guided sampling strategy called Adaptive Sample with Reward (ASR) to tackle this challenge. To the best of our knowledge, this is the first work utilizing reinforcement learning (RL) to address the sampling problem in representation learning. Our approach optimally adjusts the sampling process to achieve optimal performance. We explore geographical relationships among samples by distance-based sampling to maximize overall cumulative reward. We apply ASR to the long-standing sampling problems in similarity-based loss functions. Empirical results in information retrieval and clustering demonstrate ASR's superb performance across different datasets. We also discuss an engrossing phenomenon which we name as "ASR gravity well" in experiments.


title: Maxwell field with gauge fixing term in de Sitter space: exact solution and stress tensor

abstract: The Maxwell field with a general gauge fixing (GF) term is nontrivial, not only the longitudinal and temporal modes are mixed up in the field equations, but also unwanted consequences might arise from the GF term. We derive the complete set of solutions in de Sitter space, and implement the covariant canonical quantization which restricts the residual gauge transformation down to a quantum residual gauge transformation. Then, in the Gupta-Bleuler (GB) physical state, we calculate the stress tensor which is amazingly independent of the gauge fixing constant and is also invariant under the quantum residual gauge transformation. The transverse components are simply the same as those in the Minkowski spacetime, and the transverse vacuum stress tensor has only one UV divergent term ($\propto k^4$), which becomes zero by the 0th-order adiabatic regularization. The longitudinal-temporal stress tensor in the GB state is zero due to a cancelation between the longitudinal and temporal parts. More interesting is the stress tensor of the GF term. Its particle contribution is zero due to the cancelation in the GB state, and its vacuum contribution is twice that of a minimally-coupling massless scalar field, containing $k^4$ and $k^2$ divergences. After the 2nd-order adiabatic regularization, the GF vacuum stress tensor becomes zero too, so that there is no need to introduce a ghost field, and the zero GF vacuum stress tensor can not be a possible candidate for the cosmological constant. Thus, all the physics predicted by the Maxwell field with the GF term will be the same as that without the GF term. We also carry out analogous calculation in the Minkowski spacetime, and the stress tensor is similar to, but simpler than that in de Sitter space.


title: Semi-supervised Learning with Deterministic Labeling and Large Margin Projection

abstract: The centrality and diversity of the labeled data are very influential to the performance of semi-supervised learning (SSL), but most SSL models select the labeled data randomly. This study first construct a leading forest that forms a partially ordered topological space in an unsupervised way, and select a group of most representative samples to label with one shot (differs from active learning essentially) using property of homeomorphism. Then a kernelized large margin metric is efficiently learned for the selected data to classify the remaining unlabeled sample. Optimal leading forest (OLF) has been observed to have the advantage of revealing the difference evolution along a path within a subtree. Therefore, we formulate an optimization problem based on OLF to select the samples. Also with OLF, the multiple local metrics learning is facilitated to address multi-modal and mix-modal problem in SSL, especially when the number of class is large. Attribute to this novel design, stableness and accuracy of the performance is significantly improved when compared with the state-of-the-art graph SSL methods. The extensive experimental studies have shown that the proposed method achieved encouraging accuracy and efficiency. Code has been made available at https://github.com/alanxuji/DeLaLA.


title: Joint ergodicity of piecewise monotone interval maps

abstract: For $i = 0, 1, 2, \dots, k$, let $\mu_i$ be a Borel probability measure on $[0,1]$ which is equivalent to Lebesgue measure $\lambda$ and let $T_i:[0,1] \rightarrow [0,1]$ be $\mu_i$-preserving ergodic transformations. We say that transformations $T_0, T_1, \dots, T_k$ are uniformly jointly ergodic with respect to $(\lambda; \mu_0, \mu_1, \dots, \mu_k)$ if for any $f_0, f_1, \dots, f_k \in L^{\infty}$, \[ \lim\limits_{N -M \rightarrow \infty} \frac{1}{N-M } \sum\limits_{n=M}^{N-1} f_0 ( T_0^{n} x) \cdot f_1 (T_1^n x) \cdots f_k (T_k^n x) = \prod_{i=0}^k \int f_i \, d \mu_i \quad \text{ in } L^2(\lambda). \] We establish convenient criteria for uniform joint ergodicity and obtain numerous applications, most of which deal with interval maps. Here is a description of one such application. Let $T_G$ denote the Gauss map, $T_G(x) = \frac{1}{x} \, (\bmod \, 1)$, and, for $\beta >1$, let $T_{\beta}$ denote the $\beta$-transformation defined by $T_{\beta} x = \beta x \, (\bmod \,1)$. Let $T_0$ be an ergodic interval exchange transformation. Let $\beta_1 , \cdots , \beta_k$ be distinct real numbers with $\beta_i >1$ and assume that $\log \beta_i \ne \frac{\pi^2}{6 \log 2}$ for all $i = 1, 2, \dots, k$. Then for any $f_{0}, f_1, f_{2}, \dots, f_{k+1} \in L^{\infty} (\lambda)$, \begin{equation*} \begin{split} \lim\limits_{N -M \rightarrow \infty} \frac{1}{N -M } \sum\limits_{n=M}^{N-1} & f_{0} (T_0^n x) \cdot f_{1} (T_{\beta_1}^n x) \cdots f_{k} (T_{\beta_k}^n x) \cdot f_{k+1} (T_G^n x) &= \int f_{0} \, d \lambda \cdot \prod_{i=1}^k \int f_{i} \, d \mu_{\beta_i} \cdot \int f_{k+1} \, d \mu_G \quad \text{in } L^{2}(\lambda). \end{split} \end{equation*} We also study the phenomenon of joint mixing. Among other things we establish joint mixing for skew tent maps and for restrictions of finite Blaschke products to the unit circle.


title: Correlated topological pumping of interacting bosons assisted by Bloch oscillations

abstract: Thouless pumping, not only achieving quantized transport but also immune to moderate disorder, has attracted growing attention in both experiments and theories. Here, we explore how particle-particle interactions affect topological transport in a periodically-modulated and tilted optical lattice. Not limited to wannier states, our scheme ensures a dispersionless quantized transport even for initial Gaussian-like wave packets of interacting bosons which do not uniformly occupy a given band. This is because the tilting potential leads to Bloch oscillations uniformly sampling the Berry curvatures over the entire Brillouin zone. The interplay among on-site potential difference, tunneling rate and interactions contributes to the topological transport of bound and scattering states and the topologically resonant tunnelings. Our study deepens the understanding of correlation effects on topological states, and provides a feasible way for detecting topological properties in interacting systems.


title: Efficient dynamic point cloud coding using Slice-Wise Segmentation

abstract: With the fast growth of immersive video sequences, achieving seamless and high-quality compressed 3D content is even more critical. MPEG recently developed a video-based point cloud compression (V-PCC) standard for dynamic point cloud coding. However, reconstructed point clouds using V-PCC suffer from different artifacts, including losing data during pre-processing before applying existing video coding techniques, e.g., High-Efficiency Video Coding (HEVC). Patch generations and self-occluded points in the 3D to the 2D projection are the main reasons for missing data using V-PCC. This paper proposes a new method that introduces overlapping slicing as an alternative to patch generation to decrease the number of patches generated and the amount of data lost. In the proposed method, the entire point cloud has been cross-sectioned into variable-sized slices based on the number of self-occluded points so that data loss can be minimized in the patch generation process and projection. For this, a variable number of layers are considered, partially overlapped to retain the self-occluded points. The proposed method's added advantage is to reduce the bits requirement and to encode geometric data using the slicing base position. The experimental results show that the proposed method is much more flexible than the standard V-PCC method, improves the rate-distortion performance, and decreases the data loss significantly compared to the standard V-PCC method.


title: A Mid-infrared Flare in the Seyfert Galaxy NGC 3786: A Changing-look Event Triggered by an Obscured Tidal Disruption Event?

abstract: We report an exceptional mid-infrared flare in the Seyfert 1.8 NGC 3786. In the multi-epoch data from the Wide-field Infrared Survey Explorer, the nuclear mid-infrared brightness of NGC 3786 appears to vary substantially up to $0.5-0.8$ mag around mid-2020. However, there is no evidence of significant variation in the corresponding light curve of the optical band from the Zwicky Transient Facility. This implies that the flare may have been heavily obscured by nuclear dust. Through follow-up spectroscopic observations with Gemini-North after the flare, we find that broad emission lines in ${\rm Pa}\alpha$ and ${\rm Pa}\beta$ newly appear, while the broad ${\rm H}\beta$ emission is marginally detected in the post-flare spectrum. In addition, their central wavelengths are systematically redshifted up to 900 km s$^{-1}$ with respect to the narrow emission lines. This reveals that the flare is associated with the changing-look phenomenon from type 1.8 to type 1. Based on these findings, we argue that the flare is likely to originate from an obscured tidal disruption event, although extreme variation in the accretion rate may not be ruled out completely.


title: NECE: Narrative Event Chain Extraction Toolkit

abstract: To understand a narrative, it is essential to comprehend the temporal event flows, especially those associated with main characters; however, this can be challenging with lengthy and unstructured narrative texts. To address this, we introduce NECE, an open-access, document-level toolkit that automatically extracts and aligns narrative events in the temporal order of their occurrence. Through extensive evaluations, we show the high quality of the NECE toolkit and demonstrates its downstream application in analyzing narrative bias regarding gender. We also openly discuss the shortcomings of the current approach, and potential of leveraging generative models in future works. Lastly the NECE toolkit includes both a Python library and a user-friendly web interface, which offer equal access to professionals and layman audience alike, to visualize event chain, obtain narrative flows, or study narrative bias.


title: The Physics of Quantum Information

abstract: Rapid ongoing progress in quantum information science makes this an apt time for a Solvay Conference focused on The Physics of Quantum Information. Here I review four intertwined themes encompassed by this topic: Quantum computer science, quantum hardware, quantum matter, and quantum gravity. Though the time scale for broad practical impact of quantum computation is still uncertain, in the near future we can expect noteworthy progress toward scalable fault-tolerant quantum computing, and discoveries enabled by programmable quantum simulators. In the longer term, controlling highly complex quantum matter will open the door to profound scientific advances and powerful new technologies.


title: Revisiting the propensity score's central role: Towards bridging balance and efficiency in the era of causal machine learning

abstract: About forty years ago, in a now--seminal contribution, Rosenbaum & Rubin (1983) introduced a critical characterization of the propensity score as a central quantity for drawing causal inferences in observational study settings. In the decades since, much progress has been made across several research fronts in causal inference, notably including the re-weighting and matching paradigms. Focusing on the former and specifically on its intersection with machine learning and semiparametric efficiency theory, we re-examine the role of the propensity score in modern methodological developments. As Rosenbaum & Rubin (1983)'s contribution spurred a focus on the balancing property of the propensity score, we re-examine the degree to which and how this property plays a role in the development of asymptotically efficient estimators of causal effects; moreover, we discuss a connection between the balancing property and efficient estimation in the form of score equations and propose a score test for evaluating whether an estimator achieves balance.


title: A regularized model for wetting/dewetting problems: asymptotic analysis and $\Gamma$-convergence

abstract: By introducing height dependency in the surface energy density, we propose a novel regularized variational model to simulate wetting/dewetting problems. The regularized model leads to the appearance of a precursor layer which covers the bare substrate, with the precursor height depending on the regularization parameter $\varepsilon$. The new model enjoys lots of advantages in analysis and imulations. With the help of the precursor layer, the regularized model is naturally extended to a larger domain than that of the classical sharp-interface model, and thus can be solved in a fixed domain. There is no need to explicitly track the contact line motion, and difficulties arising from free boundary problems can be avoided. In addition, topological change events can be automatically captured. Under some mild and physically meaningful conditions, we show the positivity-preserving property of the minimizers of the new model. By using asymptotic analysis and $\Gamma$-convergence, we investigate the convergence relations between the new regularized model and the classical sharp-interface model. Finally, numerical results are provided to validate our theoretical analysis, as well as the accuracy and efficiency of the new regularized model.


title: ASTRO: An AST-Assisted Approach for Generalizable Neural Clone Detection

abstract: Neural clone detection has attracted the attention of software engineering researchers and practitioners. However, most neural clone detection methods do not generalize beyond the scope of clones that appear in the training dataset. This results in poor model performance, especially in terms of model recall. In this paper, we present an Abstract Syntax Tree (AST) assisted approach for generalizable neural clone detection, or ASTRO, a framework for finding clones in codebases reflecting industry practices. We present three main components: (1) an AST-inspired representation for source code that leverages program structure and semantics, (2) a global graph representation that captures the context of an AST among a corpus of programs, and (3) a graph embedding for programs that, in combination with extant large-scale language models, improves state-of-the-art code clone detection. Our experimental results show that ASTRO improves state-of-the-art neural clone detection approaches in both recall and F-1 scores.


title: Quantum Bayesian Computation

abstract: Quantum Bayesian Computation (QBC) is an emerging field that levers the computational gains available from quantum computers to provide an exponential speed-up in Bayesian computation. Our paper adds to the literature in two ways. First, we show how von Neumann quantum measurement can be used to simulate machine learning algorithms such as Markov chain Monte Carlo (MCMC) and Deep Learning (DL) that are fundamental to Bayesian learning. Second, we describe data encoding methods needed to implement quantum machine learning including the counterparts to traditional feature extraction and kernel embeddings methods. Our goal then is to show how to apply quantum algorithms directly to statistical machine learning problems. On the theoretical side, we provide quantum versions of high dimensional regression, Gaussian processes (Q-GP) and stochastic gradient descent (Q-SGD). On the empirical side, we apply a Quantum FFT model to Chicago housing data. Finally, we conclude with directions for future research.


title: Driving force induced transition in thermal behavior of grain boundary migration in Ni

abstract: Grain boundary (GB) migration exhibits intriguing anti-thermal behavior (or non-Arrhenius behavior), with the temperature and driving force playing crucial roles. Through atomistic simulations on nickel bicrystals, we investigate the change in GB mobility with variations in both temperature and driving force. Our results reveal that the GB mobility initially increases with temperature and subsequently decreases after reaching the transition temperature (Ttrans), and, notably, Ttrans exhibits a linear relationship with the activation energy (Q) associated with GB migration. By modulating the driving force, we found that the driving force could effectively lower Q, resulting in the shift of Ttrans towards lower temperatures. Additionally, higher driving forces were found to activate more migration modes at lower temperatures, potentially leading to a transition in the thermal behavior of GB migration. Our work supports the existing theoretical models for GB migration based on both classical thermal activation and disconnection nucleation. Furthermore, we refined the existing model by incorporating the influence of the driving force. The modified model can not only describe the effect of driving force on the thermal behavior of GB migration but also accounts for the observed "anti-driving force" phenomenon in GB migration. Our research has the potential to offer valuable insights for investigating realistic GB migration under more intricate constraints and environments.


title: Proof Engineering with Predicate Transformer Semantics

abstract: We present a lightweight, open source Agda framework for manually verifying effectful programs using predicate transformer semantics. We represent the abstract syntax trees (AST) of effectful programs with a generalized algebraic datatype (GADT) AST, whose generality enables even complex operations to be primitive AST nodes. Users can then assign bespoke predicate transformers to such operations to aid the proof effort, for example by automatically decomposing proof obligations for branching code. Our framework codifies and generalizes a proof engineering methodology used by the authors to reason about a prototype implementation of LibraBFT, a Byzantine fault tolerant consensus protocol in which code executed by participants may have effects such as updating state and sending messages. Successful use of our framework in this context demonstrates its practical applicability.


title: An Efficient Multi-Step Framework for Malware Packing Identification

abstract: Malware developers use combinations of techniques such as compression, encryption, and obfuscation to bypass anti-virus software. Malware with anti-analysis technologies can bypass AI-based anti-virus software and malware analysis tools. Therefore, classifying pack files is one of the big challenges. Problems arise if the malware classifiers learn packers' features, not those of malware. Training the models with unintended erroneous data turn into poisoning attacks, adversarial attacks, and evasion attacks. Therefore, researchers should consider packing to build appropriate malware classifier models. In this paper, we propose a multi-step framework for classifying and identifying packed samples which consists of pseudo-optimal feature selection, machine learning-based classifiers, and packer identification steps. In the first step, we use the CART algorithm and the permutation importance to preselect important 20 features. In the second step, each model learns 20 preselected features for classifying the packed files with the highest performance. As a result, the XGBoost, which learned the features preselected by XGBoost with the permutation importance, showed the highest performance of any other experiment scenarios with an accuracy of 99.67%, an F1-Score of 99.46%, and an area under the curve (AUC) of 99.98%. In the third step, we propose a new approach that can identify packers only for samples classified as Well-Known Packed.


title: Scaling of kinematical, global observables, energy and entropy densities in p+p, p+Pb and Pb+Pb collisions from 0.01 to 13 TeV

abstract: The multiplicity and average transverse momentum of the charged and identified particles produced in different kinds of colliding systems are an example of global observables used to characterize events over a wide range of energy. Studying these observables provides insights into the collective phenomena and the geometric scaling properties of the systems created in ultra-relativistic p-Pb, Pb-Pb, and even in p-p collisions. The first part of this work presents a study of these variables using different Monte Carlo event generators. It analyzes their sensitivity to find collective phenomena at 0.01, 0.9, 2.76, 7, and 13 TeV, finding a less satisfactory description as the energy decreases. The second part analyzes the average transverse momentum of charged hadrons as a function of the multiplicity for p-p, p-Pb, and Pb-Pb data from the CMS and ALICE experiments. Comparing with Monte Carlo event generators, we look for a possible scaling law of average transverse momentum scaled to the overlap transverse collision area. Additionally, the experimental data are used to compute thermodynamical quantities such as the energy and entropy densities in the Bjorken approach. The results are compared with predictions from EPOS and PYTHIA Monte Carlo event generators. We observe an excellent agreement for <pT> from p-p but not for thermodynamical observables, where a sudden rise in a small <pT> range resembles the lattice QCD results for the $\epsilon/T^4$ as a function of the temperature; however, only the experimental data from p-p show a kind of saturation.


title: Invariance of plurigenera for generalized polarized pairs with abundant nef parts

abstract: We show the invariance of plurigenera for generalized polarized pairs with abundant nef parts and generalized canonical singularities. This is obtained by investigating a type of newly introduced multiplier ideal sheaf which is of bimeromorphic nature.


title: Nanoscale three-dimensional magnetic sensing with a probabilistic nanomagnet driven by spin-orbit torque

abstract: Detection of vector magnetic fields at nanoscale dimensions is critical in applications ranging from basic material science, to medical diagnostic. Meanwhile, an all-electric operation is of great significance for achieving a simple and compact sensing system. Here, we propose and experimentally demonstrate a simple approach to sensing a vector magnetic field at nanoscale dimensions, by monitoring a probabilistic nanomagnet's transition probability from a metastable state, excited by a driving current due to SOT, to a settled state. We achieve sensitivities for Hx, Hy, and Hz of 1.02%/Oe, 1.09%/Oe and 3.43%/Oe, respectively, with a 200 x 200 nm^2 nanomagnet. The minimum detectable field is dependent on the driving pulse events N, and is expected to be as low as 1 uT if N = 3 x 10^6.


title: Structural and optical properties of micro-diamonds with SiV- color centers

abstract: Isolated, micro-meter sized diamonds are grown by micro-wave plasma chemical vapour deposition technique on Si(001) substrates. Each diamond is uniquely identified by markers milled in the Si substrate by Ga+ focused ion beam. The morphology and micrograin structure analysis indicates that the diamonds are icosahedral or bi-crystals. Icosahedral diamonds have higher (up to $\sigma_\mathrm{h}$ = 2.3 GPa), and wider distribution ($\Delta\sigma_\mathrm{h}$ = 4.47 GPa) of hydrostatic stress built up at the microcrystal grain boundaries, compared to the other crystals. The number and spectral shape of SiV- color centers incorporated in the micro-diamonds is analysed, and estimated by means of temperature dependent photoluminescence measurements, and Montecarlo simulations. The Montecarlo simulations indicate that the number of SiV- color centers is a few thousand per micro-diamond.


title: Significance of Skeleton-based Features in Virtual Try-On

abstract: The idea of \textit{Virtual Try-ON} (VTON) benefits e-retailing by giving an user the convenience of trying a clothing at the comfort of their home. In general, most of the existing VTON methods produce inconsistent results when a person posing with his arms folded i.e., bent or crossed, wants to try an outfit. The problem becomes severe in the case of long-sleeved outfits. As then, for crossed arm postures, overlap among different clothing parts might happen. The existing approaches, especially the warping-based methods employing \textit{Thin Plate Spline (TPS)} transform can not tackle such cases. To this end, we attempt a solution approach where the clothing from the source person is segmented into semantically meaningful parts and each part is warped independently to the shape of the person. To address the bending issue, we employ hand-crafted geometric features consistent with human body geometry for warping the source outfit. In addition, we propose two learning-based modules: a synthesizer network and a mask prediction network. All these together attempt to produce a photo-realistic, pose-robust VTON solution without requiring any paired training data. Comparison with some of the benchmark methods clearly establishes the effectiveness of the approach.


title: Natural cubic splines for the analysis of Alzheimer's clinical trials

abstract: Mixed model repeated measures (MMRM) is the most common analysis approach used in clinical trials for Alzheimer's disease and other progressive diseases measured with continuous outcomes measured over time. The model treats time as a categorical variable, which allows an unconstrained estimate of the mean for each study visit in each randomized group. Categorizing time in this way can be problematic when assessments occur off-schedule, as including off-schedule visits can induce bias, and excluding them ignores valuable information and violates the intention to treat principle. This problem has been exacerbated by clinical trial visits which have been delayed due to the COVID19 pandemic. As an alternative to MMRM, we propose a constrained longitudinal data analysis with natural cubic splines that treats time as continuous and uses test version effects to model the mean over time. The spline model is shown to be superior, in practice and simulation studies, to categorical-time models like MMRM and models that assume a proportional treatment effect.


title: Look in Different Views: Multi-Scheme Regression Guided Cell Instance Segmentation

abstract: Cell instance segmentation is a new and challenging task aiming at joint detection and segmentation of every cell in an image. Recently, many instance segmentation methods have applied in this task. Despite their great success, there still exists two main weaknesses caused by uncertainty of localizing cell center points. First, densely packed cells can easily be recognized into one cell. Second, elongated cell can easily be recognized into two cells. To overcome these two weaknesses, we propose a novel cell instance segmentation network based on multi-scheme regression guidance. With multi-scheme regression guidance, the network has the ability to look each cell in different views. Specifically, we first propose a gaussian guidance attention mechanism to use gaussian labels for guiding the network's attention. We then propose a point-regression module for assisting the regression of cell center. Finally, we utilize the output of the above two modules to further guide the instance segmentation. With multi-scheme regression guidance, we can take full advantage of the characteristics of different regions, especially the central region of the cell. We conduct extensive experiments on benchmark datasets, DSB2018, CA2.5 and SCIS. The encouraging results show that our network achieves SOTA (state-of-the-art) performance. On the DSB2018 and CA2.5, our network surpasses previous methods by 1.2% (AP50). Particularly on SCIS dataset, our network performs stronger by large margin (3.0% higher AP50). Visualization and analysis further prove that our proposed method is interpretable.


title: Hawking radiation from acoustic black holes in hydrodynamic flow of electrons

abstract: Acoustic black holes are formed when a fluid flowing with subsonic velocities, accelerates and becomes supersonic. When the flow is directed from the subsonic to supersonic region, the surface on which the normal component of fluid velocity equals the local speed of sound acts as an acoustic horizon. This is because no acoustic perturbation from the supersonic region can cross it to reach the subsonic part of the fluid. One can show that if the fluid velocity is locally irrotational, the field equations for acoustic perturbations of the velocity potential are identical to that of a massless scalar field propagating in a black hole background. One, therefore, expects Hawking radiation in the form of a thermal spectrum of phonons. There have been numerous investigations of this possibility, theoretically, as well as experimentally, in systems ranging from cold atom systems to quark-gluon plasma formed in relativistic heavy-ion collisions. Here we investigate this possibility in the hydrodynamic flow of electrons. Resulting Hawking radiation in this case should be observable in terms of current fluctuations. Further, current fluctuations on both sides of the acoustic horizon should show correlations expected for pairs of Hawking particles.


title: Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides

abstract: Lecture slide presentations, a sequence of pages that contain text and figures accompanied by speech, are constructed and presented carefully in order to optimally transfer knowledge to students. Previous studies in multimedia and psychology attribute the effectiveness of lecture presentations to their multimodal nature. As a step toward developing AI to aid in student learning as intelligent teacher assistants, we introduce the Multimodal Lecture Presentations dataset as a large-scale benchmark testing the capabilities of machine learning models in multimodal understanding of educational content. Our dataset contains aligned slides and spoken language, for 180+ hours of video and 9000+ slides, with 10 lecturers from various subjects (e.g., computer science, dentistry, biology). We introduce two research tasks which are designed as stepping stones towards AI agents that can explain (automatically captioning a lecture presentation) and illustrate (synthesizing visual figures to accompany spoken explanations) educational content. We provide manual annotations to help implement these two research tasks and evaluate state-of-the-art models on them. Comparing baselines and human student performances, we find that current models struggle in (1) weak crossmodal alignment between slides and spoken text, (2) learning novel visual mediums, (3) technical language, and (4) long-range sequences. Towards addressing this issue, we also introduce PolyViLT, a multimodal transformer trained with a multi-instance learning loss that is more effective than current approaches. We conclude by shedding light on the challenges and opportunities in multimodal understanding of educational presentations.


title: Intrinsic Instabilities in Fermi Glasses

abstract: We study in this paper the effect of weak, short-ranged interaction on disordered metals. Through analysing the interaction matrix elements between different eigenstates of the non-interacting and corresponding Hartree-Fock single-particle Hamiltonian, we argue that as a result of localized single-particle eigenstates around the Fermi surface, the quasi-particle states on the Fermi surface are unstable towards formation of magnetic moments for arbitrary weak (but finite) repulsive interaction in the thermodynamic limit. This is a mechanism very different from the case of strong interaction $U\sim W_B$ ($W_B=$ bandwidth) or the quantum Griffiths effect where local moments are formed at small localized regions where coupling to the surrounding is weak. Numerical simulations are performed to verify our analysis. We further propose within a Landau Fermi-liquid-type framework that our result is applicable for general electronic systems with weak, short-ranged interaction as long as the quasi-particle states exist and are localized. An analogous result is obtained for attractive interaction, suggesting that Fermi glass state is intrinsically unstable in arbitrary dimension.


title: A Hybrid SFANC-FxNLMS Algorithm for Active Noise Control based on Deep Learning

abstract: The selective fixed-filter active noise control (SFANC) method selecting the best pre-trained control filters for various types of noise can achieve a fast response time. However, it may lead to large steady-state errors due to inaccurate filter selection and the lack of adaptability. In comparison, the filtered-X normalized least-mean-square (FxNLMS) algorithm can obtain lower steady-state errors through adaptive optimization. Nonetheless, its slow convergence has a detrimental effect on dynamic noise attenuation. Therefore, this paper proposes a hybrid SFANC-FxNLMS approach to overcome the adaptive algorithm's slow convergence and provide a better noise reduction level than the SFANC method. A lightweight one-dimensional convolutional neural network (1D CNN) is designed to automatically select the most suitable pre-trained control filter for each frame of the primary noise. Meanwhile, the FxNLMS algorithm continues to update the coefficients of the chosen pre-trained control filter at the sampling rate. Owing to the effective combination of the two algorithms, experimental results show that the hybrid SFANC-FxNLMS algorithm can achieve a rapid response time, a low noise reduction error, and a high degree of robustness.


title: Two Heads are Better than One: Robust Learning Meets Multi-branch Models

abstract: Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may significantly reduce the vulnerability of neural networks and becomes the de facto standard for robust learning. While many recent works practice the data-centric philosophy, such as how to generate better adversarial examples or use generative models to produce additional training data, we look back to the models themselves and revisit the adversarial robustness from the perspective of deep feature distribution as an insightful complementarity. In this paper, we propose Branch Orthogonality adveRsarial Training (BORT) to obtain state-of-the-art performance with solely the original dataset for adversarial training. To practice our design idea of integrating multiple orthogonal solution spaces, we leverage a simple and straightforward multi-branch neural network that eclipses adversarial attacks with no increase in inference time. We heuristically propose a corresponding loss function, branch-orthogonal loss, to make each solution space of the multi-branch model orthogonal. We evaluate our approach on CIFAR-10, CIFAR-100, and SVHN against \ell_{\infty} norm-bounded perturbations of size \epsilon = 8/255, respectively. Exhaustive experiments are conducted to show that our method goes beyond all state-of-the-art methods without any tricks. Compared to all methods that do not use additional data for training, our models achieve 67.3% and 41.5% robust accuracy on CIFAR-10 and CIFAR-100 (improving upon the state-of-the-art by +7.23% and +9.07%). We also outperform methods using a training set with a far larger scale than ours. All our models and codes are available online at https://github.com/huangd1999/BORT.


title: AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets

abstract: This paper studies the Binary Neural Networks (BNNs) in which weights and activations are both binarized into 1-bit values, thus greatly reducing the memory usage and computational complexity. Since the modern deep neural networks are of sophisticated design with complex architecture for the accuracy reason, the diversity on distributions of weights and activations is very high. Therefore, the conventional sign function cannot be well used for effectively binarizing full-precision values in BNNs. To this end, we present a simple yet effective approach called AdaBin to adaptively obtain the optimal binary sets $\{b_1, b_2\}$ ($b_1, b_2\in \mathbb{R}$) of weights and activations for each layer instead of a fixed set (\textit{i.e.}, $\{-1, +1\}$). In this way, the proposed method can better fit different distributions and increase the representation ability of binarized features. In practice, we use the center position and distance of 1-bit values to define a new binary quantization function. For the weights, we propose an equalization method to align the symmetrical center of binary distribution to real-valued distribution, and minimize the Kullback-Leibler divergence of them. Meanwhile, we introduce a gradient-based optimization method to get these two parameters for activations, which are jointly trained in an end-to-end manner. Experimental results on benchmark models and datasets demonstrate that the proposed AdaBin is able to achieve state-of-the-art performance. For instance, we obtain a 66.4% Top-1 accuracy on the ImageNet using ResNet-18 architecture, and a 69.4 mAP on PASCAL VOC using SSD300. The PyTorch code is available at \url{https://github.com/huawei-noah/Efficient-Computing/tree/master/BinaryNetworks/AdaBin} and the MindSpore code is available at \url{https://gitee.com/mindspore/models/tree/master/research/cv/AdaBin}.


title: Detection and Mitigation of Byzantine Attacks in Distributed Training

abstract: A plethora of modern machine learning tasks require the utilization of large-scale distributed clusters as a critical component of the training pipeline. However, abnormal Byzantine behavior of the worker nodes can derail the training and compromise the quality of the inference. Such behavior can be attributed to unintentional system malfunctions or orchestrated attacks; as a result, some nodes may return arbitrary results to the parameter server (PS) that coordinates the training. Recent work considers a wide range of attack models and has explored robust aggregation and/or computational redundancy to correct the distorted gradients. In this work, we consider attack models ranging from strong ones: $q$ omniscient adversaries with full knowledge of the defense protocol that can change from iteration to iteration to weak ones: $q$ randomly chosen adversaries with limited collusion abilities which only change every few iterations at a time. Our algorithms rely on redundant task assignments coupled with detection of adversarial behavior. We also show the convergence of our method to the optimal point under common assumptions and settings considered in literature. For strong attacks, we demonstrate a reduction in the fraction of distorted gradients ranging from 16%-99% as compared to the prior state-of-the-art. Our top-1 classification accuracy results on the CIFAR-10 data set demonstrate 25% advantage in accuracy (averaged over strong and weak scenarios) under the most sophisticated attacks compared to state-of-the-art methods.


title: Implementation of Multi-channel Active Noise Control based on Back-propagation Mechanism

abstract: Active noise control (ANC) systems can efficiently attenuate low-frequency noises by introducing anti-noises to combine with the unwanted noises. In ANC systems, the filtered-x least mean square (FxLMS) and filtered-X normalized least-mean-square (FxNLMS) algorithm are well-known algorithms for adaptively adjusting control filters. Multi-channel ANC systems are typically required to attenuate unwanted noises in a large space. However, open-source implementations of the multi-channel FxLMS (McFxLMS) and multi-channel FxNLMS (McFxNLMS) algorithm continue to be scarce. Therefore, this paper proposes a simple and effective implementation approach of the McFxLMS and McFxNLMS algorithm. Motivated by the back-propagation process during neural network training, the McFxLMS and McFxNLMS algorithm can be implemented via automatic derivation mechanism. We implemented the two algorithms using the automatic derivation mechanism in PyTorch and made the source code available on GitHub. This implementation method can improve the practicality of multi-channel ANC systems, which is expected to be widely used in ANC applications.


title: Autonomous Resource Management in Construction Companies Using Deep Reinforcement Learning Based on IoT

abstract: Resource allocation is one of the most critical issues in planning construction projects, due to its direct impact on cost, time, and quality. There are usually specific allocation methods for autonomous resource management according to the projects objectives. However, integrated planning and optimization of utilizing resources in an entire construction organization are scarce. The purpose of this study is to present an automatic resource allocation structure for construction companies based on Deep Reinforcement Learning (DRL), which can be used in various situations. In this structure, Data Harvesting (DH) gathers resource information from the distributed Internet of Things (IoT) sensor devices all over the companys projects to be employed in the autonomous resource management approach. Then, Coverage Resources Allocation (CRA) is compared to the information obtained from DH in which the Autonomous Resource Management (ARM) determines the project of interest. Likewise, Double Deep Q-Networks (DDQNs) with similar models are trained on two distinct assignment situations based on structured resource information of the company to balance objectives with resource constraints. The suggested technique in this paper can efficiently adjust to large resource management systems by combining portfolio information with adopted individual project information. Also, the effects of important information processing parameters on resource allocation performance are analyzed in detail. Moreover, the results of the generalizability of management approaches are presented, indicating no need for additional training when the variables of situations change.


title: AutoTSMM: An Auto-tuning Framework for Building High-Performance Tall-and-Skinny Matrix-Matrix Multiplication on CPUs

abstract: In recent years, general matrix-matrix multiplication with non-regular-shaped input matrices has been widely used in many applications like deep learning and has drawn more and more attention. However, conventional implementations are not suited for non-regular-shaped matrix-matrix multiplications, and few works focus on optimizing tall-and-skinny matrix-matrix multiplication on CPUs. This paper proposes an auto-tuning framework, AutoTSMM, to build high-performance tall-and-skinny matrix-matrix multiplication. AutoTSMM selects the optimal inner kernels in the install-time stage and generates an execution plan for the pre-pack tall-and-skinny matrix-matrix multiplication in the runtime stage. Experiments demonstrate that AutoTSMM achieves competitive performance comparing to state-of-the-art tall-and-skinny matrix-matrix multiplication. And, it outperforms all conventional matrix-matrix multiplication implementations.


title: Constrained Few-Shot Learning: Human-Like Low Sample Complexity Learning and Non-Episodic Text Classification

abstract: Few-shot learning (FSL) is an emergent paradigm of learning that attempts to learn to reason with low sample complexity to mimic the way humans learn, generalise and extrapolate from only a few seen examples. While FSL attempts to mimic these human characteristics, fundamentally, the task of FSL as conventionally formulated using meta-learning with episodic-based training does not in actuality align with how humans acquire and reason with knowledge. FSL with episodic training, while only requires $K$ instances of each test class, still requires a large number of labelled training instances from disjoint classes. In this paper, we introduce the novel task of constrained few-shot learning (CFSL), a special case of FSL where $M$, the number of instances of each training class is constrained such that $M \leq K$ thus applying a similar restriction during FSL training and test. We propose a method for CFSL leveraging Cat2Vec using a novel categorical contrastive loss inspired by cognitive theories such as fuzzy trace theory and prototype theory.


title: Progressive Cross-modal Knowledge Distillation for Human Action Recognition

abstract: Wearable sensor-based Human Action Recognition (HAR) has achieved remarkable success recently. However, the accuracy performance of wearable sensor-based HAR is still far behind the ones from the visual modalities-based system (i.e., RGB video, skeleton, and depth). Diverse input modalities can provide complementary cues and thus improve the accuracy performance of HAR, but how to take advantage of multi-modal data on wearable sensor-based HAR has rarely been explored. Currently, wearable devices, i.e., smartwatches, can only capture limited kinds of non-visual modality data. This hinders the multi-modal HAR association as it is unable to simultaneously use both visual and non-visual modality data. Another major challenge lies in how to efficiently utilize multimodal data on wearable devices with their limited computation resources. In this work, we propose a novel Progressive Skeleton-to-sensor Knowledge Distillation (PSKD) model which utilizes only time-series data, i.e., accelerometer data, from a smartwatch for solving the wearable sensor-based HAR problem. Specifically, we construct multiple teacher models using data from both teacher (human skeleton sequence) and student (time-series accelerometer data) modalities. In addition, we propose an effective progressive learning scheme to eliminate the performance gap between teacher and student models. We also designed a novel loss function called Adaptive-Confidence Semantic (ACS), to allow the student model to adaptively select either one of the teacher models or the ground-truth label it needs to mimic. To demonstrate the effectiveness of our proposed PSKD method, we conduct extensive experiments on Berkeley-MHAD, UTD-MHAD, and MMAct datasets. The results confirm that the proposed PSKD method has competitive performance compared to the previous mono sensor-based HAR methods.


title: In-vehicle alertness monitoring for older adults

abstract: Alertness monitoring in the context of driving improves safety and saves lives. Computer vision based alertness monitoring is an active area of research. However, the algorithms and datasets that exist for alertness monitoring are primarily aimed at younger adults (18-50 years old). We present a system for in-vehicle alertness monitoring for older adults. Through a design study, we ascertained the variables and parameters that are suitable for older adults traveling independently in Level 5 vehicles. We implemented a prototype traveler monitoring system and evaluated the alertness detection algorithm on ten older adults (70 years and older). We report on the system design and implementation at a level of detail that is suitable for the beginning researcher or practitioner. Our study suggests that dataset development is the foremost challenge for developing alertness monitoring systems targeted at older adults. This study is the first of its kind for a hitherto under-studied population and has implications for future work on algorithm development and system design through participatory methods.


title: Paint2Pix: Interactive Painting based Progressive Image Synthesis and Editing

abstract: Controllable image synthesis with user scribbles is a topic of keen interest in the computer vision community. In this paper, for the first time we study the problem of photorealistic image synthesis from incomplete and primitive human paintings. In particular, we propose a novel approach paint2pix, which learns to predict (and adapt) "what a user wants to draw" from rudimentary brushstroke inputs, by learning a mapping from the manifold of incomplete human paintings to their realistic renderings. When used in conjunction with recent works in autonomous painting agents, we show that paint2pix can be used for progressive image synthesis from scratch. During this process, paint2pix allows a novice user to progressively synthesize the desired image output, while requiring just few coarse user scribbles to accurately steer the trajectory of the synthesis process. Furthermore, we find that our approach also forms a surprisingly convenient approach for real image editing, and allows the user to perform a diverse range of custom fine-grained edits through the addition of only a few well-placed brushstrokes. Supplemental video and demo are available at https://1jsingh.github.io/paint2pix


title: Near Threshold Computation of Partitioned Ring Learning With Error (RLWE) Post Quantum Cryptography on Reconfigurable Architecture

abstract: Ring Learning With Error (RLWE) algorithm is used in Post Quantum Cryptography (PQC) and Homomorphic Encryption (HE) algorithm. The existing classical crypto algorithms may be broken in quantum computers. The adversaries can store all encrypted data. While the quantum computer will be available, these encrypted data can be exposed by the quantum computer. Therefore, the PQC algorithms are an essential solution in recent applications. On the other hand, the HE allows operations on encrypted data which is appropriate for getting services from third parties without revealing confidential plain-texts. The FPGA based PQC and HE hardware accelerators like RLWE is much cost-effective than processor based platform and Application Specific Integrated Circuit (ASIC). FPGA based hardware accelerators still consume more power compare to ASIC based design. Near Threshold Computation (NTC) may be a convenient solution for FPGA based RLWE implementation. In this paper, we have implemented RLWE hardware accelerator which has 14 subcomponents. This paper creates clusters based on the critical path of all 14 subcomponents. Each cluster is implemented in an FPGA partition which has the same biasing voltage $V_{ccint}$. The clusters that have higher critical paths use higher Vccint to avoid timing failure. The clusters have lower critical paths use lower biasing voltage Vccint. This voltage scaled, partitioned RLWE can save ~6% and ~11% power in Vivado and VTR platform respectively. The resource usage and throughput of the implemented RLWE hardware accelerator is comparatively better than existing literature.


title: SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation

abstract: This paper introduces a novel Self-supervised Fine-grained Dialogue Evaluation framework (SelF-Eval). The core idea is to model the correlation between turn quality and the entire dialogue quality. We first propose a novel automatic data construction method that can automatically assign fine-grained scores for arbitrarily dialogue data. Then we train \textbf{SelF-Eval} with a multi-level contrastive learning schema which helps to distinguish different score levels. Experimental results on multiple benchmarks show that SelF-Eval is highly consistent with human evaluations and better than the state-of-the-art models. We give a detailed analysis of the experiments in this paper. Our code is available on GitHub.


title: Computing the strong metric dimension for co-maximal ideal graphs of commutative rings

abstract: Let $R$ be a commutative ring with identity. The co-maximal ideal graph of $R$, denoted by $\Gamma(R)$, is a simple graph whose vertices are proper ideals of $R$ which are not contained in the Jacobson radical of $R$ and two distinct vertices $I, J$ are adjacent if and only if $I+J=R$. In this paper, we use Gallai$^{^,}$s Theorem and the concept of strong resolving graph to compute the strong metric dimension for co-maximal ideal graphs of commutative rings. Explicit formulae for the strong metric dimension, depending on whether the ring is reduced or not, are established.


title: Spin-Hall magnetoresistance in quasi-two-dimensional antiferromagnetic insulator/metal bilayer systems

abstract: We study the temperature dependence of spin Hall magnetoresistance (SMR) in antiferromagnetic insulator (AFI)/metal bilayer systems. We calculate the amplitude of the SMR signal by using a quantum Monte Carlo simulation and examine how the SMR depends on the amplitude of the spin, thickness of the AFI layer, and randomness of the exchange interactions. Our results for simple quantum spin models provide a useful starting point for understanding SMR measurements on atomic layers of magnetic compounds.


title: Brain Topography Adaptive Network for Satisfaction Modeling in Interactive Information Access System

abstract: With the growth of information on the Web, most users heavily rely on information access systems (e.g., search engines, recommender systems, etc.) in their daily lives. During this procedure, modeling users' satisfaction status plays an essential part in improving their experiences with the systems. In this paper, we aim to explore the benefits of using Electroencephalography (EEG) signals for satisfaction modeling in interactive information access system design. Different from existing EEG classification tasks, the arisen of satisfaction involves multiple brain functions, such as arousal, prototypicality, and appraisals, which are related to different brain topographical areas. Thus modeling user satisfaction raises great challenges to existing solutions. To address this challenge, we propose BTA, a Brain Topography Adaptive network with a multi-centrality encoding module and a spatial attention mechanism module to capture cognitive connectivities in different spatial distances. We explore the effectiveness of BTA for satisfaction modeling in two popular information access scenarios, i.e., search and recommendation. Extensive experiments on two real-world datasets verify the effectiveness of introducing brain topography adaptive strategy in satisfaction modeling. Furthermore, we also conduct search result re-ranking task and video rating prediction task based on the satisfaction inferred from brain signals on search and recommendation scenarios, respectively. Experimental results show that brain signals extracted with BTA help improve the performance of interactive information access systems significantly.


title: Conceptual and technical challenges of quantum gravity

abstract: The appearance of infinity together with collapsing quantum state due to the observation or interaction, which are two challenging features of quantum field theory, become very serious problems in quantum gravity as well as in quantum geometry of space-time. These problems can be divided into two categories: technical and conceptual parts. In the technical aspect, the biggest problem comes from the definition of the point, which constructs classical geometry. By changing the point definition, the technical problem may be approximately bypassed, and a mathematical formulation of quantum geometry may be found. On the other hand, the conceptual problem comes from the quantum state collapse due to the observation since the entanglement between the observer and gravity cannot be eliminated in the presence of gravity. The conceptual part does not depend on the techniques which are employed. As much as possible, we try to discuss these problems by rediscovering the perception and understanding of a phenomenon for an observer in quantum theory.


title: Fuse and Mix: MACAM-Enabled Analog Activation for Energy-Efficient Neural Acceleration

abstract: Analog computing has been recognized as a promising low-power alternative to digital counterparts for neural network acceleration. However, conventional analog computing is mainly in a mixed-signal manner. Tedious analog/digital (A/D) conversion cost significantly limits the overall system's energy efficiency. In this work, we devise an efficient analog activation unit with magnetic tunnel junction (MTJ)-based analog content-addressable memory (MACAM), simultaneously realizing nonlinear activation and A/D conversion in a fused fashion. To compensate for the nascent and therefore currently limited representation capability of MACAM, we propose to mix our analog activation unit with digital activation dataflow. A fully differential framework, SuperMixer, is developed to search for an optimized activation workload assignment, adaptive to various activation energy constraints. The effectiveness of our proposed methods is evaluated on a silicon photonic accelerator. Compared to standard activation implementation, our mixed activation system with the searched assignment can achieve competitive accuracy with $>$60% energy saving on A/D conversion and activation.


title: CommitBART: A Large Pre-trained Model for GitHub Commits

abstract: GitHub commits, which record the code changes with natural language messages for description, play a critical role for software developers to comprehend the software evolution. To promote the development of the open-source software community, we collect a commit benchmark including over 7.99 million commits across 7 programming languages. Based on this benchmark, we present CommitBART, a large pre-trained encoder-decoder Transformer model for GitHub commits. The model is pre-trained by three categories (i.e., denoising objectives, cross-modal generation and contrastive learning) for six pre-training tasks to learn commit fragment representations. Furthermore, we unify a ``commit intelligence'' framework with one understanding task and three generation tasks for commits. The comprehensive experiments on these tasks demonstrate that CommitBARTsignificantly outperforms previous pre-trained works for code. Further analysis also reveals each pre-training task enhances the model performance.


title: Can primordial parity violation explain the observed cosmic birefringence?

abstract: Recently, the cross-correlation between $E$- and $B$-mode polarization of the cosmic microwave background (CMB), which is well explained by cosmic birefringence with rotation angle $\beta\approx 0.3$ deg, has been found in CMB polarization data. We carefully investigate the possibility of explaining the observed $EB$ correlation by the primordial chiral gravitational waves (CGWs), which can be generated in the parity-violating theories in the primordial Universe. We found that the CGWs scenario does not work due to the overproduction of the $BB$ auto-correlation which far exceeds the observed one by SPTPol and POLARBEAR.


title: Exciton manifolds in highly ambipolar doped WS2

abstract: The disentanglement of single and many particle properties in 2D semiconductors and their dependencies on high carrier concentration is challenging to experimentally study by pure optical means. We establish an electrolyte gated WS2 monolayer field-effect structure capable to shift the Fermi level from the valence into the conduction band suitable to optically trace exciton binding as well as the single particle band gap energies in the weakly doped regime. Combined spectroscopic imaging ellipsometry and photoluminescence spectroscopies spanning large n- and p-type doping with charge carrier densities up to 10^14 cm-2 enable to study screening phenomena and doping dependent evolution of the rich exciton manifold whose origin is controversially discussed in literature. We show that the two most prominent emission bands in photoluminescence experiments are due to the recombination of spin-forbidden and momentum-forbidden charge neutral excitons activated by phonons. The observed interband transitions are redshifted and drastically weakened under electron or hole doping. This field-effect platform is not only suitable for studying exciton manifold but is also suitable for combined optical and transport measurements on degenerately doped atomically thin quantum materials at cryogenic temperatures.


title: Existence and stability of interfacial capillary-gravity solitary waves with constant vorticity

abstract: In this paper, we consider capillary-gravity waves propagating on the interface separating two fluids of finite depth and constant density. The flow in each layer is assumed to be incompressible and of constant vorticity. We prove the existence of small-amplitude solitary wave solutions to this system in the strong surface tension regime via a spatial dynamics approach. We then use a variant of the classical Grillakis--Shatah--Strauss (GSS) method to study the orbital stability/instability of these waves. We find an explicit function of the parameters (Froude number, Bond number, and the depth and density ratios) that characterizes the stability properties. In particular, conditionally orbitally stable and unstable waves are shown to be possible.


title: Understanding Attention for Vision-and-Language Tasks

abstract: Attention mechanism has been used as an important component across Vision-and-Language(VL) tasks in order to bridge the semantic gap between visual and textual features. While attention has been widely used in VL tasks, it has not been examined the capability of different attention alignment calculation in bridging the semantic gap between visual and textual clues. In this research, we conduct a comprehensive analysis on understanding the role of attention alignment by looking into the attention score calculation methods and check how it actually represents the visual region's and textual token's significance for the global assessment. We also analyse the conditions which attention score calculation mechanism would be more (or less) interpretable, and which may impact the model performance on three different VL tasks, including visual question answering, text-to-image generation, text-and-image matching (both sentence and image retrieval). Our analysis is the first of its kind and provides useful insights of the importance of each attention alignment score calculation when applied at the training phase of VL tasks, commonly ignored in attention-based cross modal models, and/or pretrained models. Our code is available at: https://github.com/adlnlp/Attention_VL


title: Reach-avoid Verification Based on Convex Optimization

abstract: In this paper we propose novel optimization-based methods for verifying reach-avoid (or, eventuality) properties of continuous-time systems modelled by ordinary differential equations. Given a system, an initial set, a safe set and a target set of states, we say that the reach-avoid property holds if for all initial conditions in the initial set, any trajectory of the system starting at them will eventually, i.e.\ in unbounded yet finite time, enter the target set while remaining inside the safe set until that first target hit. Based on a discount value function, two sets of quantified constraints are derived for verifying the reach-avoid property via the computation of exponential/asymptotic guidance-barrier functions (they form a barrier escorting the system to the target set safely at an exponential or asymptotic rate). It is interesting to find that one set of constraints whose solution is termed exponential guidance-barrier functions is just a simplified version of the existing one derived from the moment based method, while the other one whose solution is termed asymptotic guidance-barrier functions is completely new. Furthermore, built upon this new set of constraints, we derive a set of more expressive constraints, which includes the aforementioned two sets of constraints as special instances, providing more chances for verifying the reach-avoid properties successfully. When the involved datum are polynomials, i.e., the initial set, safe set and target set are semi-algebraic, and the system has polynomial dynamics, the problem of solving these sets of constraints can be framed as a semi-definite optimization problem using sum-of-squares decomposition techniques and thus can be efficiently solved in polynomial time via interior point methods. Finally, several examples demonstrate the theoretical developments and performance of proposed methods.


title: Disentangling Identity and Pose for Facial Expression Recognition

abstract: Facial expression recognition (FER) is a challenging problem because the expression component is always entangled with other irrelevant factors, such as identity and head pose. In this work, we propose an identity and pose disentangled facial expression recognition (IPD-FER) model to learn more discriminative feature representation. We regard the holistic facial representation as the combination of identity, pose and expression. These three components are encoded with different encoders. For identity encoder, a well pre-trained face recognition model is utilized and fixed during training, which alleviates the restriction on specific expression training data in previous works and makes the disentanglement practicable on in-the-wild datasets. At the same time, the pose and expression encoder are optimized with corresponding labels. Combining identity and pose feature, a neutral face of input individual should be generated by the decoder. When expression feature is added, the input image should be reconstructed. By comparing the difference between synthesized neutral and expressional images of the same individual, the expression component is further disentangled from identity and pose. Experimental results verify the effectiveness of our method on both lab-controlled and in-the-wild databases and we achieve state-of-the-art recognition performance.


title: Symmetry restoration in the vicinity of neutron stars with a nonminimal coupling

abstract: We propose a new model of scalarized neutron stars (NSs) realized by a self-interacting scalar field $\phi$ nonminimally coupled to the Ricci scalar $R$ of the form $F(\phi)R$. The scalar field has a self-interacting potential and sits at its vacuum expectation value $\phi_v$ far away from the source. Inside the NS, the dominance of a positive nonminimal coupling over a negative mass squared of the potential leads to a symmetry restoration with the central field value $\phi_c$ close to $0$. This allows the existence of scalarized NS solutions connecting $\phi_v$ with $\phi_c$ whose difference is significant, whereas the field is located in the vicinity of $\phi=\phi_v$ for weak gravitational stars. The Arnowitt-Deser-Misner mass and radius of NSs as well as the gravitational force around the NS surface can receive sizable corrections from the scalar hair, while satisfying local gravity constraints in the Solar system. Unlike the original scenario of spontaneous scalarization induced by a negative nonminimal coupling, the catastrophic instability of cosmological solutions can be avoided. We also study the cosmological dynamics from the inflationary epoch to today and show that the scalar field $\phi$ finally approaches the asymptotic value $\phi_v$ without spoiling a successful cosmological evolution. After $\phi$ starts to oscillate about the potential minimum, the same field can also be the source for cold dark matter.


title: Characterizing M-estimators

abstract: We characterize the full classes of M-estimators for semiparametric models of general functionals by formally connecting the theory of consistent loss functions from forecast evaluation with the theory of M-estimation. This novel characterization result opens up the possibility for theoretical research on efficient and equivariant M-estimation and, more generally, it allows to leverage existing results on loss functions known from the literature of forecast evaluation in estimation theory.


title: Boosting Modern and Historical Handwritten Text Recognition with Deformable Convolutions

abstract: Handwritten Text Recognition (HTR) in free-layout pages is a challenging image understanding task that can provide a relevant boost to the digitization of handwritten documents and reuse of their content. The task becomes even more challenging when dealing with historical documents due to the variability of the writing style and degradation of the page quality. State-of-the-art HTR approaches typically couple recurrent structures for sequence modeling with Convolutional Neural Networks for visual feature extraction. Since convolutional kernels are defined on fixed grids and focus on all input pixels independently while moving over the input image, this strategy disregards the fact that handwritten characters can vary in shape, scale, and orientation even within the same document and that the ink pixels are more relevant than the background ones. To cope with these specific HTR difficulties, we propose to adopt deformable convolutions, which can deform depending on the input at hand and better adapt to the geometric variations of the text. We design two deformable architectures and conduct extensive experiments on both modern and historical datasets. Experimental results confirm the suitability of deformable convolutions for the HTR task.


title: PCC: Paraphrasing with Bottom-k Sampling and Cyclic Learning for Curriculum Data Augmentation

abstract: Curriculum Data Augmentation (CDA) improves neural models by presenting synthetic data with increasing difficulties from easy to hard. However, traditional CDA simply treats the ratio of word perturbation as the difficulty measure and goes through the curriculums only once. This paper presents \textbf{PCC}: \textbf{P}araphrasing with Bottom-k Sampling and \textbf{C}yclic Learning for \textbf{C}urriculum Data Augmentation, a novel CDA framework via paraphrasing, which exploits the textual paraphrase similarity as the curriculum difficulty measure. We propose a curriculum-aware paraphrase generation module composed of three units: a paraphrase candidate generator with bottom-k sampling, a filtering mechanism and a difficulty measure. We also propose a cyclic learning strategy that passes through the curriculums multiple times. The bottom-k sampling is proposed to generate super-hard instances for the later curriculums. Experimental results on few-shot text classification as well as dialogue generation indicate that PCC surpasses competitive baselines. Human evaluation and extensive case studies indicate that bottom-k sampling effectively generates super-hard instances, and PCC significantly improves the baseline dialogue agent.


title: Multi-parameter maximal Fourier restriction

abstract: The main result of this note is the strengthening of a quite arbitrary a priori Fourier restriction estimate to a multi-parameter maximal estimate of the same type. This allows us to discuss a certain multi-parameter Lebesgue point property of Fourier transforms, which replaces Euclidean balls by ellipsoids. Along the lines of the same proof, we also establish a $d$-parameter Menshov--Paley--Zygmund-type theorem for the Fourier transform on $\mathbb{R}^d$. Such a result is interesting for $d\geq2$ because, in a sharp contrast with the one-dimensional case, the corresponding endpoint $L^2$ estimate (i.e., a Carleson-type theorem) is known to fail since the work of C. Fefferman in 1970. Finally, we show that a Strichartz estimate for a given homogeneous constant-coefficient linear dispersive PDE can sometimes be strengthened to a certain pseudo-differential version.


title: DLCFT: Deep Linear Continual Fine-Tuning for General Incremental Learning

abstract: Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore an alternative framework to incremental learning where we continually fine-tune the model from a pre-trained representation. Our method takes advantage of linearization technique of a pre-trained neural network for simple and effective continual learning. We show that this allows us to design a linear model where quadratic parameter regularization method is placed as the optimal continual learning policy, and at the same time enjoying the high performance of neural networks. We also show that the proposed algorithm enables parameter regularization methods to be applied to class-incremental problems. Additionally, we provide a theoretical reason why the existing parameter-space regularization algorithms such as EWC underperform on neural networks trained with cross-entropy loss. We show that the proposed method can prevent forgetting while achieving high continual fine-tuning performance on image classification tasks. To show that our method can be applied to general continual learning settings, we evaluate our method in data-incremental, task-incremental, and class-incremental learning problems.


title: Semirelativistic Potential Modelling of Bound States: Advocating Due Rigour

abstract: The Poincar\'e-covariant quantum-field-theoretic description of bound states by the homogeneous Bethe-Salpeter equation usually exhibits an intrinsic complexity that can be attenuated by allowing this formalism to undergo various simplifications. The resulting approximate outcome's reliability can be assessed by applying several rigorous constraints on the nature of the bound-state spectra; most prominent here are existence, number and location of discrete eigenvalues.


title: An Empirical Study on the Membership Inference Attack against Tabular Data Synthesis Models

abstract: Tabular data typically contains private and important information; thus, precautions must be taken before they are shared with others. Although several methods (e.g., differential privacy and k-anonymity) have been proposed to prevent information leakage, in recent years, tabular data synthesis models have become popular because they can well trade-off between data utility and privacy. However, recent research has shown that generative models for image data are susceptible to the membership inference attack, which can determine whether a given record was used to train a victim synthesis model. In this paper, we investigate the membership inference attack in the context of tabular data synthesis. We conduct experiments on 4 state-of-the-art tabular data synthesis models under two attack scenarios (i.e., one black-box and one white-box attack), and find that the membership inference attack can seriously jeopardize these models. We next conduct experiments to evaluate how well two popular differentially-private deep learning training algorithms, DP-SGD and DP-GAN, can protect the models against the attack. Our key finding is that both algorithms can largely alleviate this threat by sacrificing the generation quality.


title: Zeeman effects on Yu-Shiba-Rusinov states

abstract: When the exchange interaction between the impurity spin and the spins of itinerant quasiparticles are strong or weak enough, the ground states for a magnetic impurity in a superconductor are the screened or free spins, respectively. In both cases, the lowest excited state is a bound state within the superconducting gap, known as the Yu-Shiba-Rusinov (YSR) state. The YSR state is spatially localized, energetically isolated, and fully spin-polarized, leading to applications such as functional scanning probes. While any application demands identifying whether the impurity spin is screened or free, a suitable experimental technique has been elusive. Here we demonstrate an unambiguous way to determine the impurity ground state using the Zeeman effect. We performed ultra-low temperature scanning tunneling spectroscopy of junctions formed between a Cu(111) surface and superconducting Nb tips decorated by single magnetic Fe atoms. Depending on the condition of the Fe adsorbate, the YSR peak in the spectrum either splits or shifts in a magnetic field, signifying that the Fe spin is screened or free, respectively. Our observations provide renewed insights into the competition between magnetism and superconductivity and constitute a basis for the applications of the YSR state.


title: Road detection via a dual-task network based on cross-layer graph fusion modules

abstract: Road detection based on remote sensing images is of great significance to intelligent traffic management. The performances of the mainstream road detection methods are mainly determined by their extracted features, whose richness and robustness can be enhanced by fusing features of different types and cross-layer connections. However, the features in the existing mainstream model frameworks are often similar in the same layer by the single-task training, and the traditional cross-layer fusion ways are too simple to obtain an efficient effect, so more complex fusion ways besides concatenation and addition deserve to be explored. Aiming at the above defects, we propose a dual-task network (DTnet) for road detection and cross-layer graph fusion module (CGM): the DTnet consists of two parallel branches for road area and edge detection, respectively, while enhancing the feature diversity by fusing features between two branches through our designed feature bridge modules (FBM). The CGM improves the cross-layer fusion effect by a complex feature stream graph, and four graph patterns are evaluated. Experimental results on three public datasets demonstrate that our method effectively improves the final detection result.


title: HostPhot: global and local photometry of galaxies hosting supernovae or other transients

abstract: Type Ia supernovae (SNe Ia) have assumed a fundamental role as cosmological distance indicators since the discovery of the accelerating expansion rate of the universe. Correlations between their optical peak luminosity, the decline rate of their light curves and their optical colours allow them to be standardised, reducing their observed r.m.s scatter. Over a decade ago, the optical peak luminosity of SNe Ia was found to correlate with host galaxy stellar mass, further improving their standardisation. Since then, host galaxy properties have been used in cosmological analyses of SNe Ia and tremendous effort has gone into finding the property, such as star formation rate, that fundamentally drives the correlation between SNe Ia and their host galaxies. Furthermore, it has been noted that the local environment in which the progenitors of SNe Ia evolve is much better at reducing the scatter in estimated distances than the global environment, i.e., the whole galaxy. HostPhot is a tool that facilitates the calculation of both local and global photometry of galaxies hosting SNe Ia, therefore helping in the study of the environmental effect on these objects.


title: Extreme-scale Talking-Face Video Upsampling with Audio-Visual Priors

abstract: In this paper, we explore an interesting question of what can be obtained from an $8\times8$ pixel video sequence. Surprisingly, it turns out to be quite a lot. We show that when we process this $8\times8$ video with the right set of audio and image priors, we can obtain a full-length, $256\times256$ video. We achieve this $32\times$ scaling of an extremely low-resolution input using our novel audio-visual upsampling network. The audio prior helps to recover the elemental facial details and precise lip shapes and a single high-resolution target identity image prior provides us with rich appearance details. Our approach is an end-to-end multi-stage framework. The first stage produces a coarse intermediate output video that can be then used to animate single target identity image and generate realistic, accurate and high-quality outputs. Our approach is simple and performs exceedingly well (an $8\times$ improvement in FID score) compared to previous super-resolution methods. We also extend our model to talking-face video compression, and show that we obtain a $3.5\times$ improvement in terms of bits/pixel over the previous state-of-the-art. The results from our network are thoroughly analyzed through extensive ablation experiments (in the paper and supplementary material). We also provide the demo video along with code and models on our website: \url{http://cvit.iiit.ac.in/research/projects/cvit-projects/talking-face-video-upsampling}.


title: Fast Distributed Vertex Splitting with Applications

abstract: We present ${\rm poly\log\log n}$-round randomized distributed algorithms to compute vertex splittings, a partition of the vertices of a graph into $k$ parts such that a node of degree $d(u)$ has $\approx d(u)/k$ neighbors in each part. Our techniques can be seen as the first progress towards general ${\rm poly\log\log n}$-round algorithms for the Lov\'asz Local Lemma. As the main application of our result, we obtain a randomized ${\rm poly\log\log n}$-round CONGEST algorithm for $(1+\epsilon)\Delta$-edge coloring $n$-node graphs of sufficiently large constant maximum degree $\Delta$, for any $\epsilon>0$. Further, our results improve the computation of defective colorings and certain tight list coloring problems. All the results improve the state-of-the-art round complexity exponentially, even in the LOCAL model.


title: Highly dynamic locomotion control of biped robot enhanced by swing arms

abstract: Swing arms have an irreplaceable role in promoting highly dynamic locomotion on bipedal robots by a larger angular momentum control space from the viewpoint of biomechanics. Few bipedal robots utilize swing arms and its redundancy characteristic of multiple degrees of freedom due to the lack of appropriate locomotion control strategies to perfectly integrate modeling and control. This paper presents a kind of control strategy by modeling the bipedal robot as a flywheel-spring loaded inverted pendulum (F-SLIP) to extract characteristics of swing arms and using the whole-body controller (WBC) to achieve these characteristics, and also proposes a evaluation system including three aspects of agility defined by us, stability and energy consumption for the highly dynamic locomotion of bipedal robots. We design several sets of simulation experiments and analyze the effects of swing arms according to the evaluation system during the jumping motion of Purple (Purple energy rises in the east)V1.0, a kind of bipedal robot designed to test high explosive locomotion. Results show that Purple's agility is increased by more than 10 percent, stabilization time is reduced by a factor of two, and energy consumption is reduced by more than 20 percent after introducing swing arms.


title: Scale free chaos in the confined Vicsek flocking model

abstract: The Vicsek model encompasses the paradigm of active dry matter. Motivated by collective behavior of insects in swarms, we have studied finite size effects and criticality in the three dimensional, harmonically confined Vicsek model. We have discovered a phase transition that exists for appropriate noise and small confinement strength. On the critical line of confinement versus noise, swarms are in a state of scale-free chaos characterized by minimal correlation time, correlation length proportional to swarm size and topological data analysis. The critical line separates dispersed single clusters from confined multicluster swarms. Scale-free chaotic swarms occupy a compact region of space and comprise a recognizable `condensed' nucleus and particles leaving and entering it. Susceptibility, correlation length, dynamic correlation function and largest Lyapunov exponent obey power laws. The critical line and a narrow criticality region close to it move simultaneously to zero confinement strength for infinitely many particles. At the end of the first chaotic window of confinement, there is another phase transition to infinitely dense clusters of finite size that may be termed flocking black holes.


title: Classification of G_2-orbits for pairs of octonions

abstract: Over an algebraically closed field, we described a minimal set of representatives for G_2-orbits on the set of pairs of octonions. As an application, the case of traceless octonions is considered.


title: Critical Power for Temporal-Pulse Collapse in Third-Harmonic Generation

abstract: The self-trapping critical power of light propagation is one of the key physical quantities characterizing nonlinear-beam propagation. Above the critical power, the spatial and temporal profiles of the beam deviate from its original shapes. Therefore, the critical power is considered an important indicator in nonlinear optical phenomena, such as filamentation and laser processing. However, although the concept of the critical power has been established for fundamental waves, it remains unclear if the power-dependent phenomena can also be observed in harmonic generation because of the complex interplay of nonlinear-propagation effects and ionization-plasma effects. In this study, we find the critical power for the third-harmonic generation; the criterion for whether or not temporal-pulse collapse occurs in the third-harmonic generation is determined only by the incident power. Experiments show that a certain incident power exists, at which the third-harmonic power exerts a specific dependence, independent of the focusing conditions. This incident power is approximately six times lower than the self-trapping critical power of the fundamental pulse, which indicates that it is unique to the third-harmonic generation. Numerical calculations reveal that at this incident power, the third-harmonic pulse begins to collapse temporally. Furthermore, the numerical calculations reproduce the experimental results without the nonlinear effects of the fundamental pulse, dispersion effect, and ionization-plasma effects. This shows that the pulse collapse is due to the interference effects from the third-order nonlinear term, which disappears after long-distance propagation due to phase mismatch, and higher-order nonlinear terms. This study demonstrates the existence of the critical power for harmonic pulses and show that higher-order nonlinear effects on the harmonics can yield a universal phenomenon.


title: Boosting Distributed Training Performance of the Unpadded BERT Model

abstract: Pre-training models are an important tool in Natural Language Processing (NLP), while the BERT model is a classic pre-training model whose structure has been widely adopted by followers. It was even chosen as the reference model for the MLPerf training benchmark. The distributed training performance optimization of BERT models plays an important role in accelerating the solutions of most NLP tasks. BERT model often uses padding tensors as its inputs, leading to excessive redundant computations. Thus, removing these redundant computations is essential to improve the distributed training performance. This paper designs a new approach to train BERT models with variable-length inputs efficiently. Firstly, we propose a general structure for the variable-length BERT models, and accelerate the encoder layer via our grouped multi-stream FMHA (Fused Multi-Head Attention) method. Secondly, through data exchange, we address the unbalanced workload problem caused by the variable-length inputs, which overlaps highly with the training process. Finally, we optimize the overall performance of the BERT model, such as kernel fusion, and operator optimization. Our experimental results show that our highly optimized BERT model achieves state-of-the-art throughput and ranks first in MLPerf Training v2.0 within the same GPU configuration. The optimizations in this paper can be applied to more BERT-like models in our future works.


title: A Tutorial Introduction to Lattice-based Cryptography and Homomorphic Encryption

abstract: Why study Lattice-based Cryptography? There are a few ways to answer this question. 1. It is useful to have cryptosystems that are based on a variety of hard computational problems so the different cryptosystems are not all vulnerable in the same way. 2. The computational aspects of lattice-based cryptosystem are usually simple to understand and fairly easy to implement in practice. 3. Lattice-based cryptosystems have lower encryption/decryption computational complexities compared to popular cryptosystems that are based on the integer factorisation or the discrete logarithm problems. 4. Lattice-based cryptosystems enjoy strong worst-case hardness security proofs based on approximate versions of known NP-hard lattice problems. 5. Lattice-based cryptosystems are believed to be good candidates for post-quantum cryptography, since there are currently no known quantum algorithms for solving lattice problems that perform significantly better than the best-known classical (non-quantum) algorithms, unlike for integer factorisation and (elliptic curve) discrete logarithm problems. 6. Last but not least, interesting structures in lattice problems have led to significant advances in Homomorphic Encryption, a new research area with wide-ranging applications.


title: Mechanisms to control laser-plasma coupling in laser wakefield electron acceleration

abstract: Experimental results, supported by precise modelling, demonstrate optimisation of a plasma-based injector with intermediate laser pulse energy ($<1$ J), corresponding to a normalised vector potential $a_0 = 2.15$, using ionisation injection in a tailored plasma density profile. An increase in electron bunch quality and energy is achieved experimentally with the extension of the density downramp at the plasma exit. Optimisation of the focal position of the laser pulse in the tailored plasma density profile is shown to efficiently reduce electron bunch angular deviation, leading to a better alignment of the electron bunch with the laser axis. Single peak electron spectra are produced in a previously unexplored regime by combining an early focal position and adaptive optic control of the laser wavefront through optimising the symmetry of the pre-focal laser energy distribution. Experimental results have been validated through particle-in-cell simulations using realistic laser energy, phase distribution, and temporal envelope, allowing for accurate predictions of difficult to model parameters, such as total charge and spatial properties of the electron bunches, opening the way for more accurate modelling for the design of plasma-based accelerators.


title: Effect of switching time scale of receptor activity on chemotactic performance of Escherichia coli

abstract: In the chemotactic motion of Escherichia coli, the switching of transmembrane chemoreceptors between active and inactive states is one of the most important steps of the signaling pathway. We study the effect of this switching time-scale on the chemotactic performance of the cell. We quantify performance by the chemotactic drift velocity of the cell. Our extensive numerical simulations on a detailed theoretical model show that as the activity switching rate increases, the drift velocity increases and then saturates. Our data also show the mean duration of a downhill run decreases strongly with the switching rate, while that of an uphill run decreases relatively slowly. We explain this effect from temporal variation of activity along uphill and downhill trajectories. We show that for large and small switching rates the nature of activity variation show qualitatively different behaviors along a downhill run but similar behavior along an uphill run. This results in a stronger dependence of downhill run duration on the switching rate and relatively milder dependence for uphill run duration.


title: On the Performance of Deep Learning-based Data-aided Active User Detection for GF-SCMA System

abstract: The recent works on a deep learning (DL)-based joint design of preamble set for the transmitters and data-aided active user detection (AUD) in the receiver has demonstrated a significant performance improvement for grant-free sparse code multiple access (GF-SCMA) system. The autoencoder for the joint design can be trained only in a given environment, but in an actual situation where the operating environment is constantly changing, it is difficult to optimize the preamble set for every possible environment. Therefore, a conventional, yet general approach may implement the data-aided AUD while relying on the preamble set that is designed independently rather than the joint design. In this paper, the activity detection error rate (ADER) performance of the data-aided AUD subject to the two preamble designs, i.e., independently designed preamble and jointly designed preamble, were directly compared. Fortunately, it was found that the performance loss in the data-aided AUD induced by the independent preamble design is limited to only 1dB. Furthermore, such performance characteristics of jointly designed preamble set is interpreted through average cross-correlation among the preambles associated with the same codebook (CB) (average intra-CB cross-correlation) and average cross-correlation among preambles associated with the different CBs (average inter-CB cross-correlation).


title: Predicting today's cosmological constant via the Zel'dovich-Holographic connection

abstract: This Letter proposes a solution of the Vacuum Energy and the Cosmological Constant (CC) paradox based on the Zel'dovich's ansatz, which states that the observable contribution to the vacuum energy density is given by the gravitational energy of virtual particle-antiparticle pairs, continually generated and annihilated in the vacuum state. The novelty of this work is the use of an ultraviolet cut-off length based on the Holographic Principle, which is shown to yield current values of the CC in good agreement with experimental observations.


title: Knowledge Graph Curation: A Practical Framework

abstract: Knowledge Graphs (KGs) have shown to be very important for applications such as personal assistants, question-answering systems, and search engines. Therefore, it is crucial to ensure their high quality. However, KGs inevitably contain errors, duplicates, and missing values, which may hinder their adoption and utility in business applications, as they are not curated, e.g., low-quality KGs produce low-quality applications that are built on top of them. In this vision paper, we propose a practical knowledge graph curation framework for improving the quality of KGs. First, we define a set of quality metrics for assessing the status of KGs, Second, we describe the verification and validation of KGs as cleaning tasks, Third, we present duplicate detection and knowledge fusion strategies for enriching KGs. Furthermore, we give insights and directions toward a better architecture for curating KGs.


title: Domestic sound event detection by shift consistency mean-teacher training and adversarial domain adaptation

abstract: Semi-supervised learning and domain adaptation techniques have drawn increasing attention in the field of domestic sound event detection thanks to the availability of large amounts of unlabeled data and the relative ease to generate synthetic strongly-labeled data. In a previous work, several semi-supervised learning strategies were designed to boost the performance of a mean-teacher model. Namely, these strategies include shift consistency training (SCT), interpolation consistency training (ICT), and pseudo-labeling. However, adversarial domain adaptation (ADA) did not seem to improve the event detection accuracy further when we attempt to compensate for the domain gap between synthetic and real data. In this research, we empirically found that ICT tends to pull apart the distributions of synthetic and real data in t-SNE plots. Therefore, ICT is abandoned while SCT, in contrast, is applied to train both the student and the teacher models. With these modifications, the system successfully integrates with an ADA network, and we achieve 47.2% in the F1 score on the DCASE 2020 task 4 dataset, which is 2.1% higher than what was reported in the previous work.