title: Efficient Extrinsic Calibration of Multi-Sensor 3D LiDAR Systems for Autonomous Vehicles using Static Objects Information

abstract: For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately determined. Traditional calibration methods are based on: 1) using targets specifically designed for calibration purposes in controlled environments, 2) optimizing a quality metric of the point clouds collected while traversing an unknown but static environment, or 3) optimizing the match among per-sensor incremental motion observations along a motion path fulfilling special requirements. In real scenarios, however, the online applicability of these methods can be limited, as they are typically highly dynamic, contain degenerate paths, and require fast computations. In this paper, we propose an approach that tackles some of these challenges by formulating the calibration problem as a joint but structured optimization problem of all sensor calibrations that takes as input a summary of the point cloud information consisting of ground points and pole detections. We demonstrate the efficiency and quality of the results of the proposed approach in a set of experiments with LiDAR simulation and real data from an urban trip.


title: Higgs Production and $H^0 \to c\overline{c}$ at a Future Muon-Ion Collider

abstract: We investigate the production of Higgs bosons in neutral- and charged-current interactions at a future Muon-Ion Collider (MuIC) with emphasis on $H^0 \to c\overline{c}$ decay. In particular, we focus on the leading production mechanisms and explore the impact of a range of Parton Distribution Function (PDF) scenarios, with emphasis on the role of heavy intrinsic quark flavor. We emphasize estimates of non-resonant di-charm background production and explore the impact of this background on a possible future measurement of $H^0 \to c\overline{c}$ at a future Muon-Ion Collider facility.


title: Real hyperbolic representations of PU(1,n)

abstract: It is shown that for n bigger than 1, the group of holomorphic isometries of the n dimensional complex hyperbolic space does not admit non-elementary representations into the group of isometries of the infinite dimensional real hyperbolic space.


title: A search for heavy Higgs bosons decaying into vector bosons in same-sign two-lepton final states in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A search for heavy Higgs bosons produced in association with a vector boson and decaying into a pair of vector bosons is performed in final states with two leptons (electrons or muons) of the same electric charge, missing transverse momentum and jets. A data sample of proton-proton collisions at a centre-of-mass energy of 13 TeV recorded with the ATLAS detector at the Large Hadron Collider between 2015 and 2018 is used. The data correspond to a total integrated luminosity of 139 fb$^{-1}$. The observed data are in agreement with Standard Model background expectations. The results are interpreted using higher-dimensional operators in an effective field theory. Upper limits on the production cross-section are calculated at 95% confidence level as a function of the heavy Higgs boson's mass and coupling strengths to vector bosons. Limits are set in the Higgs boson mass range from 300 to 1500 GeV, and depend on the assumed couplings. The highest excluded mass for a heavy Higgs boson with the coupling combinations explored is 900 GeV. Limits on coupling strengths are also provided.


title: Perturbative Understanding of Non-Perturbative Processes and Quantumization versus Classicalization

abstract: In some instances of study of quantum evolution of classical backgrounds it is considered inevitable to resort to non-perturbative methods at the price of treating the system semiclassically. We show that a fully quantum perturbative treatment, in which the background is resolved as a multi-particle state, recovers the semiclassical non-perturbative results and allows going beyond. We reproduce particle-creation by a classical field in a theory of two scalars as well as in scalar QED in terms of scattering processes of high multiplicity. The multi-particle treatment also gives a transparent picture of why a single-process transition from a classical to a quantum state, which we call quantumization, is exponentially suppressed, whereas the opposite process, classicalization, can take place swiftly if the microstate degeneracy of the classical state is high. An example is provided by the $N$-graviton portrait of a black hole: a black hole can form efficiently via a $2\to N$ classicalization process in the collision of high-energy particles but its quantumization via a decay $N \to 2$ is exponentially suppressed.


title: HYDRA-HGR: A Hybrid Transformer-based Architecture for Fusion of Macroscopic and Microscopic Neural Drive Information

abstract: Development of advance surface Electromyogram (sEMG)-based Human-Machine Interface (HMI) systems is of paramount importance to pave the way towards emergence of futuristic Cyber-Physical-Human (CPH) worlds. In this context, the main focus of recent literature was on development of different Deep Neural Network (DNN)-based architectures that perform Hand Gesture Recognition (HGR) at a macroscopic level (i.e., directly from sEMG signals). At the same time, advancements in acquisition of High-Density sEMG signals (HD-sEMG) have resulted in a surge of significant interest on sEMG decomposition techniques to extract microscopic neural drive information. However, due to complexities of sEMG decomposition and added computational overhead, HGR at microscopic level is less explored than its aforementioned DNN-based counterparts. In this regard, we propose the HYDRA-HGR framework, which is a hybrid model that simultaneously extracts a set of temporal and spatial features through its two independent Vision Transformer (ViT)-based parallel architectures (the so called Macro and Micro paths). The Macro Path is trained directly on the pre-processed HD-sEMG signals, while the Micro path is fed with the p-to-p values of the extracted Motor Unit Action Potentials (MUAPs) of each source. Extracted features at macroscopic and microscopic levels are then coupled via a Fully Connected (FC) fusion layer. We evaluate the proposed hybrid HYDRA-HGR framework through a recently released HD-sEMG dataset, and show that it significantly outperforms its stand-alone counterparts. The proposed HYDRA-HGR framework achieves average accuracy of 94.86% for the 250 ms window size, which is 5.52% and 8.22% higher than that of the Macro and Micro paths, respectively.


title: Time Series Synthesis via Multi-scale Patch-based Generation of Wavelet Scalogram

abstract: A framework is proposed for the unconditional generation of synthetic time series based on learning from a single sample in low-data regime case. The framework aims at capturing the distribution of patches in wavelet scalogram of time series using single image generative models and producing realistic wavelet coefficients for the generation of synthetic time series. It is demonstrated that the framework is effective with respect to fidelity and diversity for time series with insignificant to no trends. Also, the performance is more promising for generating samples with the same duration (reshuffling) rather than longer ones (retargeting).


title: A formal framework for generalized reporting methods in parametric settings

abstract: Effect size measures and visualization techniques aimed at maximizing the interpretability and comparability of results from statistical models have long been of great importance and are recently again receiving increased attention in the literature. However, since the methods proposed in this context originate from a wide variety of disciplines and are more often than not practically motivated, they lack a common theoretical framework and many quantities are narrowly or heuristically defined. In this work, we put forward a common mathematical setting for effect size measures and visualization techniques aimed at the results of parametric regression and define a formal framework for the consistent derivation of both existing and new variants of such quantities. Throughout the presented theory, we utilize probability measures to derive weighted means over areas of interest. While we take a Bayesian approach to quantifying uncertainty in order to derive consistent results for every defined quantity, all proposed methods apply to the results of both frequentist and Bayesian inference. We apply selected specifications derived from the proposed framework to data from a clinical trial and a multi-analyst study to illustrate its versatility and relevance.


title: PhysioGait: Context-Aware Physiological Context Modeling for Person Re-identification Attack on Wearable Sensing

abstract: Person re-identification is a critical privacy breach in publicly shared healthcare data. We investigate the possibility of a new type of privacy threat on publicly shared privacy insensitive large scale wearable sensing data. In this paper, we investigate user specific biometric signatures in terms of two contextual biometric traits, physiological (photoplethysmography and electrodermal activity) and physical (accelerometer) contexts. In this regard, we propose PhysioGait, a context-aware physiological signal model that consists of a Multi-Modal Siamese Convolutional Neural Network (mmSNN) which learns the spatial and temporal information individually and performs sensor fusion in a Siamese cost with the objective of predicting a person's identity. We evaluated PhysioGait attack model using 4 real-time collected datasets (3-data under IRB #HP-00064387 and one publicly available data) and two combined datasets achieving 89% - 93% accuracy of re-identifying persons.


title: Efficiently computing the Uhlmann fidelity for density matrices

abstract: We consider the problem of efficiently computing the Uhlmann fidelity in the case when explicit density matrix descriptions are available. We derive an alternative formula which is simpler to evaluate numerically, saving a factor of 10 in time for large matrices.


title: Spatial Graph Signal Interpolation with an Application for Merging BCI Datasets with Various Dimensionalities

abstract: BCI Motor Imagery datasets usually are small and have different electrodes setups. When training a Deep Neural Network, one may want to capitalize on all these datasets to increase the amount of data available and hence obtain good generalization results. To this end, we introduce a spatial graph signal interpolation technique, that allows to interpolate efficiently multiple electrodes. We conduct a set of experiments with five BCI Motor Imagery datasets comparing the proposed interpolation with spherical splines interpolation. We believe that this work provides novel ideas on how to leverage graphs to interpolate electrodes and on how to homogenize multiple datasets.


title: MAEEG: Masked Auto-encoder for EEG Representation Learning

abstract: Decoding information from bio-signals such as EEG, using machine learning has been a challenge due to the small data-sets and difficulty to obtain labels. We propose a reconstruction-based self-supervised learning model, the masked auto-encoder for EEG (MAEEG), for learning EEG representations by learning to reconstruct the masked EEG features using a transformer architecture. We found that MAEEG can learn representations that significantly improve sleep stage classification (~5% accuracy increase) when only a small number of labels are given. We also found that input sample lengths and different ways of masking during reconstruction-based SSL pretraining have a huge effect on downstream model performance. Specifically, learning to reconstruct a larger proportion and more concentrated masked signal results in better performance on sleep classification. Our findings provide insight into how reconstruction-based SSL could help representation learning for EEG.


title: Leveraging Statistical Shape Priors in GAN-based ECG Synthesis

abstract: Electrocardiogram (ECG) data collection during emergency situations is challenging, making ECG data generation an efficient solution for dealing with highly imbalanced ECG training datasets. In this paper, we propose a novel approach for ECG signal generation using Generative Adversarial Networks (GANs) and statistical ECG data modeling. Our approach leverages prior knowledge about ECG dynamics to synthesize realistic signals, addressing the complex dynamics of ECG signals. To validate our approach, we conducted experiments using ECG signals from the MIT-BIH arrhythmia database. Our results demonstrate that our approach, which models temporal and amplitude variations of ECG signals as 2-D shapes, generates more realistic signals compared to state-of-the-art GAN based generation baselines. Our proposed approach has significant implications for improving the quality of ECG training datasets, which can ultimately lead to better performance of ECG classification algorithms. This research contributes to the development of more efficient and accurate methods for ECG analysis, which can aid in the diagnosis and treatment of cardiac diseases.


title: An IoT Cloud and Big Data Architecture for the Maintenance of Home Appliances

abstract: Billions of interconnected Internet of Things (IoT) sensors and devices collect tremendous amounts of data from real-world scenarios. Big data is generating increasing interest in a wide range of industries. Once data is analyzed through compute-intensive Machine Learning (ML) methods, it can derive critical business value for organizations. Powerfulplatforms are essential to handle and process such massive collections of information cost-effectively and conveniently. This work introduces a distributed and scalable platform architecture that can be deployed for efficient real-world big data collection and analytics. The proposed system was tested with a case study for Predictive Maintenance of Home Appliances, where current and vibration sensors with high acquisition frequency were connected to washing machines and refrigerators. The introduced platform was used to collect, store, and analyze the data. The experimental results demonstrated that the presented system could be advantageous for tackling real-world IoT scenarios in a cost-effective and local approach.


title: Two-Timescale Transmission Design for Wireless Communication Systems Aided by Active RIS

abstract: This paper considers an active reconfigurable intelligent surface (RIS)-aided communication system, where an M-antenna base station (BS) transmits data symbols to a single-antenna user via an N-element active RIS. We use two-timescale channel state information (CSI) in our system, so that the channel estimation overhead and feedback overhead can be decreased dramatically. A closed-form approximate expression of the achievable rate (AR) is derived and the phase shift at the active RIS is optimized. In addition, we compare the performance of the active RIS system with that of the passive RIS system. The conclusion shows that the active RIS system achieves a lager AR than the passive RIS system.


title: Multi-view Multi-label Fine-grained Emotion Decoding from Human Brain Activity

abstract: Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain activity pattern and the decoded emotion categories are coarse-grained, which is inconsistent with the complex emotional expression of human; the other is ignoring the discrepancy of emotion expression between the left and right hemispheres of human brain. In this paper, we propose a novel multi-view multi-label hybrid model for fine-grained emotion decoding (up to 80 emotion categories) which can learn the expressive neural representations and predicting multiple emotional states simultaneously. Specifically, the generative component of our hybrid model is parametrized by a multi-view variational auto-encoder, in which we regard the brain activity of left and right hemispheres and their difference as three distinct views, and use the product of expert mechanism in its inference network. The discriminative component of our hybrid model is implemented by a multi-label classification network with an asymmetric focal loss. For more accurate emotion decoding, we first adopt a label-aware module for emotion-specific neural representations learning and then model the dependency of emotional states by a masked self-attention mechanism. Extensive experiments on two visually evoked emotional datasets show the superiority of our method.


title: Recursive Estimation of User Intent from Noninvasive Electroencephalography using Discriminative Models

abstract: We study the problem of inferring user intent from noninvasive electroencephalography (EEG) to restore communication for people with severe speech and physical impairments (SSPI). The focus of this work is improving the estimation of posterior symbol probabilities in a typing task. At each iteration of the typing procedure, a subset of symbols is chosen for the next query based on the current probability estimate. Evidence about the user's response is collected from event-related potentials (ERP) in order to update symbol probabilities, until one symbol exceeds a predefined confidence threshold. We provide a graphical model describing this task, and derive a recursive Bayesian update rule based on a discriminative probability over label vectors for each query, which we approximate using a neural network classifier. We evaluate the proposed method in a simulated typing task and show that it outperforms previous approaches based on generative modeling.


title: Data-driven design of fault diagnosis for three-phase PWM rectifier using random forests technique with transient synthetic features

abstract: A three-phase pulse-width modulation (PWM) rectifier can usually maintain operation when open-circuit faults occur in insulated-gate bipolar transistors (IGBTs), which will lead the system to be unstable and unsafe. Aiming at this problem, based on random forests with transient synthetic features, a data-driven online fault diagnosis method is proposed to locate the open-circuit faults of IGBTs timely and effectively in this study. Firstly, by analysing the open-circuit fault features of IGBTs in the three-phase PWM rectifier, it is found that the occurrence of the fault features is related to the fault location and time, and the fault features do not always appear immediately with the occurrence of the fault. Secondly, different data-driven fault diagnosis methods are compared and evaluated, the performance of random forests algorithm is better than that of support vector machine or artificial neural networks. Meanwhile, the accuracy of fault diagnosis classifier trained by transient synthetic features is higher than that trained by original features. Also, the random forests fault diagnosis classifier trained by multiplicative features is the best with fault diagnosis accuracy can reach 98.32%. Finally, the online fault diagnosis experiments are carried out and the results demonstrate the effectiveness of the proposed method, which can accurately locate the open-circuit faults in IGBTs while ensuring system safety.


title: Fault Diagnosis for Power Electronics Converters based on Deep Feedforward Network and Wavelet Compression

abstract: A fault diagnosis method for power electronics converters based on deep feedforward network and wavelet compression is proposed in this paper. The transient historical data after wavelet compression are used to realize the training of fault diagnosis classifier. Firstly, the correlation analysis of the voltage or current data running in various fault states is performed to remove the redundant features and the sampling point. Secondly, the wavelet transform is used to remove the redundant data of the features, and then the training sample data is greatly compressed. The deep feedforward network is trained by the low frequency component of the features, while the training speed is greatly accelerated. The average accuracy of fault diagnosis classifier can reach over 97%. Finally, the fault diagnosis classifier is tested, and final diagnosis result is determined by multiple-groups transient data, by which the reliability of diagnosis results is improved. The experimental result proves that the classifier has strong generalization ability and can accurately locate the open-circuit faults in IGBTs.


title: A Theoretical Study on Solving Continual Learning

abstract: Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL settings, class incremental learning (CIL) and task incremental learning (TIL). A major challenge of CL is catastrophic forgetting (CF). While a number of techniques are already available to effectively overcome CF for TIL, CIL remains to be highly challenging. So far, little theoretical study has been done to provide a principled guidance on how to solve the CIL problem. This paper performs such a study. It first shows that probabilistically, the CIL problem can be decomposed into two sub-problems: Within-task Prediction (WP) and Task-id Prediction (TP). It further proves that TP is correlated with out-of-distribution (OOD) detection, which connects CIL and OOD detection. The key conclusion of this study is that regardless of whether WP and TP or OOD detection are defined explicitly or implicitly by a CIL algorithm, good WP and good TP or OOD detection are necessary and sufficient for good CIL performances. Additionally, TIL is simply WP. Based on the theoretical result, new CIL methods are also designed, which outperform strong baselines in both CIL and TIL settings by a large margin.


title: False negative probability in iGSR detection: a Bayesian approach

abstract: This article discusses the detection of inorganic gunshot residue (iGSR) particles through scanning electron microscopy with energy dispersive X-ray spectrometer (SEM/EDS) in the discovery step. We calculated the probability that all characteristic inorganic gunshot residue particles (iGSR) go undetected and their dependence on the image pixel resolution setup. We built and validated a iGSR particle detection model that relates particle size with equipment registers, and we applied it to 1,174 samples analyzed by a forensic science laboratory. Our results indicate that the probability of missing all characteristic iGSR particles is below 5% for pixel sizes below $0.32 \mu m^{2}$. These values indicate that pixel sizes as great as the double in area that is commonly used in laboratory casework, $0.16 \mu m^{2}$, are effective for an initial scanning of a sample as it yields good rates of detection of characteristic particles, which might exponentially reduce laboratory workload.

categories: eess.SP eess.IV physics.data-an physics.ins-det


title: On the estimation of the evolutionary power spectral density

abstract: Two popular spectral-based approaches for estimating the evolutionary power spectral density (EPSD) function from the samples of the evolutionary process are based on the short-time Fourier transform (STFT) and the continuous wavelet transform. Both rely on the concept of slowly varying modulation or EPSD function, although the quantification of the effect of the 'slow' variation in the estimated EPSD is elusive. We propose, in the present study, to use the derivatives of the EPSD function to quantify the smoothness of the EPSD function in the context of estimating the EPSD function. We derive equations for estimating EPSD by using the S-transform and continuous wavelet transform. These equations are as simple to use as that derived based on STFT. We also derive the corresponding equations for assessing the residual for the estimated EPSD by using these transforms, including STFT. The residual provides an approach for identifying or quantifying, in the context of its estimation, the 'slow' variation of the EPSD function. The derived equations and numerical results indicate that the residual depends on both the derivatives of the EPSD function with respect to time and frequency as well as the adopted transform.


title: Towards Alzheimer's Disease Progression Assessment: A Review of Machine Learning Methods

abstract: Alzheimer's Disease (AD), as the most devastating neurodegenerative disease worldwide, has reached nearly 10 million new cases annually. Current technology provides unprecedented opportunities to study the progression and etiology of this disease with the advanced in imaging techniques. With the recent emergence of a society driven by big data and machine learning (ML), researchers have exerted considerable effort to summarize recent advances in ML-based AD diagnosis. Here, we outline some of the most prevalent and recent ML models for assessing the progression of AD and provide insights on the challenges, opportunities, and future directions that could be advantageous to future research in AD using ML.


title: Emotion Recognition With Temporarily Localized 'Emotional Events' in Naturalistic Context

abstract: Emotion recognition using EEG signals is an emerging area of research due to its broad applicability in BCI. Emotional feelings are hard to stimulate in the lab. Emotions do not last long, yet they need enough context to be perceived and felt. However, most EEG-related emotion databases either suffer from emotionally irrelevant details (due to prolonged duration stimulus) or have minimal context doubting the feeling of any emotion using the stimulus. We tried to reduce the impact of this trade-off by designing an experiment in which participants are free to report their emotional feelings simultaneously watching the emotional stimulus. We called these reported emotional feelings "Emotional Events" in our Dataset on Emotion with Naturalistic Stimuli (DENS). We used EEG signals to classify emotional events on different combinations of Valence(V) and Arousal(A) dimensions and compared the results with benchmark datasets of DEAP and SEED. STFT is used for feature extraction and used in the classification model consisting of CNN-LSTM hybrid layers. We achieved significantly higher accuracy with our data compared to DEEP and SEED data. We conclude that having precise information about emotional feelings improves the classification accuracy compared to long-duration EEG signals which might be contaminated by mind-wandering.


title: A Knowledge Distillation Framework For Enhancing Ear-EEG Based Sleep Staging With Scalp-EEG Data

abstract: Sleep plays a crucial role in the well-being of human lives. Traditional sleep studies using Polysomnography are associated with discomfort and often lower sleep quality caused by the acquisition setup. Previous works have focused on developing less obtrusive methods to conduct high-quality sleep studies, and ear-EEG is among popular alternatives. However, the performance of sleep staging based on ear-EEG is still inferior to scalp-EEG based sleep staging. In order to address the performance gap between scalp-EEG and ear-EEG based sleep staging, we propose a cross-modal knowledge distillation strategy, which is a domain adaptation approach. Our experiments and analysis validate the effectiveness of the proposed approach with existing architectures, where it enhances the accuracy of the ear-EEG based sleep staging by 3.46% and Cohen's kappa coefficient by a margin of 0.038.


title: PIPPI2021: An Approach to Automated Diagnosis and Texture Analysis of the Fetal Liver & Placenta in Fetal Growth Restriction

abstract: Fetal growth restriction (FGR) is a prevalent pregnancy condition characterised by failure of the fetus to reach its genetically predetermined growth potential. We explore the application of model fitting techniques, linear regression machine learning models, deep learning regression, and Haralick textured features from multi-contrast MRI for multi-fetal organ analysis of FGR. We employed T2 relaxometry and diffusion-weighted MRI datasets (using a combined T2-diffusion scan) for 12 normally grown and 12 FGR gestational age (GA) matched pregnancies. We applied the Intravoxel Incoherent Motion Model and novel multi-compartment models for MRI fetal analysis, which exhibit potential to provide a multi-organ FGR assessment, overcoming the limitations of empirical indicators - such as abnormal artery Doppler findings - to evaluate placental dysfunction. The placenta and fetal liver presented key differentiators between FGR and normal controls (decreased perfusion, abnormal fetal blood motion and reduced fetal blood oxygenation. This may be associated with the preferential shunting of the fetal blood towards the fetal brain. These features were further explored to determine their role in assessing FGR severity, by employing simple machine learning models to predict FGR diagnosis (100\% accuracy in test data, n=5), GA at delivery, time from MRI scan to delivery, and baby weight. Moreover, we explored the use of deep learning to regress the latter three variables. Image texture analysis of the fetal organs demonstrated prominent textural variations in the placental perfusion fractions maps between the groups (p$<$0.0009), and spatial differences in the incoherent fetal capillary blood motion in the liver (p$<$0.009). This research serves as a proof-of-concept, investigating the effect of FGR on fetal organs.


title: Minimizers of Nonlocal Polyconvex Energies in Nonlocal Hyperelasticity

abstract: We develop a theory of existence of minimizers of energy functionals in vectorial problems based on a nonlocal gradient under Dirichlet boundary conditions. The model shares many features with the peridynamics model and is also applicable to nonlocal solid mechanics, especially nonlinear elasticity. This nonlocal gradient was introduced in an earlier work, inspired by Riesz' fractional gradient, but suitable for bounded domains. The main assumption on the integrand of the energy is polyconvexity. Thus, we adapt the corresponding results of the classical case to this nonlocal context, notably, Piola's identity, the integration by parts of the determinant and the weak continuity of the determinant. The proof exploits the fact that every nonlocal gradient is a classical gradient. Contrary to classical elasticity, this existence result is compatible with cavitation and fracture.


title: Graph Neural Networks on SPD Manifolds for Motor Imagery Classification: A Perspective from the Time-Frequency Analysis

abstract: The motor imagery (MI) classification has been a prominent research topic in brain-computer interfaces based on electroencephalography (EEG). Over the past few decades, the performance of MI-EEG classifiers has seen gradual enhancement. In this study, we amplify the geometric deep learning-based MI-EEG classifiers from the perspective of time-frequency analysis, introducing a new architecture called Graph-CSPNet. We refer to this category of classifiers as Geometric Classifiers, highlighting their foundation in differential geometry stemming from EEG spatial covariance matrices. Graph-CSPNet utilizes novel manifold-valued graph convolutional techniques to capture the EEG features in the time-frequency domain, offering heightened flexibility in signal segmentation for capturing localized fluctuations. To evaluate the effectiveness of Graph-CSPNet, we employ five commonly-used publicly available MI-EEG datasets, achieving near-optimal classification accuracies in nine out of eleven scenarios. The Python repository can be found at https://github.com/GeometricBCI/Tensor-CSPNet-and-Graph-CSPNet.


title: A Meta-GNN approach to personalized seizure detection and classification

abstract: In this paper, we propose a personalized seizure detection and classification framework that quickly adapts to a specific patient from limited seizure samples. We achieve this by combining two novel paradigms that have recently seen much success in a wide variety of real-world applications: graph neural networks (GNN), and meta-learning. We train a Meta-GNN based classifier that learns a global model from a set of training patients such that this global model can eventually be adapted to a new unseen patient using very limited samples. We apply our approach on the TUSZ-dataset, one of the largest and publicly available benchmark datasets for epilepsy. We show that our method outperforms the baselines by reaching 82.7% on accuracy and 82.08% on F1 score after only 20 iterations on new unseen patients.


title: A Transformer Architecture for Online Gesture Recognition of Mathematical Expressions

abstract: The Transformer architecture is shown to provide a powerful framework as an end-to-end model for building expression trees from online handwritten gestures corresponding to glyph strokes. In particular, the attention mechanism was successfully used to encode, learn and enforce the underlying syntax of expressions creating latent representations that are correctly decoded to the exact mathematical expression tree, providing robustness to ablated inputs and unseen glyphs. For the first time, the encoder is fed with spatio-temporal data tokens potentially forming an infinitely large vocabulary, which finds applications beyond that of online gesture recognition. A new supervised dataset of online handwriting gestures is provided for training models on generic handwriting recognition tasks and a new metric is proposed for the evaluation of the syntactic correctness of the output expression trees. A small Transformer model suitable for edge inference was successfully trained to an average normalised Levenshtein accuracy of 94%, resulting in valid postfix RPN tree representation for 94% of predictions.


title: Strong Casimir-like Forces in Flocking Active Matter

abstract: Confining in space the equilibrium fluctuations of statistical systems with long-range correlations is known to result into effective forces on the boundaries. Here we demonstrate the occurrence of Casimir-like forces in the non-equilibrium context provided by flocking active matter. In particular, we consider a system of aligning self-propelled particles in two spatial dimensions, which are transversally confined by reflecting or partially reflecting walls. We show that in the ordered flocking phase this confined active vectorial fluid is characterized by extensive boundary layers, as opposed to the finite ones usually observed in confined scalar active matter. Moreover, a finite-size,fluctuation-induced contribution to the pressure on the wall emerges, which decays slowly and algebraically upon increasing the distance between the walls. We explain our findings, which display a certain degree of universality, within a hydrodynamic description of the density and velocity fields.


title: Safe Zeroth-Order Convex Optimization Using Quadratic Local Approximations

abstract: We address black-box convex optimization problems, where the objective and constraint functions are not explicitly known but can be sampled within the feasible set. The challenge is thus to generate a sequence of feasible points converging towards an optimal solution. By leveraging the knowledge of the smoothness properties of the objective and constraint functions, we propose a novel zeroth-order method, SZO-QQ, that iteratively computes quadratic approximations of the constraint functions, constructs local feasible sets and optimizes over them. We prove convergence of the sequence of the objective values generated at each iteration to the minimum. Through experiments, we show that our method can achieve faster convergence compared with state-of-the-art zeroth-order approaches to convex optimization.


title: Robustness of Fusion-based Multimodal Classifiers to Cross-Modal Content Dilutions

abstract: As multimodal learning finds applications in a wide variety of high-stakes societal tasks, investigating their robustness becomes important. Existing work has focused on understanding the robustness of vision-and-language models to imperceptible variations on benchmark tasks. In this work, we investigate the robustness of multimodal classifiers to cross-modal dilutions - a plausible variation. We develop a model that, given a multimodal (image + text) input, generates additional dilution text that (a) maintains relevance and topical coherence with the image and existing text, and (b) when added to the original text, leads to misclassification of the multimodal input. Via experiments on Crisis Humanitarianism and Sentiment Detection tasks, we find that the performance of task-specific fusion-based multimodal classifiers drops by 23.3% and 22.5%, respectively, in the presence of dilutions generated by our model. Metric-based comparisons with several baselines and human evaluations indicate that our dilutions show higher relevance and topical coherence, while simultaneously being more effective at demonstrating the brittleness of the multimodal classifiers. Our work aims to highlight and encourage further research on the robustness of deep multimodal models to realistic variations, especially in human-facing societal applications. The code and other resources are available at https://claws-lab.github.io/multimodal-robustness/.


title: Neural Grasp Distance Fields for Robot Manipulation

abstract: We formulate grasp learning as a neural field and present Neural Grasp Distance Fields (NGDF). Here, the input is a 6D pose of a robot end effector and output is a distance to a continuous manifold of valid grasps for an object. In contrast to current approaches that predict a set of discrete candidate grasps, the distance-based NGDF representation is easily interpreted as a cost, and minimizing this cost produces a successful grasp pose. This grasp distance cost can be incorporated directly into a trajectory optimizer for joint optimization with other costs such as trajectory smoothness and collision avoidance. During optimization, as the various costs are balanced and minimized, the grasp target is allowed to smoothly vary, as the learned grasp field is continuous. We evaluate NGDF on joint grasp and motion planning in simulation and the real world, outperforming baselines by 63% execution success while generalizing to unseen query poses and unseen object shapes. Project page: https://sites.google.com/view/neural-grasp-distance-fields.


title: HoloLens 2 Sensor Streaming

abstract: We present a HoloLens 2 server application for streaming device data via TCP in real time. The server can stream data from the four grayscale cameras, depth sensor, IMU, front RGB camera, microphone, head tracking, eye tracking, and hand tracking. Each sent data frame has a timestamp and, optionally, the instantaneous pose of the device in 3D space. The server allows downloading device calibration data, such as camera intrinsics, and can be integrated into Unity projects as a plugin, with support for basic upstream capabilities. To achieve real time video streaming at full frame rate, we leverage the video encoding capabilities of the HoloLens 2. Finally, we present a Python library for receiving and decoding the data, which includes utilities that facilitate passing the data to other libraries. The source code, Python demos, and precompiled binaries are available at https://github.com/jdibenes/hl2ss.


title: Polar hairs of mixed-parity nodal superconductors in Rarita-Schwinger-Weyl metals

abstract: Linearly dispersing Rarita-Schwinger-Weyl (RSW) fermions featuring two Fermi velocities are the key constituents of itinerant spin-3/2 quantum materials. When doped, RSW metals sustain two Fermi surfaces (FSs), around which one fully gapped $s$-wave and five \emph{mixed-parity} local pairings can take place. The intraband components of four mixed-parity pairings support point nodes at the poles of two FSs, only around which long-lived quasiparticles live. For weak (strong) pairing amplitudes ($\Delta$), gapless north and south poles belonging to the same (different) FS(s) get connected by \emph{polar hairs}, one-dimensional line nodes occupying the region between two FSs. The remaining one, by contrast, supports four nodal rings in between two FSs, symmetrically placed about their equators, but only when $\Delta$ is small. For large $\Delta$, this paired state becomes fully gapped. The transition temperature and pairing amplitudes follow the BCS scaling. We explicitly showcase these outcomes for a rotationally symmetric RSW metal, and contrast our findings when the system possesses an enlarged Lorentz symmetry and with those in spin-3/2 Luttinger materials.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.str-el hep-th


title: Self-Adapting Noise-Contrastive Estimation for Energy-Based Models

abstract: Training energy-based models (EBMs) with noise-contrastive estimation (NCE) is theoretically feasible but practically challenging. Effective learning requires the noise distribution to be approximately similar to the target distribution, especially in high-dimensional domains. Previous works have explored modelling the noise distribution as a separate generative model, and then concurrently training this noise model with the EBM. While this method allows for more effective noise-contrastive estimation, it comes at the cost of extra memory and training complexity. Instead, this thesis proposes a self-adapting NCE algorithm which uses static instances of the EBM along its training trajectory as the noise distribution. During training, these static instances progressively converge to the target distribution, thereby circumventing the need to simultaneously train an auxiliary noise model. Moreover, we express this self-adapting NCE algorithm in the framework of Bregman divergences and show that it is a generalization of maximum likelihood learning for EBMs. The performance of our algorithm is evaluated across a range of noise update intervals, and experimental results show that shorter update intervals are conducive to higher synthesis quality.


title: Did JWST observe imprints of axion miniclusters or primordial black holes?

abstract: The James Webb Space Telescope has detected surprisingly luminous early galaxies that indicate a tension with the $\Lambda$CDM. Motivated by scenarios including axion miniclusters or primordial black holes, we consider power-law modifications of the matter power spectrum. We show that the tension could be resolved if dark matter consists of $2\times 10^{-18}{\rm eV}$ axions or if a fraction $f_{\rm PBH} > 0.005$ of dark matter is composed of compact heavy $4\times 10^6 M_\odot (f_{\rm PBH}/0.005)^{-1}$ structures such as primordial black hole clusters. However, in both cases, the star formation efficiency needs to be significantly enhanced.


title: AntFuzzer: A Grey-Box Fuzzing Framework for EOSIO Smart Contracts

abstract: In the past few years, several attacks against the vulnerabilities of EOSIO smart contracts have caused severe financial losses to this prevalent blockchain platform. As a lightweight test-generation approach, grey-box fuzzing can open up the possibility of improving the security of EOSIO smart contracts. However, developing a practical grey-box fuzzer for EOSIO smart contracts from scratch is time-consuming and requires a deep understanding of EOSIO internals. In this work, we proposed AntFuzzer, the first highly extensible grey-box fuzzing framework for EOSIO smart contracts. AntFuzzer implements a novel approach that interfaces AFL to conduct AFL-style grey-box fuzzing on EOSIO smart contracts. Compared to black-box fuzzing tools, AntFuzzer can effectively trigger those hard-to-cover branches. It achieved an improvement in code coverage on 37.5% of smart contracts in our benchmark dataset. AntFuzzer provides unified interfaces for users to easily develop new detection plugins for continually emerging vulnerabilities. We have implemented 6 detection plugins on AntFuzzer to detect major vulnerabilities of EOSIO smart contracts. In our large-scale fuzzing experiments on 4,616 real-world smart contracts, AntFuzzer successfully detected 741 vulnerabilities. The results demonstrate the effectiveness and efficiency of AntFuzzer and our detection pl


title: Solving Subset Sum Problems using Quantum Inspired Optimization Algorithms with Applications in Auditing and Financial Data Analysis

abstract: Many applications in automated auditing and the analysis and consistency check of financial documents can be formulated in part as the subset sum problem: Given a set of numbers and a target sum, find the subset of numbers that sums up to the target. The problem is NP-hard and classical solving algorithms are therefore not practical to use in many real applications. We tackle the problem as a QUBO (quadratic unconstrained binary optimization) problem and show how gradient descent on Hopfield Networks reliably finds solutions for both artificial and real data. We outline how this algorithm can be applied by adiabatic quantum computers (quantum annealers) and specialized hardware (field programmable gate arrays) for digital annealing and run experiments on quantum annealing hardware.


title: Evidence of a compensated semimetal with electronic correlations at the CNP of twisted double bilayer graphene

abstract: Recently, magic-angle twisted bilayer graphene (MATBLG) has shown the emergence of various interaction-driven novel quantum phases at the commensurate fillings of the moir'e superlattice, while the charge neutrality point (CNP) remains mostly a vanilla insulator. Here, we show an emerging phase of nearly compensated semimetallicity at the CNP of twisted double bilayer graphene (TDBLG), a close cousin of MATBLG, with signatures of electronic correlation. Using electrical and thermal transport, we find almost two orders of magnitude enhancement of the thermopower in magnetic fields much smaller than the extreme quantum limit, accompanied by a large magnetoresistance($\sim 2500\%$) at CNP. This provides indisputable experimental evidence that TDBLG near CNP is a compensated semimetal. Moreover, at low temperatures, we observe an unusual sublinear temperature dependence of resistance. A recent theory predicts the formation of an excitonic metal near CNP, where small electron and hole pockets coexist. We understand the sublinear temperature dependence in terms of critical fluctuations in this theory.


title: Search for Microlensing Signature in Gravitational Waves from Binary Black Hole Events

abstract: In a recent search (Kim et al. 2022), we looked for microlensing signature in gravitational waves from spectrograms of the binary black hole events in the first and second gravitational-wave transient catalogs. For the search, we have implemented a deep learning-based method (Kim et al. 2021) and figured out that one event, GW190707 093326, out of forty-six events, is classified into the lensed class. However, upon estimating the p-value of this event, we observed that the uncertainty of the p-value still includes the possibility of the event being unlensed. Therefore, we concluded that no significant evidence of beating patterns from the evaluated binary black hole events has found from the search. For a consequence study, we discuss the distinguishability between microlensed gravitational waves and the signal from precessing black hole binaries.


title: A Fuzzy-set-based Joint Distribution Adaptation Method for Regression and its Application to Online Damage Quantification for Structural Digital Twin

abstract: Online damage quantification suffers from insufficient labeled data that weakens its accuracy. In this context, adopting the domain adaptation on historical labeled data from similar structures/damages or simulated digital twin data to assist the current diagnosis task would be beneficial. However, most domain adaptation methods are designed for classification and cannot efficiently address damage quantification, a regression problem with continuous real-valued labels. This study first proposes a novel domain adaptation method, the Online Fuzzy-set-based Joint Distribution Adaptation for Regression, to address this challenge. By converting the continuous real-valued labels to fuzzy class labels via fuzzy sets, the marginal and conditional distribution discrepancy are simultaneously measured to achieve the domain adaptation for the damage quantification task. Thanks to the superiority of the proposed method, a state-of-the-art online damage quantification framework based on domain adaptation is presented. Finally, the framework has been comprehensively demonstrated with a damaged helicopter panel, in which three types of damage domain adaptations (across different damage locations, across different damage types, and from simulation to experiment) are all conducted, proving the accuracy of damage quantification can be significantly improved in a realistic environment. It is expected that the proposed approach to be applied to the fleet-level digital twin considering the individual differences.


title: MolE: a molecular foundation model for drug discovery

abstract: Models that accurately predict properties based on chemical structure are valuable tools in drug discovery. However, for many properties, public and private training sets are typically small, and it is difficult for the models to generalize well outside of the training data. Recently, large language models have addressed this problem by using self-supervised pretraining on large unlabeled datasets, followed by fine-tuning on smaller, labeled datasets. In this paper, we report MolE, a molecular foundation model that adapts the DeBERTa architecture to be used on molecular graphs together with a two-step pretraining strategy. The first step of pretraining is a self-supervised approach focused on learning chemical structures, and the second step is a massive multi-task approach to learn biological information. We show that fine-tuning pretrained MolE achieves state-of-the-art results on 9 of the 22 ADMET tasks included in the Therapeutic Data Commons.


title: Dealing with Drift of Adaptation Spaces in Learning-based Self-Adaptive Systems using Lifelong Self-Adaptation

abstract: Recently, machine learning (ML) has become a popular approach to support self-adaptation. ML has been used to deal with several problems in self-adaptation, such as maintaining an up-to-date runtime model under uncertainty and scalable decision-making. Yet, exploiting ML comes with inherent challenges. In this paper, we focus on a particularly important challenge for learning-based self-adaptive systems: drift in adaptation spaces. With adaptation space we refer to the set of adaptation options a self-adaptive system can select from at a given time to adapt based on the estimated quality properties of the adaptation options. Drift of adaptation spaces originates from uncertainties, affecting the quality properties of the adaptation options. Such drift may imply that eventually no adaptation option can satisfy the initial set of the adaptation goals, deteriorating the quality of the system, or adaptation options may emerge that allow enhancing the adaptation goals. In ML, such shift corresponds to novel class appearance, a type of concept drift in target data that common ML techniques have problems dealing with. To tackle this problem, we present a novel approach to self-adaptation that enhances learning-based self-adaptive systems with a lifelong ML layer. We refer to this approach as lifelong self-adaptation. The lifelong ML layer tracks the system and its environment, associates this knowledge with the current tasks, identifies new tasks based on differences, and updates the learning models of the self-adaptive system accordingly. A human stakeholder may be involved to support the learning process and adjust the learning and goal models. We present a general architecture for lifelong self-adaptation and apply it to the case of drift of adaptation spaces that affects the decision-making in self-adaptation. We validate the approach for a series of scenarios using the DeltaIoT exemplar.


title: Ultimate speed of the supercurrent and its pairing mechanism

abstract: Recently, the room-temperature superconductor (RTSC) was discovered as a two-dimensional (2D) square lattice made of a metal wherein positive charges, i.e. holes, were heavily concentrated. The experimental result for the critical magnetic field $H_{c}$ was fully consistent with the view on the RTSC that its lattice unit -- a metal island -- is filled with the Slater's atoms. Each Slater's atom has the expanded diameter of 14.5 nm in order to have perfect diamagnetism with the magnitude corresponding to a single flux quantum $\phi_{0}$. Its expanded orbit is associated with the fine structure constant $\alpha \approx \frac{1}{137}$. In this paper, another important critical value -- the critical current $I_{c}$ -- is reported. It was found that the supercurrent has achieved the ultimate speed of matter, i.e., the speed of light, $c$. Beginning with a warm-up exercise for the Bohr's atom, how the Slater's atom is formed and why the $c$ appears are shown. These considerations lead to a simple view on the pairing mechanism of superconductivity, which also gives an ample indication of the most mysterious physical number $\alpha$. Finally, it is shown that the proposed pairing mechanism in terms of London's canonical momentum naturally generates the perfect diamagnetic $\phi_{0}$ of the Slater's atom, and the superconducting energy gap $\Delta$ is predicted.


title: De novo PROTAC design using graph-based deep generative models

abstract: PROteolysis TArgeting Chimeras (PROTACs) are an emerging therapeutic modality for degrading a protein of interest (POI) by marking it for degradation by the proteasome. Recent developments in artificial intelligence (AI) suggest that deep generative models can assist with the de novo design of molecules with desired properties, and their application to PROTAC design remains largely unexplored. We show that a graph-based generative model can be used to propose novel PROTAC-like structures from empty graphs. Our model can be guided towards the generation of large molecules (30--140 heavy atoms) predicted to degrade a POI through policy-gradient reinforcement learning (RL). Rewards during RL are applied using a boosted tree surrogate model that predicts a molecule's degradation potential for each POI. Using this approach, we steer the generative model towards compounds with higher likelihoods of predicted degradation activity. Despite being trained on sparse public data, the generative model proposes molecules with substructures found in known degraders. After fine-tuning, predicted activity against a challenging POI increases from 50% to >80% with near-perfect chemical validity for sampled compounds, suggesting this is a promising approach for the optimization of large, PROTAC-like molecules for targeted protein degradation.


title: White dwarfs as a probe of exceptionally light QCD axions

abstract: We study the effects of exceptionally light QCD axions on the stellar configuration of white dwarfs. At finite baryon density, the non-derivative coupling of the axion to nucleons displaces the axion from its in-vacuum minimum which implies a reduction of the nucleon mass. This dramatically alters the composition of stellar remnants. In particular, the modifications of the mass-radius relationship of white dwarfs allow us to probe large regions of unexplored parameter space without requiring that axions are dark matter.


title: Gravitational Blocks, Spindles and GK Geometry

abstract: We derive a gravitational block formula for the supersymmetric action for a general class of supersymmetric AdS solutions, described by GK geometry. Extremal points of this action describe supersymmetric AdS$_3$ solutions of type IIB supergravity, sourced by D3-branes, and supersymmetric AdS$_2$ solutions of $D=11$ supergravity, sourced by M2-branes. In both cases, the branes are also wrapped over a two-dimensional orbifold known as a spindle, or a two-sphere. We develop various geometric methods for computing the gravitational block contributions, allowing us to recover previously known results for various explicit supergravity solutions, and to significantly generalize these results to other compactifications. For the AdS$_3$ solutions we give a general proof that our off-shell supersymmetric action agrees with an appropriate off-shell $c$-function in the dual field theory, establishing a very general exact result in holography. For the AdS$_2$ solutions our gravitational block formula allows us to obtain the entropy for supersymmetric, magnetically charged and accelerating black holes in AdS$_4$.


title: Quantum noise spectroscopy of dynamical critical phenomena

abstract: The transition between distinct phases of matter is characterized by the nature of fluctuations near the critical point. We demonstrate that noise spectroscopy can not only diagnose the presence of a phase transition, but can also determine fundamental properties of its criticality. In particular, by analyzing a scaling collapse of the decoherence profile, one can directly extract the critical exponents of the transition and identify its universality class. Our approach naturally captures the presence of conservation laws and distinguishes between classical and quantum phase transitions. In the context of quantum magnetism, our proposal complements existing techniques and provides a novel toolset optimized for interrogating two-dimensional magnetic materials.


title: TNO or Comet? The Search for Activity and Characterization of Distant Object 418993 (2009 MS9)

abstract: 2009 MS9 is a trans-Neptunian object (TNO) whose perihelion brings it close to the distance where some long period comets are seen to become active. Knowing this, and the fact that this object appears to brighten in excess of it's predicted nucleus brightness suggests that 2009 MS9 has a delayed onset of activity brought on by the sublimation of a species more volatile than water. In this paper we characterize 2009 MS9's physical properties and investigate potential outgassing through composite images, sublimation models, and measurements of spectral reflectivity. We find that deep composite images of the object at various epochs along its orbit show no evidence of dust yet place sensitive limits to the dust production. We estimate the nucleus radius to be 11.5 km $\pm 3.5$ km using thermal IR modeling from NEOWISE data and use this and data pre-perihelion to estimate a geometric albedo of 0.25. We compare a CO-sublimation activity model to its post perihelion heliocentric light curve and find this data supports an active fractional area of $5 \times 10^{-6}$ assuming 2 $\mu$m sized grains and other typical comet parameters. The spectral reflectivity of the surface materials obtained with the Gemini Observatory and CFHT at different epochs shows a reddening spectral slope. We compare the physical properties of 2009 MS9 to both TNO and comet populations, and speculate that 2009 MS9's reddening may be due to the buildup of a dust mantle on the surface and could be an explanation of why TNOs exhibit a color bimodality.


title: Photometric Objects Around Cosmic Webs (PAC) Delineated in a Spectroscopic Survey. IV. High Precision Constraints on the Evolution of Stellar-Halo Mass Relation at Redshift $z<0.7$

abstract: Taking advantage of the Photometric objects Around Cosmic webs (PAC) method developed in Paper I, we measure the excess surface density $\bar{n}_2w_{{\rm{p}}}$ of photometric objects around spectroscopic objects down to stellar mass $10^{8.0}M_{\odot}$, $10^{9.2}M_{\odot}$ and $10^{9.8}M_{\odot}$ in the redshift ranges of $z_s<0.2$, $0.2<z_s<0.4$ and $0.5<z_s<0.7$ respectively, using the data from the DESI Legacy Imaging Surveys and the spectroscopic samples of Slogan Digital Sky Survey (i.e. Main, LOWZ and CMASS samples). We model the measured $\bar{n}_2w_{{\rm{p}}}$ in N-body simulation using abundance matching method and constrain the stellar-halo mass relations (SHMR) in the three redshift ranges to percent level. With the accurate modeling, we demonstrate that the stellar mass scatter for given halo mass is nearly a constant, and that the empirical form of Behroozi et al describes the SHMR better than the double power law form at low mass. Our SHMR accurately captures the downsizing of massive galaxies since $z_s=0.7$, while it also indicates that small galaxies are still growing faster than their host halos. The galaxy stellar mass functions (GSMF) from our modeling are in perfect agreement with the {\it model-independent} measurements in Paper III, though the current work extends the GSMF to a much smaller stellar mass. Based on the GSMF and SHMR, we derive the stellar mass completeness and halo occupation distributions for the LOWZ and CMASS samples, which are useful for correctly interpreting their cosmological measurements such as galaxy-galaxy lensing and redshift space distortion.


title: Measuring Oscillations with A Million Atmospheric Neutrinos

abstract: After two decades of measurements, neutrino physics is now advancing into the precision era. Withthe long-baseline experiments designed to tackle current open questions, a new query arises: can atmospheric neutrino experiments also play a role? To that end, we analyze the expected sensitivity of current and near-future water(ice)-Cherenkov atmospheric neutrino experiments in the context of standard three-flavor neutrino oscillations. In this first in depth combined atmospheric neutrino analysis, we analyze the current shared systematic uncertainties arising from the common flux and neutrino-water interactions. We then implement the systematic uncertainties of each experiment in detail and develop the atmospheric neutrino simulations for Super-Kamiokande, with and without neutron-tagging capabilities, IceCube Upgrade, ORCA, and Hyper-Kamiokande detectors. We carefully review the synergies and features of these experiments to examine the potential of a joint analysis of these atmospheric neutrino data in resolving the $\theta_{23}$ octant at 99% confidence level, and determining the neutrino mass ordering above 5$\sigma$ by 2030. Additionally, we assess the capability to constrain $\theta_{13}$ and the CP -violating phase ($\delta_{CP}$) in the leptonic sector independently from reactor and accelerator neutrino data. A combination of the atmospheric neutrino measurements will enhance the sensitivity to a greater extent than the simple sum of individual experiment results reaching more than 3$\sigma$ for some values of $\delta_{CP}$ . These results will provide vital information for next-generation accelerator neutrino oscillation experiments such as DUNE and Hyper-Kamiokande.


title: Deconfounded Imitation Learning

abstract: Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. We break down the space of confounded imitation learning problems and identify three settings with different data requirements in which the correct imitation policy can be identified. We then introduce an algorithm for deconfounded imitation learning, which trains an inference model jointly with a latent-conditional policy. At test time, the agent alternates between updating its belief over the latent and acting under the belief. We show in theory and practice that this algorithm converges to the correct interventional policy, solves the confounding issue, and can under certain assumptions achieve an asymptotically optimal imitation performance.


title: Interplay of superconductivity and localization near a 2D ferromagnetic quantum critical point

abstract: We study the superconducting instability of a two-dimensional disordered Fermi liquid weakly coupled to the soft fluctuations associated with proximity to an Ising-ferromagnetic quantum critical point. We derive interaction-induced corrections to the Usadel equation governing the superconducting gap function, and show that diffusion and localization effects drastically modify the interplay between fermionic incoherence and strong pairing interactions. In particular, we obtain the phase diagram, and demonstrate that: (i) there is an intermediate range of disorder strength where superconductivity is enhanced, eventually followed by a tendency towards the superconductor-insulator transition at stronger disorder; and (ii) diffusive particle-particle modes (so-called `Cooperons') acquire anomalous dynamical scaling $z=4$, indicating strong non-Fermi liquid behavior.


title: Testing the evolutionary pathways of galaxies and their supermassive black holes and the impact of feedback from Active Galactic Nuclei via large multiwavelength datasets

abstract: It is still a matter of intense debate how supermassive black holes (SMBH) grow, and the role played by feedback from active galactic nuclei (AGN) in the co-evolution of SMBHs and galaxies. To test the coevolution proposed by theoretical models, we compile a large AGN sample of 5639 X-ray detected AGN, over a wide redshift range, spanning nearly three orders of magnitude in X-ray luminosity. The AGN have been detected in the {\it{COSMOS-Legacy}}, the Bo$\rm \ddot{o}$tes, the XMM-{\it{XXL}} and the eFEDS fields. Using the specific star formation rate estimates, we split the AGN host galaxies into star forming (SF), starburst (SB) and quiescent (Q). Our results show that the AGN accretion is increased in SB systems compared to SF and Q. Our analysis reveals a mild increase of L$_X$ with M$_*$. The L$_X$/SFR ratio has a weak dependence on M$_*$, and at fixed M$_*$ it is highest in Q systems. The latter trend is mostly driven by the significant drop in SFR in the Q state. The measured strong variations in SFR from the SB/SF to Q mirror those predicted in merger models with AGN feedback. However, the observed mild variations in L$_X$ are at variance with the same models. We also study the evolution of SFR for a galaxy control sample and found that it is very similar to that of X-ray AGN. This suggests that either AGN play a minor role in the star formation quenching, or the relative timescales of the two processes are different.


title: Flashlights: More than A Dozen High-Significance Microlensing Events of Extremely Magnified Stars in Galaxies at Redshifts z=0.7-1.5

abstract: Once only accessible in nearby galaxies, we can now study individual stars across much of the observable universe aided by galaxy-cluster gravitational lenses. When a star, compact object, or multiple such objects in the foreground galaxy-cluster lens become aligned, they can magnify a background individual star, and the timescale of a magnification peak can limit its size to tens of AU. The number and frequency of microlensing events therefore opens a window into the population of stars and compact objects, as well as high-redshift stars. To assemble the first statistical sample of stars in order to constrain the initial mass function (IMF) of massive stars at redshift z=0.7-1.5, the abundance of primordial black holes in galaxy-cluster dark matter, and the IMF of the stars making up the intracluster light, we are carrying out a 192-orbit program with the Hubble Space Telescope called "Flashlights," which is now two-thirds complete owing to scheduling challenges. We use the ultrawide F200LP and F350LP long-pass WFC3 UVIS filters and conduct two 16-orbit visits separated by one year. Having an identical roll angle during both visits, while difficult to schedule, yields extremely clean subtraction. Here we report the discovery of more than a dozen bright microlensing events, including multiple examples in the famous "Dragon Arc" discovered in the 1980s, as well as the "Spocks" and "Warhol" arcs that have hosted already known supergiants. The ultradeep observer-frame ultraviolet-through-optical imaging is sensitive to hot stars, which will complement deep James Webb Space Telescope infrared imaging. We are also acquiring Large Binocular Telescope LUCI and Keck-I MOSFIRE near-infrared spectra of the highly magnified arcs to constrain their recent star-formation histories.


title: Discovery of a double sequence of blue straggler stars in the core-collapsed globular cluster NGC 6256

abstract: We used a combination of high-resolution optical images acquired with the Hubble Space Telescope and near-IR wide-field data to investigate the stellar density profile and the population of blue straggler star (BSS) in the Galactic globular cluster NGC6256, with the aim of probing its current stage of internal dynamical evolution. We found that the inner stellar density profile significantly deviates from a King model while is well reproduced by a steep cusp with a power-law slope alpha=-0.89, thus implying that the cluster is currently in the post core-collapse (PCC) phase. This is also confirmed by the very high segregation level of the BSS population measured through the A+ parameter. We also found that the distribution of BSSs in the color-magnitude diagram is characterized by a collimated blue sequence and a red more sparse component, as already observed in other three PCC clusters. The comparison with appropriate collisional models demonstrates that the vast majority of the BSSs lying along the collimated blue sequence is consistent with a generation of coeval (1 Gyr-old) stars with different masses originated by an event that highly enhanced the collisional rate of the system (i.e. the core collapse). This study confirms that the segregation level of BSSs is a powerful dynamical diagnostic also of star cluster in a very advanced stage of dynamical evolution. Moreover, it pushes forward the possibility of using the morphology of the BSS in the color-magnitude diagram as a tracer of the core-collapse and subsequent dynamical evolutionary phases.


title: Gregory-Laflamme encounters Superradiance

abstract: We investigate the effect of superradiant scattering of gravitational perturbations on the stability of rotating black strings, focusing on the six dimensional equal-spinning Myers-Perry black string. We find that rapidly rotating black strings are unstable to gravitational superradiant modes within a bounded range of string lengths. The instability occurs because momentum along the string direction creates a potential barrier that allows for the confinement of superradiant modes. Yet, five dimensional Myers-Perry black holes do not have stable particle orbits so, unlike other known superradiant systems, these black strings remain stable to perturbations with sufficiently high azimuthal mode number -- this is a `finite-$m$' superradiant instability. For some parameters, this instability competes with the Gregory-Laflamme instability, but otherwise exists independently. The onset of this instability is degenerate and branches to multiple steady-state solutions. This paper is the first of a trilogy: in the next two, we construct two distinct families of rotating strings emerging from the superradiant onset (the `black resonator strings' and `helical black strings'). We argue that similar physics is present in 5-dimensional Kerr black strings, but not in $D>6$ equal-spinning Myers-Perry black strings.


title: Unusual Abundances from Planetary System Material Polluting the White Dwarf G238-44

abstract: Ultraviolet and optical spectra of the hydrogen-dominated atmosphere white dwarf star G238-44 obtained with FUSE, Keck/HIRES, HST/COS, and HST/STIS reveal ten elements heavier than helium: C, N, O, Mg, Al, Si, P, S, Ca, and Fe. G238-44 is only the third white dwarf with nitrogen detected in its atmosphere from polluting planetary system material. Keck/HIRES data taken on eleven nights over 24 years show no evidence for variation in the equivalent width of measured absorption lines, suggesting stable and continuous accretion from a circumstellar reservoir. From measured abundances and limits on other elements we find an anomalous abundance pattern and evidence for the presence of metallic iron. If the pollution is from a single parent body, then it would have no known counterpart within the solar system. If we allow for two distinct parent bodies, then we can reproduce the observed abundances with a mix of iron-rich Mercury-like material and an analog of an icy Kuiper Belt object with a respective mass ratio of 1.7:1. Such compositionally disparate objects would provide chemical evidence for both rocky and icy bodies in an exoplanetary system and would be indicative of a planetary system so strongly perturbed that G238-44 is able to capture both asteroid- and Kuiper Belt-analog bodies near-simultaneously within its $<$100 Myr cooling age.


title: Wind Power Forecasting Considering Data Privacy Protection: A Federated Deep Reinforcement Learning Approach

abstract: In a modern power system with an increasing proportion of renewable energy, wind power prediction is crucial to the arrangement of power grid dispatching plans due to the volatility of wind power. However, traditional centralized forecasting methods raise concerns regarding data privacy-preserving and data islands problem. To handle the data privacy and openness, we propose a forecasting scheme that combines federated learning and deep reinforcement learning (DRL) for ultra-short-term wind power forecasting, called federated deep reinforcement learning (FedDRL). Firstly, this paper uses the deep deterministic policy gradient (DDPG) algorithm as the basic forecasting model to improve prediction accuracy. Secondly, we integrate the DDPG forecasting model into the framework of federated learning. The designed FedDRL can obtain an accurate prediction model in a decentralized way by sharing model parameters instead of sharing private data which can avoid sensitive privacy issues. The simulation results show that the proposed FedDRL outperforms the traditional prediction methods in terms of forecasting accuracy. More importantly, while ensuring the forecasting performance, FedDRL can effectively protect the data privacy and relieve the communication pressure compared with the traditional centralized forecasting method. In addition, a simulation with different federated learning parameters is conducted to confirm the robustness of the proposed scheme.


title: An Adversarial Robustness Perspective on the Topology of Neural Networks

abstract: In this paper, we investigate the impact of neural networks (NNs) topology on adversarial robustness. Specifically, we study the graph produced when an input traverses all the layers of a NN, and show that such graphs are different for clean and adversarial inputs. We find that graphs from clean inputs are more centralized around highway edges, whereas those from adversaries are more diffuse, leveraging under-optimized edges. Through experiments on a variety of datasets and architectures, we show that these under-optimized edges are a source of adversarial vulnerability and that they can be used to detect adversarial inputs.


title: Context-tree weighting and Bayesian Context Trees: Asymptotic and non-asymptotic justifications

abstract: The Bayesian Context Trees (BCT) framework is a recently introduced, general collection of statistical and algorithmic tools for modelling, analysis and inference with discrete-valued time series. The foundation of this development is built in part on some well-known information-theoretic ideas and techniques, including Rissanen's tree sources and Willems et al.'s context-tree weighting algorithm. This paper presents a collection of theoretical results that provide mathematical justifications and further insight into the BCT modelling framework and the associated practical tools. It is shown that the BCT prior predictive likelihood (the probability of a time series of observations averaged over all models and parameters) is both pointwise and minimax optimal, in agreement with the MDL principle and the BIC criterion. The posterior distribution is shown to be asymptotically consistent with probability one (over both models and parameters), and asymptotically Gaussian (over the parameters). And the posterior predictive distribution is also shown to be asymptotically consistent with probability one.


title: Effects of shady environments on fish collective behavior

abstract: Despite significant efforts devoted to understanding the underlying complexity and emergence of collective movement in animal groups, the role of different external settings on this type of movement remains largely unexplored. Here, by combining time series analysis and complex network tools, we present an extensive investigation of the effects of shady environments on the behavior of a fish species (Silver Carp Hypophthalmichthys molitrix) within earthen ponds. We find that shade encourages fish residence during daylight hours, but the degree of preference for shade varies substantially among trials and ponds. Silver Carp are much slower and exhibit lower persistence in their speeds when under shade than out of it during daytime and nighttime, with fish displaying the highest persistence degree and speeds at night. Furthermore, our research shows that shade affects fish schooling behavior by reducing their polarization, number of interactions among individuals, and the stability among local neighbors; however, fish keep a higher local degree of order when under shade compared to nighttime positions.


title: Efficient ECG-based Atrial Fibrillation Detection via Parameterised Hypercomplex Neural Networks

abstract: Atrial fibrillation (AF) is the most common cardiac arrhythmia and associated with a high risk for serious conditions like stroke. The use of wearable devices embedded with automatic and timely AF assessment from electrocardiograms (ECGs) has shown to be promising in preventing life-threatening situations. Although deep neural networks have demonstrated superiority in model performance, their use on wearable devices is limited by the trade-off between model performance and complexity. In this work, we propose to use lightweight convolutional neural networks (CNNs) with parameterised hypercomplex (PH) layers for AF detection based on ECGs. The proposed approach trains small-scale CNNs, thus overcoming the limited computing resources on wearable devices. We show comparable performance to corresponding real-valued CNNs on two publicly available ECG datasets using significantly fewer model parameters. PH models are more flexible than other hypercomplex neural networks and can operate on any number of input ECG leads.


title: Automatic Seizure Prediction using CNN and LSTM

abstract: The electroencephalogram (EEG) is one of the most precious technologies to understand the happenings inside our brain and further understand our body's happenings. Automatic prediction of oncoming seizures using the EEG signals helps the doctors and clinical experts and reduces their workload. This paper proposes an end-to-end deep learning algorithm to fully automate seizure prediction's laborious task without any heavy pre-processing on the EEG data or feature engineering. The proposed deep learning network is a blend of signal processing and deep learning pipeline, which automates the seizure prediction framework using the EEG signals. This proposed model was evaluated on an open EEG dataset, CHB-MIT. The network achieved an average sensitivity of 97.746\text{\%} and a false positive rate (FPR) of 0.2373 per hour.


title: Climbing Routes Clustering Using Energy-Efficient Accelerometers Attached to the Quickdraws

abstract: One of the challenges for climbing gyms is to find out popular routes for the climbers to improve their services and optimally use their infrastructure. This problem must be addressed preserving both the privacy and convenience of the climbers and the costs of the gyms. To this aim, a hardware prototype is developed to collect data using accelerometer sensors attached to a piece of climbing equipment mounted on the wall, called quickdraw, that connects the climbing rope to the bolt anchors. The corresponding sensors are configured to be energy-efficient, hence becoming practical in terms of expenses and time consumption for replacement when used in large quantities in a climbing gym. This paper describes hardware specifications, studies data measured by the sensors in ultra-low power mode, detect patterns in data during climbing different routes, and develops an unsupervised approach for route clustering.


title: Deep Distance Sensitivity Oracles

abstract: One of the most fundamental graph problems is finding a shortest path from a source to a target node. While in its basic forms the problem has been studied extensively and efficient algorithms are known, it becomes significantly harder as soon as parts of the graph are susceptible to failure. Although one can recompute a shortest replacement path after every outage, this is rather inefficient both in time and/or storage. One way to overcome this problem is to shift computational burden from the queries into a pre-processing step, where a data structure is computed that allows for fast querying of replacement paths, typically referred to as a Distance Sensitivity Oracle (DSO). While DSOs have been extensively studied in the theoretical computer science community, to the best of our knowledge this is the first work to construct DSOs using deep learning techniques. We show how to use deep learning to utilize a combinatorial structure of replacement paths. More specifically, we utilize the combinatorial structure of replacement paths as a concatenation of shortest paths and use deep learning to find the pivot nodes for stitching shortest paths into replacement paths.


title: Evaluating Emerging CXL-enabled Memory Pooling for HPC Systems

abstract: Current HPC systems provide memory resources that are statically configured and tightly coupled with compute nodes. However, workloads on HPC systems are evolving. Diverse workloads lead to a need for configurable memory resources to achieve high performance and utilization. In this study, we evaluate a memory subsystem design leveraging CXL-enabled memory pooling. Two promising use cases of composable memory subsystems are studied -- fine-grained capacity provisioning and scalable bandwidth provisioning. We developed an emulator to explore the performance impact of various memory compositions. We also provide a profiler to identify the memory usage patterns in applications and their optimization opportunities. Seven scientific and six graph applications are evaluated on various emulated memory configurations. Three out of seven scientific applications had less than 10% performance impact when the pooled memory backed 75% of their memory footprint. The results also show that a dynamically configured high-bandwidth system can effectively support bandwidth-intensive unstructured mesh-based applications like OpenFOAM. Finally, we identify interference through shared memory pools as a practical challenge for adoption on HPC systems.


title: An efficient electrostatic embedding QM/MM method using periodic boundary conditions based on particle-mesh Ewald sums and electrostatic potential fitted charge operators

abstract: Hybrid quantum mechanics / molecular mechanics (QM/MM) models successfully describe the properties of biological macromolecules. However, most QM/MM methodologies are constrained to unrealistic gas phase models, thus limiting their applicability. In the literature, several works have attempted to define a QM/MM model in periodic boundary conditions (PBC) but frequently the models are too time-consuming for general applicability to biological systems in solution. Here, we define a simple and efficient electrostatic embedding QM/MM model in PBC combining the benefits of electrostatic potential fitted (ESPF) atomic charges and particle-mesh Ewald sums, that can efficiently treat systems of arbitrary size at a reasonable computational cost. To illustrate this, we apply our scheme to extract the lowest singlet excitation energies from a model for arabidopsis thaliana cryptochrome 1 containing circa 93000 atoms, reproducing accurately the experimental absorption maximum.


title: Digital quantum simulation of scalar Yukawa coupling

abstract: Motivated by the revitalized interest in the digital quantum simulation of coupled fermion-boson models from medium- and high-energy physics, we investigate the nonequilibrium dynamics following a Yukawa-interaction quench on IBM Q. Adopting -- due to current quantum-hardware limitations -- a single-site (zero-dimensional) version of the scalar Yukawa-coupling model as our point of departure, we design low-depth quantum circuits that emulate its dynamics with up to three bosons. In particular, using advanced circuit-optimization techniques, in the one-boson case we demonstrate circuit compression, i.e.~design a constant-depth circuit containing only two CNOT gates, regardless of the total simulation time. In the three-boson case -- where such a compression is not possible -- we design a circuit in which one Trotter step entails $8$ CNOTs, this number being far below the maximal CNOT-cost of a generic three-qubit gate. Using an analogy with the travelling salesman problem, we also provide a CNOT-cost estimate for quantum circuits emulating the system dynamics for higher boson-number truncations. Based on the designed circuits, we quantify the system dynamics for the initial vacuum state by evaluating the expected boson number at an arbitrary time after a Yukawa-interaction quench, as well as the survival probability of the initial state (the Loschmidt echo). Finally, we make use of the designed circuits to drive adiabatic transitions and compute the energies of the ground- and first excited state of the model under consideration. We validate our results by performing error mitigation in the form of zero-noise extrapolation, finding an excellent agreement of our obtained results with the exact ones obtained through classical benchmarking.


title: Quantum Work Capacitances: ultimate limits for energy extraction on noisy quantum batteries

abstract: We present a theoretical analysis of the energy recovery efficiency for quantum batteries composed of many identical quantum cells undergoing noise. While the possibility of using quantum effects to speed up the charging processes of batteries have been vastly investigated, In order to traslate these ideas into working devices it is crucial to assess the stability of the storage phase in the quantum battery elements when they are in contact with environmental noise. In this work we formalize this problem introducing a series of operationally well defined figures of merit (the work capacitances and the Maximal Asymptotic Work/Energy Ratios) which gauge the highest efficiency one can attain in recovering useful energy from quantum battery models that are formed by large collections of identical and independent elements (quantum cells or q-cells). Explicit evaluations of such quantities are presented for the case where the energy storing system undergoes through dephasing and depolarizing noise.


title: LightNorm: Area and Energy-Efficient Batch Normalization Hardware for On-Device DNN Training

abstract: When training early-stage deep neural networks (DNNs), generating intermediate features via convolution or linear layers occupied most of the execution time. Accordingly, extensive research has been done to reduce the computational burden of the convolution or linear layers. In recent mobile-friendly DNNs, however, the relative number of operations involved in processing these layers has significantly reduced. As a result, the proportion of the execution time of other layers, such as batch normalization layers, has increased. Thus, in this work, we conduct a detailed analysis of the batch normalization layer to efficiently reduce the runtime overhead in the batch normalization process. Backed up by the thorough analysis, we present an extremely efficient batch normalization, named LightNorm, and its associated hardware module. In more detail, we fuse three approximation techniques that are i) low bit-precision, ii) range batch normalization, and iii) block floating point. All these approximate techniques are carefully utilized not only to maintain the statistics of intermediate feature maps, but also to minimize the off-chip memory accesses. By using the proposed LightNorm hardware, we can achieve significant area and energy savings during the DNN training without hurting the training accuracy. This makes the proposed hardware a great candidate for the on-device training.


title: Exponentially distorted subgroups in wreath products

abstract: We exhibit exponentially distorted subgroups in $\mathbb{Z} \wr ( \mathbb{Z} \wr \mathbb{Z} )$ and $\mathbb{Z} \wr F_2$.


title: Axioms for the category of Hilbert spaces and linear contractions

abstract: The category of Hilbert spaces and linear contractions is characterised by elementary categorical properties that do not refer to probabilities, complex numbers, norm, continuity, convexity, or dimension.


title: The Friedrichs Operator and Circular Domains

abstract: The Friedrichs operator of a domain (in $\mathbb{C}^n$) is closely related to its Bergman projection and encodes crucial information (geometric, quadrature, potential theoretic etc.) about the domain. We show that the Friedrichs operator of a domain has rank one if the domain can be covered by a circular domain via a proper holomorphic map of finite multiplicity whose Jacobian is a homogeneous polynomial. As an application, we show that the Friedrichs operator is of rank one on the tetrablock, pentablock, and the symmetrized polydisc - domains of significance in the study of $\mu$-synthesis in control theory.


title: Speech enhancement using ego-noise references with a microphone array embedded in an unmanned aerial vehicle

abstract: A method is proposed for performing speech enhancement using ego-noise references with a microphone array embedded in an unmanned aerial vehicle (UAV). The ego-noise reference signals are captured with microphones located near the UAV's propellers and used in the prior knowledge multichannel Wiener filter (PK-MWF) to obtain the speech correlation matrix estimate. Speech presence probability (SPP) can be estimated for detecting speech activity from an external microphone near the speech source, providing a performance benchmark, or from one of the embedded microphones, assuming a more realistic scenario. Experimental measurements are performed in a semi-anechoic chamber, with a UAV mounted on a stand and a loudspeaker playing a speech signal, while setting three distinct and fixed propeller rotation speeds, resulting in three different signal-to-noise ratios (SNRs). The recordings obtained and made available online are used to compare the proposed method to the use of the standard multichannel Wiener filter (MWF) estimated with and without the propellers' microphones being used in its formulation. Results show that compared to those, the use of PK-MWF achieves higher levels of improvement in speech intelligibility and quality, measured by STOI and PESQ, while the SNR improvement is similar.


title: Optimised Trotter Decompositions for Classical and Quantum Computing

abstract: Suzuki-Trotter decompositions of exponential operators like $\exp(Ht)$ are required in almost every branch of numerical physics. Often the exponent under consideration has to be split into more than two operators $H=\sum_k A_k$, for instance as local gates on quantum computers. We demonstrate how highly optimised schemes originally derived for exactly two operators $A_{1,2}$ can be applied to such generic Suzuki-Trotter decompositions, providing a formal proof of correctness as well as numerical evidence of efficiency. A comprehensive review of existing symmetric decomposition schemes up to order $n\le4$ is presented and complemented by a number of novel schemes, including both real and complex coefficients. We derive the theoretically most efficient unitary and non-unitary 4th order decompositions. The list is augmented by several exceptionally efficient schemes of higher order $n\le8$. Furthermore we show how Taylor expansions can be used on classical devices to reach machine precision at a computational effort at which state of the art Trotterization schemes do not surpass a relative precision of $10^{-4}$. Finally, a short and easily understandable summary explains how to choose the optimal decomposition in any given scenario.

categories: quant-ph cond-mat.stat-mech cond-mat.str-el hep-lat physics.comp-ph


title: High-Order Spline Upwind for Space-Time Isogeometric Analysis

abstract: We propose an innovative isogeometric space-time method for the heat equation, with smooth splines approximation in both space and time. To enhance the stability of the method we add a stabilizing term, based on a linear combination of high-order artificial diffusions. This term is designed in order to make the linear system lower block-triangular, that is, lower triangular with respect to time. In order to keep optimal accuracy, the stabilization terms are further weighted in terms of the residual. Through a series of numerical experiments, we validate the method's capability, showcasing its stability and accuracy.


title: Kekul\'e spiral order in magic-angle graphene: a density matrix renormalization group study

abstract: When the two layers of a twisted moir\'e system are subject to different degrees of strain, the effect is amplified by the inverse twist angle, e.g., by a factor of 50 in magic angle twisted bilayer graphene (TBG). Samples of TBG typically have heterostrains of 0.1-0.7%, increasing the bandwidth of the "flat'' bands by as much as tenfold, placing TBG in an intermediate coupling regime. Here we study the phase diagram of TBG in the presence of heterostrain with unbiased, large-scale density matrix renormalization group calculations (bond dimension $\chi=24576$), including all spin and valley degrees of freedom. Working at filling $\nu = -3$, we find a strain of $0.05\%$ drives a transition from a quantized anomalous Hall insulator into an incommensurate-Kekul\'e spiral (IKS) phase. This peculiar order, proposed and studied at mean-field level by Kwan et al (PRX 11, 041063), breaks both valley conservation and translation symmetry $\hat{T}$, but preserves a modified translation symmetry $\hat{T}'$ with moir\'e-incommensurate phase modulation. Even higher strains drive the system to a fully symmetric metal.


title: Geometry of Rounding

abstract: Rounding has proven to be a fundamental tool in theoretical computer science. By observing that rounding and partitioning of $\mathbb{R}^d$ are equivalent, we introduce the following natural partition problem which we call the {\em secluded hypercube partition problem}: Given $k\in \mathbb{N}$ (ideally small) and $\epsilon>0$ (ideally large), is there a partition of $\mathbb{R}^d$ with unit hypercubes such that for every point $p \in \mathbb{R}^d$, its closed $\epsilon$-neighborhood (in the $\ell_{\infty}$ norm) intersects at most $k$ hypercubes? We undertake a comprehensive study of this partition problem. We prove that for every $d\in \mathbb{N}$, there is an explicit (and efficiently computable) hypercube partition of $\mathbb{R}^d$ with $k = d+1$ and $\epsilon = \frac{1}{2d}$. We complement this construction by proving that the value of $k=d+1$ is the best possible (for any $\epsilon$) for a broad class of ``reasonable'' partitions including hypercube partitions. We also investigate the optimality of the parameter $\epsilon$ and prove that any partition in this broad class that has $k=d+1$, must have $\epsilon\leq\frac{1}{2\sqrt{d}}$. These bounds imply limitations of certain deterministic rounding schemes existing in the literature. Furthermore, this general bound is based on the currently known lower bounds for the dissection number of the cube, and improvements to this bound will yield improvements to our bounds. While our work is motivated by the desire to understand rounding algorithms, one of our main conceptual contributions is the introduction of the {\em secluded hypercube partition problem}, which fits well with a long history of investigations by mathematicians on various hypercube partitions/tilings of Euclidean space.


title: WaveNets: Wavelet Channel Attention Networks

abstract: Channel Attention reigns supreme as an effective technique in the field of computer vision. However, the proposed channel attention by SENet suffers from information loss in feature learning caused by the use of Global Average Pooling (GAP) to represent channels as scalars. Thus, designing effective channel attention mechanisms requires finding a solution to enhance features preservation in modeling channel inter-dependencies. In this work, we utilize Wavelet transform compression as a solution to the channel representation problem. We first test wavelet transform as an Auto-Encoder model equipped with conventional channel attention module. Next, we test wavelet transform as a standalone channel compression method. We prove that global average pooling is equivalent to the recursive approximate Haar wavelet transform. With this proof, we generalize channel attention using Wavelet compression and name it WaveNet. Implementation of our method can be embedded within existing channel attention methods with a couple of lines of code. We test our proposed method using ImageNet dataset for image classification task. Our method outperforms the baseline SENet, and achieves the state-of-the-art results. Our code implementation is publicly available at https://github.com/hady1011/WaveNet-C.


title: MalGrid: Visualization Of Binary Features In Large Malware Corpora

abstract: The number of malware is constantly on the rise. Though most new malware are modifications of existing ones, their sheer number is quite overwhelming. In this paper, we present a novel system to visualize and map millions of malware to points in a 2-dimensional (2D) spatial grid. This enables visualizing relationships within large malware datasets that can be used to develop triage solutions to screen different malware rapidly and provide situational awareness. Our approach links two visualizations within an interactive display. Our first view is a spatial point-based visualization of similarity among the samples based on a reduced dimensional projection of binary feature representations of malware. Our second spatial grid-based view provides a better insight into similarities and differences between selected malware samples in terms of the binary-based visual representations they share. We also provide a case study where the effect of packing on the malware data is correlated with the complexity of the packing algorithm.