title: Mode Selection in Cognitive Radar Networks

abstract: Cognitive Radar Networks, which were popularized by Simon Haykin in 2006, have been proposed to address limitations with legacy radar installations. These limitations include large physical size, power consumption, fixed operating parameters, and single point vulnerabilities. Cognitive radar solves part of this problem through adaptability, using biologically inspired techniques to observe the environment and adjust operation accordingly. Cognitive radar networks (CRNs) extend the capabilities of cognitive radar spatially, providing the opportunity to observe targets from multiple angles to mitigate stealth effects; distribute resources over space and in time; obtain better tracking performance; and gain more information from a scene. Often, problems of cognition in CRNs are viewed through the lens of iterative learning problems - one or multiple cognitive processes are implemented in the network, where each process first observes the environment, then selects operating parameters (from discrete or continuous options) using the history of observations and previous rewards, then repeats the cycle. Further, cognitive radar networks often are modeled with a flexible architecture and wide-bandwidth front-ends, enabling the addition of electronic support measures such as passive signal estimation. In this work we consider questions of the form "How should a cognitive radar network choose when to observe targets?" and "How can a cognitive radar network reduce the amount of energy it uses?". We implement tools from the multi-armed bandit and age of information literature to select modes for the network, choosing either an active radar mode or a passive signal estimation mode. We show that through the use of target classes, the network can determine how often each target should be observed to optimize tracking performance.


title: Deep Learning-Enabled Swallowing Monitoring and Postoperative Recovery Biosensing System

abstract: This study introduces an innovative 3D printed dry electrode tailored for biosensing in postoperative recovery scenarios. Fabricated through a drop coating process, the electrode incorporates a novel 2D material.


title: Deep Representation Learning for Open Vocabulary Electroencephalography-to-Text Decoding

abstract: Previous research has demonstrated the potential of using pre-trained language models for decoding open vocabulary Electroencephalography (EEG) signals captured through a non-invasive Brain-Computer Interface (BCI). However, the impact of embedding EEG signals in the context of language models and the effect of subjectivity, remain unexplored, leading to uncertainty about the best approach to enhance decoding performance. Additionally, current evaluation metrics used to assess decoding effectiveness are predominantly syntactic and do not provide insights into the comprehensibility of the decoded output for human understanding. We present an end-to-end deep learning framework for non-invasive brain recordings that brings modern representational learning approaches to neuroscience. Our proposal introduces the following innovations: 1) an end-to-end deep learning architecture for open vocabulary EEG decoding, incorporating a subject-dependent representation learning module for raw EEG encoding, a BART language model, and a GPT-4 sentence refinement module; 2) a more comprehensive sentence-level evaluation metric based on the BERTScore; 3) an ablation study that analyses the contributions of each module within our proposal, providing valuable insights for future research. We evaluate our approach on two publicly available datasets, ZuCo v1.0 and v2.0, comprising EEG recordings of 30 subjects engaged in natural reading tasks. Our model achieves a BLEU-1 score of 42.75%, a ROUGE-1-F of 33.28%, and a BERTScore-F of 53.86%, outperforming the previous state-of-the-art methods by 3.38%, 8.43%, and 6.31%, respectively.


title: Optimized Transmission Strategy for UAV-RIS 2.0 Assisted Communications Using Rate Splitting Multiple Access

abstract: In this paper, we study the transmission strategy of a ground-based beyond diagonal reconfigurable intelligent surface (BD-RIS), a.k.a RIS 2.0, in a network where multiple unmanned aerial vehicles (UAVs) simultaneously transmit signals to the respective groups of users. It is assumed that each group is assigned subcarriers orthogonal to those assigned to other groups and rate splitting multiple access (RSMA) is adopted within each group. A corresponding mixed integer nonlinear programming problem (MINLP) is formulated, which aims to jointly optimize 1) allocation of BD-RIS elements to groups, 2) BD-RIS phase rotations, 3) rate allocation in RSMA, and 4) precoders. To solve the problem, we propose using generalized benders decomposition (GBD) augmented with a manifold-based algorithm. GBD splits the MINLP problem into two sub-problems, namely the primal and the relaxed master problem, which are solved alternately and iteratively. In the primal problem, we apply block coordinate descent (BCD) to manage the coupling of variables effectively. Moreover, we recognize the manifold structure in the phase rotation constraint of BD-RIS, enabling the Riemannian conjugate gradient (RCG). Simulation results demonstrate the effectiveness of the proposed approach in maximizing spectral efficiency.


title: Radiation of anomalous energy

abstract: In the Coulomb field of nucleus cut off on it size, besides usual atomic states, there are additional ones. These anomalous states are deep (in the range of $10\,MeV$) in the Dirac sea and can exist solely during a macroscopic acceleration of the nucleus exceeding the certain level. This way a low energy perturbation, providing the nucleus acceleration, can result in $\sim 10\,MeV$ gamma and neutron radiation due to electron transitions to those anomalous levels. Experimentally observed gamma quanta and neutrons of that energy scale, in the electric discharge in air, look as radiation from "nothing" if to forget about the transitions to the anomalous states. The perspective of energy generation, exceeding the input level, is discussed.


title: Point-of-Care Real-Time Signal Quality for Fetal Doppler Ultrasound Using a Deep Learning Approach

abstract: In this study, we present a deep learning framework designed to integrate with our previously developed system that facilitates large-scale 1D fetal Doppler data collection, aiming to enhance data quality. This system, tailored for traditional Indigenous midwives in low-resource communities, leverages a cost-effective Android phone to improve the quality of recorded signals. We have shown that the Doppler data can be used to identify fetal growth restriction, hypertension, and other concerning issues during pregnancy. However, the quality of the signal is dependent on many factors, including radio frequency interference, position of the fetus, maternal body habitus, and usage of the Doppler by the birth attendants. In order to provide instant feedback to allow correction of the data at source, a signal quality metric is required that can run in real-time on the mobile phone. In this study, 191 DUS signals with durations mainly in the range between 5 to 10 minutes were evaluated for quality and classified into five categories: Good, Poor, (Radiofrequency) Interference, Talking, and Silent, at a resolution of 3.75 seconds. A deep neural network was trained on each 3.75-second segment from these recordings and validated using five-fold cross-validation. An average micro F1 = 97.4\% and macro F1 = 94.2\% were achieved, with F1 = 99.2\% for `Good' quality data. These results indicate that the algorithm, which will now be implemented in the midwives' app, should allow a significant increase in the quality of data at the time of capture.


title: Task Tree Retrieval For Robotic Cooking

abstract: This paper is based on developing different algorithms, which generate the task tree planning for the given goal node(recipe). The knowledge representation of the dishes is called FOON. It contains the different objects and their between them with respective to the motion node The graphical representation of FOON is made by noticing the change in the state of an object with respect to the human manipulators. We will explore how the FOON is created for different recipes by the robots. Task planning contains difficulties in exploring unknown problems, as its knowledge is limited to the FOON. To get the task tree planning for a given recipe, the robot will retrieve the information of different functional units from the knowledge retrieval process called FOON. Thus the generated subgraphs will allow the robot to cook the required dish. Thus the robot can able to cook the given recipe by following the sequence of instructions.


title: Fermionic quartet and vestigial gravity

abstract: We discuss the two-step transitions in superconductors, where the intermediate state between the Cooper pair state and the normal metal is the 4-fermion condensate, which is called the intertwined vestigial order. We discuss different types of the vestigial order, which are possible in the spin-triplet superfluid $^3$He, and the topological objects in the vestigial phases. Since in $^3$He the order parameter $A_{\alpha i}$ represents the analog of gravitational tetrads, we suggest that the vestigial states are possible in quantum gravity. As in superconductors, the fermionic vacuum can experience two consequent phase transitions. At first transition the metric appears as the bilinear combination of tetrads $g_{\mu\nu} =\eta_{ab}< \hat E^a_\mu \hat E^b_\nu>$, while the tetrad order parameter is still absent, $e_\mu^a=< \hat E^a_\mu> =0$. This corresponds to the bosonic Einstein general relativity, which emerges in the fermionic vacuum. The nonzero tetrads $e_\mu^a=< \hat E^a_\mu> \neq 0$ appear at the second transition, where a kind of the Einstein-Cartan-Sciama-Kibble tetrad gravity is formed. This suggests that on the levels of particles, gravity acts with different strength on fermions and bosons.


title: Temporal Transfer Learning for Traffic Optimization with Coarse-grained Advisory Autonomy

abstract: The recent development of connected and automated vehicle (CAV) technologies has spurred investigations to optimize dense urban traffic. This paper considers advisory autonomy, in which real-time driving advisories are issued to drivers, thus blending the CAV and the human driver. Due to the complexity of traffic systems, recent studies of coordinating CAVs have resorted to leveraging deep reinforcement learning (RL). Advisory autonomy is formalized as zero-order holds, and we consider a range of hold duration from 0.1 to 40 seconds. However, despite the similarity of the higher frequency tasks on CAVs, a direct application of deep RL fails to be generalized to advisory autonomy tasks. We introduce Temporal Transfer Learning (TTL) algorithms to select source tasks, systematically leveraging the temporal structure to solve the full range of tasks. TTL selects the most suitable source tasks to maximize the performance of the range of tasks. We validate our algorithms on diverse mixed-traffic scenarios, demonstrating that TTL more reliably solves the tasks than baselines. This paper underscores the potential of coarse-grained advisory autonomy with TTL in traffic flow optimization.


title: Riemannian Prediction of Anatomical Diagnoses in Congenital Heart Disease based on 12-lead ECGs

abstract: Congenital heart disease (CHD) is a relatively rare disease that affects patients at birth and results in extremely heterogeneous anatomical and functional defects. 12-lead ECG signal is routinely collected in CHD patients because it provides significant biomarkers for disease prognosis. However, developing accurate machine learning models is challenging due to the lack of large available datasets. Here, we suggest exploiting the Riemannian geometry of the spatial covariance structure of the ECG signal to improve classification. Firstly, we use covariance augmentation to mix samples across the Riemannian geodesic between corresponding classes. Secondly, we suggest to project the covariance matrices to their respective class Riemannian mean to enhance the quality of feature extraction via tangent space projection. We perform several ablation experiments and demonstrate significant improvement compared to traditional machine learning models and deep learning on ECG time series data.


title: A Beauville-Laszlo-type descent theorem for locally Noetherian schemes

abstract: Let $X$ be a locally Noetherian scheme with a closed subscheme $Z$. Let $\mathcal{X}$ be the completion of $X$ at $Z$, considered as a formal scheme. We show that a coherent sheaf on $X$ is equivalently given by a coherent sheaf on $\mathcal{X}$, a coherent sheaf on the complement of $Z$, and an isomorphism of pullbacks of these sheaves to a certain adic space $W$. By defining $W$ as an adic space instead of as a Berkovich space we are able to generalize the descent result of Ben-Bassat and Temkin from finite type $k$-schemes to locally Noetherian schemes.


title: Smart Roads: Roadside Perception, Vehicle-Road Cooperation and Business Model

abstract: Smart roads have become an essential component of intelligent transportation systems (ITS). The roadside perception technology, a critical aspect of smart roads, utilizes various sensors, roadside units (RSUs), and edge computing devices to gather real-time traffic data for vehicle-road cooperation. However, the full potential of smart roads in improving the safety and efficiency of autonomous vehicles only can be realized through the mass deployment of roadside perception and communication devices. On the one hand, roadside devices require significant investment but can only achieve monitoring function currently, resulting in no profitability for investors. On the other hand, drivers lack trust in the safety of autonomous driving technology, making it difficult to promote large-scale commercial applications. To deal with the dilemma of mass deployment, we propose a novel smart-road vehicle-guiding architecture for vehicle-road cooperative autonomous driving, based on which we then propose the corresponding business model and analyze its benefits from both operator and driver perspectives. The numerical simulations validate that our proposed smart road solution can enhance driving safety and traffic efficiency. Moreover, we utilize the cost-benefit analysis (CBA) model to assess the economic advantages of the proposed business model which indicates that the smart highway that can provide vehicle-guided-driving services for autonomous vehicles yields more profit than the regular highway.


title: Model-independent Gamma-Ray Bursts Constraints on Cosmological Models Using Machine Learning

abstract: In this paper, we calibrate the luminosity relation of gamma-ray bursts (GRBs) with the machine learning (ML) methods for reconstructing distance-redshift relation from the Pantheon+ sample of type Ia supernovae (SNe Ia) in a cosmology-independent way. The A219 GRB data set at low redshift are used to calibrate the Amati relation ($E_{\rm p}$-$E_{\rm iso}$) relation by the ML methods selected with the best performance %and the calibrated results are extrapolated to the high redshift data to construct the Hubble diagram at high redshift. We constrain cosmological models via the Markov Chain Monte Carlo numerical method with the GRBs at high redshift and the latest observational Hubble data (OHD). By the K-Nearest Neighbors (KNN) methods, we obtain $\Omega_{\rm m}$ = $0.29^{+0.09}_{-0.06}$, $h$ = $0.66^{+0.04}_{-0.07}$ , $w_0$ = $-0.83^{+0.66}_{-0.31}$, $w_a$ = $-0.91^{+0.87}_{-0.46}$ at 1-$\sigma$ confidence level for the Chevallier-Polarski-Linder (CPL) model in a flat space, which favor the dark energy with a possible evolution ($w_a\neq0$) at 1-$\sigma$. These results are consistent with those obtained from GRBs calibrated via the Gaussian Process.


title: A question about generalized nonvanishing

abstract: Let $(X,\Delta)$ be a projective, $\mathbb{Q}$-factorial log canonical pair and let $L$ be a pseudoeffective $\mathbb{Q}$-divisor on $X$ such that $K_X + \Delta + L$ is pseudoeffective. Is there an effective $\mathbb{Q}$-divisor $M$ on $X$ such that $K_X + \Delta + L$ is numerically equivalent to $M$? We are not aware of any counterexamples, but the answer is not completely clear even in the case of surfaces.


title: A Compact LSTM-SVM Fusion Model for Long-Duration Cardiovascular Diseases Detection

abstract: Globally, cardiovascular diseases (CVDs) are the leading cause of mortality, accounting for an estimated 17.9 million deaths annually. One critical clinical objective is the early detection of CVDs using electrocardiogram (ECG) data, an area that has received significant attention from the research community. Recent advancements based on machine learning and deep learning have achieved great progress in this domain. However, existing methodologies exhibit inherent limitations, including inappropriate model evaluations and instances of data leakage. In this study, we present a streamlined workflow paradigm for preprocessing ECG signals into consistent 10-second durations, eliminating the need for manual feature extraction/beat detection. We also propose a hybrid model of Long Short-Term Memory (LSTM) with Support Vector Machine (SVM) for fraud detection. This architecture consists of two LSTM layers and an SVM classifier, which achieves a SOTA results with an Average precision score of 0.9402 on the MIT-BIH arrhythmia dataset and 0.9563 on the MIT-BIH atrial fibrillation dataset. Based on the results, we believe our method can significantly benefit the early detection and management of CVDs.


title: Variations of Particle Motion in the Van Allen Belts

abstract: Earth's magnetic field traps charged particles from the solar wind in the Van Allen belts. These trapped ions execute three types of motion: helical motion around magnetic field lines, longitudinal motion between North and South mirror points, and latitudinal drift motion around Earth. Each is associated with an adiabatic invariant, which expresses restrictions on each type of motion. This study examines the effect on proton motion and the three adiabatic invariants when the strength of Earth's magnetic moment varies with time. Using a Python 3 code developed in Google Colaboratory, each invariant was calculated and graphed for a static magnetic field, for magnetic fields that varied with periods shorter than the invariant period, and for magnetic fields that varied with periods longer than the invariant period. The results demonstrate that if Earth's magnetic moment changes quickly enough with time, the adiabatic invariant is no longer constant, allowing a wider variety of ion movement. Further study of these invariants and how they change in time-varying magnetic fields could help predict ion motion and changes to the magnetosphere during events that affect space weather, like solar storms or pole reversals.


title: BICM-compatible Rate Adaptive Geometric Constellation Shaping Using Optimized Many-to-one Labeling

abstract: In this paper, a rate adaptive geometric constellation shaping (GCS) scheme which is fully backward-compatible with existing state of the art bit-interleaved coded modulation (BICM) systems is proposed and experimentally demonstrated. The system relies on optimization of the positions of the quadrature amplitude modulation (QAM) points on the I/Q plane for maximized achievable information rate, while maintaining quantization and fiber nonlinear noise robustness. Furthermore, `dummy' bits are multiplexed with coded bits before mapping to symbols. Rate adaptivity is achieved by tuning the ratio of coded and `dummy' bits, while maintaining a fixed forward error-correction block and a fixed modulation format size. The points' positions and their labeling are optimized using automatic differentiation. The proposed GCS scheme is compared to a time-sharing hybrid (TH) QAM modulation and the now mainstream probabilistic amplitude shaping (PAS) scheme. The TH without shaping is outperformed for all studied data rates in a simulated linear channel by up to 0.7 dB. In a linear channel, PAS is shown to outperform the proposed GCS scheme, while similar performances are reported for PAS and the proposed GCS in a simulated nonlinear fiber channel. The GCS scheme is experimentally demonstrated in a multi-span recirculating loop coherent optical fiber transmission system with a total distance of up to 3000 km. Near-continuous zero-error flexible throughput is reported as a function of the transmission distance. Up to 1-2 spans of increased reach gains are achieved at the same net data rate w.r.t. conventional QAM. At a given distance, up to 0.79 bits/2D symbol of gain w.r.t. conventional QAM is achieved. In the experiment, similar performance to PAS is demonstrated.

categories: eess.SP cs.IT math.IT math.OC physics.optics


title: IncepSE: Leveraging InceptionTime's performance with Squeeze and Excitation mechanism in ECG analysis

abstract: Our study focuses on the potential for modifications of Inception-like architecture within the electrocardiogram (ECG) domain. To this end, we introduce IncepSE, a novel network characterized by strategic architectural incorporation that leverages the strengths of both InceptionTime and channel attention mechanisms. Furthermore, we propose a training setup that employs stabilization techniques that are aimed at tackling the formidable challenges of severe imbalance dataset PTB-XL and gradient corruption. By this means, we manage to set a new height for deep learning model in a supervised learning manner across the majority of tasks. Our model consistently surpasses InceptionTime by substantial margins compared to other state-of-the-arts in this domain, noticeably 0.013 AUROC score improvement in the "all" task, while also mitigating the inherent dataset fluctuations during training.


title: A Distributed Inference System for Detecting Task-wise Single Trial Event-Related Potential in Stream of Satellite Images

abstract: Brain-computer interface (BCI) has garnered the significant attention for their potential in various applications, with event-related potential (ERP) performing a considerable role in BCI systems. This paper introduces a novel Distributed Inference System tailored for detecting task-wise single-trial ERPs in a stream of satellite images. Unlike traditional methodologies that employ a single model for target detection, our system utilizes multiple models, each optimized for specific tasks, ensuring enhanced performance across varying image transition times and target onset times. Our experiments, conducted on four participants, employed two paradigms: the Normal paradigm and an AI paradigm with bounding boxes. Results indicate that our proposed system outperforms the conventional methods in both paradigms, achieving the highest $F_{\beta}$ scores. Furthermore, including bounding boxes in the AI paradigm significantly improved target recognition. This study underscores the potential of our Distributed Inference System in advancing the field of ERP detection in satellite image streams.


title: Compressible Navier-Stokes equations without heat conduction in Lp-framework

abstract: In this paper, we mainly consider global well-posedness and long time behavior of compressible Navier-Stokes equations without heat conduction in $L^p$-framework. This is a generalization of Peng and Zhai \cite{peng}(SIMA, 55(2023), no.2, 1439-1463), where they obtained the corresponding result in $L^2$-framework. Based on the key observation that we can release the regularity of non-dissipative entropy $S$ in high frequency in \cite{peng}, we ultimately achieve the desired $L^p$ estimate in the high frequency via complicated calculations on the nonlinear terms. In addition, we get the $L^p$-decay rate of the solution.


title: Elastic wave dispersion in layered media with suture joints: influence of structural hierarchy and viscoelasticity

abstract: Suture joints contribute to the exceptional combination of stiffness, strength, toughness and efficient load bearing and transmission of many biological structures like the cranium or ammonite fossil shells. However, their role in the attenuation of vibrations and effect on dynamic loads is less clear. Moreover, the self-similar hierarchical geometry often associated with suture joints renders its treatment with standard numerical approaches computationally prohibitive. To address this problem, this paper investigates the dynamic response of periodic layered media with suture joints using an analytical approach based on material homogenization. A general trapezoidal suture geometry is considered together with the fundamental ingredients of hierarchy and viscoelasticity. The Spectral Element Method and Bloch theorem are used to derive the dispersion relation and band diagram of the system, including propagating and evanescent dispersion modes. A strong influence of the suture morphology and material properties emerges, and the analysis reveals an important advantage of adding hierarchy, i.e. the possibility of simultaneously obtaining wider bandgaps and their shift to higher frequencies. A synergy between hierarchy and structure is also observed, providing superior levels of wave attenuation. These findings suggest a possible design concept for bioinspired devices with efficient and tailorable wave attenuation properties.


title: vEEGNet: learning latent representations to reconstruct EEG raw data via variational autoencoders

abstract: Electroencephalografic (EEG) data are complex multi-dimensional time-series that are very useful in many applications, from diagnostics to driving brain-computer interface systems. Their classification is still a challenging task, due to the inherent within- and between-subject variability and their low signal-to-noise ratio. On the other hand, the reconstruction of raw EEG data is even more difficult because of the high temporal resolution of these signals. Recent literature has proposed numerous machine and deep learning models that could classify, e.g., different types of movements, with an accuracy in the range 70% to 80% (with 4 classes). On the other hand, a limited number of works targeted the reconstruction problem, with very limited results. In this work, we propose vEEGNet, a DL architecture with two modules, i.e., an unsupervised module based on variational autoencoders to extract a latent representation of the data, and a supervised module based on a feed-forward neural network to classify different movements. To build the encoder and the decoder of VAE we exploited the well-known EEGNet network. We implemented two slightly different architectures of vEEGNet, thus showing state-of-the-art classification performance, and the ability to reconstruct both low-frequency and middle-range components of the raw EEG. Although preliminary, this work is promising as we found out that the low-frequency reconstructed signals are consistent with the so-called motor-related cortical potentials, well-known motor-related EEG patterns and we could improve over previous literature by reconstructing faster EEG components, too. Further investigations are needed to explore the potentialities of vEEGNet in reconstructing the full EEG data, generating new samples, and studying the relationship between classification and reconstruction performance.


title: Performance-Based Optimization of 2D Reinforced Concrete Moment Frames through Pushover Analysis and ABC Optimization Algorithm

abstract: Conducting nonlinear pushover analysis typically demands intricate and resource-intensive computational attempts, and involves a process that is highly iterative and necessary for satisfying design-defined and also requirements of codes in performance-based design. A computer-based technique is presented for reinforced concrete (RC) buildings in this study, incorporating optimization numerical approaches, techniques of optimality criteria and pushover analysis to seismic design automatically the pushover drift performance. The optimal design based on the performance of concrete beams, columns and shear walls in concrete moment frames is presented using the artificial bee colony optimization algorithm. The design is applied to three frames such as a 4-story, an 8-story and a 12-story. These structures are designed to minimize the overall weight while satisfying the levels of performance include Life Safety (L-S), Collapse Prevention (C-P), and Immediate Occupancy (I-O). To achieve this goal, three main steps are performed. In the first step, optimization codes are implemented in MATLAB software, and the OpenSees software is used for nonlinear static analysis of the structure. By solving the optimization problem, several top designs are obtained for each frame and shear wall. Pushover analysis is performed considering the constraints of relative displacement and plastic hinge rotation based on the nonlinear provisions of FEMA356 code to achieve each levels of performance. Following this, convergence, pushover, and drift history curves are plotted for each frame, and selecting the best design for each frame ultimately occurs. The results demonstrate the algorithm's performance is desirable for the structure to achieve selecting the best design and lower weight.


title: MANTIS at #SMM4H 2023: Leveraging Hybrid and Ensemble Models for Detection of Social Anxiety Disorder on Reddit

abstract: This paper presents our system employed for the Social Media Mining for Health 2023 Shared Task 4: Binary classification of English Reddit posts self-reporting a social anxiety disorder diagnosis. We systematically investigate and contrast the efficacy of hybrid and ensemble models that harness specialized medical domain-adapted transformers in conjunction with BiLSTM neural networks. The evaluation results outline that our best performing model obtained 89.31% F1 on the validation set and 83.76% F1 on the test set.


title: Efficient Multi-Pair IoT Communication with Holographically Enhanced Meta-Surfaces Leveraging OAM Beams: Bridging Theory and Prototype

abstract: Meta-surfaces, also known as Reconfigurable Intelligent Surfaces (RIS), have emerged as a cost-effective, low power consumption, and flexible solution for enabling multiple applications in Internet of Things (IoT). However, in the context of meta-surface-assisted multi-pair IoT communications, significant interference issues often arise amount multiple channels. This issue is particularly pronounced in scenarios characterized by Line-of-Sight (LoS) conditions, where the channels exhibit low rank due to the significant correlation in propagation paths. These challenges pose a considerable threat to the quality of communication when multiplexing data streams. In this paper, we introduce a meta-surface-aided communication scheme for multi-pair interactions in IoT environments. Inspired by holographic technology, a novel compensation method on the whole meta-surface has been proposed, which allows for independent multi-pair direct data streams transmission with low interference. To further reduce correlation under LoS channel conditions, we propose a vortex beam-based solution that leverages the low correlation property between distinct topological modes. We use different vortex beams to carry distinct data streams, thereby enabling distinct receivers to capture their intended signal with low interference, aided by holographic meta-surfaces. Moreover, a prototype has been performed successfully to demonstrate two-pair multi-node communication scenario operating at 10 GHz with QPSK/16-QAM modulation.


title: The Cauchy Mean Value Theorem for Intuitionistic Fuzzy Functions

abstract: In this paper, we first study the arithmetic properties of intuitionistic fuzzy number, the monotonicity of intuitionistic fuzzy function and the derivative of intuitionistic fuzzy functions and then we study the fundamental properties on monotone function. After that, we proposed a mean value theorem for differentiable function in intuitionistic fuzzy calculus, from which we derived a general version using Cauchy mean value theorem for intuitionistic fuzzy calculus. At last, we give some examples and we also show as a corollary that the mean value theorem is a special case of the Cauchy version of mean value theorem.


title: Uncertainty Quantification in Machine Learning for Biosignal Applications -- A Review

abstract: Uncertainty Quantification (UQ) has gained traction in an attempt to fix the black-box nature of Deep Learning. Specifically (medical) biosignals such as electroencephalography (EEG), electrocardiography (ECG), electroocculography (EOG) and electromyography (EMG) could benefit from good UQ, since these suffer from a poor signal to noise ratio, and good human interpretability is pivotal for medical applications and Brain Computer Interfaces. In this paper, we review the state of the art at the intersection of Uncertainty Quantification and Biosignal with Machine Learning. We present various methods, shortcomings, uncertainty measures and theoretical frameworks that currently exist in this application domain. Overall it can be concluded that promising UQ methods are available, but that research is needed on how people and systems may interact with an uncertainty model in a (clinical) environment.


title: Integration of Robotics, Computer Vision, and Algorithm Design: A Chinese Poker Self-Playing Robot

abstract: This paper presents Chinese Poker Self-Playing Robot, an integrated system enabling a TM5-900 robotic arm to independently play the four-person card game Chinese poker. The robot uses a custom sucker mechanism to pick up and play cards. An object detection model based on YOLOv5 is utilized to recognize the suit and number of 13 cards dealt to the robot. A greedy algorithm is developed to divide the 13 cards into optimal hands of 3, 5, and 5 cards to play. Experiments demonstrate that the robot can successfully obtain the cards, identify them using computer vision, strategically select hands to play using the algorithm, and physically play the selected cards in the game. The system showcases effective integration of mechanical design, computer vision, algorithm design, and robotic control to accomplish the complex task of independently playing cards.


title: Pioneering EEG Motor Imagery Classification Through Counterfactual Analysis

abstract: The application of counterfactual explanation (CE) techniques in the realm of electroencephalography (EEG) classification has been relatively infrequent in contemporary research. In this study, we attempt to introduce and explore a novel non-generative approach to CE, specifically tailored for the analysis of EEG signals. This innovative approach assesses the model's decision-making process by strategically swapping patches derived from time-frequency analyses. By meticulously examining the variations and nuances introduced in the classification outcomes through this method, we aim to derive insights that can enhance interpretability. The empirical results obtained from our experimental investigations serve not only to validate the efficacy of our proposed approach but also to reinforce human confidence in the model's predictive capabilities. Consequently, these findings underscore the significance and potential value of conducting further, more extensive research in this promising direction.


title: Functional Analytics for Document Ordering for Curriculum Development and Comprehension

abstract: We propose multiple techniques for automatic document order generation for (1) curriculum development and for (2) creation of optimal reading order for use in learning, training, and other content-sequencing applications. Such techniques could potentially be used to improve comprehension, identify areas that need expounding, generate curricula, and improve search engine results. We advance two main techniques: The first uses document similarities through various methods. The second uses entropy against the backdrop of topics generated through Latent Dirichlet Allocation (LDA). In addition, we try the same methods on the summarized documents and compare them against the results obtained using the complete documents. Our results showed that while the document orders for our control document sets (biographies, novels, and Wikipedia articles) could not be predicted using our methods, our test documents (textbooks, courses, journal papers, dissertations) provided more reliability. We also demonstrated that summarized documents were good stand-ins for the complete documents for the purposes of ordering.


title: Model-independent confirmation of a constant speed of light over cosmological distances

abstract: Recent attempts at measuring the variation of $c$ using an assortment of standard candles and the redshift-dependent Hubble expansion rate inferred from the currently available catalog of cosmic chronometers have tended to show that the speed of light appears to be constant, at least up to $z\sim 2$. A notable exception is the use of high-redshift UV $+$ X-ray quasars, whose Hubble diagram seems to indicate a $\sim 2.7\sigma$ deviation of c from its value $c_0$ ($\equiv 2.99792458 \times 10^{10}$ cm s$^{-1}$) on Earth. We show in this paper, however, that this anomaly is due to an error in the derived relation between the luminosity distance, $D_L$, and $H(z)$ when $c$ is allowed to vary with redshift, and an imprecise calibration of the quasar catalog. When these deficiences are addressed correctly, one finds that $c/c_0=0.95 \pm 0.14$ in the redshift range $0\lesssim z\lesssim 2$, fully consistent with zero variation within the measurement errors.


title: A Novel 1D Generative Adversarial Network-based Framework for Atrial Fibrillation Detection using Restored Wrist Photoplethysmography Signals

abstract: Atrial fibrillation (AF) increases the risk of stroke. Electrocardiogram (ECG) is used for AF detection, while photoplethysmography (PPG) is simple to use and appropriate for long-term monitoring. We have developed a novel approach to detect AF from smartwatch-based wrist PPG signals. To the best of our knowledge, this is the first study to employ 1D CycleGAN for the reconstruction of 1D wrist PPG signals, since the quality of wrist PPG signals is very poor due to motion artifacts and acquisition site limitations. Our proposed approach is validated on a dataset of 21,278 10s long wrist PPG segments. The dataset was divided into two halves and two experiments were conducted. One half was used for training and the other half for testing and vice versa. Our classification model (Self-AFNet) with 1D-CycleGAN for restoration achieves an accuracy of 96.41% and 97.09% for both splits, respectively. There is a noteworthy improvement in accuracy (2.94% and 5.08% for test splits, respectively) for restored signals as compared to unrestored PPG. AF detection task was also performed using ECG signals with the matched PPG signals to assess the validity of employing reconstructed PPG-based AF classification. Self-AFNet managed to achieve an accuracy of 98.07% and 98.97%, respectively using two ECG splits which is comparable to the performance of AF detection utilizing reconstructed PPG segments. This study reflects that reconstructed wrist PPG signals acquired from wearable devices can be used for reliable detection of atrial fibrillation, which can significantly help in the reduction of the risk of stroke.


title: Taming Waves: A Physically-Interpretable Machine Learning Framework for Realizable Control of Wave Dynamics

abstract: Controlling systems governed by partial differential equations is an inherently hard problem. Specifically, control of wave dynamics is challenging due to additional physical constraints and intrinsic properties of wave phenomena such as dissipation, attenuation, reflection, and scattering. In this work, we introduce an environment designed for the study of the control of acoustic waves by actuated metamaterial designs. We utilize this environment for the development of a novel machine-learning method, based on deep neural networks, for efficiently learning the dynamics of an acoustic PDE from samples. Our model is fully interpretable and maps physical constraints and intrinsic properties of the real acoustic environment into its latent representation of information. Within our model we use a trainable perfectly matched layer to explicitly learn the property of acoustic energy dissipation. Our model can be used to predict and control scattered wave energy. The capabilities of our model are demonstrated on an important problem in acoustics, which is the minimization of total scattered energy. Furthermore, we show that the prediction of scattered energy by our model generalizes in time and can be extended to long time horizons. We make our code repository publicly available.


title: Improving Generalization of Drowsiness State Classification by Domain-Specific Normalization

abstract: Abnormal driver states, particularly have been major concerns for road safety, emphasizing the importance of accurate drowsiness detection to prevent accidents. Electroencephalogram (EEG) signals are recognized for their effectiveness in monitoring a driver's mental state by monitoring brain activities. However, the challenge lies in the requirement for prior calibration due to the variation of EEG signals among and within individuals. The necessity of calibration has made the brain-computer interface (BCI) less accessible. We propose a practical generalized framework for classifying driver drowsiness states to improve accessibility and convenience. We separate the normalization process for each driver, treating them as individual domains. The goal of developing a general model is similar to that of domain generalization. The framework considers the statistics of each domain separately since they vary among domains. We experimented with various normalization methods to enhance the ability to generalize across subjects, i.e. the model's generalization performance of unseen domains. The experiments showed that applying individual domain-specific normalization yielded an outstanding improvement in generalizability. Furthermore, our framework demonstrates the potential and accessibility by removing the need for calibration in BCI applications.


title: Applying Machine Learning Models on Metrology Data for Predicting Device Electrical Performance

abstract: Moore Law states that transistor density will double every two years, which is sustained until today due to continuous multi-directional innovations, such as extreme ultraviolet lithography, novel patterning techniques etc., leading the semiconductor industry towards 3nm node and beyond. For any patterning scheme, the most important metric to evaluate the quality of printed patterns is EPE, with overlay being its largest contribution. Overlay errors can lead to fatal failures of IC devices such as short circuits or broken connections in terms of P2P electrical contacts. Therefore, it is essential to develop effective overlay analysis and control techniques to ensure good functionality of fabricated semiconductor devices. In this work we have used an imec N14 BEOL process flow using LELE patterning technique to print metal layers with minimum pitch of 48nm with 193i lithography. FF structures are decomposed into two mask layers (M1A and M1B) and then the LELE flow is carried out to make the final patterns. Since a single M1 layer is decomposed into two masks, control of overlay between the two masks is critical. The goal of this work is of two-fold as, (a) to quantify the impact of overlay on capacitance and (b) to see if we can predict the final capacitance measurements with selected machine learning models at an early stage. To do so, scatterometry spectra are collected on these electrical test structures at (a)post litho, (b)post TiN hardmask etch, and (c)post Cu plating and CMP. Critical Dimension and overlay measurements for line-space pattern are done with SEM post litho, post etch and post Cu CMP. Various machine learning models are applied to do the capacitance prediction with multiple metrology inputs at different steps of wafer processing. Finally, we demonstrate that by using appropriate machine learning models we are able to do better prediction of electrical results.


title: Partial Rewriting for Multi-Stage ASR

abstract: For many streaming automatic speech recognition tasks, it is important to provide timely intermediate streaming results, while refining a high quality final result. This can be done using a multi-stage architecture, where a small left-context only model creates streaming results and a larger left- and right-context model produces a final result at the end. While this significantly improves the quality of the final results without compromising the streaming emission latency of the system, streaming results do not benefit from the quality improvements. Here, we propose using a text manipulation algorithm that merges the streaming outputs of both models. We improve the quality of streaming results by around 10%, without altering the final results. Our approach introduces no additional latency and reduces flickering. It is also lightweight, does not require retraining the model, and it can be applied to a wide variety of multi-stage architectures.


title: Enhanced Eye Diagram Estimation Method for Nonlinear Systems With Input Jitter

abstract: An enhanced multiple-edge response (MER) based eye diagram estimation method is proposed to evaluate the performance of nonlinear systems with input jitter. Compared with existing MER-based methods which only took into account the bit effect, the proposed method first determines both orders of bit effect and jitter effect. These decided orders can affirm the necessary MERs. Subsequently, the proposed method figures out the minimal number of sampling points so that the necessary MERs can be recovered quickly based on the Nyquist theory and can be used to create eye diagrams. Lastly, the eye diagrams and their parameters are compared with those generated by traditional transient simulation and an existing MER-based method which introduces input jitter through a convolution process. The result indicates that this enhanced method is more accurate than the existing MER-based method.


title: On the Fundamentals of Quantum Rate Theory and the Long-range Electron Transport in Respiratory Chains

abstract: It has been shown that both the electron-transfer rate constant of an electrochemical reaction and the conductance quantum are correlated with the concept of quantum capacitance. This simple association between the two separate concepts has an entirely quantum rate basis that encompasses the electron-transfer rate theory as originally proposed by Rudolph A. Marcus whether the statistical mechanism is properly taken into account. Presently, it is conducted a concise review of the quantum mechanical rate theory principles focused on its relativistic quantum electrodynamics character to demonstrate that it can reconcile the conflicting views established on attempting to use the super-exchange (supported on electron transfer) or `metallic-like' (supported on conductance quantum) mechanisms separately to explain the highly efficient long-distance electron transport observed in the respiratory processes of living cells. The unresolved issues related to long-range electron transport are clarified in light of the quantum rate theory with a discussion focused on Geobacter sulfurreducens films as a reference standard of the respiration chain. Theoretical analyses supported by experimental data suggest that the efficiency of respiration within a long-range electron transport path is intrinsically a quantum mechanical event that follows relativistic quantum electrodynamics principles as addressed by quantum rate theory.


title: Enhancing Trajectory Prediction through Self-Supervised Waypoint Noise Prediction

abstract: Trajectory prediction is an important task that involves modeling the indeterminate nature of traffic actors to forecast future trajectories given the observed trajectory sequences. However, current methods confine themselves to presumed data manifolds, assuming that trajectories strictly adhere to these manifolds, resulting in overly simplified predictions. To this end, we propose a novel approach called SSWNP (Self-Supervised Waypoint Noise Prediction). In our approach, we first create clean and noise-augmented views of past observed trajectories across the spatial domain of waypoints. We then compel the trajectory prediction model to maintain spatial consistency between predictions from these two views, in addition to the trajectory prediction task. Introducing the noise-augmented view mitigates the model's reliance on a narrow interpretation of the data manifold, enabling it to learn more plausible and diverse representations. We also predict the noise present in the two views of past observed trajectories as an auxiliary self-supervised task, enhancing the model's understanding of the underlying representation and future predictions. Empirical evidence demonstrates that the incorporation of SSWNP into the model learning process significantly improves performance, even in noisy environments, when compared to baseline methods. Our approach can complement existing trajectory prediction methods. To showcase the effectiveness of our approach, we conducted extensive experiments on three datasets: NBA Sports VU, ETH-UCY, and TrajNet++, with experimental results highlighting the substantial improvement achieved in trajectory prediction tasks.


title: Performance Analysis of Fixed Broadband Wireless Access in mmWave Band in 5G

abstract: An end-to-end fiber-based network holds the potential to provide multi-gigabit fixed access to end-users. However, deploying fiber access, especially in areas where fiber is non-existent, can be time-consuming and costly, resulting in delayed returns for Operators. This work investigates transmission data from fixed broadband wireless access in the mmWave band in 5G. Given the growing interest in this domain, understanding the transmission characteristics of the data becomes crucial. While existing datasets for the mmWave band are available, they are often generated from simulated environments. In this study, we introduce a dataset compiled from real-world transmission data collected from the Fixed Broadband Wireless Access in mmWave Band device (RWM6050). The aim is to facilitate self-configuration based on transmission characteristics. To achieve this, we propose an online machine learning-based approach for real-time training and classification of transmission characteristics. Additionally, we present two advanced temporal models for more accurate classifications. Our results demonstrate the ability to detect transmission angle and distance directly from the analysis of transmission data with very high accuracy, reaching up to 99% accuracy on the combined classification task. Finally, we outline promising future research directions based on the collected data.


title: Safe Reinforcement Learning in a Simulated Robotic Arm

abstract: Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages, including safe exploration which will be inevitable in cases when RL systems need to be trained directly in the physical environment (e.g. in human-robot interaction). The popular Safety Gym library offers three mobile agent types that can learn goal-directed tasks while considering various safety constraints. In this paper, we extend the applicability of safe RL algorithms by creating a customized environment with Panda robotic arm where Safety Gym algorithms can be tested. We performed pilot experiments with the popular PPO algorithm comparing the baseline with the constrained version and show that the constrained version is able to learn the equally good policy while better complying with safety constraints and taking longer training time as expected.


title: Clinical Text Deduplication Practices for Efficient Pretraining and Improved Clinical Tasks

abstract: Despite being a unique source of information on patients' status and disease progression, clinical notes are characterized by high levels of duplication and information redundancy. In general domain text, it has been shown that deduplication does not harm language model (LM) pretraining, thus helping reduce the training cost. Although large LMs have proven to learn medical knowledge, they still require specialized domain adaptation for improved downstream clinical tasks. By leveraging large real-world clinical corpora, we first provided a fine-grained characterization of duplicates stemming from common writing practices and clinical relevancy. Second, we demonstrated that deduplicating clinical text can help clinical LMs encode less redundant information in a more efficient manner and do not harm classification tasks via prompt-based learning.


title: Nef vector bundles on a hyperquadric with first Chern class two

abstract: We classify nef vector bundles on a smooth hyperquadric of dimension $\geq 4$ with first Chern class two over an algebraically closed field of characteristic zero.


title: Topological nonlocal operations on toroidal flux qubits

abstract: We propose a conceptual model of a toroidal flux qubit, which consists of a quantized toroidal magnetic flux coupled to a charged particle on a quantum ring through field-free interaction. Scaling the system to two or more flux qubits results in emergent field-free coupling between them. We show that the topological and nonlocal aspects of this system can have profound applications in quantum information. We illustrate it with examples of nonlocal operations on these flux qubits which are protected from environmental noise, including creating entanglement and ``teleporting'' excitation energy between the flux qubits.


title: The Optimal Strategy against Hedge Algorithm in Repeated Games

abstract: This paper aims to solve the optimal strategy against a well-known adaptive algorithm, the Hedge algorithm, in a finitely repeated $2\times 2$ zero-sum game. In the literature, related theoretical results are very rare. To this end, we make the evolution analysis for the resulting dynamical game system and build the action recurrence relation based on the Bellman optimality equation. First, we define the state and the State Transition Triangle Graph (STTG); then, we prove that the game system will behave in a periodic-like way when the opponent adopts the myopic best response. Further, based on the myopic path and the recurrence relation between the optimal actions at time-adjacent states, we can solve the optimal strategy of the opponent, which is proved to be periodic on the time interval truncated by a tiny segment and has the same period as the myopic path. Results in this paper are rigorous and inspiring, and the method might help solve the optimal strategy for general games and general algorithms.


title: On the motion of the closed free surface in three-dimensional incompressible ideal MHD with surface tension

abstract: We consider the three-dimensional free boundary incompressible ideal magnetohydrodynamics (MHD) equations with surface tension in a bounded domain. The moving closed surface is parameterized by the height function, which is defined on a smooth and compact reference hypersurface. In Eulerian coordinates, we establish a priori estimates for smooth solutions in the $C^\infty$-class without losing any regularity. This approach allows us to avoid dealing with the spatial regularity of the flow map in Lagrangian coordinates, which may lack maximal regularity and the geometric characteristics, such as the curvature and normal velocity, of the evolutionary domain. The scaling $\partial_t\sim\nabla^{\frac 32}$ motivates us to formulate the energy functional, and the regularity estimates are driven by the curvature bound and the regularity of the pressure. In the spirit of the Beale-Kato-Majda criterion, we propose a set of the a priori assumptions to guarantee the possibility of extending the solution for a short period while preserving the initial regularity within the time interval of existence. As far as we know, this is the first result involving the blow-up of the free boundary incompressible ideal MHD equations with surface tension. It is worth noting that the velocity and magnetic fields remain bounded in Sobolev's space $H^6$, while the second fundamental form remains bounded in $H^5$, throughout the time interval $[0,T_0]$. The value of $T_0$ depends only on the $H^6$ norm of the initial velocity and magnetic fields, the initial domain, and the $H^5$ norm of the mean curvature.


title: Exploiting a derivative discontinuity estimate for accurate $G_0W_0$ ionization potentials and electron affinities

abstract: The $GW$ approximation has become an important tool for predicting charged excitations of isolated molecules and condensed systems. Its popularity can be attributed to many factors, including a favorable scaling and relatively good accuracy. In practical applications, the $GW$ is often performed as a one-shot perturbation known as $G_0W_0$. Unfortunately, $G_0W_0$ suffers from a strong starting point dependence and is often not as accurate as one would need. Self-consistent $GW$ methodologies alleviate these problems but come with a marked increase in computational cost. In this manuscript, we propose the use of an estimate of the exchange-correlation derivative discontinuity to provide a remarkably good starting point for $G_0W_0$ calculations, yielding ionization potentials and electron affinities with eigenvalue self-consistent $GW$ quality at no additional cost. We assess the quality of the resulting methodology with the GW100 benchmark set and compare its advantages over other similar methods.


title: Position-momentum conditioning, relative entropy decomposition and convergence to equilibrium in stochastic Hamiltonian systems

abstract: This paper is concerned with a class of multivariable stochastic Hamiltonian systems whose generalised position is related by an ordinary differential equation to the momentum governed by an Ito stochastic differential equation. The latter is driven by a standard Wiener process and involves both conservative and viscous damping forces. With the mass, diffusion and damping matrices being position-dependent, the resulting nonlinear model of Langevin dynamics describes dissipative mechanical systems (possibly with rotational degrees of freedom) or their electromechanical analogues subject to external random forcing. We study the time evolution of the joint position-momentum probability distribution for the system and its convergence to equilibrium by decomposing the Fokker-Planck-Kolmogorov equation (FPKE) and the Kullback-Leibler relative entropy with respect to the invariant measure into those for the position distribution and the momentum distribution conditioned on the position. This decomposition reveals a manifestation of the Barbashin-Krasovskii-LaSalle principle and higher-order dissipation inequalities for the relative entropy as a Lyapunov functional for the FPKE.


title: Emergence of 6-particle "hexciton'' states in WS$_2$ and MoSe$_2$ monolayers

abstract: When doped with a high density of mobile charge carriers, monolayer transition-metal dichalcogenide (TMD) semiconductors can host new types of composite many-particle exciton states that do not exist in conventional semiconductors. Such multi-particle bound states arise when a photoexcited electron-hole pair couples to not just a single Fermi sea that is quantum-mechanically distinguishable (as for the case of conventional charged excitons or trions), but rather couples simultaneously to \textit{multiple} Fermi seas, each having distinct spin and valley quantum numbers. Composite six-particle ``hexciton'' states were recently identified in electron-doped WSe$_2$ monolayers, but under suitable conditions they should also form in all other members of the monolayer TMD family. Here we present spectroscopic evidence demonstrating the emergence of many-body hexcitons in charge-tunable WS$_2$ monolayers (at the A-exciton) and MoSe$_2$ monolayers (at the B-exciton). The roles of distinguishability and carrier screening on the stability of hexcitons are discussed.


title: Smooth symmetric systems over a finite field and applications

abstract: We study the set of common $\mathbb{F}_q$-rational solutions of "smooth" systems of multivariate symmetric polynomials with coefficients in a finite field $\mathbb{F}_q$. We show that, under certain conditions, the set of common solutions of such polynomial systems over the algebraic closure of $\mathbb{F}_q$ has a "good" geometric behavior. This allows us to obtain precise estimates on the corresponding number of common $\mathbb{F}_q$-rational solutions. In the case of hypersurfaces we are able to improve the results. We illustrate the interest of these estimates through their application to certain classical combinatorial problems over finite fields.


title: Entropy Causal Graphs for Multivariate Time Series Anomaly Detection

abstract: Many multivariate time series anomaly detection frameworks have been proposed and widely applied. However, most of these frameworks do not consider intrinsic relationships between variables in multivariate time series data, thus ignoring the causal relationship among variables and degrading anomaly detection performance. This work proposes a novel framework called CGAD, an entropy Causal Graph for multivariate time series Anomaly Detection. CGAD utilizes transfer entropy to construct graph structures that unveil the underlying causal relationships among time series data. Weighted graph convolutional networks combined with causal convolutions are employed to model both the causal graph structures and the temporal patterns within multivariate time series data. Furthermore, CGAD applies anomaly scoring, leveraging median absolute deviation-based normalization to improve the robustness of the anomaly identification process. Extensive experiments demonstrate that CGAD outperforms state-of-the-art methods on real-world datasets with a 15% average improvement based on three different multivariate time series anomaly detection metrics.


title: LQG Information Design

abstract: This paper addresses information design with linear best responses of agents, quadratic objective functions of an information designer, and a payoff state distributed according to a Gaussian distribution. We formulate the problem as semidefinite programming (SDP) and use the duality principle to characterize an optimal information structure. There exists a Gaussian information structure that is optimal among all information structures. A necessary and sufficient condition for optimality is that the realizations of the induced action profile and a state satisfy linear constraints derived from the primal and dual SDP. As a result, an observed action profile typically reveals the true state even if individual agents have only partial knowledge. In symmetric network games, an optimal information structure inherits this symmetry, which facilitates the computation of an optimal information structure.


title: TAB: Text-Align Anomaly Backbone Model for Industrial Inspection Tasks

abstract: In recent years, the focus on anomaly detection and localization in industrial inspection tasks has intensified. While existing studies have demonstrated impressive outcomes, they often rely heavily on extensive training datasets or robust features extracted from pre-trained models trained on diverse datasets like ImageNet. In this work, we propose a novel framework leveraging the visual-linguistic CLIP model to adeptly train a backbone model tailored to the manufacturing domain. Our approach concurrently considers visual and text-aligned embedding spaces for normal and abnormal conditions. The resulting pre-trained backbone markedly enhances performance in industrial downstream tasks, particularly in anomaly detection and localization. Notably, this improvement is substantiated through experiments conducted on multiple datasets such as MVTecAD, BTAD, and KSDD2. Furthermore, using our pre-trained backbone weights allows previous works to achieve superior performance in few-shot scenarios with less training data. The proposed anomaly backbone provides a foundation model for more precise anomaly detection and localization.


title: Continual Adversarial Defense

abstract: In response to the rapidly evolving nature of adversarial attacks against visual classifiers on a monthly basis, numerous defenses have been proposed to generalize against as many known attacks as possible. However, designing a defense method that generalizes to all types of attacks is not realistic because the environment in which defense systems operate is dynamic and comprises various unique attacks that emerge as time goes on. The defense system must gather online few-shot defense feedback to promptly enhance itself, leveraging efficient memory utilization. Therefore, we propose the first continual adversarial defense (CAD) framework that adapts to any attacks in a dynamic scenario, where various attacks emerge stage by stage. In practice, CAD is modeled under four principles: (1) continual adaptation to new attacks without catastrophic forgetting, (2) few-shot adaptation, (3) memory-efficient adaptation, and (4) high accuracy on both clean and adversarial images. We explore and integrate cutting-edge continual learning, few-shot learning, and ensemble learning techniques to qualify the principles. Experiments conducted on CIFAR-10 and ImageNet-100 validate the effectiveness of our approach against multiple stages of modern adversarial attacks and demonstrate significant improvements over numerous baseline methods. In particular, CAD is capable of quickly adapting with minimal feedback and a low cost of defense failure, while maintaining good performance against previous attacks. Our research sheds light on a brand-new paradigm for continual defense adaptation against dynamic and evolving attacks.


title: An open problem and a conjecture on binary linear complementary pairs of codes

abstract: The existence of $q$-ary linear complementary pairs (LCPs) of codes with $q> 2$ has been completely characterized so far. This paper gives a characterization for the existence of binary LCPs of codes. As a result, we solve an open problem proposed by Carlet $et~al.$ (IEEE Trans. Inf. Theory 65(3): 1694-1704, 2019) and a conjecture proposed by Choi $et~al.$ (Cryptogr. Commun. 15(2): 469-486, 2023).


title: Electromagnetic probes for critical fluctuations of phase transitions in dense QCD

abstract: We study how the dilepton production rates and electric conductivity are affected by the phase transition to color superconductivity and the QCD critical point. Effects of the soft modes associated with these phase transitions are incorporated through the photon self-energy called the Aslamazov-Larkin, Maki-Thompson, and density-of-states terms, which are responsible for the paraconductivity in metallic superconductors. We show that anomalous enhancements of the production rate in the low energy/momentum region and the conductivity occur around the respective critical points.


title: A coherent phonon-induced hidden quadrupolar ordered state in Ca$_2$RuO$_4$

abstract: Ultrafast laser excitation provides a means to transiently realize long-range ordered electronic states of matter that are hidden in thermal equilibrium. Recently, this approach has unveiled a variety of thermally inaccessible ordered states in strongly correlated materials, including charge density wave, ferroelectric, magnetic, and intertwined charge-orbital ordered states. However, more exotic hidden states exhibiting higher multipolar ordering remain elusive owing to the challenge of directly manipulating and detecting them with light. Here we demonstrate a method to induce a dynamical transition from a thermally allowed to a thermally forbidden spin-orbit entangled quadrupolar ordered state in Ca$_2$RuO$_4$ by coherently exciting a phonon that is strongly coupled to the order parameter. Combining probe photon energy-resolved coherent phonon spectroscopy measurements with model Hamiltonian calculations, we show that the dynamical transition is manifested through anomalies in the temperature, pump excitation fluence, and probe photon energy dependence of the strongly coupled phonon. With this procedure, we introduce a general pathway to uncover hidden multipolar ordered states and to control their re-orientation on ultrashort timescales.


title: Probabilistic degenerate Dowling polynomials associated with random variables

abstract: The aim of this paper is to study probabilistic versions of the degenerate Whitney numbers of the second kind and those of the degenerate Dowling polynomials, namely the probabilistic degenerate Whitney numbers of the second kind associated with Y and the probabilistic degenerate Dowling polynomials associated with Y. Here Y is a random variable whose moment generating function exists in some neighborhood of the origin. We derive some properties, explicit expressions, certain identities, recurrence relations and generating functions for those numbers and polynomials. In addition, we investigate their generalizations, namely the probabilistic degenerate r-Whitney numbers of the second kind associated with Y and the probabilistic degenerate r-Dowling polynomials associated with Y, and get similar results to the aforementioned numbers and polynomials.


title: Unraveling Batch Normalization for Realistic Test-Time Adaptation

abstract: While recent test-time adaptations exhibit efficacy by adjusting batch normalization to narrow domain disparities, their effectiveness diminishes with realistic mini-batches due to inaccurate target estimation. As previous attempts merely introduce source statistics to mitigate this issue, the fundamental problem of inaccurate target estimation still persists, leaving the intrinsic test-time domain shifts unresolved. This paper delves into the problem of mini-batch degradation. By unraveling batch normalization, we discover that the inexact target statistics largely stem from the substantially reduced class diversity in batch. Drawing upon this insight, we introduce a straightforward tool, Test-time Exponential Moving Average (TEMA), to bridge the class diversity gap between training and testing batches. Importantly, our TEMA adaptively extends the scope of typical methods beyond the current batch to incorporate a diverse set of class information, which in turn boosts an accurate target estimation. Built upon this foundation, we further design a novel layer-wise rectification strategy to consistently promote test-time performance. Our proposed method enjoys a unique advantage as it requires neither training nor tuning parameters, offering a truly hassle-free solution. It significantly enhances model robustness against shifted domains and maintains resilience in diverse real-world scenarios with various batch sizes, achieving state-of-the-art performance on several major benchmarks. Code is available at \url{https://github.com/kiwi12138/RealisticTTA}.


title: Transport response of topological hinge modes in $\alpha$-Bi$_4$Br$_4$

abstract: Electronic topological phases are renowned for their unique properties, where conducting surface states exist on the boundary of an insulating three-dimensional bulk. While the transport response of the surface states has been extensively studied, the response of the topological hinge modes remains elusive. Here, we investigate a layered topological insulator $\alpha$-Bi$_4$Br$_4$, and provide the first evidence for quantum transport in gapless topological hinge states existing within the insulating bulk and surface energy gaps. Our magnetoresistance measurements reveal pronounced h/e periodic (where h denotes Planck's constant and e represents the electron charge) Aharonov-Bohm oscillation. The observed periodicity, which directly reflects the enclosed area of phase-coherent electron propagation, matches the area enclosed by the sample hinges, providing compelling evidence for the quantum interference of electrons circumnavigating around the hinges. Notably, the h/e oscillations evolve as a function of magnetic field orientation, following the interference paths along the hinge modes that are allowed by topology and symmetry, and in agreement with the locations of the hinge modes according to our scanning tunneling microscopy images. Remarkably, this demonstration of quantum transport in a topological insulator can be achieved using a flake geometry and we show that it remains robust even at elevated temperatures. Our findings collectively reveal the quantum transport response of topological hinge modes with both topological nature and quantum coherence, which can be directly applied to the development of efficient quantum electronic devices.

categories: cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph quant-ph


title: Sequence adaptive field-imperfection estimation (SAFE): retrospective estimation and correction of $B_1^+$ and $B_0$ inhomogeneities for enhanced MRF quantification

abstract: $B_1^+$ and $B_0$ field-inhomogeneities can significantly reduce accuracy and robustness of MRF's quantitative parameter estimates. Additional $B_1^+$ and $B_0$ calibration scans can mitigate this but add scan time and cannot be applied retrospectively to previously collected data. Here, we proposed a calibration-free sequence-adaptive deep-learning framework, to estimate and correct for $B_1^+$ and $B_0$ effects of any MRF sequence. We demonstrate its capability on arbitrary MRF sequences at 3T, where no training data were previously obtained. Such approach can be applied to any previously-acquired and future MRF-scans. The flexibility in directly applying this framework to other quantitative sequences is also highlighted.


title: Multi-stage Learning for Radar Pulse Activity Segmentation

abstract: Radio signal recognition is a crucial function in electronic warfare. Precise identification and localisation of radar pulse activities are required by electronic warfare systems to produce effective countermeasures. Despite the importance of these tasks, deep learning-based radar pulse activity recognition methods have remained largely underexplored. While deep learning for radar modulation recognition has been explored previously, classification tasks are generally limited to short and non-interleaved IQ signals, limiting their applicability to military applications. To address this gap, we introduce an end-to-end multi-stage learning approach to detect and localise pulse activities of interleaved radar signals across an extended time horizon. We propose a simple, yet highly effective multi-stage architecture for incrementally predicting fine-grained segmentation masks that localise radar pulse activities across multiple channels. We demonstrate the performance of our approach against several reference models on a novel radar dataset, while also providing a first-of-its-kind benchmark for radar pulse activity segmentation.


title: Efficient Machine Learning Force Field for Large-Scale Molecular Simulations of Organic Systems

abstract: To address the computational challenges of ab initio molecular dynamics and the accuracy limitations of empirical force fields, the introduction of machine learning force fields has proven effective in various systems including metals and inorganic materials. However, in large-scale organic systems, the application of machine learning force fields is often hindered by impediments such as the complexity of long-range intermolecular interactions and molecular conformations, as well as the instability in long-time molecular simulations. Therefore, we propose a universal multiscale higher-order equivariant model combined with active learning techniques, efficiently capturing the complex long-range intermolecular interactions and molecular conformations. Compared to existing equivariant models, our model achieves the highest predictive accuracy, and magnitude-level improvements in computational speed and memory efficiency. In addition, a bond length stretching method is designed to improve the stability of long-time molecular simulations. Utilizing only 901 samples from a dataset with 120 atoms, our model successfully extends high precision to systems with hundreds of thousands of atoms. These achievements guarantee high predictive accuracy, fast simulation speed, minimal memory consumption, and robust simulation stability, satisfying the requirements for high-precision and long-time molecular simulations in large-scale organic systems.


title: Axion-like Particle Detection in Alkali-Noble-Gas Haloscopes

abstract: Revealing the essence of dark matter (DM) and dark energy is essential for understanding our universe. Ultralight (rest energy $<$10 eV) bosonic particles, including pseudoscalar axions and axion-like particles (ALPs) have emerged among leading candidates to explain the composition of DM and searching for them has become an important part of precision-measurement science. Ultrahigh-sensitivity alkali-noble-gas based comagnetometers and magnetometers are being used as powerful haloscopes, i.e., devices designed to search for DM present in the galactic halo. A broad variety of such devices include clock-comparison comagnetometers, self-compensating comagnetometers, hybrid-spin-resonance magnetometer, spin-exchange-relaxation-free magnetometers, nuclear magnetic-resonance magnetometers, Floquet magnetometers, masers, as well as devices like the cosmic axion spin-precession experiment (CASPEr) using liquid $^{129}$Xe, prepolarized via spin-exchange optical pumping with rubidium atoms. The combination of alkali metal and noble gas allows one to take the best advantage of the complementary properties of the two spin systems. This review summarizes the operational principles, experimental setups and the successful explorations of new physics using these haloscopes. Additionally, some limiting factors are pointed out for further improvement.


title: Three-state active lattice gas: a discrete Vicseklike model with excluded volume

abstract: We study a discrete-space model of active matter with excluded volume. Particles are restricted to the sites of a triangular lattice, and can assume one of three orientations. Varying the density and noise intensity, Monte Carlo simulations reveal a variety of spatial patterns. Ordered states occur in the form of condensed structures, which (away from the full occupancy limit) coexist with a low-density vapor. The condensed structures feature low particle mobility, particularly those that wrap the system via the periodic boundaries. As the noise intensity is increased, dense structures give way to a disordered phase. We characterize the parameter values associated with the condensed phases and perform a detailed study of the order-disorder transition at (1) full occupation and (2) at a density of 0.1. In the former case, the model possesses the same symmetry as the three-state Potts model and exhibits a continuous phase transition, as expected, with critical exponents consistent with those of the associated Potts model. In the low-density case, the transition is clearly discontinuous, with strong dependence of the final state upon the initial configuration, hysteresis,and nonmonotonic dependence of the Binder cumulant upon noise intensity.


title: Emergence and Growth Dynamics of Wetting-induced Phase Separation on Soft Solids

abstract: Liquid droplets on soft solids, such as soft polymeric gels, can induce substantial surface deformations, leading to the formation of wetting ridges at the contact points. While these contact ridges have been shown to govern the rich surface mechanics of complaint substrates, the inherently divergent characteristics at contact points and the multiphase nature of soft reticulated gels both pose great challenges for continuum mechanical theories in modeling soft wetting phenomena. In this study, we report in-situ experimental characterizations of the emergence and growth dynamics of the wetting-induced phase separation. The measurements demonstrate how the migration of free chains prevents the stress singularities at contact points. Based on the Onsager variational principle, we present a phenomenological model that effectively captures the growth dynamics of this phase separation, including the crossover from a short-term diffusive state to a long-term equilibrium state. Comparing the model predictions with the experimental results obtained for varied crosslinking densities, we reveal how the intrinsic material parameters of soft gels dictate the phase separation dynamics.


title: No-Skim: Towards Efficiency Robustness Evaluation on Skimming-based Language Models

abstract: To reduce the computation cost and the energy consumption in large language models (LLM), skimming-based acceleration dynamically drops unimportant tokens of the input sequence progressively along layers of the LLM while preserving the tokens of semantic importance. However, our work for the first time reveals the acceleration may be vulnerable to Denial-of-Service (DoS) attacks. In this paper, we propose No-Skim, a general framework to help the owners of skimming-based LLM to understand and measure the robustness of their acceleration scheme. Specifically, our framework searches minimal and unnoticeable perturbations at character-level and token-level to generate adversarial inputs that sufficiently increase the remaining token ratio, thus increasing the computation cost and energy consumption. We systematically evaluate the vulnerability of the skimming acceleration in various LLM architectures including BERT and RoBERTa on the GLUE benchmark. In the worst case, the perturbation found by No-Skim substantially increases the running cost of LLM by over 145% on average. Moreover, No-Skim extends the evaluation framework to various scenarios, making the evaluation conductible with different level of knowledge.


title: Relativistic Effects on Circumbinary Disk Evolution: Breaking the Polar Alignment around Eccentric Black Hole Binary Systems

abstract: We study the effects of general relativity (GR) on the evolution and alignment of circumbinary disks around binaries on all scales. We implement relativistic apsidal precession of the binary into the hydrodynamics code {\sc phantom}. We find that the effects of GR can suppress the stable polar alignment of a circumbinary disk, depending on how the relativistic binary apsidal precession timescale compares to the disk nodal precession timescale. Studies of circumbinary disk evolution typically ignore the effects of GR which is an appropriate simplification for low mass or widely separated binary systems. In this case, polar alignment occurs providing that the disks initial misalignment is sufficiently large. However, systems with a very short relativistic precession timescale cannot polar align and instead move toward coplanar alignment. In the intermediate regime where the timescales are similar, the outcome depends upon the properties of the disk. Polar alignment is more likely in the wavelike disk regime (where the disk viscosity parameter is less than the aspect ratio, $\alpha<H/r$) since the disk is in good radial communication. In the viscous disk regime disk breaking is more likely. Multiple rings can destructively interact with one another resulting in short disk lifetimes, and the disk moving towards coplanar alignment. Around main-sequence star or stellar mass black hole binaries, polar alignment may be suppressed far from the binary but in general the inner parts of the disk can align to polar. Polar alignment may be completely suppressed for disks around supermassive black holes for close binary separations.


title: Image Deblurring using GAN

abstract: In recent years, deep generative models, such as Generative Adversarial Network (GAN), has grabbed significant attention in the field of computer vision. This project focuses on the application of GAN in image deblurring with the aim of generating clearer images from blurry inputs caused by factors such as motion blur. However, traditional image restoration techniques have limitations in handling complex blurring patterns. Hence, a GAN-based framework is proposed as a solution to generate high-quality deblurred images. The project defines a GAN model in Tensorflow and trains it with GoPRO dataset. The Generator will intake blur images directly to create fake images to convince the Discriminator which will receive clear images at the same time and distinguish between the real image and the fake image. After obtaining the trained parameters, the model was used to deblur motion-blur images taken in daily life as well as testing set for validation. The result shows that the pretrained network of GAN can obtain sharper pixels in image, achieving an average of 29.3 Peak Signal-to-Noise Ratio (PSNR) and 0.72 Structural Similarity Assessment (SSIM). This help to effectively address the challenges posed by image blurring, leading to the generation of visually pleasing and sharp images. By exploiting the adversarial learning framework, the proposed approach enhances the potential for real-world applications in image restoration.


title: Sobolev extensions over Cantor-cuspidal graphs

abstract: For a continuous function $f:\mathbb{R}\to\mathbb{R}$, define the corresponding graph by setting \[\Gamma_f := {(x1, f(x1)) : x_1\in\mathbb{R}} .\] In this paper, we study the Sobolev extension property for the upper and lower domains over the graph $\Gamma_{\psi^\alpha_c}$ for $\psi^\alpha_c(x_1):=d(x_1, \mathcal C)^\alpha$, where $\mathcal C$ is the classical ternary Cantor set in the unit interval and $\alpha\in(0, 1)$.


title: Neural Gaussian Similarity Modeling for Differential Graph Structure Learning

abstract: Graph Structure Learning (GSL) has demonstrated considerable potential in the analysis of graph-unknown non-Euclidean data across a wide range of domains. However, constructing an end-to-end graph structure learning model poses a challenge due to the impediment of gradient flow caused by the nearest neighbor sampling strategy. In this paper, we construct a differential graph structure learning model by replacing the non-differentiable nearest neighbor sampling with a differentiable sampling using the reparameterization trick. Under this framework, we argue that the act of sampling \mbox{nearest} neighbors may not invariably be essential, particularly in instances where node features exhibit a significant degree of similarity. To alleviate this issue, the bell-shaped Gaussian Similarity (GauSim) modeling is proposed to sample non-nearest neighbors. To adaptively model the similarity, we further propose Neural Gaussian Similarity (NeuralGauSim) with learnable parameters featuring flexible sampling behaviors. In addition, we develop a scalable method by transferring the large-scale graph to the transition graph to significantly reduce the complexity. Experimental results demonstrate the effectiveness of the proposed methods.


title: The limit theorems on extreme order statistics and partial sums of i.i.d. random variables

abstract: This paper proves several weak limit theorems for the joint version of extreme order statistics and partial sums of independently and identically distributed random variables. The results are also extended to almost sure limit version.


title: General Higher Order $L^p$ Mean Zonoids

abstract: In 1970, Schneider introduced the higher-order difference body and the associated Rogers-Shephard inequality. Recently, Haddad, Langharst, Putterman, Roysdon and Ye expanded the concept to a burgeoning higher-order Brunn-Minkowski theory. In 1991, Zhang introduced mean zonoids of a convex body, which was extended to the Firey-Brunn-Minkowski theory setting by Xi, Guo and Leng in 2014. In this note, we extend these $L^p$ mean zonoids to the higher-order setting and establish the associated isoperimetric inequality.


title: EDA: Evolving and Distinct Anchors for Multimodal Motion Prediction

abstract: Motion prediction is a crucial task in autonomous driving, and one of its major challenges lands in the multimodality of future behaviors. Many successful works have utilized mixture models which require identification of positive mixture components, and correspondingly fall into two main lines: prediction-based and anchor-based matching. The prediction clustering phenomenon in prediction-based matching makes it difficult to pick representative trajectories for downstream tasks, while the anchor-based matching suffers from a limited regression capability. In this paper, we introduce a novel paradigm, named Evolving and Distinct Anchors (EDA), to define the positive and negative components for multimodal motion prediction based on mixture models. We enable anchors to evolve and redistribute themselves under specific scenes for an enlarged regression capacity. Furthermore, we select distinct anchors before matching them with the ground truth, which results in impressive scoring performance. Our approach enhances all metrics compared to the baseline MTR, particularly with a notable relative reduction of 13.5% in Miss Rate, resulting in state-of-the-art performance on the Waymo Open Motion Dataset. Code is available at https://github.com/Longzhong-Lin/EDA.


title: Tighter monogamy inequalities of multiqubit entanglement

abstract: Multipartite entanglement holds great importance in quantum information processing. The distribution of entanglement among subsystems can be characterized by monogamy relations. Based on the $\beta$th power of concurrence and negativity, we provide two new monogamy inequalities. Through detailed examples, we demonstrate that these inequalities are tighter than previous results.


title: Towards Neuromorphic Compression based Neural Sensing for Next-Generation Wireless Implantable Brain Machine Interface

abstract: This work introduces a neuromorphic compression based neural sensing architecture with address-event representation inspired readout protocol for massively parallel, next-gen wireless iBMI. The architectural trade-offs and implications of the proposed method are quantitatively analyzed in terms of compression ratio and spike information preservation. For the latter, we use metrics such as root-mean-square error and correlation coefficient between the original and recovered signal to assess the effect of neuromorphic compression on spike shape. Furthermore, we use accuracy, sensitivity, and false detection rate to understand the effect of compression on downstream iBMI tasks, specifically, spike detection. We demonstrate that a data compression ratio of $50-100$ can be achieved, $5-18\times$ more than prior work, by selective transmission of event pulses corresponding to neural spikes. A correlation coefficient of $\approx0.9$ and spike detection accuracy of over $90\%$ for the worst-case analysis involving $10K$-channel simulated recording and typical analysis using $100$ or $384$-channel real neural recordings. We also analyze the collision handling capability and scalability of the proposed pipeline.


title: Combinatorial Complexes: Bridging the Gap Between Cell Complexes and Hypergraphs

abstract: Graph-based signal processing techniques have become essential for handling data in non-Euclidean spaces. However, there is a growing awareness that these graph models might need to be expanded into `higher-order' domains to effectively represent the complex relations found in high-dimensional data. Such higher-order domains are typically modeled either as hypergraphs, or as simplicial, cubical or other cell complexes. In this context, cell complexes are often seen as a subclass of hypergraphs with additional algebraic structure that can be exploited, e.g., to develop a spectral theory. In this article, we promote an alternative perspective. We argue that hypergraphs and cell complexes emphasize \emph{different} types of relations, which may have different utility depending on the application context. Whereas hypergraphs are effective in modeling set-type, multi-body relations between entities, cell complexes provide an effective means to model hierarchical, interior-to-boundary type relations. We discuss the relative advantages of these two choices and elaborate on the previously introduced concept of a combinatorial complex that enables co-existing set-type and hierarchical relations. Finally, we provide a brief numerical experiment to demonstrate that this modelling flexibility can be advantageous in learning tasks.


title: Adaptive Integration of Partial Label Learning and Negative Learning for Enhanced Noisy Label Learning

abstract: There has been significant attention devoted to the effectiveness of various domains, such as semi-supervised learning, contrastive learning, and meta-learning, in enhancing the performance of methods for noisy label learning (NLL) tasks. However, most existing methods still depend on prior assumptions regarding clean samples amidst different sources of noise (\eg, a pre-defined drop rate or a small subset of clean samples). In this paper, we propose a simple yet powerful idea called \textbf{NPN}, which revolutionizes \textbf{N}oisy label learning by integrating \textbf{P}artial label learning (PLL) and \textbf{N}egative learning (NL). Toward this goal, we initially decompose the given label space adaptively into the candidate and complementary labels, thereby establishing the conditions for PLL and NL. We propose two adaptive data-driven paradigms of label disambiguation for PLL: hard disambiguation and soft disambiguation. Furthermore, we generate reliable complementary labels using all non-candidate labels for NL to enhance model robustness through indirect supervision. To maintain label reliability during the later stage of model training, we introduce a consistency regularization term that encourages agreement between the outputs of multiple augmentations. Experiments conducted on both synthetically corrupted and real-world noisy datasets demonstrate the superiority of NPN compared to other state-of-the-art (SOTA) methods. The source code has been made available at {\color{purple}{\url{https://github.com/NUST-Machine-Intelligence-Laboratory/NPN}}}.


title: System Integration of Xilinx DPU and HDMI for Real-Time inference in PYNQ Environment with Image Enhancement

abstract: Use of edge computing in application of Computer Vision (CV) is an active field of research. Today, most CV applications make use of Convolutional Neural Networks (CNNs) to inference on and interpret video data. These edge devices are responsible for several CV related tasks, such as gathering, processing and enhancing, inferencing on, and displaying video data. Due to ease of reconfiguration, computation on FPGA fabric is used to achieve such complex computation tasks. Xilinx provides the PYNQ environment as a user-friendly interface that facilitates in Hardware/Software system integration. However, to the best of authors' knowledge there is no end-to-end framework available for the PYNQ environment that allows Hardware/Software system integration and deployment of CNNs for real-time input feed from High Definition Multimedia Interface (HDMI) input to HDMI output, along with insertion of customized hardware IPs. In this work we propose an integration of rea\textbf{L}-time image \textbf{E}nancement IP with \textbf{A}I inferencing engine in the \textbf{P}ynq environment (\textbf{LEAP}), that integrates HDMI, AI acceleration, image enhancement in the PYNQ environment for Xilinx's Microprocessor on Chip (MPSoC) platform. We evaluate our methodology with two well know CNN models, Resnet50 and YOLOv3. To validate our proposed methodology, LEAP, a simple image enhancement algorithm, histogram equalization, is designed and integrated in the FPGA fabric along with Xilinx's Deep Processing Unit (DPU). Our results show successful implementation of end-to-end integration using completely open source information.


title: WAVER: Writing-style Agnostic Text-Video Retrieval via Distilling Vision-Language Models Through Open-Vocabulary Knowledge

abstract: Text-video retrieval, a prominent sub-field within the domain of multimodal information retrieval, has witnessed remarkable growth in recent years. However, existing methods assume video scenes are consistent with unbiased descriptions. These limitations fail to align with real-world scenarios since descriptions can be influenced by annotator biases, diverse writing styles, and varying textual perspectives. To overcome the aforementioned problems, we introduce $\texttt{WAVER}$, a cross-domain knowledge distillation framework via vision-language models through open-vocabulary knowledge designed to tackle the challenge of handling different writing styles in video descriptions. $\texttt{WAVER}$ capitalizes on the open-vocabulary properties that lie in pre-trained vision-language models and employs an implicit knowledge distillation approach to transfer text-based knowledge from a teacher model to a vision-based student. Empirical studies conducted across four standard benchmark datasets, encompassing various settings, provide compelling evidence that $\texttt{WAVER}$ can achieve state-of-the-art performance in text-video retrieval task while handling writing-style variations. The code is available at: https://github.com/Fsoft-AIC/WAVER


title: IndicIRSuite: Multilingual Dataset and Neural Information Models for Indian Languages

abstract: In this paper, we introduce Neural Information Retrieval resources for 11 widely spoken Indian Languages (Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, and Telugu) from two major Indian language families (Indo-Aryan and Dravidian). These resources include (a) INDIC-MARCO, a multilingual version of the MSMARCO dataset in 11 Indian Languages created using Machine Translation, and (b) Indic-ColBERT, a collection of 11 distinct Monolingual Neural Information Retrieval models, each trained on one of the 11 languages in the INDIC-MARCO dataset. To the best of our knowledge, IndicIRSuite is the first attempt at building large-scale Neural Information Retrieval resources for a large number of Indian languages, and we hope that it will help accelerate research in Neural IR for Indian Languages. Experiments demonstrate that Indic-ColBERT achieves 47.47% improvement in the MRR@10 score averaged over the INDIC-MARCO baselines for all 11 Indian languages except Oriya, 12.26% improvement in the NDCG@10 score averaged over the MIRACL Bengali and Hindi Language baselines, and 20% improvement in the MRR@100 Score over the Mr.Tydi Bengali Language baseline. IndicIRSuite is available at https://github.com/saifulhaq95/IndicIRSuite