title: Factorization Vision Transformer: Modeling Long Range Dependency with Local Window Cost

abstract: Transformers have astounding representational power but typically consume considerable computation which is quadratic with image resolution. The prevailing Swin transformer reduces computational costs through a local window strategy. However, this strategy inevitably causes two drawbacks: (1) the local window-based self-attention hinders global dependency modeling capability; (2) recent studies point out that local windows impair robustness. To overcome these challenges, we pursue a preferable trade-off between computational cost and performance. Accordingly, we propose a novel factorization self-attention mechanism (FaSA) that enjoys both the advantages of local window cost and long-range dependency modeling capability. By factorizing the conventional attention matrix into sparse sub-attention matrices, FaSA captures long-range dependencies while aggregating mixed-grained information at a computational cost equivalent to the local window-based self-attention. Leveraging FaSA, we present the factorization vision transformer (FaViT) with a hierarchical structure. FaViT achieves high performance and robustness, with linear computational complexity concerning input image spatial resolution. Extensive experiments have shown FaViT's advanced performance in classification and downstream tasks. Furthermore, it also exhibits strong model robustness to corrupted and biased data and hence demonstrates benefits in favor of practical applications. In comparison to the baseline model Swin-T, our FaViT-B2 significantly improves classification accuracy by 1% and robustness by 7%, while reducing model parameters by 14%. Our code will soon be publicly available at https://github.com/q2479036243/FaViT.


title: On Matrix Product Factorization of graphs

abstract: In this paper, we explore the concept of the ``matrix product of graphs," initially introduced by Prasad, Sudhakara, Sujatha, and M. Vinay. This operation involves the multiplication of adjacency matrices of two graphs with assigned labels, resulting in a weighted digraph. Our primary focus is on identifying graphs that can be expressed as the graphical matrix product of two other graphs. Notably, we establish that the only complete graph fitting this framework is $K_{4n+1}$, and moreover the factorization is not unique. In addition, the only complete bipartite graph that can be expressed as the graphical matrix product of two other graphs is $K_{2n,2m}$ Furthermore, we introduce several families of graphs that exhibit such factorization and, conversely, some families that do not admit any factorization such as wheel graphs, friendship graphs, hypercubes and paths.


title: A Generalized Neural Diffusion Framework on Graphs

abstract: Recent studies reveal the connection between GNNs and the diffusion process, which motivates many diffusion-based GNNs to be proposed. However, since these two mechanisms are closely related, one fundamental question naturally arises: Is there a general diffusion framework that can formally unify these GNNs? The answer to this question can not only deepen our understanding of the learning process of GNNs, but also may open a new door to design a broad new class of GNNs. In this paper, we propose a general diffusion equation framework with the fidelity term, which formally establishes the relationship between the diffusion process with more GNNs. Meanwhile, with this framework, we identify one characteristic of graph diffusion networks, i.e., the current neural diffusion process only corresponds to the first-order diffusion equation. However, by an experimental investigation, we show that the labels of high-order neighbors actually exhibit monophily property, which induces the similarity based on labels among high-order neighbors without requiring the similarity among first-order neighbors. This discovery motives to design a new high-order neighbor-aware diffusion equation, and derive a new type of graph diffusion network (HiD-Net) based on the framework. With the high-order diffusion equation, HiD-Net is more robust against attacks and works on both homophily and heterophily graphs. We not only theoretically analyze the relation between HiD-Net with high-order random walk, but also provide a theoretical convergence guarantee. Extensive experimental results well demonstrate the effectiveness of HiD-Net over state-of-the-art graph diffusion networks.


title: RTLCoder: Outperforming GPT-3.5 in Design RTL Generation with Our Open-Source Dataset and Lightweight Solution

abstract: The automatic generation of RTL code (e.g., Verilog) using natural language instructions and large language models (LLMs) has attracted significant research interest recently. However, most existing approaches heavily rely on commercial LLMs such as ChatGPT, while open-source LLMs tailored for this specific design generation task exhibit notably inferior performance. The absence of high-quality open-source solutions restricts the flexibility and data privacy of this emerging technique. In this study, we present a new customized LLM solution with a modest parameter count of only 7B, achieving better performance than GPT-3.5 on two representative benchmarks for RTL code generation. This remarkable balance between accuracy and efficiency is made possible by leveraging our new RTL code dataset and a customized LLM algorithm, both of which will be made fully open-source. Furthermore, we have successfully quantized our LLM to 4-bit with a total size of 4GB, enabling it to function on a single laptop with only slight performance degradation. This efficiency allows the RTL generator to serve as a local assistant for engineers, ensuring all design privacy concerns are addressed.


title: Zebra: Extending Context Window with Layerwise Grouped Local-Global Attention

abstract: This paper introduces a novel approach to enhance the capabilities of Large Language Models (LLMs) in processing and understanding extensive text sequences, a critical aspect in applications requiring deep comprehension and synthesis of large volumes of information. Recognizing the inherent challenges in extending the context window for LLMs, primarily built on Transformer architecture, we propose a new model architecture, referred to as Zebra. This architecture efficiently manages the quadratic time and memory complexity issues associated with full attention in the Transformer by employing grouped local-global attention layers. Our model, akin to a zebra's alternating stripes, balances local and global attention layers, significantly reducing computational requirements and memory consumption. Comprehensive experiments, including pretraining from scratch, continuation of long context adaptation training, and long instruction tuning, are conducted to evaluate the Zebra's performance. The results show that Zebra achieves comparable or superior performance on both short and long sequence benchmarks, while also enhancing training and inference efficiency.


title: Proofreading mechanism for colloidal self-assembly

abstract: Designing components that can robustly self-assemble into structures with biological complexity is a grand challenge for material science. Proofreading and error correction is required to improve assembly yield beyond equilibrium limits, using energy to avoid kinetic traps in the energy landscape. Here we introduce an explicit two staged proofreading scheme for patchy particle colloidal assemblies that substantially improves assembly yield and robustness. The first stage implements local rules whereby particles increase their binding strengths when they detect a local environment corresponding to a desired target. The second stage corrects remaining errors, adding a reverse pathway inspired by kinetic proofreading. The scheme shows significant yield improvements, eliminating kinetic traps, giving a much broader temperature range with high yield. Additionally, the scheme is robust against quenched disorder in the components. Our findings illuminate a pathway for advancing programmable design of synthetic living materials, potentially fostering the synthesis of novel biological materials and functional behaviors.


title: Convergence rate of Dirichlet Laplacians on domains with holes to the Schr\"{o}dinger operator with $L^p$ potential

abstract: We consider the Dirichlet Laplacian $\mathcal{A}_\varepsilon=-\Delta$ in the domain $\Omega\setminus\bigcup_i K_{i\varepsilon}\subset\mathbb{R}^n$ with holes $K_{i\varepsilon}$ and the Schr\"{o}dinger operator $\mathcal{A}=-\Delta+V$ in $\Omega$ where $V$ is the $L^n(\Omega)$ limit of the density of the capacities $\operatorname{cap}(K_{i\varepsilon}).$ Strong resolvent convergence for many $V\in W^{-1,\infty}(\Omega)$ was studied by the author. In this paper, we study about convergence rate for $\mathcal{A}_\varepsilon\to\mathcal{A}$ in norm resolvent sense. The case for which $V$ is a constant is studied by Andrii Khrabustovskyi and Olaf Post.


title: Quadrupedal Locomotion Control On Inclined Surfaces Using Collocation Method

abstract: Inspired by Chukars wing-assisted incline running (WAIR), in this work, we employ a high-fidelity model of our Husky Carbon quadrupedal-legged robot to walk over steep slopes of up to 45 degrees. Chukars use the aerodynamic forces generated by their flapping wings to manipulate ground contact forces and traverse steep slopes and even overhangs. By exploiting the thrusters on Husky, we employed a collocation approach to rapidly resolving the joint and thruster actions. Our approach uses a polynomial approximation of the reduced-order dynamics of Husky, called HROM, to quickly and efficiently find optimal control actions that permit high-slope walking without violating friction cone conditions.


title: Scalable Ensemble-based Detection Method against Adversarial Attacks for speaker verification

abstract: Automatic speaker verification (ASV) is highly susceptible to adversarial attacks. Purification modules are usually adopted as a pre-processing to mitigate adversarial noise. However, they are commonly implemented across diverse experimental settings, rendering direct comparisons challenging. This paper comprehensively compares mainstream purification techniques in a unified framework. We find these methods often face a trade-off between user experience and security, as they struggle to simultaneously maintain genuine sample performance and reduce adversarial perturbations. To address this challenge, some efforts have extended purification modules to encompass detection capabilities, aiming to alleviate the trade-off. However, advanced purification modules will always come into the stage to surpass previous detection method. As a result, we further propose an easy-to-follow ensemble approach that integrates advanced purification modules for detection, achieving state-of-the-art (SOTA) performance in countering adversarial noise. Our ensemble method has great potential due to its compatibility with future advanced purification techniques.


title: A semi-analytical model of RF condensation that can handle localized power depositions

abstract: A nonlinear effect, RF (radio frequency) condensation, can be used to facilitate RF stabilization of magnetic islands. Previously studied semi-analytical models for RF condensation are suited mainly for broad deposition profiles and are unable to handle power depositions that are localized in the interior of a magnetic island. Here, a model is developed that can handle both localized profiles and broad profiles. This allows a comparison of RF condensation for narrow vs. broad deposition profiles, and it allows a study of the dependence of RF condensation of localized deposition profiles on key parameters.


title: Mixed Reality Communication for Medical Procedures: Teaching the Placement of a Central Venous Catheter

abstract: Medical procedures are an essential part of healthcare delivery, and the acquisition of procedural skills is a critical component of medical education. Unfortunately, procedural skill is not evenly distributed among medical providers. Skills may vary within departments or institutions, and across geographic regions, depending on the provider's training and ongoing experience. We present a mixed reality real-time communication system to increase access to procedural skill training and to improve remote emergency assistance. Our system allows a remote expert to guide a local operator through a medical procedure. RGBD cameras capture a volumetric view of the local scene including the patient, the operator, and the medical equipment. The volumetric capture is augmented onto the remote expert's view to allow the expert to spatially guide the local operator using visual and verbal instructions. We evaluated our mixed reality communication system in a study in which experts teach the ultrasound-guided placement of a central venous catheter (CVC) to students in a simulation setting. The study compares state-of-the-art video communication against our system. The results indicate that our system enhances and offers new possibilities for visual communication compared to video teleconference-based training.


title: Graph Network Surrogate Model for Subsurface Flow Optimization

abstract: The optimization of well locations and controls is an important step in the design of subsurface flow operations such as oil production or geological CO2 storage. These optimization problems can be computationally expensive, however, as many potential candidate solutions must be evaluated. In this study, we propose a graph network surrogate model (GNSM) for optimizing well placement and controls. The GNSM transforms the flow model into a computational graph that involves an encoding-processing-decoding architecture. Separate networks are constructed to provide global predictions for the pressure and saturation state variables. Model performance is enhanced through the inclusion of the single-phase steady-state pressure solution as a feature. A multistage multistep strategy is used for training. The trained GNSM is applied to predict flow responses in a 2D unstructured model of a channelized reservoir. Results are presented for a large set of test cases, in which five injection wells and five production wells are placed randomly throughout the model, with a random control variable (bottom-hole pressure) assigned to each well. Median relative error in pressure and saturation for 300 such test cases is 1-2%. The ability of the trained GNSM to provide accurate predictions for a new (geologically similar) permeability realization is demonstrated. Finally, the trained GNSM is used to optimize well locations and controls with a differential evolution algorithm. GNSM-based optimization results are comparable to those from simulation-based optimization, with a runtime speedup of a factor of 36. Much larger speedups are expected if the method is used for robust optimization, in which each candidate solution is evaluated on multiple geological models.


title: Accessing Excitation Spectrum of Many-body Systems via Single-Mode Approximation within Quantum Monte Carlo Simulations

abstract: We extend the Single Mode Approximation (SMA) into quantum Monte Carlo (QMC) simulations to provides an efficient and fast method to obtain the dynamical dispersion of quantum many-body systems. Based on Stochastic Series Expansion (SSE) and its projector algorithms, The SMA + SSE method can simply extract the dispersion of the dynamical spectrum in the long wave-length limit and the upper bound of the dispersion elsewhere, without external calculations and high technique barriers. Meanwhile, numerical analytic continuation methods require the fine data of imaginary time correlations and complex programming. Therefore, our method can approach the excitation dispersion of large systems, e.g., we take the two-dimensional Heisenberg model on a $512 \times 512$ square lattice. We demonstrate the effectiveness and efficiency of our method with high precision via additional examples. We also demonstrate that SMA combined with SSE goes beyond spin-wave theory with numerical results.


title: Harnessing the global correlations of the QCD power spectrum

abstract: As multiplicity increases at the CERN Large Hadron Collider, an opportunity arises to explore the information contained in the full QCD power spectrum on an event-by-event basis. This paper lays the foundations for a framework to encode and extract the information contained in finite sampling of a QCD event.


title: YOLO-OB: An improved anchor-free real-time multiscale colon polyp detector in colonoscopy

abstract: Colon cancer is expected to become the second leading cause of cancer death in the United States in 2023. Although colonoscopy is one of the most effective methods for early prevention of colon cancer, up to 30% of polyps may be missed by endoscopists, thereby increasing patients' risk of developing colon cancer. Though deep neural networks have been proven to be an effective means of enhancing the detection rate of polyps. However, the variation of polyp size brings the following problems: (1) it is difficult to design an efficient and sufficient multi-scale feature fusion structure; (2) matching polyps of different sizes with fixed-size anchor boxes is a hard challenge. These problems reduce the performance of polyp detection and also lower the model's training and detection efficiency. To address these challenges, this paper proposes a new model called YOLO-OB. Specifically, we developed a bidirectional multiscale feature fusion structure, BiSPFPN, which could enhance the feature fusion capability across different depths of a CNN. We employed the ObjectBox detection head, which used a center-based anchor-free box regression strategy that could detect polyps of different sizes on feature maps of any scale. Experiments on the public dataset SUN and the self-collected colon polyp dataset Union demonstrated that the proposed model significantly improved various performance metrics of polyp detection, especially the recall rate. Compared to the state-of-the-art results on the public dataset SUN, the proposed method achieved a 6.73% increase on recall rate from 91.5% to 98.23%. Furthermore, our YOLO-OB was able to achieve real-time polyp detection at a speed of 39 frames per second using a RTX3090 graphics card. The implementation of this paper can be found here: https://github.com/seanyan62/YOLO-OB.


title: ChatSOS: LLM-based knowledge Q&A system for safety engineering

abstract: Recent advancements in large language models (LLMs) have notably propelled natural language processing (NLP) capabilities, demonstrating significant potential in safety engineering applications. Despite these advancements, LLMs face constraints in processing specialized tasks, attributed to factors such as corpus size, input processing limitations, and privacy concerns. Obtaining useful information from reliable sources in a limited time is crucial for LLM. Addressing this, our study introduces an LLM-based Q&A system for safety engineering, enhancing the comprehension and response accuracy of the model. We employed prompt engineering to incorporate external knowledge databases, thus enriching the LLM with up-to-date and reliable information. The system analyzes historical incident reports through statistical methods, utilizes vector embedding to construct a vector database, and offers an efficient similarity-based search functionality. Our findings indicate that the integration of external knowledge significantly augments the capabilities of LLM for in-depth problem analysis and autonomous task assignment. It effectively summarizes accident reports and provides pertinent recommendations. This integration approach not only expands LLM applications in safety engineering but also sets a precedent for future developments towards automation and intelligent systems.


title: Pseudo-neutrino versus recoil formalism for 4-body phase space and applications to nuclear decay

abstract: It is well-known that the traditional treatment of radiative corrections that utilizes the "true" neutrino momentum $\vec{p}_\nu$ in the differential decay rate formula could lead to a $\sim \alpha/\pi$ systematic error in certain observables due to the mistreatment of 4-body kinematics. We investigate the theory structure of one of the proposed solutions, the "$\nu'$-formalism", in the non-recoil limit appropriate for neutron and nuclear beta decays. We derive an elegant master formula for the 4-body phase space and use it to re-analyze the spectrum-dependent "outer" radiative corrections to the beta decay of a polarized spin-half nucleus; a complete set of analytic expressions is provided for readers to straightforwardly obtain the final numerical results. We compare it to the "recoil formalism" where the energy of the recoil nucleus is fixed.


title: Semi-supervised Semantic Segmentation Meets Masked Modeling:Fine-grained Locality Learning Matters in Consistency Regularization

abstract: Semi-supervised semantic segmentation aims to utilize limited labeled images and abundant unlabeled images to achieve label-efficient learning, wherein the weak-to-strong consistency regularization framework, popularized by FixMatch, is widely used as a benchmark scheme. Despite its effectiveness, we observe that such scheme struggles with satisfactory segmentation for the local regions. This can be because it originally stems from the image classification task and lacks specialized mechanisms to capture fine-grained local semantics that prioritizes in dense prediction. To address this issue, we propose a novel framework called \texttt{MaskMatch}, which enables fine-grained locality learning to achieve better dense segmentation. On top of the original teacher-student framework, we design a masked modeling proxy task that encourages the student model to predict the segmentation given the unmasked image patches (even with 30\% only) and enforces the predictions to be consistent with pseudo-labels generated by the teacher model using the complete image. Such design is motivated by the intuition that if the predictions are more consistent given insufficient neighboring information, stronger fine-grained locality perception is achieved. Besides, recognizing the importance of reliable pseudo-labels in the above locality learning and the original consistency learning scheme, we design a multi-scale ensembling strategy that considers context at different levels of abstraction for pseudo-label generation. Extensive experiments on benchmark datasets demonstrate the superiority of our method against previous approaches and its plug-and-play flexibility.


title: Measuring entanglement entropy and its topological signature for phononic systems

abstract: Entanglement entropy is a fundamental concept with rising importance in different fields ranging from quantum information science, black holes to materials science. In complex materials and systems, entanglement entropy provides insight into the collective degrees of freedom that underlie the systems' complex behaviours. As well-known predictions, the entanglement entropy exhibits area laws for systems with gapped excitations, whereas it follows the Gioev-Klich-Widom scaling law in gapless fermion systems. Furthermore, the entanglement spectrum provides salient characterizations of topological phases and phase transitions beyond the conventional paradigms. However, many of these fundamental predictions have not yet been confirmed in experiments due to the difficulties in measuring entanglement entropy in physical systems. Here, we report the experimental verification of the above predictions by probing the nonlocal correlations in phononic systems. From the pump-probe responses in phononic crystals, we obtain the entanglement entropy and entanglement spectrum for phononic systems with the fermion filling analog. With these measurements, we verify the Gioev-Klich-Widom scaling law of entanglement entropy for various quasiparticle dispersions in one- and two-dimensions. Moreover, we observe the salient signatures of topological phases in the entanglement spectrum and entanglement entropy which unveil an unprecedented probe of topological phases without relying on the bulk-boundary correspondence. The progress here opens a frontier where entanglement entropy serves as an important experimental tool in the study of emergent phases and phase transitions which can be generalized to non-Hermitian and other unconventional regimes.


title: Restriction estimates for one class of hypersurfaces with vanishing curvature in $\mathbb{R}^n$

abstract: In this paper, we study the restriction problem for one class of hypersurfaces with vanishing curvature in $\mathbb{R}^n$ with $n$ being odd. We obtain an $L^2-L^p$ restriction estimate, which is optimal except at the endpoint. Furthermore, we establish an $L^s-L^p$ restriction estimate for these hypersurfaces, which is achieved by improving the known $L^{\infty}$ restriction estimate for hypersurfaces with $\frac{n-1}{2}$ positive principal curvatures and $\frac{n-1}{2}$ negative principal curvatures.


title: Unlocking High Performance, Ultra-Low Power Van der Waals Transistors: Towards Back-End-of-Line In-Sensor Machine Vision Applications

abstract: Recent reports on machine learning (ML) and machine vision (MV) devices have demonstrated the potentials of 2D materials and devices. Yet, scalable 2D devices are being challenged by contact resistance and Fermi Level Pinning (FLP), power consumption, and low-cost CMOS compatible lithography processes. To enable CMOS+2D, it is essential to find a proper lithography strategy that can fulfill these requirements. Here, we explore modified van der Waals (vdW) deposition lithography and demonstrate a relatively new class of van-der-Waals-Field-Effect-Transistors (vdW-FETs) based on 2D materials. This lithography strategy enables us to unlock high performance devices evident by high current on-off ratio (Ion/Ioff), high turn-on current density (Ion), and weak Fermi Level Pinning (FLP). We utilize this approach to demonstrate a gate-tunable near-ideal diode using MoS2/WSe2 heterojunction with an ideality factor of ~1.65 and current rectification of 102. We finally demonstrate a highly sensitive, scalable, and ultra-low power phototransistor using MoS2/ WSe2 vdW-FET for Back-End-of-Line (BEOL) integration. Our phototransistor exhibits the highest gate-tunable photoresponsivity achieved to date for white light detection with ultra-low power dissipation, enabling ultra-sensitive, ultra-fast, and efficient optoelectronic applications such as in-sensor neuromorphic machine vision. Our approach shows the great potential of modified vdW deposition lithography for back-end-of-line CMOS+2D applications.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.app-ph physics.optics


title: OGLE-2017-BLG-0448Lb: A Low Mass-Ratio Wide-Orbit Microlensing Planet?

abstract: The gravitational microlensing technique is most sensitive to planets in a Jupiter-like orbit and has detected more than 200 planets. However, only a few wide-orbit ($s > 2$) microlensing planets have been discovered, where $s$ is the planet-to-host separation normalized to the angular Einstein ring radius, $\theta_{\rm E}$. Here we present the discovery and analysis of a strong candidate wide-orbit microlensing planet in the event, OGLE-2017-BLG-0448. The whole light curve exhibits long-term residuals to the static binary-lens single-source model, so we investigate the residuals by adding the microlensing parallax, microlensing xallarap, an additional lens, or an additional source. For the first time, we observe a complex degeneracy between all four effects. The wide-orbit models with $s \sim 2.5$ and a planet-to-host mass-ratio of $q \sim 10^{-4}$ are significantly preferred, but we cannot rule out the close models with $s \sim 0.35$ and $q \sim 10^{-3}$. A Bayesian analysis based on a Galactic model indicates that, despite the complicated degeneracy, the surviving wide-orbit models all contain a super-Earth-mass to Neptune-mass planet at a projected planet-host separation of $\sim 6$ au and the surviving close-orbit models all consist of a Jovian-mass planet at $\sim 1$ au. The host star is probably an M or K dwarf. We discuss the implications of this dimension-degeneracy disaster on microlensing light-curve analysis and its potential impact on statistical studies.


title: MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task Learning

abstract: Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific decoders. However, the complexity of the decoders increases with the number of tasks. To tackle this challenge, we integrate the decoder-free vision-language model CLIP, which exhibits robust zero-shot generalization capability. Recently, parameter-efficient transfer learning methods have been extensively explored with CLIP for adapting to downstream tasks, where prompt tuning showcases strong potential. Nevertheless, these methods solely fine-tune a single modality (text or visual), disrupting the modality structure of CLIP. In this paper, we first propose Multi-modal Alignment Prompt (MmAP) for CLIP, which aligns text and visual modalities during fine-tuning process. Building upon MmAP, we develop an innovative multi-task prompt learning framework. On the one hand, to maximize the complementarity of tasks with high similarity, we utilize a gradient-driven task grouping method that partitions tasks into several disjoint groups and assign a group-shared MmAP to each group. On the other hand, to preserve the unique characteristics of each task, we assign an task-specific MmAP to each task. Comprehensive experiments on two large multi-task learning datasets demonstrate that our method achieves significant performance improvements compared to full fine-tuning while only utilizing approximately 0.09% of trainable parameters.


title: Arithmetic of a certain semigroup of probability distributions on the group $\mathbb{R}\times \mathbb{Z}(2)$

abstract: We consider a certain convolution semigroup $\Theta$ of probability distributions on the group $\mathbb{R}\times \mathbb{Z}(2)$, where $\mathbb{R}$ is the group of real numbers and $\mathbb{Z}(2)$ is the additive group of the integers modulo 2. This semigroup appeared in connection with the study of a characterization problem of mathematical statistics on $a$-adic solenoids containing an element of order 2. We answer the questions that arise in the study of arithmetic of the semigroup $\Theta$. Namely, we describe the class of infinitely divisible distributions, the class of indecomposable distributions, and the class of distributions which have no indecomposable factors.


title: Nonlinear optical responses in multi-orbital topological superconductors

abstract: We theoretically study first and second-order optical responses in a transition metal dichalcogenide monolayer with distinct trivial, nodal, and time-reversal invariant topological superconducting (TRITOPS) phases. We show that the second-order DC response, also known as the photogalvanic response, contains signatures for differentiating these phases while the first-order optical response does not. We find that the high-frequency photogalvanic response is insensitive to the phase of the system, while the low-frequency response exhibits features distinguishing the three phases. At zero doping, corresponding to an electron filling in which the Fermi level lies at nodal points, there are opposite sign zero-frequency divergences in the response when approaching the nodal phase boundaries from the trivial and the TRITOPS phases. In the trivial phase, both the high-frequency and low-frequency response of the system are negative, but in the TRITOPS phase, the low-frequency response becomes positive while the high-frequency response remains negative. Furthermore, since phase transitions are controlled by the Rashba spin-orbit coupling and the ratio of intra-orbital and inter-orbital paring amplitudes, our results not only help distinguish the phases but can also provide an estimate of the pairing amplitudes based on the photogalvanic response of the system.


title: On the complexity of list $\mathcal H$-packing for sparse graph classes

abstract: The problem of packing as many subgraphs isomorphic to $H \in \mathcal H$ as possible in a graph for a class $\mathcal H$ of graphs is well studied in the literature. Both vertex-disjoint and edge-disjoint versions are known to be NP-complete for $H$ that contains at least three vertices and at least three edges, respectively. In this paper, we consider ``list variants'' of these problems: Given a graph $G$, an integer $k$, and a collection $\mathcal L_{\mathcal H}$ of subgraphs of $G$ isomorphic to some $H \in \mathcal H$, the goal is to compute $k$ subgraphs in $\mathcal L_{\mathcal H}$ that are pairwise vertex- or edge-disjoint. We show several positive and negative results, focusing on classes of sparse graphs, such as bounded-degree graphs, planar graphs, and bounded-treewidth graphs.


title: Digital Divide in Disasters: Investigating Spatial and Socioeconomic Disparities in Internet Service Disruptions During Extreme Weather Events

abstract: The resilience of internet service is crucial for ensuring consistent communication, facilitating emergency response in digitally-dependent society. Due to empirical data constraints, there has been limited research on internet service disruptions during extreme weather events. To bridge this gap, this study utilizes observational datasets on internet performance to quantitatively assess extent of internet disruption during two recent extreme weather events. Taking Harris County in United States as study region, we jointly analyzed the hazard severity and the associated internet disruptions in two extreme weather events. The results show that hazard events significantly impacted regional internet connectivity. There exists a pronounced temporal synchronicity between magnitude of disruption and hazard severity: as severity of hazards intensifies, internet disruptions correspondingly escalate, and eventually return to baseline levels post-event. Spatial analyses show internet service disruptions can happen even in areas not directly impacted by hazards, demonstrating that repercussions of hazards extend beyond immediate area of impact. This interplay of temporal synchronization and spatial variance underscores complex relationships between hazard severity and Internet disruption. Socio-demographic analysis suggests vulnerable communities, already grappling with myriad challenges, face exacerbated service disruptions during hazard events, emphasizing the need for prioritized disaster mitigation strategiesfor improving the resilience of internet services. To the best of our knowledge, this research is among the first studies to examine the Internet disruptions during hazardous events using a quantitative observational dataset. Insights obtained hold significant implications for city administrators, guiding them towards more resilient and equitable infrastructure planning.


title: Towards Automatic Data Augmentation for Disordered Speech Recognition

abstract: Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain TDNN and end-to-end Conformer ASR systems on such data. The handcrafted temporal and spectral mask operations in the standard SpecAugment method that are task and system dependent, together with additionally introduced minimum and maximum cut-offs of these time-frequency masks, are now automatically learned using an RNN-based policy controller and tightly integrated with ASR system training. Experiments on the UASpeech corpus suggest the proposed RL-based data augmentation approach consistently produced performance superior or comparable that obtained using expert or handcrafted SpecAugment policies. Our RL auto-augmented PyChain TDNN system produced an overall WER of 28.79% on the UASpeech test set of 16 dysarthric speakers.


title: Metacognition-Enhanced Few-Shot Prompting With Positive Reinforcement

abstract: Few-shot prompting elicits the remarkable abilities of large language models by equipping them with a few demonstration examples in the input. However, the traditional method of providing large language models with all demonstration input-output pairs at once may not effectively guide large language models to learn the specific input-output mapping relationship. In this paper, inspired by the regulatory and supportive role of metacognition in students' learning, we propose a novel metacognition-enhanced few-shot prompting, which guides large language models to reflect on their thought processes to comprehensively learn the given demonstration examples. Furthermore, considering that positive reinforcement can improve students' learning motivation, we introduce positive reinforcement into our metacognition-enhanced few-shot prompting to promote the few-shot learning of large language models by providing response-based positive feedback. The experimental results on two real-world datasets show that our metacognition-enhanced few-shot prompting with positive reinforcement surpasses traditional few-shot prompting in classification accuracy and macro F1.


title: Unveiling the Bent Jet Structure and Polarization of OJ 287 at 1.7 GHz with Space VLBI

abstract: We present total intensity and linear polarization images of OJ287 at 1.68GHz, obtained through space-based VLBI observations with RadioAstron on April 16, 2016. The observations were conducted using a ground array consisting of the VLBA and the EVN. Ground-space fringes were detected with a maximum projected baseline length of 5.6 Earth's diameter, resulting in an angular resolution of 530 uas. With this unprecedented resolution at such a low frequency, the progressively bending jet structure of OJ287 has been resolved up to 10 pc of the projected distance from the radio core. In comparison with close-in-time VLBI observations at 15, 43, 86 GHz from MOJAVE and VLBA-BU-BLAZAR monitoring projects, we obtain the spectral index map showing the opaque core and optically thin jet components. The optically thick core has a brightness temperature of 10$^{13}$ K, and is further resolved into two sub-components at higher frequencies labeled C1 and C2. These sub-components exhibit a transition from optically thick to thin, with a SSA turnover frequency estimated to be 33 and 11.5 GHz, and a turnover flux density 4 and 0.7 Jy, respectively. Assuming a Doppler boosting factor of 10, the SSA values provide the estimate of the magnetic field strengths from SSA of 3.4 G for C1 and 1.0 G for C2. The magnetic field strengths assuming equipartition arguments are also estimated as 2.6 G and 1.6 G, respectively. The integrated degree of linear polarization is found to be approximately 2.5 %, with the electric vector position angle being well aligned with the local jet direction at the core region. This alignment suggests a predominant toroidal magnetic field, which is in agreement with the jet formation model that requires a helical magnetic field anchored to either the black hole ergosphere or the accretion disk. Further downstream, the jet seems to be predominantly threaded by a poloidal magnetic field.


title: Generative Model-based Feature Knowledge Distillation for Action Recognition

abstract: Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus on designing loss functions and fusing cross-modal information. This overlooks the spatial-temporal feature semantics, resulting in limited advancements in model compression. Addressing this gap, our paper introduces an innovative knowledge distillation framework, with the generative model for training a lightweight student model. In particular, the framework is organized into two steps: the initial phase is Feature Representation, wherein a generative model-based attention module is trained to represent feature semantics; Subsequently, the Generative-based Feature Distillation phase encompasses both Generative Distillation and Attention Distillation, with the objective of transferring attention-based feature semantics with the generative model. The efficacy of our approach is demonstrated through comprehensive experiments on diverse popular datasets, proving considerable enhancements in video action recognition task. Moreover, the effectiveness of our proposed framework is validated in the context of more intricate video action detection task. Our code is available at https://github.com/aaai-24/Generative-based-KD.


title: Electric-Field-Induced Domain Walls in Wurtzite Ferroelectrics

abstract: Wurtzite ferroelectrics possess transformative potential for next-generation microelectronics. A comprehensive understanding of their ferroelectric properties and domain energetics is crucial for tailoring their ferroelectric characteristics and exploiting their functional properties in practical devices. Despite burgeoning interest, the exact configurations, and electronic structures of the domain walls in wurtzite ferroelectrics remain elusive. In this work, we elucidate the atomic configurations and electronic properties of electric-field-induced domain walls in ferroelectric ScGaN. By combining transmission electron microscopy and theoretical calculations, a novel charged domain wall with a buckled two-dimensional hexagonal phase is revealed. The dangling bonds associated with these domain walls give rise to unprecedented metallic-like mid-gap states within the forbidden band. Quantitative analysis further unveils a universal charge-compensation mechanism stabilizing antipolar domain walls in ferroelectric materials, wherein the polarization discontinuity at the 180{\deg} domain wall is compensated by the dangling bond electrons. Furthermore, the reconfigurable conductivity of these domain walls is experimentally demonstrated, showcasing their potential for ultra-scaled device applications. Our findings represent a pivotal advancement in understanding the structural and electronic properties of wurtzite ferroelectric domain walls and lay the groundwork for fundamental physics studies and device applications.


title: Guarding the Grid: Enhancing Resilience in Automated Residential Demand Response Against False Data Injection Attacks

abstract: Utility companies are increasingly leveraging residential demand flexibility and the proliferation of smart/IoT devices to enhance the effectiveness of residential demand response (DR) programs through automated device scheduling. However, the adoption of distributed architectures in these systems exposes them to the risk of false data injection attacks (FDIAs), where adversaries can manipulate decision-making processes by injecting false data. Given the limited control utility companies have over these distributed systems and data, the need for reliable implementations to enhance the resilience of residential DR schemes against FDIAs is paramount. In this work, we present a comprehensive framework that combines DR optimisation, anomaly detection, and strategies for mitigating the impacts of attacks to create a resilient and automated device scheduling system. To validate the robustness of our framework against FDIAs, we performed an evaluation using real-world data sets, highlighting its effectiveness in securing residential DR systems.


title: Toward a Ginsparg-Wilson Lattice Hamiltonian

abstract: To address quantum computation of quantities in quantum chromodynamics (QCD) for which chiral symmetry is important, it would be useful to have the Hamiltonian for a fermion satisfying the Ginsparg-Wilson (GW) equation. I work with an approximate solution to the GW equation which is fractional linear in time derivatives. The resulting Hamiltonian is non-local and has ghosts, but is free of doublers and has the correct continuum limit. This construction works in general odd spatial dimensions, and I provide an explicit expression for the Hamiltonian in 1 spatial dimension.


title: CLIP-guided Federated Learning on Heterogeneous and Long-Tailed Data

abstract: Federated learning (FL) provides a decentralized machine learning paradigm where a server collaborates with a group of clients to learn a global model without accessing the clients' data. User heterogeneity is a significant challenge for FL, which together with the class-distribution imbalance further enhances the difficulty of FL. Great progress has been made in large vision-language models, such as Contrastive Language-Image Pre-training (CLIP), which paves a new way for image classification and object recognition. Inspired by the success of CLIP on few-shot and zero-shot learning, we use CLIP to optimize the federated learning between server and client models under its vision-language supervision. It is promising to mitigate the user heterogeneity and class-distribution balance due to the powerful cross-modality representation and rich open-vocabulary prior knowledge. In this paper, we propose the CLIP-guided FL (CLIP2FL) method on heterogeneous and long-tailed data. In CLIP2FL, the knowledge of the off-the-shelf CLIP model is transferred to the client-server models, and a bridge is built between the client and server. Specifically, for client-side learning, knowledge distillation is conducted between client models and CLIP to improve the ability of client-side feature representation. For server-side learning, in order to mitigate the heterogeneity and class-distribution imbalance, we generate federated features to retrain the server model. A prototype contrastive learning with the supervision of the text encoder of CLIP is introduced to generate federated features depending on the client-side gradients, and they are used to retrain a balanced server classifier.


title: A decomposition theorem for balanced measures

abstract: Let $G = (V,E)$ be a connected graph. A probability measure $\mu$ on $V$ is called "balanced" if it has the following property: if $T_\mu(v)$ denotes the "earth mover's" cost of transporting all the mass of $\mu$ from all over the graph to the vertex $v$, then $T_\mu$ attains its global maximum at each point in the support of $\mu$. We prove a decomposition result that characterizes balanced measures as convex combinations of suitable "extremal" balanced measures that we call "basic." An upper bound on the number of basic balanced measures on $G$ follows, and an example shows that this estimate is essentially sharp.


title: PhyOT: Physics-informed object tracking in surveillance cameras

abstract: While deep learning has been very successful in computer vision, real world operating conditions such as lighting variation, background clutter, or occlusion hinder its accuracy across several tasks. Prior work has shown that hybrid models -- combining neural networks and heuristics/algorithms -- can outperform vanilla deep learning for several computer vision tasks, such as classification or tracking. We consider the case of object tracking, and evaluate a hybrid model (PhyOT) that conceptualizes deep neural networks as ``sensors'' in a Kalman filter setup, where prior knowledge, in the form of Newtonian laws of motion, is used to fuse sensor observations and to perform improved estimations. Our experiments combine three neural networks, performing position, indirect velocity and acceleration estimation, respectively, and evaluate such a formulation on two benchmark datasets: a warehouse security camera dataset that we collected and annotated and a traffic camera open dataset. Results suggest that our PhyOT can track objects in extreme conditions that the state-of-the-art deep neural networks fail while its performance in general cases does not degrade significantly from that of existing deep learning approaches. Results also suggest that our PhyOT components are generalizable and transferable.


title: Towards Inductive Robustness: Distilling and Fostering Wave-induced Resonance in Transductive GCNs Against Graph Adversarial Attacks

abstract: Graph neural networks (GNNs) have recently been shown to be vulnerable to adversarial attacks, where slight perturbations in the graph structure can lead to erroneous predictions. However, current robust models for defending against such attacks inherit the transductive limitations of graph convolutional networks (GCNs). As a result, they are constrained by fixed structures and do not naturally generalize to unseen nodes. Here, we discover that transductive GCNs inherently possess a distillable robustness, achieved through a wave-induced resonance process. Based on this, we foster this resonance to facilitate inductive and robust learning. Specifically, we first prove that the signal formed by GCN-driven message passing (MP) is equivalent to the edge-based Laplacian wave, where, within a wave system, resonance can naturally emerge between the signal and its transmitting medium. This resonance provides inherent resistance to malicious perturbations inflicted on the signal system. We then prove that merely three MP iterations within GCNs can induce signal resonance between nodes and edges, manifesting as a coupling between nodes and their distillable surrounding local subgraph. Consequently, we present Graph Resonance-fostering Network (GRN) to foster this resonance via learning node representations from their distilled resonating subgraphs. By capturing the edge-transmitted signals within this subgraph and integrating them with the node signal, GRN embeds these combined signals into the central node's representation. This node-wise embedding approach allows for generalization to unseen nodes. We validate our theoretical findings with experiments, and demonstrate that GRN generalizes robustness to unseen nodes, whilst maintaining state-of-the-art classification accuracy on perturbed graphs.


title: The mass and spectral function of scalar and pseudoscalar mesons in a hot and chirally imbalanced medium using the two-flavor NJL model

abstract: We explore the properties of neutral mesons within the context of a chirally imbalanced medium, employing the two-flavor Nambu--Jona-Lasinio model. The temperature dependence of the constituent quark mass at finite values of the chiral chemical potential (CCP) demonstrates the well-established phenomena of chiral catalysis at lower temperatures and inverse chiral catalysis at higher temperatures. The polarization functions in both the scalar ($\sigma$) and pseudo-scalar ($\pi^0$) channels have been evaluated using real time formalism of thermal field theory. These have been used to determine the masses and spectral functions of $ \sigma $ and $ \pi $ mesons. Detailed investigation of the analytic structure of the imaginary part of the polarization function for $\sigma$ and $\pi$ mesons results in the emergence of non-trivial Landau cut contributions due to the presence of chiral imbalance. The multiple solutions for the mass of the $\pi$ meson for specific values of CCP have been analysed on the basis of their residue at the pole. Furthermore, we have observed abrupt changes in the masses of both scalar and pseudo-scalar mesons at finite CCP values, particularly at higher temperatures. A decreasing trend in the Mott transition temperature is seen with the increase in CCP.


title: SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector

abstract: In this paper, we attempt to specialize the VLM model for OWOD tasks by distilling its open-world knowledge into a language-agnostic detector. Surprisingly, we observe that the combination of a simple \textbf{knowledge distillation} approach and the automatic pseudo-labeling mechanism in OWOD can achieve better performance for unknown object detection, even with a small amount of data. Unfortunately, knowledge distillation for unknown objects severely affects the learning of detectors with conventional structures for known objects, leading to catastrophic forgetting. To alleviate these problems, we propose the \textbf{down-weight loss function} for knowledge distillation from vision-language to single vision modality. Meanwhile, we propose the \textbf{cascade decouple decoding structure} that decouples the learning of localization and recognition to reduce the impact of category interactions of known and unknown objects on the localization learning process. Ablation experiments demonstrate that both of them are effective in mitigating the impact of open-world knowledge distillation on the learning of known objects. Additionally, to alleviate the current lack of comprehensive benchmarks for evaluating the ability of the open-world detector to detect unknown objects in the open world, we propose two benchmarks, which we name "\textbf{StandardSet}$\heartsuit$" and "\textbf{IntensiveSet}$\spadesuit$" respectively, based on the complexity of their testing scenarios. Comprehensive experiments performed on OWOD, MS-COCO, and our proposed benchmarks demonstrate the effectiveness of our methods. The code and proposed dataset are available at \url{https://github.com/xiaomabufei/SKDF}.


title: Automated detection of Zika and dengue in Aedes aegypti using neural spiking analysis

abstract: Mosquito-borne diseases present considerable risks to the health of both animals and humans. Aedes aegypti mosquitoes are the primary vectors for numerous medically important viruses such as dengue, Zika, yellow fever, and chikungunya. To characterize this mosquito neural activity, it is essential to classify the generated electrical spikes. However, no open-source neural spike classification method is currently available for mosquitoes. Our work presented in this paper provides an innovative artificial intelligence-based method to classify the neural spikes in uninfected, dengue-infected, and Zika-infected mosquitoes. Aiming for outstanding performance, the method employs a fusion of normalization, feature importance, and dimension reduction for the preprocessing and combines convolutional neural network and extra gradient boosting (XGBoost) for classification. The method uses the electrical spiking activity data of mosquito neurons recorded by microelectrode array technology. We used data from 0, 1, 2, 3, and 7 days post-infection, containing over 15 million samples, to analyze the method's performance. The performance of the proposed method was evaluated using accuracy, precision, recall, and the F1 scores. The results obtained from the method highlight its remarkable performance in differentiating infected vs uninfected mosquito samples, achieving an average of 98.1%. The performance was also compared with 6 other machine learning algorithms to further assess the method's capability. The method outperformed all other machine learning algorithms' performance. Overall, this research serves as an efficient method to classify the neural spikes of Aedes aegypti mosquitoes and can assist in unraveling the complex interactions between pathogens and mosquitoes.


title: The small kt-region in Drell-Yan production at next-to-leading order with the Parton Branching Method

abstract: The Parton Branching (PB) method describes the evolution of transverse momentum dependent (TMD) parton distributions, covering all kinematic regions from small to large transverse momenta kT. The small kT-region is very sensitive both to the contribution of the intrinsic motion of partons (intrinsic kT) and to the resummation of soft gluons taken into account by the PB TMD evolution equations. We study the role of soft-gluon emissions in TMD as well as integrated parton distributions. We perform a detailed investigation of the PB TMD methodology at next-to-leading order (NLO) in Drell-Yan (DY) production for low transverse momenta. We present the extraction of the nonperturbative "intrinsic-kT" distribution from recent measurements of DY transverse momentum distributions at the LHC across a wide range in DY masses, including a detailed treatment of statistical, correlated and uncorrelated uncertainties. We comment on the (in)dependence of intrinsic transverse momentum on DY mass and center-of-mass energy, and on the comparison with other approaches.


title: MaxK-GNN: Extremely Fast GPU Kernel Design for Accelerating Graph Neural Networks Training

abstract: In the acceleration of deep neural network training, the GPU has become the mainstream platform. GPUs face substantial challenges on GNNs, such as workload imbalance and memory access irregularities, leading to underutilized hardware. Existing solutions such as PyG, DGL with cuSPARSE, and GNNAdvisor frameworks partially address these challenges but memory traffic is still significant. We argue that drastic performance improvements can only be achieved by the vertical optimization of algorithm and system innovations, rather than treating the speedup optimization as an "after-thought" (i.e., (i) given a GNN algorithm, designing an accelerator, or (ii) given hardware, mainly optimizing the GNN algorithm). In this paper, we present MaxK-GNN, an advanced high-performance GPU training system integrating algorithm and system innovation. (i) We introduce the MaxK nonlinearity and provide a theoretical analysis of MaxK nonlinearity as a universal approximator, and present the Compressed Balanced Sparse Row (CBSR) format, designed to store the data and index of the feature matrix after nonlinearity; (ii) We design a coalescing enhanced forward computation with row-wise product-based SpGEMM Kernel using CBSR for input feature matrix fetching and strategic placement of a sparse output accumulation buffer in shared memory; (iii) We develop an optimized backward computation with outer product-based and SSpMM Kernel. We conduct extensive evaluations of MaxK-GNN and report the end-to-end system run-time. Experiments show that MaxK-GNN system could approach the theoretical speedup limit according to Amdahl's law. We achieve comparable accuracy to SOTA GNNs, but at a significantly increased speed: 3.22/4.24 times speedup (vs. theoretical limits, 5.52/7.27 times) on Reddit compared to DGL and GNNAdvisor implementations.


title: Hydrodynamic limits from the self-organized kinetic system for body attitude coordination

abstract: The self-organized kinetic system for body attitude coordination (SOKB) was recently derived by Degond et al. (Math. Models Methods Appl. Sci. 27(6), 1005-1049, 2017). This system describe a new collective motion for multi-agents dynamics, where each agent is described by its position and body attitude: agents travel at a constant speed in a given direction and their body can rotate round it adopting different configurations (representing by rotation matrix in $\mathrm{SO(3)}$). In this paper, we study the hydrodynamic limit of the scaled SOKB system with constant intensity of coordination $\nu ( \Lambda [f] \cdot A ) = \nu_0 > 0$ by employing the Generalized Collision Invariants (GCI)-based Hilbert expansion approach. The limit is the self-organized hydrodynamic model for body attitude coordination (SOHB). In spherical coordinates, the SOHB system is singular. To avoid this coordinate singularity, we transfer SOHB system into a non-singular form by stereographic projection. This work provides the first analytically rigorous justification of the modeling and asymptotic analysis in Degond et al. (Math. Models Methods Appl. Sci. 27(6), 1005-1049, 2017).


title: Real-time Autonomous Control of a Continuous Macroscopic Process as Demonstrated by Plastic Forming

abstract: To meet the demands for more adaptable and expedient approaches to augment both research and manufacturing, we report an autonomous system using real-time in-situ characterization and an autonomous, decision-making processer based on an active learning algorithm. This system was applied to a plastic film forming system to highlight its efficiency and accuracy in determining the process conditions for specified target film dimensions, importantly, without any human intervention. Application of this system towards nine distinct film dimensions demonstrated the system ability to quickly determine the appropriate and stable process conditions (average 11 characterization-adjustment iterations, 19 minutes) and the ability to avoid traps, such as repetitive over-correction. Furthermore, comparison of the achieved film dimensions to the target values showed a high accuracy (R2 = 0.87, 0.90) for film width and thickness, respectively. In addition, the use of an active learning algorithm afforded our system to proceed optimization with zero initial training data, which was unavailable due to the complex relationships between the control factors (material supply rate, applied force, material viscosity) within the plastic forming process. As our system is intrinsically general and can be applied to any most material processes, these results have significant implications in accelerating both research and industrial processes.

categories: cond-mat.soft cond-mat.mtrl-sci cs.AI cs.LG physics.data-an


title: On the Image-Based Detection of Tomato and Corn leaves Diseases : An in-depth comparative experiments

abstract: The research introduces a novel plant disease detection model based on Convolutional Neural Networks (CNN) for plant image classification, marking a significant contribution to image categorization. The innovative training approach enables a streamlined and efficient system implementation. The model classifies two distinct plant diseases into four categories, presenting a novel technique for plant disease identification. In Experiment 1, Inception-V3, Dense-Net-121, ResNet-101-V2, and Xception models were employed for CNN training. The newly created plant disease image dataset includes 1963 tomato plant images and 7316 corn plant images from the PlantVillage dataset. Of these, 1374 tomato images and 5121 corn images were used for training, while 589 tomato images and 2195 corn images were used for testing/validation. Results indicate that the Xception model outperforms the other three models, yielding val_accuracy values of 95.08% and 92.21% for the tomato and corn datasets, with corresponding val_loss values of 0.3108 and 0.4204, respectively. In Experiment 2, CNN with Batch Normalization achieved disease detection rates of approximately 99.89% in the training set and val_accuracy values exceeding 97.52%, accompanied by a val_loss of 0.103. Experiment 3 employed a CNN architecture as the base model, introducing additional layers in Model 2, skip connections in Model 3, and regularizations in Model 4. Detailed experiment results and model efficiency are outlined in the paper's sub-section 1.5. Experiment 4 involved combining all corn and tomato images, utilizing various models, including MobileNet (val_accuracy=86.73%), EfficientNetB0 (val_accuracy=93.973%), Xception (val_accuracy=74.91%), InceptionResNetV2 (val_accuracy=31.03%), and CNN (59.79%). Additionally, our proposed model achieved a val_accuracy of 84.42%.


title: Low-rank constrained multichannel signal denoising considering channel-dependent sensitivity inspired by self-supervised learning for optical fiber sensing

abstract: Optical fiber sensing is a technology wherein audio, vibrations, and temperature are detected using an optical fiber; especially the audio/vibrations-aware sensing is called distributed acoustic sensing (DAS). In DAS, observed data, which is comprised of multichannel data, has suffered from severe noise levels because of the optical noise or the installation methods. In conventional methods for denoising DAS data, signal-processing- or deep-neural-network (DNN)-based models have been studied. The signal-processing-based methods have the interpretability, i.e., non-black box. The DNN-based methods are good at flexibility designing network architectures and objective functions, that is, priors. However, there is no balance between the interpretability and the flexibility of priors in the DAS studies. The DNN-based methods also require a large amount of training data in general. To address the problems, we propose a DNN-structure signal-processing-based denoising method in this paper. As the priors of DAS, we employ spatial knowledge; low rank and channel-dependent sensitivity using the DNN-based structure. The result of fiber-acoustic sensing shows that the proposed method outperforms the conventional methods and the robustness to the number of the spatial ranks. Moreover, the optimized parameters of the proposed method indicate the relationship with the channel sensitivity; the interpretability.


title: Supersymmetric Shimura operators and interpolation polynomials

abstract: The Shimura operators are a certain distinguished basis for invariant differential operators on a Hermitian symmetric space. Answering a question of Shimura, Sahi--Zhang showed that the Harish-Chandra images of these operators are specializations of certain $BC$-symmetric interpolation polynomials that were defined by Okounkov. We consider the analogs of Shimura operators for the Hermitian symmetric superpair $(\mathfrak{g},\mathfrak{k})$ where $\mathfrak{g}= \mathfrak{gl}(2p|2q)$ and $\mathfrak{k}= \mathfrak{gl}(p|q)\oplus \mathfrak{gl}(p|q)$ and we prove their Harish-Chandra images are specializations of certain $BC$-supersymmetric interpolation polynomials introduced by Sergeev--Veselov.


title: From Centralized to Self-Supervised: Pursuing Realistic Multi-Agent Reinforcement Learning

abstract: In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent Reinforcement Learning (MARL) methods adopt centralized approaches that involve either centralized training or reward-sharing, often violating the realistic ways in which living organisms, like animals or humans, process information and interact. MARL strategies deploying decentralized training with intrinsic motivation offer a self-supervised approach, enable agents to develop flexible social strategies through the interaction of autonomous agents. However, by contrasting the self-supervised and centralized methods, we reveal that populations trained with reward-sharing methods surpass those using self-supervised methods in a mixed-motive environment. We link this superiority to specialized role emergence and an agent's expertise in its role. Interestingly, this gap shrinks in pure-motive settings, emphasizing the need for evaluations in more complex, realistic environments (mixed-motive). Our preliminary results suggest a gap in population performance that can be closed by improving self-supervised methods and thereby pushing MARL closer to real-world readiness.


title: Analysis of $T_{cc}$ and $T_{bb}$ based on the hadronic molecular model and their spin multiplets

abstract: ${T_{cc}(cc\bar{u}\bar{d})}^{+}$ has been reported by the LHCb experiment in 2022. The analysis using the Breit-Wigner parametrization found the small binding energy, $0.273$ MeV, which is measured from the threshold of $D^{*+}D^{0}$. In this paper, we consider $T_{cc}$ as a $DD^*$ hadronic molecule as a deuteron-like state. The one boson exchange model is employed as for the heavy meson interactions, where we determine the cut-off parameter $\Lambda$ to reproduce the reported binding energy of $T_{cc}$ with $I(J^P)=0(1^+)$. We discuss the properties of the bound state, and also search for $T_{cc}$ with the quantum numbers other than $0(1^{+})$. Futhermore, we analyze $T_{bb}$ as a bottom counterpart of $T_{cc}$, which involves two bottom quarks, and obtain several bound states. Finally we consider the light-cloud basis for wave functions of the doubly heavy tetraquarks in the heavy quark limit. Using the basis, we find the spin multiplets of their bound states, indicating the spin structures of diquarks in $T_{cc}$ and $T_{bb}$ with the finite quark masses.


title: SPEAL: Skeletal Prior Embedded Attention Learning for Cross-Source Point Cloud Registration

abstract: Point cloud registration, a fundamental task in 3D computer vision, has remained largely unexplored in cross-source point clouds and unstructured scenes. The primary challenges arise from noise, outliers, and variations in scale and density. However, neglected geometric natures of point clouds restricts the performance of current methods. In this paper, we propose a novel method termed SPEAL to leverage skeletal representations for effective learning of intrinsic topologies of point clouds, facilitating robust capture of geometric intricacy. Specifically, we design the Skeleton Extraction Module to extract skeleton points and skeletal features in an unsupervised manner, which is inherently robust to noise and density variances. Then, we propose the Skeleton-Aware GeoTransformer to encode high-level skeleton-aware features. It explicitly captures the topological natures and inter-point-cloud skeletal correlations with the noise-robust and density-invariant skeletal representations. Next, we introduce the Correspondence Dual-Sampler to facilitate correspondences by augmenting the correspondence set with skeletal correspondences. Furthermore, we construct a challenging novel large-scale cross-source point cloud dataset named KITTI CrossSource for benchmarking cross-source point cloud registration methods. Extensive quantitative and qualitative experiments are conducted to demonstrate our approach's superiority and robustness on both cross-source and same-source datasets. To the best of our knowledge, our approach is the first to facilitate point cloud registration with skeletal geometric priors.


title: Confinement of electron holes via the peroxo group formation in the negative charge-transfer materials on the example of SrFeO3: plane-wave density functional theory predictions

abstract: The present work puts forward a concept that the thermostable O1s XPS peaks with energy of about 531 eV in negative charge-transfer SrFeO_{3-\delta} perovskite are determined by the peroxo-like oxygen species. The peroxo group forms via coupling two oxygen anions coordinated to iron cations with d^5\bar-under{L} (\bar-under{L}-oxygen electron hole) configuration. By means of plane-wave DFT+U approach there have been shown that the peroxo group represents a metastable state in the absence of oxygen vacancies nearby. The O-O bonding confines two electron holes freezing the 3+ oxidation state for two iron cations bridged by peroxide. Increasing the peroxo group numbers makes the ferrite a semiconductor with charge-transfer gap of about 0.6 eV.


title: Irreducible modules of modular Lie superalgebras and super version of the first Kac-Weisfeiler conjecture

abstract: Suppose $g=g_0+g_1$ is a finite-dimensional restricted Lie superalgebra over an algebraically closed field $k$ of characteristic $p>2$. In this article, we propose a conjecture for maximal dimensions of irreducible modules over the universal enveloping algebra $U(g)$ of $g$, as a super generalization of the celebrated first Kac-Weisfeiler conjecture. It is demonstrated that the conjecture holds for all basic classical Lie superalgebras and all completely solvable restricted Lie superalgebras. In this process, we investigate irreducible representations of solvable Lie superalgebras.


title: Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Survey

abstract: Due to the greatly improved capabilities of devices, massive data, and increasing concern about data privacy, Federated Learning (FL) has been increasingly considered for applications to wireless communication networks (WCNs). Wireless FL (WFL) is a distributed method of training a global deep learning model in which a large number of participants each train a local model on their training datasets and then upload the local model updates to a central server. However, in general, non-independent and identically distributed (non-IID) data of WCNs raises concerns about robustness, as a malicious participant could potentially inject a "backdoor" into the global model by uploading poisoned data or models over WCN. This could cause the model to misclassify malicious inputs as a specific target class while behaving normally with benign inputs. This survey provides a comprehensive review of the latest backdoor attacks and defense mechanisms. It classifies them according to their targets (data poisoning or model poisoning), the attack phase (local data collection, training, or aggregation), and defense stage (local training, before aggregation, during aggregation, or after aggregation). The strengths and limitations of existing attack strategies and defense mechanisms are analyzed in detail. Comparisons of existing attack methods and defense designs are carried out, pointing to noteworthy findings, open challenges, and potential future research directions related to security and privacy of WFL.


title: Versatile Telescopic-Wheeled-Legged Locomotion of Tachyon 3 via Full-Centroidal Nonlinear Model Predictive Control

abstract: This paper presents a nonlinear model predictive control (NMPC) toward versatile motion generation for the telescopic-wheeled-legged robot Tachyon 3, the unique hardware structure of which poses challenges in control and motion planning. We apply the full-centroidal NMPC formulation with dedicated constraints that can capture the accurate kinematics and dynamics of Tachyon 3. We have developed a control pipeline that includes an internal state integrator to apply NMPC to Tachyon 3, the actuators of which employ high-gain position-controllers. We conducted simulation and hardware experiments on the perceptive locomotion of Tachyon 3 over structured terrains and demonstrated that the proposed method can achieve smooth and dynamic motion generation under harsh physical and environmental constraints.


title: In situ Remnants of Solar Surface Structures from Jensen-Shannon Scalogram

abstract: The heliosphere is permeated with highly structured solar wind originating from the sun. One of the primary science objectives of Parker Solar Probe (PSP) is to determine the structures and dynamics of the plasma and magnetic fields at the sources of the solar wind. However, establishing the connection between in situ measurements and structures and dynamics in the solar atmosphere is challenging: most of the magnetic footpoint mapping techniques have significant uncertainties in the source localization of a plasma parcel observed in situ, and the PSP plasma measurements suffer from a limited field of view. Therefore it lacks a universal tool to self-contextualize the in situ measurements. Here we develop a novel time series visualization method named Jensen-Shannon Scalogram. Utilizing this method, by analyzing the magnetic magnitude data from both PSP and Ulysses, we successfully identify in situ remnants of solar atmospheric and magnetic structures spanning more than seven orders of magnitude, from years to seconds, including polar and mid-latitude coronal holes, as well as structures compatible with super-granulation, ``jetlets'' and very small scale flaring activity. Furthermore, computer simulations of Alfv\'enic turbulence support key features of the observed magnetic magnitude distribution. Building upon these discoveries, the Jensen-Shannon Scalogram therefore not only enables us to reveal the fractal fine structures in the solar wind time series from both PSP and decades-old data archive, but will also serve as a general-purpose data visualization method applicable to all time series.


title: Temporal-Spatial Entropy Balancing for Causal Continuous Treatment-Effect Estimation

abstract: In the field of intracity freight transportation, changes in order volume are significantly influenced by temporal and spatial factors. When building subsidy and pricing strategies, predicting the causal effects of these strategies on order volume is crucial. In the process of calculating causal effects, confounding variables can have an impact. Traditional methods to control confounding variables handle data from a holistic perspective, which cannot ensure the precision of causal effects in specific temporal and spatial dimensions. However, temporal and spatial dimensions are extremely critical in the logistics field, and this limitation may directly affect the precision of subsidy and pricing strategies. To address these issues, this study proposes a technique based on flexible temporal-spatial grid partitioning. Furthermore, based on the flexible grid partitioning technique, we further propose a continuous entropy balancing method in the temporal-spatial domain, which named TS-EBCT (Temporal-Spatial Entropy Balancing for Causal Continue Treatments). The method proposed in this paper has been tested on two simulation datasets and two real datasets, all of which have achieved excellent performance. In fact, after applying the TS-EBCT method to the intracity freight transportation field, the prediction accuracy of the causal effect has been significantly improved. It brings good business benefits to the company's subsidy and pricing strategies.


title: Uplifting the Expressive Power of Graph Neural Networks through Graph Partitioning

abstract: Graph Neural Networks (GNNs) have paved its way for being a cornerstone in graph related learning tasks. From a theoretical perspective, the expressive power of GNNs is primarily characterised according to their ability to distinguish non-isomorphic graphs. It is a well-known fact that most of the conventional GNNs are upper-bounded by Weisfeiler-Lehman graph isomorphism test (1-WL). In this work, we study the expressive power of graph neural networks through the lens of graph partitioning. This follows from our observation that permutation invariant graph partitioning enables a powerful way of exploring structural interactions among vertex sets and subgraphs, and can help uplifting the expressive power of GNNs efficiently. Based on this, we first establish a theoretical connection between graph partitioning and graph isomorphism. Then we introduce a novel GNN architecture, namely Graph Partitioning Neural Networks (GPNNs). We theoretically analyse how a graph partitioning scheme and different kinds of structural interactions relate to the k-WL hierarchy. Empirically, we demonstrate its superior performance over existing GNN models in a variety of graph benchmark tasks.


title: CAT: A Causally Graph Attention Network for Trimming Heterophilic Graph

abstract: Local Attention-guided Message Passing Mechanism (LAMP) adopted in Graph Attention Networks (GATs) is designed to adaptively learn the importance of neighboring nodes for better local aggregation on the graph, which can bring the representations of similar neighbors closer effectively, thus showing stronger discrimination ability. However, existing GATs suffer from a significant discrimination ability decline in heterophilic graphs because the high proportion of dissimilar neighbors can weaken the self-attention of the central node, jointly resulting in the deviation of the central node from similar nodes in the representation space. This kind of effect generated by neighboring nodes is called the Distraction Effect (DE) in this paper. To estimate and weaken the DE of neighboring nodes, we propose a Causally graph Attention network for Trimming heterophilic graph (CAT). To estimate the DE, since the DE are generated through two paths (grab the attention assigned to neighbors and reduce the self-attention of the central node), we use Total Effect to model DE, which is a kind of causal estimand and can be estimated from intervened data; To weaken the DE, we identify the neighbors with the highest DE (we call them Distraction Neighbors) and remove them. We adopt three representative GATs as the base model within the proposed CAT framework and conduct experiments on seven heterophilic datasets in three different sizes. Comparative experiments show that CAT can improve the node classification accuracy of all base GAT models. Ablation experiments and visualization further validate the enhancement of discrimination ability brought by CAT. The source code is available at https://github.com/GeoX-Lab/CAT.


title: Segment Beyond View: Handling Partially Missing Modality for Audio-Visual Semantic Segmentation

abstract: Augmented Reality (AR) devices, emerging as prominent mobile interaction platforms, face challenges in user safety, particularly concerning oncoming vehicles. While some solutions leverage onboard camera arrays, these cameras often have limited field-of-view (FoV) with front or downward perspectives. Addressing this, we propose a new out-of-view semantic segmentation task and Segment Beyond View (SBV), a novel audio-visual semantic segmentation method. SBV supplements the visual modality, which miss the information beyond FoV, with the auditory information using a teacher-student distillation model (Omni2Ego). The model consists of a vision teacher utilising panoramic information, an auditory teacher with 8-channel audio, and an audio-visual student that takes views with limited FoV and binaural audio as input and produce semantic segmentation for objects outside FoV. SBV outperforms existing models in comparative evaluations and shows a consistent performance across varying FoV ranges and in monaural audio settings.


title: Depolarization dyadics for truncated spheres, spheroids, and ellipsoids

abstract: Depolarization dyadics play a central role in theoretical studies involving scattering from small particles and homogenization of particulate composite materials. Closed-form expressions for depolarization dyadics have been developed for truncated spheres and truncated spheroids, and the formalism has been extended to truncated ellipsoids; the evaluation of depolarization dyadics for this latter case requires numerical integration. The H\"{o}lder continuity condition has been exploited to fix the origin of the coordinate system for the evaluation of depolarization dyadics.These results will enable theoretical studies involving scattering from small particles and homogenization of particulate composite materials to accommodate particles with a much wider range of shapes than was the case hitherto.


title: AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection

abstract: While DeepFake applications are becoming popular in recent years, their abuses pose a serious privacy threat. Unfortunately, most related detection algorithms to mitigate the abuse issues are inherently vulnerable to adversarial attacks because they are built atop DNN-based classification models, and the literature has demonstrated that they could be bypassed by introducing pixel-level perturbations. Though corresponding mitigation has been proposed, we have identified a new attribute-variation-based adversarial attack (AVA) that perturbs the latent space via a combination of Gaussian prior and semantic discriminator to bypass such mitigation. It perturbs the semantics in the attribute space of DeepFake images, which are inconspicuous to human beings (e.g., mouth open) but can result in substantial differences in DeepFake detection. We evaluate our proposed AVA attack on nine state-of-the-art DeepFake detection algorithms and applications. The empirical results demonstrate that AVA attack defeats the state-of-the-art black box attacks against DeepFake detectors and achieves more than a 95% success rate on two commercial DeepFake detectors. Moreover, our human study indicates that AVA-generated DeepFake images are often imperceptible to humans, which presents huge security and privacy concerns.


title: SEF-VC: Speaker Embedding Free Zero-Shot Voice Conversion with Cross Attention

abstract: Zero-shot voice conversion (VC) aims to transfer the source speaker timbre to arbitrary unseen target speaker timbre, while keeping the linguistic content unchanged. Although the voice of generated speech can be controlled by providing the speaker embedding of the target speaker, the speaker similarity still lags behind the ground truth recordings. In this paper, we propose SEF-VC, a speaker embedding free voice conversion model, which is designed to learn and incorporate speaker timbre from reference speech via a powerful position-agnostic cross-attention mechanism, and then reconstruct waveform from HuBERT semantic tokens in a non-autoregressive manner. The concise design of SEF-VC enhances its training stability and voice conversion performance. Objective and subjective evaluations demonstrate the superiority of SEF-VC to generate high-quality speech with better similarity to target reference than strong zero-shot VC baselines, even for very short reference speeches.


title: Adaptive Shortcut Debiasing for Online Continual Learning

abstract: We propose a novel framework DropTop that suppresses the shortcut bias in online continual learning (OCL) while being adaptive to the varying degree of the shortcut bias incurred by continuously changing environment. By the observed high-attention property of the shortcut bias, highly-activated features are considered candidates for debiasing. More importantly, resolving the limitation of the online environment where prior knowledge and auxiliary data are not ready, two novel techniques -- feature map fusion and adaptive intensity shifting -- enable us to automatically determine the appropriate level and proportion of the candidate shortcut features to be dropped. Extensive experiments on five benchmark datasets demonstrate that, when combined with various OCL algorithms, DropTop increases the average accuracy by up to 10.4% and decreases the forgetting by up to 63.2%.


title: Deep Learning with Physics Priors as Generalized Regularizers

abstract: In various scientific and engineering applications, there is typically an approximate model of the underlying complex system, even though it contains both aleatoric and epistemic uncertainties. In this paper, we present a principled method to incorporate these approximate models as physics priors in modeling, to prevent overfitting and enhancing the generalization capabilities of the trained models. Utilizing the structural risk minimization (SRM) inductive principle pioneered by Vapnik, this approach structures the physics priors into generalized regularizers. The experimental results demonstrate that our method achieves up to two orders of magnitude of improvement in testing accuracy.


title: A Local Appearance Model for Volumetric Capture of Diverse Hairstyle

abstract: Hair plays a significant role in personal identity and appearance, making it an essential component of high-quality, photorealistic avatars. Existing approaches either focus on modeling the facial region only or rely on personalized models, limiting their generalizability and scalability. In this paper, we present a novel method for creating high-fidelity avatars with diverse hairstyles. Our method leverages the local similarity across different hairstyles and learns a universal hair appearance prior from multi-view captures of hundreds of people. This prior model takes 3D-aligned features as input and generates dense radiance fields conditioned on a sparse point cloud with color. As our model splits different hairstyles into local primitives and builds prior at that level, it is capable of handling various hair topologies. Through experiments, we demonstrate that our model captures a diverse range of hairstyles and generalizes well to challenging new hairstyles. Empirical results show that our method improves the state-of-the-art approaches in capturing and generating photorealistic, personalized avatars with complete hair.


title: Heterogeneous Graph Neural Architecture Search with GPT-4

abstract: Heterogeneous graph neural architecture search (HGNAS) represents a powerful tool for automatically designing effective heterogeneous graph neural networks. However, existing HGNAS algorithms suffer from inefficient searches and unstable results. In this paper, we present a new GPT-4 based HGNAS model to improve the search efficiency and search accuracy of HGNAS. Specifically, we present a new GPT-4 enhanced Heterogeneous Graph Neural Architecture Search (GHGNAS for short). The basic idea of GHGNAS is to design a set of prompts that can guide GPT-4 toward the task of generating new heterogeneous graph neural architectures. By iteratively asking GPT-4 with the prompts, GHGNAS continually validates the accuracy of the generated HGNNs and uses the feedback to further optimize the prompts. Experimental results show that GHGNAS can design new HGNNs by leveraging the powerful generalization capability of GPT-4. Moreover, GHGNAS runs more effectively and stably than previous HGNAS models based on reinforcement learning and differentiable search algorithms.


title: Splittings and poly-freeness of triangle Artin groups

abstract: We prove that the triangle Artin group $\mathrm{Art}_{23M}$ splits as a graph of free groups if and only if $M$ is greater than $5$ and even. This answers two questions of Jankiewicz \cite[Question 2.2, Question 2.3]{Jan21} in the negative. Combined with the results of Squier and Jankiewicz, this completely determines when a triangle Artin group splits as a graph of free groups. Furthermore, we prove that the triangle Artin groups are virtually poly-free when the labels are not of the form $(2,3, 2k+1)$ with $k\geq 3$. This partially answers a question of Bestvina \cite{Be99}.


title: High-coherence parallelization in integrated photonics

abstract: Coherent optics has profoundly impacted diverse applications ranging from communications, LiDAR to quantum computations. However, building coherent systems in integrated photonics previously came at great expense in hardware integration and energy efficiency: the lack of a power-efficient way to generate highly coherent light necessitates bulky lasers and amplifiers, while frequency and phase recovery schemes require huge digital signal processing resources. In this work, we demonstrate a high-coherence parallelization strategy that facilitates advanced integrated coherent systems at a minimum price. Using a self-injection locked microcomb to injection lock a distributed feedback laser array, we boost the microcomb power by a record high gain of up to 60 dB on chip with no degradation in coherence. This strategy enables tens of highly coherent channels with an intrinsic linewidth down to the 10 Hz level and power of more than 20 dBm. The overall electrical to optical wall-plug efficiency reaches 19%, comparable with that of the state-of-the-art semiconductor lasers. Driven by this parallel source, we demonstrate a silicon photonic communication link with an unprecedented data rate beyond 60 Tbit/s. Importantly, the high coherence we achieve reduces the coherent-related DSP consumption by 99.999% compared with the traditional III-V laser pump scheme. This work paves a way to realizing scalable, high-performance coherent integrated photonic systems, potentially benefiting numerous applications.


title: A twist over a minimal \'etale groupoid that is topologically nontrivial over the interior of the isotropy

abstract: We present an example of a twist over a minimal Hausdorff \'etale groupoid such that the restriction of the twist to the interior of the isotropy is not topologically trivial; that is, the restricted twist is not induced by a continuous 2-cocycle.


title: Stein-MAP: A Sequential Variational Inference Framework for Maximum A Posteriori Estimation

abstract: State estimation poses substantial challenges in robotics, often involving encounters with multimodality in real-world scenarios. To address these challenges, it is essential to calculate Maximum a posteriori (MAP) sequences from joint probability distributions of latent states and observations over time. However, it generally involves a trade-off between approximation errors and computational complexity. In this article, we propose a new method for MAP sequence estimation called Stein-MAP, which effectively manages multimodality with fewer approximation errors while significantly reducing computational and memory burdens. Our key contribution lies in the introduction of a sequential variational inference framework designed to handle temporal dependencies among transition states within dynamical system models. The framework integrates Stein's identity from probability theory and reproducing kernel Hilbert space (RKHS) theory, enabling computationally efficient MAP sequence estimation. As a MAP sequence estimator, Stein-MAP boasts a computational complexity of O(N), where N is the number of particles, in contrast to the O(N^2) complexity of the Viterbi algorithm. The proposed method is empirically validated through real-world experiments focused on range-only (wireless) localization. The results demonstrate a substantial enhancement in state estimation compared to existing methods. A remarkable feature of Stein-MAP is that it can attain improved state estimation with only 40 to 50 particles, as opposed to the 1000 particles that the particle filter or its variants require.


title: Privacy Amplification by Iteration for ADMM with (Strongly) Convex Objective Functions

abstract: We examine a private ADMM variant for (strongly) convex objectives which is a primal-dual iterative method. Each iteration has a user with a private function used to update the primal variable, masked by Gaussian noise for local privacy, without directly adding noise to the dual variable. Privacy amplification by iteration explores if noises from later iterations can enhance the privacy guarantee when releasing final variables after the last iteration. Cyffers et al. [ICML 2023] explored privacy amplification by iteration for the proximal ADMM variant, where a user's entire private function is accessed and noise is added to the primal variable. In contrast, we examine a private ADMM variant requiring just one gradient access to a user's function, but both primal and dual variables must be passed between successive iterations. To apply Balle et al.'s [NeurIPS 2019] coupling framework to the gradient ADMM variant, we tackle technical challenges with novel ideas. First, we address the non-expansive mapping issue in ADMM iterations by using a customized norm. Second, because the dual variables are not masked with any noise directly, their privacy guarantees are achieved by treating two consecutive noisy ADMM iterations as a Markov operator. Our main result is that the privacy guarantee for the gradient ADMM variant can be amplified proportionally to the number of iterations. For strongly convex objective functions, this amplification exponentially increases with the number of iterations. These amplification results align with the previously studied special case of stochastic gradient descent.


title: Open images of spaces with a Lusin $\pi$-base

abstract: In [5] we studied spaces with a Lusin $\pi$-base and $\pi$-spaces and posed the following question: Does the class of continuous open images of spaces with a Lusin $\pi$-base equal the class of continuous open images of $\pi$-spaces? We give a negative answer to this question.


title: Magneto-optical effects of an artificially-layered ferromagnetic topological insulator

abstract: Magnetic topological insulator is a fertile platform to study the interplay between magnetism and topology. The unique electronic band structure can induce exotic transport and optical properties. However, a comprehensive optical study in both near-infrared frequency and terahertz frequency has been lacking. Here, we report magneto-optical effects from a heterostructure of Cr-incorporated topological insulator, CBST. We use 800 nm magneto-optical Kerr effect to reveal a ferromagnetic order in the CBST film with a high transition temperature at 160 K. We also use time-domain terahertz polarimetry to reveal a terahertz Faraday rotation of 1.5 mrad and Kerr rotation of 5.1 mrad at 2 K. The calculated terahertz Hall conductance is 0.42 $e^2/h$. Our work shows the optical responses of an artificially layered magnetic topological insulator, paving the way towards high-temperature quantum anomalous Hall effect via heterostructure engineering.


title: TigerBot: An Open Multilingual Multitask LLM

abstract: We release and introduce the TigerBot family of large language models (LLMs), consisting of base and chat models, sized from 7, 13, 70 and 180 billion parameters. We develop our models embarking from Llama-2 and BLOOM, and push the boundary further in data, training algorithm, infrastructure, and application tools. Our models yield meaningful performance gain over SOTA open-source models, e.g., Llama-2, specifically 6% gain in English and 20% gain in Chinese. TigerBot model family also achieves leading performance in major academic and industrial benchmarks and leaderboards. We believe that TigerBot represents just a snapshot of lightning-fast progression in LLM open-source community. Therefore, we are thrilled to give back by publicly releasing our models and reporting our approach behind, with additional emphases on building SOTA LLMs in a democratized way and making LLMs of use in real-world applications.


title: Safety-Critical Coordination of Legged Robots via Layered Controllers and Forward Reachable Set based Control Barrier Functions

abstract: This paper presents a safety-critical approach to the coordination of robots in dynamic environments. To this end, we leverage control barrier functions (CBFs) with the forward reachable set to guarantee the safe coordination of the robots while preserving a desired trajectory via a layered controller. The top-level planner generates a safety-ensured trajectory for each agent, accounting for the dynamic constraints in the environment. This planner leverages high-order CBFs based on the forward reachable set to ensure safety-critical coordination control, i.e., guarantee the safe coordination of the robots during locomotion. The middle-level trajectory planner employs single rigid body (SRB) dynamics to generate optimal ground reaction forces (GRFs) to track the safety-ensured trajectories from the top-level planner. The whole-body motions to adhere to the optimal GRFs while ensuring the friction cone condition at the end of each stance leg are generated from the low-level controller. The effectiveness of the approach is demonstrated through simulation and hardware experiments.