title: Challenges in addressing student difficulties with basics and change of basis for two-state quantum systems using a multiple-choice question sequence in online and in-person classes

abstract: Research-validated multiple-choice questions comprise an easy-to-implement instructional tool for scaffolding student learning and providing formative assessment of students' knowledge. We present findings from the implementation of a research-validated multiple-choice question sequence on the basics of two-state quantum systems, including inner products, outer products, translation between Dirac notation and matrix representation in a particular basis, and change of basis. This study was conducted in an advanced undergraduate quantum mechanics course, in both online and in-person learning environments, across three years. For each cohort, students had their learning assessed after traditional lecture-based instruction in relevant concepts before engaging with the multiple-choice question sequence. Their performance was evaluated again afterwards with a similar assessment and compared to their earlier performance. We analyze, compare, and discuss the trends observed in the three implementations.


title: A Hierarchical Dataflow-Driven Heterogeneous Architecture for Wireless Baseband Processing

abstract: Wireless baseband processing (WBP) is a key element of wireless communications, with a series of signal processing modules to improve data throughput and counter channel fading. Conventional hardware solutions, such as digital signal processors (DSPs) and more recently, graphic processing units (GPUs), provide various degrees of parallelism, yet they both fail to take into account the cyclical and consecutive character of WBP. Furthermore, the large amount of data in WBPs cannot be processed quickly in symmetric multiprocessors (SMPs) due to the unpredictability of memory latency. To address this issue, we propose a hierarchical dataflow-driven architecture to accelerate WBP. A pack-and-ship approach is presented under a non-uniform memory access (NUMA) architecture to allow the subordinate tiles to operate in a bundled access and execute manner. We also propose a multi-level dataflow model and the related scheduling scheme to manage and allocate the heterogeneous hardware resources. Experiment results demonstrate that our prototype achieves $2\times$ and $2.3\times$ speedup in terms of normalized throughput and single-tile clock cycles compared with GPU and DSP counterparts in several critical WBP benchmarks. Additionally, a link-level throughput of $288$ Mbps can be achieved with a $45$-core configuration.


title: Improved uniform error bounds for long-time dynamics of the high-dimensional nonlinear space fractional sine-Gordon equation with weak nonlinearity

abstract: In this paper, we derive the improved uniform error bounds for the long-time dynamics of the $d$-dimensional $(d=2,3)$ nonlinear space fractional sine-Gordon equation (NSFSGE). The nonlinearity strength of the NSFSGE is characterized by $\varepsilon^2$ where $0<\varepsilon \le 1$ is a dimensionless parameter. The second-order time-splitting method is applied to the temporal discretization and the Fourier pseudo-spectral method is used for the spatial discretization. To obtain the explicit relation between the numerical errors and the parameter $\varepsilon$, we introduce the regularity compensation oscillation technique to the convergence analysis of fractional models. Then we establish the improved uniform error bounds $O\left(\varepsilon^2 \tau^2\right)$ for the semi-discretization scheme and $O\left(h^m+\varepsilon^2 \tau^2\right)$ for the full-discretization scheme up to the long time at $O(1/\varepsilon^2)$. Further, we extend the time-splitting Fourier pseudo-spectral method to the complex NSFSGE as well as the oscillatory complex NSFSGE, and the improved uniform error bounds for them are also given. Finally, extensive numerical examples in two-dimension or three-dimension are provided to support the theoretical analysis. The differences in dynamic behaviors between the fractional sine-Gordon equation and classical sine-Gordon equation are also discussed.


title: Challenges in addressing student difficulties with quantum measurement of two-state quantum systems using a multiple-choice question sequence in online and in-person classes

abstract: Research-validated multiple-choice questions comprise an easy-to-implement instructional tool that serves to scaffold student learning and formatively assess students' knowledge. We present findings from the implementation, in consecutive years, of a research-validated multiple-choice question sequence [referred to in this study as a Clicker Question Sequence (CQS)] on quantum measurement as it applies to two-state quantum systems. This study was conducted in an advanced undergraduate quantum mechanics course, in both online and in-person learning environments across three years. Student learning was assessed after traditional lecture-based instruction in relevant concepts, and their performance was compared with that on a similar assessment given after engaging with the CQS. We analyze, compare, and discuss the trends observed in the three implementations.


title: Tensor Network Space-Time Spectral Collocation Method for Time Dependent Convection-Diffusion-Reaction Equations

abstract: Emerging tensor network techniques for solutions of Partial Differential Equations (PDEs), known for their ability to break the curse of dimensionality, deliver new mathematical methods for ultrafast numerical solutions of high-dimensional problems. Here, we introduce a Tensor Train (TT) Chebyshev spectral collocation method, in both space and time, for solution of the time dependent convection-diffusion-reaction (CDR) equation with inhomogeneous boundary conditions, in Cartesian geometry. Previous methods for numerical solution of time dependent PDEs often use finite difference for time, and a spectral scheme for the spatial dimensions, which leads to slow linear convergence. Spectral collocation space-time methods show exponential convergence, however, for realistic problems they need to solve large four-dimensional systems. We overcome this difficulty by using a TT approach as its complexity only grows linearly with the number of dimensions. We show that our TT space-time Chebyshev spectral collocation method converges exponentially, when the solution of the CDR is smooth, and demonstrate that it leads to very high compression of linear operators from terabytes to kilobytes in TT-format, and tens of thousands times speedup when compared to full grid space-time spectral method. These advantages allow us to obtain the solutions at much higher resolutions.


title: A One-step Image Retargeing Algorithm Based on Conformal Energy

abstract: The image retargeting problem is to find a proper mapping to resize an image to one with a prescribed aspect ratio, which is quite popular these days. In this paper, we propose an efficient and orientation-preserving one-step image retargeting algorithm based on minimizing the harmonic energy, which can well preserve the regions of interest (ROIs) and line structures in the image. We also give some mathematical proofs in the paper to ensure the well-posedness and accuracy of our algorithm.


title: Challenges in addressing student difficulties with time-development of two-state quantum systems using a multiple-choice question sequence in virtual and in-person classes

abstract: Research-validated clicker questions as instructional tools for formative assessment are relatively easy to implement and can provide effective scaffolding when developed and implemented in a sequence. We present findings from the implementation of a research-validated clicker question sequence (CQS) on student understanding of the time-development of two-state quantum systems. This study was conducted in an advanced undergraduate quantum mechanics course for two consecutive years in virtual and in-person classes. The effectiveness of the CQS discussed here in both modes of instruction was determined by evaluating students' performance after traditional lecture-based instruction and comparing it to their performance after engaging with the CQS.


title: Online Ecological Gearshift Strategy via Neural Network with Soft-Argmax Operator

abstract: This paper presents a neural network optimizer with soft-argmax operator to achieve an ecological gearshift strategy in real-time. The strategy is reformulated as the mixed-integer model predictive control (MIMPC) problem to minimize energy consumption. Then the outer convexification is introduced to transform integer variables into relaxed binary controls. To approximate binary solutions properly within training, the soft-argmax operator is applied to the neural network with the fact that all the operations of this scheme are differentiable. Moreover, this operator can help push the relaxed binary variables close to 0 or 1. To evaluate the strategy effect, we deployed it to a 2-speed electric vehicle (EV). In contrast to the mature solver Bonmin, our proposed method not only achieves similar energy-saving effects but also significantly reduces the solution time to meet real-time requirements. This results in a notable energy savings of 6.02% compared to the rule-based method.


title: Locating heating channels of the solar corona in a plage region with the aid of high-resolution 10830 \AA\ filtergrams

abstract: In this paper, with a set of high-resolution He I 10830 \AA\ filtergrams, we select an area in a plage, very likely an EUV moss area, as an interface layer to follow the clues of coronal heating channels down to the photosphere. The filtergrams are obtained from the 1-meter aperture New Vacuum Solar Telescope (NVST). We make a distinction between the darker and the brighter regions in the selected area and name the two regions enhanced absorption patches (EAPs) and low absorption patches (LAPs). With well-aligned, nearly simultaneous data from multiple channels of the AIA and the continuum of the HMI on board SDO, we compare the EUV/UV emissions, emission measure, mean temperature, and continuum intensity in the two kinds of regions. The following progress is made: 1) The mean EUV emissions over EAPs are mostly stronger than the corresponding emissions over LAPs except for the emission at 335 \AA. The UV emissions at 1600 and 1700 \AA\ fail to capture the difference between the two regions. 2) In the logarithmic temperature range of 5.6-6.2, EAPs have higher EUV emission measure than LAPs, but they have lower mean coronal temperature. 3) The mean continuum intensity over EAPs is lower. Based on the above progress, we suggest that the energy for coronal heating in the moss region can be traced down to some areas in intergranular lanes with enhanced density of both cool and hot material. The lower temperature over the EAPs is due to the greater fraction of cool material over there.


title: Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis

abstract: Diffusion model is a promising approach to image generation and has been employed for Pose-Guided Person Image Synthesis (PGPIS) with competitive performance. While existing methods simply align the person appearance to the target pose, they are prone to overfitting due to the lack of a high-level semantic understanding on the source person image. In this paper, we propose a novel Coarse-to-Fine Latent Diffusion (CFLD) method for PGPIS. In the absence of image-caption pairs and textual prompts, we develop a novel training paradigm purely based on images to control the generation process of a pre-trained text-to-image diffusion model. A perception-refined decoder is designed to progressively refine a set of learnable queries and extract semantic understanding of person images as a coarse-grained prompt. This allows for the decoupling of fine-grained appearance and pose information controls at different stages, and thus circumventing the potential overfitting problem. To generate more realistic texture details, a hybrid-granularity attention module is proposed to encode multi-scale fine-grained appearance features as bias terms to augment the coarse-grained prompt. Both quantitative and qualitative experimental results on the DeepFashion benchmark demonstrate the superiority of our method over the state of the arts for PGPIS. Code is available at https://github.com/YanzuoLu/CFLD.


title: The Neumann-Moser dynamical system and the Korteweg-de Vries hierarchy

abstract: At the focus of the paper are applications of the well-known Moser transformation of the C. Neumann dynamical system. It yields us a new quadratic integrable dynamical system on $\mathbb{C}^{3n+1}$, which we call the Neumann-Moser dynamical system. We present an explicit formula of the inverse of the Moser transformation. Consequently, we obtain explicitly an invertible transformation of the Uhlenbeck-Devaney integrals of the Neumann system into the integrals of our system. One of the main results of the paper is the recurrent solutions of the Neumann-Moser system. We show that every solution of our system solves the Mumford dynamical system, and vice versa. Every solution of the Neumann-Moser system is proven to solve the stationary Korteweg-de Vries hierarchy. As a corollary, we construct explicit solutions of the Neumann-Moser system in hyperelliptic Kleinian functions.


title: Challenges in addressing student difficulties with measurement uncertainty of two-state quantum systems using a multiple-choice question sequence in online and in-person classes

abstract: Research-validated multiple-choice questions comprise an easy-to-implement instructional tool that serves to scaffold student learning and formatively assess students knowledge. We present findings from the implementation, in consecutive years, of research-validated multiple-choice question sequence on measurement uncertainty as it applies to two-state quantum systems. This study was conducted in an advanced undergraduate quantum mechanics course, in an online and in-person learning environments in consecutive years. Student learning was assessed after receiving traditional lecture-based instruction in relevant concepts, and their performance was compared with that on a similar assessment given after engaging with the multiple-choice question sequence. We analyze and discuss the similar and differing trends observed in the two modes of instruction.


title: Dynamics Around the Earth-Moon Triangular Points in the Hill Restricted 4-Body Problem

abstract: This paper investigates the motion of a small particle moving near the triangular points of the Earth-Moon system. The dynamics are modeled in the Hill restricted 4-body problem (HR4BP), which includes the effect of the Earth and Moon as in the circular restricted 3-body problem (CR3BP), as well as the direct and indirect effect of the Sun as a periodic time-dependent perturbation of the CR3BP. Due to the periodic perturbation, the triangular points of the CR3BP are no longer equilibrium solutions; rather, the triangular points are replaced by periodic orbits with the same period as the perturbation. Additionally, there is a 2:1 resonant periodic orbit that persists from the CR3BP into the HR4BP. In this work, we investigate the dynamics around these invariant objects by computing families of 2-dimensional invariant tori and their linear normal behavior. We identify bifurcations and relationships between families. Mechanisms for transport between Earth, L4, and Moon are discussed. Comparisons are made between the results presented here and in the bicircular problem (BCP).


title: Study of superconductivity of very thin $\mathrm{FeSe}_{1-x}\mathrm{Te}_x$ films investigated by microwave complex conductivity measurements

abstract: Complex conductivity measurements spanning the entire temperature range, including the vicinity of $T_c$, were conducted on systematically varied FeSe$_{1-x}$Te$_x$ ($x$ = 0 - 0.5) very thin films. By applying a novel cavity measurement technique employing microwave electric fields parallel to FeSe$_{1-x}$Te$_x$ films, we observed distinct temperature-dependent alterations in superfluid fraction and quasiparticle scattering rate at the nematic boundary. These changes in the nematic boundary suggests variations in the superconducting gap structure between samples in the nematic and non-nematic phase. Moreover, fluctuation is visible up to 1.2 $T_c$ irrespective of nematic order, consistent with large superconducting fluctuations in iron chalcogenide superconductors reported previously in [H. Takahashi $\textit{et al}$, Phys. Rev. B 99, 060503(R) (2019)] and [F. Nabeshima $\textit{et al}$, Phys. Rev. B 97, 024504(R) (2018)].


title: Gravitational wave memory signatures in identifying transition redshift

abstract: Many astrophysical and cosmological observations consistently indicate that the universe is currently accelerating. Despite many possible explanations, the exact cause of this acceleration remains unknown. Therefore, additional observational probes are necessary to pinpoint the cause. Gravitational waves (GWs) have the potential to unravel some of the unresolved mysteries in cosmology. In this work, we highlight the potential utility of gravitational wave memory as a tool to identify the cause of this acceleration. We evaluate cosmological memory as a particular case of the master equation for GW memory in Locally Rotationally Symmetric type II spacetimes. Unlike the previous works, the master equation for GW memory contains non-linear dependence of the background quantities. Hence, even though the successive GWs generated are smaller than their predecessors, we demonstrate that their cumulative effect over cosmological time leads to observable signatures, akin to the growth of density perturbations resulting in large-scale structures. Finally, we show that the GW memory exhibits distinct signatures between accelerated and decelerated universes, potentially enabling the identification of the transition redshift from a matter-dominated to a dark-energy-dominated universe.


title: Spannotation: Enhancing Semantic Segmentation for Autonomous Navigation with Efficient Image Annotation

abstract: Spannotation is an open source user-friendly tool developed for image annotation for semantic segmentation specifically in autonomous navigation tasks. This study provides an evaluation of Spannotation, demonstrating its effectiveness in generating accurate segmentation masks for various environments like agricultural crop rows, off-road terrains and urban roads. Unlike other popular annotation tools that requires about 40 seconds to annotate an image for semantic segmentation in a typical navigation task, Spannotation achieves similar result in about 6.03 seconds. The tools utility was validated through the utilization of its generated masks to train a U-Net model which achieved a validation accuracy of 98.27% and mean Intersection Over Union (mIOU) of 96.66%. The accessibility, simple annotation process and no-cost features have all contributed to the adoption of Spannotation evident from its download count of 2098 (as of February 25, 2024) since its launch. Future enhancements of Spannotation aim to broaden its application to complex navigation scenarios and incorporate additional automation functionalities. Given its increasing popularity and promising potential, Spannotation stands as a valuable resource in autonomous navigation and semantic segmentation. For detailed information and access to Spannotation, readers are encouraged to visit the project's GitHub repository at https://github.com/sof-danny/spannotation


title: AI-assisted Tagging of Deepfake Audio Calls using Challenge-Response

abstract: Scammers are aggressively leveraging AI voice-cloning technology for social engineering attacks, a situation significantly worsened by the advent of audio Real-time Deepfakes (RTDFs). RTDFs can clone a target's voice in real-time over phone calls, making these interactions highly interactive and thus far more convincing. Our research confidently addresses the gap in the existing literature on deepfake detection, which has largely been ineffective against RTDF threats. We introduce a robust challenge-response-based method to detect deepfake audio calls, pioneering a comprehensive taxonomy of audio challenges. Our evaluation pitches 20 prospective challenges against a leading voice-cloning system. We have compiled a novel open-source challenge dataset with contributions from 100 smartphone and desktop users, yielding 18,600 original and 1.6 million deepfake samples. Through rigorous machine and human evaluations of this dataset, we achieved a deepfake detection rate of 86% and an 80% AUC score, respectively. Notably, utilizing a set of 11 challenges significantly enhances detection capabilities. Our findings reveal that combining human intuition with machine precision offers complementary advantages. Consequently, we have developed an innovative human-AI collaborative system that melds human discernment with algorithmic accuracy, boosting final joint accuracy to 82.9%. This system highlights the significant advantage of AI-assisted pre-screening in call verification processes. Samples can be heard at https://mittalgovind.github.io/autch-samples/


title: Generalizable Two-Branch Framework for Image Class-Incremental Learning

abstract: Deep neural networks often severely forget previously learned knowledge when learning new knowledge. Various continual learning (CL) methods have been proposed to handle such a catastrophic forgetting issue from different perspectives and achieved substantial improvements. In this paper, a novel two-branch continual learning framework is proposed to further enhance most existing CL methods. Specifically, the main branch can be any existing CL model and the newly introduced side branch is a lightweight convolutional network. The output of each main branch block is modulated by the output of the corresponding side branch block. Such a simple two-branch model can then be easily implemented and learned with the vanilla optimization setting without whistles and bells. Extensive experiments with various settings on multiple image datasets show that the proposed framework yields consistent improvements over state-of-the-art methods.


title: Using Text Embeddings for Deductive Qualitative Research at Scale in Physics Education

abstract: We propose a technique for performing deductive qualitative data analysis at scale on text-based data. Using a natural language processing technique known as text embeddings, we create vector-based representations of texts in a high-dimensional meaning space within which it is possible to quantify differences as vector distances. To apply the technique, we build off prior work that used topic modeling via Latent Dirichlet Allocation to thematically analyze 18 years of the Physics Education Research Conference proceedings literature. We first extend this analysis through 2023. Next, we create embeddings of all texts and, using representative articles from the 10 topics found by the LDA analysis, define centroids in the meaning space. We calculate the distances between every article and centroid and use the inverted, scaled distances between these centroids and articles to create an alternate topic model. We benchmark this model against the LDA model results and show that this embeddings model recovers most of the trends from that analysis. Finally, to illustrate the versatility of the method we define 8 new topic centroids derived from a review of the physics education research literature by Docktor and Mestre (2014) and re-analyze the literature using these researcher-defined topics. Based on these analyses, we critically discuss the features, uses, and limitations of this method and argue that it holds promise for flexible deductive qualitative analysis of a wide variety of text-based data that avoids many of the drawbacks inherent to prior NLP methods.


title: Bimanual Manipulation of Steady Hand Eye Robots with Adaptive Sclera Force Control: Cooperative vs. Teleoperation Strategies

abstract: Performing intricate eye microsurgery, such as retinal vein cannulation (RVC), as a potential treatment for retinal vein occlusion (RVO), without the assistance of a surgical robotic system is very challenging to do safely. The main limitation has to do with the physiological hand tremor of surgeons. Robot-assisted eye surgery technology may resolve the problems of hand tremors and fatigue and improve the safety and precision of RVC. The Steady-Hand Eye Robot (SHER) is an admittance-based robotic system that can filter out hand tremors and enables ophthalmologists to manipulate a surgical instrument inside the eye cooperatively. However, the admittance-based cooperative control mode does not address crucial safety considerations, such as minimizing contact force between the surgical instrument and the sclera surface to prevent tissue damage. An adaptive sclera force control algorithm was proposed to address this limitation using an FBG-based force-sensing tool to measure and minimize the tool-sclera interaction force. Additionally, features like haptic feedback or hand motion scaling, which can improve the safety and precision of surgery, require a teleoperation control framework. We implemented a bimanual adaptive teleoperation (BMAT) control mode using SHER 2.0 and SHER 2.1 and compared its performance with a bimanual adaptive cooperative (BMAC) mode. Both BMAT and BMAC modes were tested in sitting and standing postures during a vessel-following experiment under a surgical microscope. It is shown, for the first time to the best of our knowledge in robot-assisted retinal surgery, that integrating the adaptive sclera force control algorithm with the bimanual teleoperation framework enables surgeons to safely perform bimanual telemanipulation of the eye without over-stretching it, even in the absence of registration between the two robots.


title: PIMSIM-NN: An ISA-based Simulation Framework for Processing-in-Memory Accelerators

abstract: Processing-in-memory (PIM) has shown extraordinary potential in accelerating neural networks. To evaluate the performance of PIM accelerators, we present an ISA-based simulation framework including a dedicated ISA targeting neural networks running on PIM architectures, a compiler, and a cycleaccurate configurable simulator. Compared with prior works, this work decouples software algorithms and hardware architectures through the proposed ISA, providing a more convenient way to evaluate the effectiveness of software/hardware optimizations. The simulator adopts an event-driven simulation approach and has better support for hardware parallelism. The framework is open-sourced at https://github.com/wangxy-2000/pimsim-nn.


title: Computing Minimal Absent Words and Extended Bispecial Factors with CDAWG Space

abstract: A string $w$ is said to be a minimal absent word (MAW) for a string $S$ if $w$ does not occur in $S$ and any proper substring of $w$ occurs in $S$. We focus on non-trivial MAWs which are of length at least 2. Finding such non-trivial MAWs for a given string is motivated for applications in bioinformatics and data compression. Fujishige et al. [TCS 2023] proposed a data structure of size $\Theta(n)$ that can output the set $\mathsf{MAW}(S)$ of all MAWs for a given string $S$ of length $n$ in $O(n + |\mathsf{MAW}(S)|)$ time, based on the directed acyclic word graph (DAWG). In this paper, we present a more space efficient data structure based on the compact DAWG (CDAWG), which can output $\mathsf{MAW}(S)$ in $O(|\mathsf{MAW}(S)|)$ time with $O(\mathsf{e}_\min)$ space, where $\mathsf{e}_\min$ denotes the minimum of the sizes of the CDAWGs for $S$ and for its reversal $S^R$. For any strings of length $n$, it holds that $\mathsf{e}_\min < 2n$, and for highly repetitive strings $\mathsf{e}_\min$ can be sublinear (up to logarithmic) in $n$. We also show that MAWs and their generalization minimal rare words have close relationships with extended bispecial factors, via the CDAWG.


title: Polos: Multimodal Metric Learning from Human Feedback for Image Captioning

abstract: Establishing an automatic evaluation metric that closely aligns with human judgments is essential for effectively developing image captioning models. Recent data-driven metrics have demonstrated a stronger correlation with human judgments than classic metrics such as CIDEr; however they lack sufficient capabilities to handle hallucinations and generalize across diverse images and texts partially because they compute scalar similarities merely using embeddings learned from tasks unrelated to image captioning evaluation. In this study, we propose Polos, a supervised automatic evaluation metric for image captioning models. Polos computes scores from multimodal inputs, using a parallel feature extraction mechanism that leverages embeddings trained through large-scale contrastive learning. To train Polos, we introduce Multimodal Metric Learning from Human Feedback (M$^2$LHF), a framework for developing metrics based on human feedback. We constructed the Polaris dataset, which comprises 131K human judgments from 550 evaluators, which is approximately ten times larger than standard datasets. Our approach achieved state-of-the-art performance on Composite, Flickr8K-Expert, Flickr8K-CF, PASCAL-50S, FOIL, and the Polaris dataset, thereby demonstrating its effectiveness and robustness.


title: Context-aware Talking Face Video Generation

abstract: In this paper, we consider a novel and practical case for talking face video generation. Specifically, we focus on the scenarios involving multi-people interactions, where the talking context, such as audience or surroundings, is present. In these situations, the video generation should take the context into consideration in order to generate video content naturally aligned with driving audios and spatially coherent to the context. To achieve this, we provide a two-stage and cross-modal controllable video generation pipeline, taking facial landmarks as an explicit and compact control signal to bridge the driving audio, talking context and generated videos. Inside this pipeline, we devise a 3D video diffusion model, allowing for efficient contort of both spatial conditions (landmarks and context video), as well as audio condition for temporally coherent generation. The experimental results verify the advantage of the proposed method over other baselines in terms of audio-video synchronization, video fidelity and frame consistency.


title: ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detection

abstract: The proliferation of phishing sites and emails poses significant challenges to existing cybersecurity efforts. Despite advances in spam filters and email security protocols, problems with oversight and false positives persist. Users often struggle to understand why emails are flagged as spam, risking the possibility of missing important communications or mistakenly trusting phishing emails. This study introduces ChatSpamDetector, a system that uses large language models (LLMs) to detect phishing emails. By converting email data into a prompt suitable for LLM analysis, the system provides a highly accurate determination of whether an email is phishing or not. Importantly, it offers detailed reasoning for its phishing determinations, assisting users in making informed decisions about how to handle suspicious emails. We conducted an evaluation using a comprehensive phishing email dataset and compared our system to several LLMs and baseline systems. We confirmed that our system using GPT-4 has superior detection capabilities with an accuracy of 99.70%. Advanced contextual interpretation by LLMs enables the identification of various phishing tactics and impersonations, making them a potentially powerful tool in the fight against email-based phishing threats.


title: On the Existence of Cyclic Lattice Codes

abstract: A coding lattice $\Lambda_c$ and a shaping lattice $\Lambda_s$ forms a nested lattice code $\mathcal{C}$ if $\Lambda_s \subseteq \Lambda_c$. Under some conditions, $\mathcal{C}$ is a finite cyclic group formed by rectangular encoding. This paper presents the conditions for the existence of such $\mathcal{C}$ and provides some designs. These designs correspond to solutions to linear Diophantine equations so that a cyclic lattice code $\mathcal C$ of arbitrary codebook size $M$ can possess group isomorphism, which is an essential property for a nested lattice code to be applied in physical layer network relaying techniques such as compute and forward.


title: Exergetic Port-Hamiltonian Systems for Multibody Dynamics

abstract: Multibody dynamics simulation plays an important role in various fields, including mechanical engineering, robotics, and biomechanics. Setting up computational models however becomes increasingly challenging as systems grow in size and complexity. Especially the consistent combination of models across different physical domains usually demands a lot of attention. This motivates us to study formal languages for compositional modeling of multiphysical systems. This article shows how multibody systems, or more precisely assemblies of rigid bodies connected by lower kinematic pairs, fit into the framework of Exergetic Port-Hamiltonian Systems (EPHS). This approach is based on the hierarchical decomposition of systems into their ultimately primitive components, using a simple graphical syntax. Thereby, cognitive load can be reduced and communication is facilitated, even with non-experts. Moreover, the encapsulation and reuse of subsystems promotes efficient model development and management. In contrast to established modeling languages such as Modelica, the primitive components of EPHS are not defined by arbitrary equations. Instead, there are four kinds of components, each defined by a particular geometric structure with a clear physical interpretation. This higher-level approach could make the process of building and maintaining large-scale models simpler and also safer.

categories: eess.SY cs.SY math-ph math.MP physics.class-ph


title: No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization

abstract: Key-Value (KV) Caching has become an essential technique for accelerating the inference speed and throughput of generative Large Language Models~(LLMs). However, the memory footprint of the KV cache poses a critical bottleneck in LLM deployment as the cache size grows with batch size and sequence length, often surpassing even the size of the model itself. Although recent methods were proposed to select and evict unimportant KV pairs from the cache to reduce memory consumption, the potential ramifications of eviction on the generative process are yet to be thoroughly examined. In this paper, we examine the detrimental impact of cache eviction and observe that unforeseen risks arise as the information contained in the KV pairs is exhaustively discarded, resulting in safety breaches, hallucinations, and context loss. Surprisingly, we find that preserving even a small amount of information contained in the evicted KV pairs via reduced precision quantization substantially recovers the incurred degradation. On the other hand, we observe that the important KV pairs must be kept at a relatively higher precision to safeguard the generation quality. Motivated by these observations, we propose \textit{Mixed-precision KV cache}~(MiKV), a reliable cache compression method that simultaneously preserves the context details by retaining the evicted KV pairs in low-precision and ensure generation quality by keeping the important KV pairs in high-precision. Experiments on diverse benchmarks and LLM backbones show that our proposed method offers a state-of-the-art trade-off between compression ratio and performance, compared to other baselines.


title: Exploring the Dynamics of Mass Inflation: Implications for Cauchy Horizon Stability and Black Hole Physics in General Relativity and $f(R)$ Gravity

abstract: This article investigates the phenomenon of mass inflation and its consequential impact on the stability of Cauchy horizons within the framework of general relativity. Mass inflation, defined by an exponential surge in energy, is pivotal in preserving causality across solutions like the Kerr black hole, ensuring the singular nature of causality-violating regions. Through a nuanced examination, the study expands the traditional understanding of mass inflation beyond stationary geometries to include dynamic black hole configurations. This exploration is enriched with a mathematical analysis of Schwarzschild and Kerr-Newman metrics, alongside a discussion on $f(R)$ gravity's implications for black hole physics. The findings challenge existing paradigms, proposing new models that accommodate mass inflation, thereby inviting further inquiry into the interplay between general relativity, quantum mechanics, and $f(R)$ gravity.


title: Moduli of stable sheaves on quadric threefold

abstract: For each $0<\alpha<\frac{1}{2}$, there exists a Bayer--Lahoz--Macr{\`{\i}}--Stellari's inducing Bridgeland stability condition $\sigma(\alpha)$ on a Kuznetsov component $\mathrm{Ku}(Q)$ of the smooth quadric threefold $Q$. We obtain the non-empty of the moduli space $M_{\sigma(\alpha)}([\mathcal{P}_{x}])$ of $\sigma(\alpha)$-semistable objects in $\mathrm{Ku}(Q)$ with the numerical class $[\mathcal{P}_{x}]$, where $\mathcal{P}_{x}\in \mathrm{Ku}(Q)$ is the projection sheaf of the skyscraper sheaf at a closed point $x\in Q$. We show that the moduli space $\overline{M}_{Q}(\mathbf{v})$ of Gieseker semistable sheaves with Chern character $\mathbf{v}=\mathrm{ch}(\mathcal{P}_{x})$ is smooth and irreducible of dimension four, and prove that the moduli space $M_{\sigma(\alpha)}([\mathcal{P}_{x}])$ is isomorphic to $\overline{M}_{Q}(\mathbf{v})$. As an application, we show that the quadric threefold $Q$ can be reinterpreted as a Brill--Noether locus in the Bridgeland moduli space $M_{\sigma(\alpha)}([\mathcal{P}_{x}])$. In the appendices, we show that the moduli space $M_{\sigma(\alpha)}([S])$ contains only one single point corresponding to the spinor bundle $S$ and give a Bridgeland moduli interpretation for the Hilbert scheme of lines in $Q$.


title: Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models

abstract: Model editing aims to precisely alter the behaviors of large language models (LLMs) in relation to specific knowledge, while leaving unrelated knowledge intact. This approach has proven effective in addressing issues of hallucination and outdated information in LLMs. However, the potential of using model editing to modify knowledge in the medical field remains largely unexplored, even though resolving hallucination is a pressing need in this area. Our observations indicate that current methods face significant challenges in dealing with specialized and complex knowledge in medical domain. Therefore, we propose MedLaSA, a novel Layer-wise Scalable Adapter strategy for medical model editing. MedLaSA harnesses the strengths of both adding extra parameters and locate-then-edit methods for medical model editing. We utilize causal tracing to identify the association of knowledge in neurons across different layers, and generate a corresponding scale set from the association value for each piece of knowledge. Subsequently, we incorporate scalable adapters into the dense layers of LLMs. These adapters are assigned scaling values based on the corresponding specific knowledge, which allows for the adjustment of the adapter's weight and rank. The more similar the content, the more consistent the scale between them. This ensures precise editing of semantically identical knowledge while avoiding impact on unrelated knowledge. To evaluate the editing impact on the behaviours of LLMs, we propose two model editing studies for medical domain: (1) editing factual knowledge for medical specialization and (2) editing the explanatory ability for complex knowledge. We build two novel medical benchmarking datasets and introduce a series of challenging and comprehensive metrics. Extensive experiments on medical LLMs demonstrate the editing efficiency of MedLaSA, without affecting unrelated knowledge.


title: Direct and retrograde signal propagation in unidirectionally coupled Wilson-Cowan oscillators

abstract: Certain biological systems exhibit both direct and retrograde propagating wave signals, despite unidirectional neural coupling. However, there is no model to explain this. Therefore, the underlying physics of reversing the signal's direction for one-way coupling remains unclear. Here, we resolve this issue using a Wilson-Cowan oscillators network. By analyzing the limit cycle period of various coupling configurations, we determine that intrinsic frequency differences among oscillators control wave directionality.


title: Assessing the Efficacy of Grammar Error Correction: A Human Evaluation Approach in the Japanese Context

abstract: In this study, we evaluated the performance of the state-of-the-art sequence tagging grammar error detection and correction model (SeqTagger) using Japanese university students' writing samples. With an automatic annotation toolkit, ERRANT, we first evaluated SeqTagger's performance on error correction with human expert correction as the benchmark. Then a human-annotated approach was adopted to evaluate Seqtagger's performance in error detection using a subset of the writing dataset. Results indicated a precision of 63.66% and a recall of 20.19% for error correction in the full dataset. For the subset, after manual exclusion of irrelevant errors such as semantic and mechanical ones, the model shows an adjusted precision of 97.98% and an adjusted recall of 42.98% for error detection, indicating the model's high accuracy but also its conservativeness. Thematic analysis on errors undetected by the model revealed that determiners and articles, especially the latter, were predominant. Specifically, in terms of context-independent errors, the model occasionally overlooked basic ones and faced challenges with overly erroneous or complex structures. Meanwhile, context-dependent errors, notably those related to tense and noun number, as well as those possibly influenced by the students' first language (L1), remained particularly challenging.


title: Passive Snapshot Coded Aperture Dual-Pixel RGB-D Imaging

abstract: Passive, compact, single-shot 3D sensing is useful in many application areas such as microscopy, medical imaging, surgical navigation, and autonomous driving where form factor, time, and power constraints can exist. Obtaining RGB-D scene information over a short imaging distance, in an ultra-compact form factor, and in a passive, snapshot manner is challenging. Dual-pixel (DP) sensors are a potential solution to achieve the same. DP sensors collect light rays from two different halves of the lens in two interleaved pixel arrays, thus capturing two slightly different views of the scene, like a stereo camera system. However, imaging with a DP sensor implies that the defocus blur size is directly proportional to the disparity seen between the views. This creates a trade-off between disparity estimation vs. deblurring accuracy. To improve this trade-off effect, we propose CADS (Coded Aperture Dual-Pixel Sensing), in which we use a coded aperture in the imaging lens along with a DP sensor. In our approach, we jointly learn an optimal coded pattern and the reconstruction algorithm in an end-to-end optimization setting. Our resulting CADS imaging system demonstrates improvement of >1.5dB PSNR in all-in-focus (AIF) estimates and 5-6% in depth estimation quality over naive DP sensing for a wide range of aperture settings. Furthermore, we build the proposed CADS prototypes for DSLR photography settings and in an endoscope and a dermoscope form factor. Our novel coded dual-pixel sensing approach demonstrates accurate RGB-D reconstruction results in simulations and real-world experiments in a passive, snapshot, and compact manner.


title: Neurological disorders leading to mechanical dysfunction of the esophagus: an emergent behavior of a neuromechanical dynamical system

abstract: An understanding how neurological disorders lead to mechanical dysfunction of the esophagus requires knowledge of the neural circuit of the enteric nervous system. Historically, this has been elusive. Here, we present an empirically guided neural circuit for the esophagus. It has a chain of unidirectionally coupled relaxation oscillators, receiving excitatory signals from stretch receptors along the esophagus. The resulting neuromechanical model reveals complex patterns and behaviors that emerge from interacting components in the system. A wide variety of clinically observed normal and abnormal esophageal responses to distension are successfully predicted. Specifically, repetitive antegrade contractions (RACs) are conclusively shown to emerge from the coupled neuromechanical dynamics in response to sustained volumetric distension. Normal RACs are shown to have a robust balance between excitatory and inhibitory neuronal populations, and the mechanical input through stretch receptors. When this balance is affected, contraction patterns akin to motility disorders are observed. For example, clinically observed repetitive retrograde contractions emerge due to a hyper stretch sensitive wall. Such neuromechanical insights could be crucial to eventually develop targeted pharmacological interventions.


title: Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise and Reconstruction

abstract: In recent years, large language models (LLMs) have demonstrated notable success across various tasks, but the trustworthiness of LLMs is still an open problem. One specific threat is the potential to generate toxic or harmful responses. Attackers can craft adversarial prompts that induce harmful responses from LLMs. In this work, we pioneer a theoretical foundation in LLMs security by identifying bias vulnerabilities within the safety fine-tuning and design a black-box jailbreak method named DRA (Disguise and Reconstruction Attack), which conceals harmful instructions through disguise and prompts the model to reconstruct the original harmful instruction within its completion. We evaluate DRA across various open-source and closed-source models, showcasing state-of-the-art jailbreak success rates and attack efficiency. Notably, DRA boasts a 91.1% attack success rate on OpenAI GPT-4 chatbot.


title: JEL ratio test for independence between a continuous and a categorical random variable

abstract: The categorical Gini covariance is a dependence measure between a numerical variable and a categorical variable. The Gini covariance measures dependence by quantifying the difference between the conditional and unconditional distributional functions. A value of zero for the categorical Gini covariance implies independence of the numerical variable and the categorical variable. We propose a non-parametric test for testing the independence between a numerical and categorical variable using the categorical Gini covariance. We used the theory of U-statistics to find the test statistics and study the properties. The test has an asymptotic normal distribution. As the implementation of a normal-based test is difficult, we develop a jackknife empirical likelihood (JEL) ratio test for testing independence. Extensive Monte Carlo simulation studies are carried out to validate the performance of the proposed JEL-based test. We illustrate the test procedure using real a data set.


title: On the Stability of the $s$-Nonlocal $p$-Obstacle Problem and their Coincidence Sets and Free Boundaries

abstract: We show that the solutions to the nonlocal obstacle problems for the nonlocal $-\Delta_p^s$ operator, when the fractional parameter $s\to\sigma$ for $0<\sigma\leq1$, converge to the solution of the corresponding obstacle problem for $-\Delta_p^\sigma$, being $\sigma=1$ the classical obstacle problem for the local $p$-Laplacian. We discuss the weak stability of the quasi-characteristic functions of coincidence sets of the solution with the obstacle, which is a strong convergence of their characteristic functions when $s\nearrow 1$ under a nondegeneracy condition. This stability can be shown also in terms of the convergence of the free boundaries, as well as of the coincidence sets, in Hausdorff distance when $s\nearrow 1$, under non-degeneracy local assumptions on the external force and a local topological property of the coincidence set of the limit classical obstacle problem for the local $p$-Laplacian, essentially when the limit coincidence set is the closure of its interior.


title: Multimodal Interaction Modeling via Self-Supervised Multi-Task Learning for Review Helpfulness Prediction

abstract: In line with the latest research, the task of identifying helpful reviews from a vast pool of user-generated textual and visual data has become a prominent area of study. Effective modal representations are expected to possess two key attributes: consistency and differentiation. Current methods designed for Multimodal Review Helpfulness Prediction (MRHP) face limitations in capturing distinctive information due to their reliance on uniform multimodal annotation. The process of adding varied multimodal annotations is not only time-consuming but also labor-intensive. To tackle these challenges, we propose an auto-generated scheme based on multi-task learning to generate pseudo labels. This approach allows us to simultaneously train for the global multimodal interaction task and the separate cross-modal interaction subtasks, enabling us to learn and leverage both consistency and differentiation effectively. Subsequently, experimental results validate the effectiveness of pseudo labels, and our approach surpasses previous textual and multimodal baseline models on two widely accessible benchmark datasets, providing a solution to the MRHP problem.


title: Large Deviation Principle for Multi-Scale Fully Local Monotone Stochastic Dynamical Systems with Multiplicative Noise

abstract: This paper is devoted to proving the small noise asymptotic behaviour, particularly large deviation principle, for multi-scale stochastic dynamical systems with fully local monotone coefficients driven by multiplicative noise. The main techniques are based on a combination of the weak convergence approach, the time discretization technique and the theory of pseudo-monotone operator. The main results derived in this paper have broad applicability to various multi-scale models, where the slow component could be such as stochastic porous medium equations, stochastic Cahn-Hilliard equations and stochastic 2D Liquid crystal equations.


title: Dual-Context Aggregation for Universal Image Matting

abstract: Natural image matting aims to estimate the alpha matte of the foreground from a given image. Various approaches have been explored to address this problem, such as interactive matting methods that use guidance such as click or trimap, and automatic matting methods tailored to specific objects. However, existing matting methods are designed for specific objects or guidance, neglecting the common requirement of aggregating global and local contexts in image matting. As a result, these methods often encounter challenges in accurately identifying the foreground and generating precise boundaries, which limits their effectiveness in unforeseen scenarios. In this paper, we propose a simple and universal matting framework, named Dual-Context Aggregation Matting (DCAM), which enables robust image matting with arbitrary guidance or without guidance. Specifically, DCAM first adopts a semantic backbone network to extract low-level features and context features from the input image and guidance. Then, we introduce a dual-context aggregation network that incorporates global object aggregators and local appearance aggregators to iteratively refine the extracted context features. By performing both global contour segmentation and local boundary refinement, DCAM exhibits robustness to diverse types of guidance and objects. Finally, we adopt a matting decoder network to fuse the low-level features and the refined context features for alpha matte estimation. Experimental results on five matting datasets demonstrate that the proposed DCAM outperforms state-of-the-art matting methods in both automatic matting and interactive matting tasks, which highlights the strong universality and high performance of DCAM. The source code is available at \url{https://github.com/Windaway/DCAM}.


title: The Logarithmic Random Bidding for the Parallel Roulette Wheel Selection with Precise Probabilities

abstract: The roulette wheel selection is a critical process in heuristic algorithms, enabling the probabilistic choice of items based on assigned fitness values. It selects an item with a probability proportional to its fitness value. This technique is commonly employed in ant-colony algorithms to randomly determine the next city to visit when solving the traveling salesman problem. Our study focuses on parallel algorithms designed to select one of multiple processors, each associated with fitness values, using random wheel selection. We propose a novel approach called logarithmic random bidding, which achieves an expected runtime logarithmic to the number of processors with non-zero fitness values, using the CRCW-PRAM model with a shared memory of constant size. Notably, the logarithmic random bidding technique demonstrates efficient performance, particularly in scenarios where only a few processors are assigned non-zero fitness values.


title: On global regularity of some bi-rotational Euler flows in $\mathbb{R}^{4}$

abstract: In this paper, we consider incompressible Euler flows in $ \mathbb{R}^{4} $ under bi-rotational symmetry, namely solutions that are invariant under rotations in $\mathbb{R}^{4}$ fixing either the first two or last two axes. With the additional swirl-free assumption, our first main result gives local wellposedness of Yudovich-type solutions, extending the work of Danchin [Uspekhi Mat. Nauk 62(2007), no.3, 73-94] for axisymmetric flows in $\mathbb{R}^{3}$. The second main result establishes global wellposedness under additional decay conditions near the axes and at infinity. This in particular gives global regularity of $C^{\infty}$ smooth and decaying Euler flows in $\mathbb{R}^{4}$ subject to bi-rotational symmetry without swirl.


title: Simple But Effective: Rethinking the Ability of Deep Learning in fNIRS to Exclude Abnormal Input

abstract: Functional near-infrared spectroscopy (fNIRS) is a non-invasive technique for monitoring brain activity. To better understand the brain, researchers often use deep learning to address the classification challenges of fNIRS data. Our study shows that while current networks in fNIRS are highly accurate for predictions within their training distribution, they falter at identifying and excluding abnormal data which is out-of-distribution, affecting their reliability. We propose integrating metric learning and supervised methods into fNIRS research to improve networks capability in identifying and excluding out-of-distribution outliers. This method is simple yet effective. In our experiments, it significantly enhances the performance of various networks in fNIRS, particularly transformer-based one, which shows the great improvement in reliability. We will make our experiment data available on GitHub.


title: Small But Funny: A Feedback-Driven Approach to Humor Distillation

abstract: The emergence of Large Language Models (LLMs) has brought to light promising language generation capabilities, particularly in performing tasks like complex reasoning and creative writing. Consequently, distillation through imitation of teacher responses has emerged as a popular technique to transfer knowledge from LLMs to more accessible, Small Language Models (SLMs). While this works well for simpler tasks, there is a substantial performance gap on tasks requiring intricate language comprehension and creativity, such as humor generation. We hypothesize that this gap may stem from the fact that creative tasks might be hard to learn by imitation alone and explore whether an approach, involving supplementary guidance from the teacher, could yield higher performance. To address this, we study the effect of assigning a dual role to the LLM - as a "teacher" generating data, as well as a "critic" evaluating the student's performance. Our experiments on humor generation reveal that the incorporation of feedback significantly narrows the performance gap between SLMs and their larger counterparts compared to merely relying on imitation. As a result, our research highlights the potential of using feedback as an additional dimension to data when transferring complex language abilities via distillation.


title: PIMSYN: Synthesizing Processing-in-memory CNN Accelerators

abstract: Processing-in-memory architectures have been regarded as a promising solution for CNN acceleration. Existing PIM accelerator designs rely heavily on the experience of experts and require significant manual design overhead. Manual design cannot effectively optimize and explore architecture implementations. In this work, we develop an automatic framework PIMSYN for synthesizing PIM-based CNN accelerators, which greatly facilitates architecture design and helps generate energyefficient accelerators. PIMSYN can automatically transform CNN applications into execution workflows and hardware construction of PIM accelerators. To systematically optimize the architecture, we embed an architectural exploration flow into the synthesis framework, providing a more comprehensive design space. Experiments demonstrate that PIMSYN improves the power efficiency by several times compared with existing works. PIMSYN can be obtained from https://github.com/lixixi-jook/PIMSYN-NN.


title: UniVS: Unified and Universal Video Segmentation with Prompts as Queries

abstract: Despite the recent advances in unified image segmentation (IS), developing a unified video segmentation (VS) model remains a challenge. This is mainly because generic category-specified VS tasks need to detect all objects and track them across consecutive frames, while prompt-guided VS tasks require re-identifying the target with visual/text prompts throughout the entire video, making it hard to handle the different tasks with the same architecture. We make an attempt to address these issues and present a novel unified VS architecture, namely UniVS, by using prompts as queries. UniVS averages the prompt features of the target from previous frames as its initial query to explicitly decode masks, and introduces a target-wise prompt cross-attention layer in the mask decoder to integrate prompt features in the memory pool. By taking the predicted masks of entities from previous frames as their visual prompts, UniVS converts different VS tasks into prompt-guided target segmentation, eliminating the heuristic inter-frame matching process. Our framework not only unifies the different VS tasks but also naturally achieves universal training and testing, ensuring robust performance across different scenarios. UniVS shows a commendable balance between performance and universality on 10 challenging VS benchmarks, covering video instance, semantic, panoptic, object, and referring segmentation tasks. Code can be found at \url{https://github.com/MinghanLi/UniVS}.


title: Block and Detail: Scaffolding Sketch-to-Image Generation

abstract: We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their shape and silhouettes. We develop a two-pass algorithm for generating high-fidelity images from such sketches at any point in the iterative process. In the first pass we use a ControlNet to generate an image that strictly follows all the strokes (blocking and detail) and in the second pass we add variation by renoising regions surrounding blocking strokes. We also present a dataset generation scheme that, when used to train a ControlNet architecture, allows regions that do not contain strokes to be interpreted as not-yet-specified regions rather than empty space. We show that this partial-sketch-aware ControlNet can generate coherent elements from partial sketches that only contain a small number of strokes. The high-fidelity images produced by our approach serve as scaffolds that can help the user adjust the shape and proportions of objects or add additional elements to the composition. We demonstrate the effectiveness of our approach with a variety of examples and evaluative comparisons.


title: PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation

abstract: Tremendous breakthroughs have been developed in Semi-Supervised Semantic Segmentation (S4) through contrastive learning. However, due to limited annotations, the guidance on unlabeled images is generated by the model itself, which inevitably exists noise and disturbs the unsupervised training process. To address this issue, we propose a robust contrastive-based S4 framework, termed the Probabilistic Representation Contrastive Learning (PRCL) framework to enhance the robustness of the unsupervised training process. We model the pixel-wise representation as Probabilistic Representations (PR) via multivariate Gaussian distribution and tune the contribution of the ambiguous representations to tolerate the risk of inaccurate guidance in contrastive learning. Furthermore, we introduce Global Distribution Prototypes (GDP) by gathering all PRs throughout the whole training process. Since the GDP contains the information of all representations with the same class, it is robust from the instant noise in representations and bears the intra-class variance of representations. In addition, we generate Virtual Negatives (VNs) based on GDP to involve the contrastive learning process. Extensive experiments on two public benchmarks demonstrate the superiority of our PRCL framework.


title: Sectional category \`a la Quillen

abstract: In this note we give a characterization of the sectional category of a map between rational spaces in terms of its Koszul-Quillen model.


title: Modeling and Analysis of Crypto-Backed Over-Collateralized Stable Derivatives in DeFi

abstract: In decentralized finance (DeFi), stablecoins like DAI are designed to offer a stable value amidst the fluctuating nature of cryptocurrencies. We examine the class of crypto-backed stable derivatives, with a focus on mechanisms for price stabilization, which is exemplified by the well-known stablecoin DAI from MakerDAO. For simplicity, we focus on a single-collateral setting. We introduce a belief parameter to the simulation model of DAI in a previous work (DAISIM), reflecting market sentiments about the value and stability of DAI, and show that it better matches the expected behavior when this parameter is set to a sufficiently high value. We also propose a simple mathematical model of DAI price to explain its stability and dependency on ETH price. Finally, we analyze possible risk factors associated with these stable derivatives to provide valuable insights for stakeholders in the DeFi ecosystem.


title: Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?

abstract: Prior research in representation engineering has revealed that LLMs encode concepts within their representation spaces, predominantly centered around English. In this study, we extend this philosophy to a multilingual scenario, delving into multilingual human value concepts in LLMs. Through our comprehensive exploration covering 7 types of human values, 16 languages and 3 LLM series with distinct multilinguality, we empirically substantiate the existence of multilingual human values in LLMs. Further cross-lingual analysis on these concepts discloses 3 traits arising from language resource disparities: cross-lingual inconsistency, distorted linguistic relationships, and unidirectional cross-lingual transfer between high- and low-resource languages, all in terms of human value concepts. Additionally, we validate the feasibility of cross-lingual control over value alignment capabilities of LLMs, leveraging the dominant language as a source language. Drawing from our findings on multilingual value alignment, we prudently provide suggestions on the composition of multilingual data for LLMs pre-training: including a limited number of dominant languages for cross-lingual alignment transfer while avoiding their excessive prevalence, and keeping a balanced distribution of non-dominant languages. We aspire that our findings would contribute to enhancing the safety and utility of multilingual AI.


title: Saving the legacy of Hero Ibash: Evaluating Four Language Models for Aminoacian

abstract: This study assesses four cutting-edge language models in the underexplored Aminoacian language. Through evaluation, it scrutinizes their adaptability, effectiveness, and limitations in text generation, semantic coherence, and contextual understanding. Uncovering insights into these models' performance in a low-resourced language, this research pioneers pathways to bridge linguistic gaps. By offering benchmarks and understanding challenges, it lays groundwork for future advancements in natural language processing, aiming to elevate the applicability of language models in similar linguistic landscapes, marking a significant step toward inclusivity and progress in language technology.


title: G4G:A Generic Framework for High Fidelity Talking Face Generation with Fine-grained Intra-modal Alignment

abstract: Despite numerous completed studies, achieving high fidelity talking face generation with highly synchronized lip movements corresponding to arbitrary audio remains a significant challenge in the field. The shortcomings of published studies continue to confuse many researchers. This paper introduces G4G, a generic framework for high fidelity talking face generation with fine-grained intra-modal alignment. G4G can reenact the high fidelity of original video while producing highly synchronized lip movements regardless of given audio tones or volumes. The key to G4G's success is the use of a diagonal matrix to enhance the ordinary alignment of audio-image intra-modal features, which significantly increases the comparative learning between positive and negative samples. Additionally, a multi-scaled supervision module is introduced to comprehensively reenact the perceptional fidelity of original video across the facial region while emphasizing the synchronization of lip movements and the input audio. A fusion network is then used to further fuse the facial region and the rest. Our experimental results demonstrate significant achievements in reenactment of original video quality as well as highly synchronized talking lips. G4G is an outperforming generic framework that can produce talking videos competitively closer to ground truth level than current state-of-the-art methods.


title: Fixture calibration with guaranteed bounds from a few correspondence-free surface points

abstract: Calibration of fixtures in robotic work cells is essential but also time consuming and error-prone, and poor calibration can easily lead to wasted debugging time in downstream tasks. Contact-based calibration methods let the user measure points on the fixture's surface with a tool tip attached to the robot's end effector. Most such methods require the user to manually annotate correspondences on the CAD model, however, this is error-prone and a cumbersome user experience. We propose a correspondence-free alternative: The user simply measures a few points from the fixture's surface, and our method provides a tight superset of the poses which could explain the measured points. This naturally detects ambiguities related to symmetry and uninformative points and conveys this uncertainty to the user. Perhaps more importantly, it provides guaranteed bounds on the pose. The computation of such bounds is made tractable by the use of a hierarchical grid on SE(3). Our method is evaluated both in simulation and on a real collaborative robot, showing great potential for easier and less error-prone fixture calibration. Project page at https://sites.google.com/view/ttpose


title: From Simulations to Reality: Dark Energy Reconstruction with Simulated SNIa data from the Vera C. Rubin Observatory

abstract: In this paper, we present an Artificial Neural Network (ANN) based reconstruction analysis of the Supernova Ia (SNIa) distance moduli ($\mu(z)$), and hence dark energy, using LSST simulated three-year SNIa data. Our ANN reconstruction architecture can model both the distance moduli and their corresponding error estimates. For this we employ astroANN and incorporate Monte Carlo dropout techniques to quantify uncertainties in our predictions. We tune our hyperparameters through advanced genetic algorithms, including elitism, utilizing the DEAP library. We compared the performance of the ANN based reconstruction with two theoretical descriptions of dark energy models, $\Lambda$CDM and Chevallier-Linder-Polarski (CPL). We perform a Bayesian analysis for these two theoretical models using the LSST simulations and also compare with observations from Pantheon and Pantheon+ SNIa real data. We show that our model-independent reconstruction using ANN is consistent with both of them. We assessed the performance using mean squared error (MSE) and showed that the ANN can produce distance estimates in better agreement with the LSST dataset than either $\Lambda$CDM or CPL, albeit very small. We included an additional residual analysis and a null test with $F$-scores to show that the reconstructed distances from the ANN model, are in excellent agreement with the $\Lambda$CDM or CPL model.


title: 27Al-NMR Study on a square-Kagome lattice antiferromagnet

abstract: NMR study has been performed on an S = 1/2 antiferromagnet KCu6AlBiO4(SO4)5Cl on the square-Kagome lattice, which has three slightly inequivalent nearest-neighbor interactions. Because of the geometrical frustration inherited from triangles within the square kagome lattice and of the low dimensionality, a long range magnetic order is strongly suppressed; its absence has so far been confirmed in low temperatures down to dilution refrigerator region. 27Al-NMR spectra and the longitudinal relaxation time T1 were measured by a conventional pulsed spectrometer on powder sample under several magnetic fields between 3 and 10 T and in low temperatures down to 0.35 K. The NMR line width due to the inhomogeneous broadening increased with lowering temperatures and leveled off below 3 K, where FWHM reached the value as large as 0.1 T, implying that the ground state is magnetic one, consistent with previous reports. On the other hand, the longitudinal nuclear spin relaxation rate 1/T1 obeyed the Arrhenius law with the thermal activation energy {\Delta} = 2K at low temperatures, suggesting that a small gap is formed in the spin excitation spectrum.


title: Ultra-light Dark Matter Search with Astrophysical Neutrino Flavour

abstract: The ultra-light dark matter is a new class of dark matter candidates. Unlike traditional dark matter particle candidates, the ultra-light dark matter behaves like a classical field, which saturates the entire Milky Way galaxy with a coherent oscillation. If such dark matter exists and couples with neutrinos, properties of astrophysical neutrinos propagating in the Milky Way would be modified and detectable by neutrino telescopes such as IceCube. Meantime, IceCube looked for quantum-gravity-motivated effects from the astrophysical neutrino flavour information. IceCube did not find evidence of new physics, and they set limits on neutrino - Lorentz violating field couplings. Here, we investigate if these results can be applied to limit the ultra-light dark matter couplings with neutrinos. It is found that the strong limits of neutrino-dark matter couplings in low dark matter mass regions can be obtained in this approach.


title: Hierarchical Multi-Relational Graph Representation Learning for Large-Scale Prediction of Drug-Drug Interactions

abstract: Most existing methods for predicting drug-drug interactions (DDI) predominantly concentrate on capturing the explicit relationships among drugs, overlooking the valuable implicit correlations present between drug pairs (DPs), which leads to weak predictions. To address this issue, this paper introduces a hierarchical multi-relational graph representation learning (HMGRL) approach. Within the framework of HMGRL, we leverage a wealth of drug-related heterogeneous data sources to construct heterogeneous graphs, where nodes represent drugs and edges denote clear and various associations. The relational graph convolutional network (RGCN) is employed to capture diverse explicit relationships between drugs from these heterogeneous graphs. Additionally, a multi-view differentiable spectral clustering (MVDSC) module is developed to capture multiple valuable implicit correlations between DPs. Within the MVDSC, we utilize multiple DP features to construct graphs, where nodes represent DPs and edges denote different implicit correlations. Subsequently, multiple DP representations are generated through graph cutting, each emphasizing distinct implicit correlations. The graph-cutting strategy enables our HMGRL to identify strongly connected communities of graphs, thereby reducing the fusion of irrelevant features. By combining every representation view of a DP, we create high-level DP representations for predicting DDIs. Two genuine datasets spanning three distinct tasks are adopted to gauge the efficacy of our HMGRL. Experimental outcomes unequivocally indicate that HMGRL surpasses several leading-edge methods in performance.


title: Downstream Task Guided Masking Learning in Masked Autoencoders Using Multi-Level Optimization

abstract: Masked Autoencoder (MAE) is a notable method for self-supervised pretraining in visual representation learning. It operates by randomly masking image patches and reconstructing these masked patches using the unmasked ones. A key limitation of MAE lies in its disregard for the varying informativeness of different patches, as it uniformly selects patches to mask. To overcome this, some approaches propose masking based on patch informativeness. However, these methods often do not consider the specific requirements of downstream tasks, potentially leading to suboptimal representations for these tasks. In response, we introduce the Multi-level Optimized Mask Autoencoder (MLO-MAE), a novel framework that leverages end-to-end feedback from downstream tasks to learn an optimal masking strategy during pretraining. Our experimental findings highlight MLO-MAE's significant advancements in visual representation learning. Compared to existing methods, it demonstrates remarkable improvements across diverse datasets and tasks, showcasing its adaptability and efficiency. Our code is available at: https://github.com/Alexiland/MLOMAE


title: On the Inductive Biases of Demographic Parity-based Fair Learning Algorithms

abstract: Fair supervised learning algorithms assigning labels with little dependence on a sensitive attribute have attracted great attention in the machine learning community. While the demographic parity (DP) notion has been frequently used to measure a model's fairness in training fair classifiers, several studies in the literature suggest potential impacts of enforcing DP in fair learning algorithms. In this work, we analytically study the effect of standard DP-based regularization methods on the conditional distribution of the predicted label given the sensitive attribute. Our analysis shows that an imbalanced training dataset with a non-uniform distribution of the sensitive attribute could lead to a classification rule biased toward the sensitive attribute outcome holding the majority of training data. To control such inductive biases in DP-based fair learning, we propose a sensitive attribute-based distributionally robust optimization (SA-DRO) method improving robustness against the marginal distribution of the sensitive attribute. Finally, we present several numerical results on the application of DP-based learning methods to standard centralized and distributed learning problems. The empirical findings support our theoretical results on the inductive biases in DP-based fair learning algorithms and the debiasing effects of the proposed SA-DRO method.


title: Sequential Change-point Detection for Compositional Time Series with Exogenous Variables

abstract: Sequential change-point detection for time series enables us to sequentially check the hypothesis that the model still holds as more and more data are observed. It is widely used in data monitoring in practice. In this work, we consider sequential change-point detection for compositional time series, time series in which the observations are proportions. For fitting compositional time series, we propose a generalized Beta AR(1) model, which can incorporate exogenous variables upon which the time series observations are dependent. We show the compositional time series are strictly stationary and geometrically ergodic and consider maximum likelihood estimation for model parameters. We show the partial MLEs are consistent and asymptotically normal and propose a parametric sequential change-point detection method for the compositional time series model. The change-point detection method is illustrated using a time series of Covid-19 positivity rates.


title: Identifying changing-look AGNs using variability characteristics

abstract: Changing-look (CL) Active Galactic Nuclei (AGNs), characterized by appearance/disappearance of broad emission lines in the span of a few years, present a challenge for the AGN unified model, whereby the Type 1 vs. Type 2 dichotomy results from orientation effects alone. We present a systematic study of a large sample of spectroscopically classified AGNs, using optical variability data from the Zwicky Transient Facility (ZTF) as well as follow-up spectroscopy data. We demonstrate that Type 1 vs. 2 AGN can be neatly separated on the basis of the variability metric $\sigma_{\rm QSO}$, which quantifies the resemblance of a light curve to a damp random walk model. For a small sub-sample, however, the ZTF light curves are inconsistent with their previous classification, suggesting the occurrence of a CL event. Specifically, we identify 35 (12) turn-on (turn-off) CL AGN candidates at $z < 0.35$. Based on follow-up spectroscopy, we confirm 17 (4) turn-on (turn-off) CL AGNs out of 21 (5) candidates, presenting a high success rate of our method. Our results suggest that the occurrence rate of CL AGNs is $\sim$0.3% over timescales of 5 to 20 years, and confirm that the CL transition typically occurs at the Eddington ratio of $\leq 0.01$.


title: Understanding the Role of Pathways in a Deep Neural Network

abstract: Deep neural networks have demonstrated superior performance in artificial intelligence applications, but the opaqueness of their inner working mechanism is one major drawback in their application. The prevailing unit-based interpretation is a statistical observation of stimulus-response data, which fails to show a detailed internal process of inherent mechanisms of neural networks. In this work, we analyze a convolutional neural network (CNN) trained in the classification task and present an algorithm to extract the diffusion pathways of individual pixels to identify the locations of pixels in an input image associated with object classes. The pathways allow us to test the causal components which are important for classification and the pathway-based representations are clearly distinguishable between categories. We find that the few largest pathways of an individual pixel from an image tend to cross the feature maps in each layer that is important for classification. And the large pathways of images of the same category are more consistent in their trends than those of different categories. We also apply the pathways to understanding adversarial attacks, object completion, and movement perception. Further, the total number of pathways on feature maps in all layers can clearly discriminate the original, deformed, and target samples.


title: Classes Are Not Equal: An Empirical Study on Image Recognition Fairness

abstract: In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent for image classification models across various datasets, network architectures, and model capacities. Moreover, several intriguing properties of fairness are identified. First, the unfairness lies in problematic representation rather than classifier bias. Second, with the proposed concept of Model Prediction Bias, we investigate the origins of problematic representation during optimization. Our findings reveal that models tend to exhibit greater prediction biases for classes that are more challenging to recognize. It means that more other classes will be confused with harder classes. Then the False Positives (FPs) will dominate the learning in optimization, thus leading to their poor accuracy. Further, we conclude that data augmentation and representation learning algorithms improve overall performance by promoting fairness to some degree in image classification. The Code is available at https://github.com/dvlab-research/Parametric-Contrastive-Learning.


title: Learning to Deblur Polarized Images

abstract: A polarization camera can capture four polarized images with different polarizer angles in a single shot, which is useful in polarization-based vision applications since the degree of polarization (DoP) and the angle of polarization (AoP) can be directly computed from the captured polarized images. However, since the on-chip micro-polarizers block part of the light so that the sensor often requires a longer exposure time, the captured polarized images are prone to motion blur caused by camera shakes, leading to noticeable degradation in the computed DoP and AoP. Deblurring methods for conventional images often show degenerated performance when handling the polarized images since they only focus on deblurring without considering the polarization constrains. In this paper, we propose a polarized image deblurring pipeline to solve the problem in a polarization-aware manner by adopting a divide-and-conquer strategy to explicitly decompose the problem into two less ill-posed sub-problems, and design a two-stage neural network to handle the two sub-problems respectively. Experimental results show that our method achieves state-of-the-art performance on both synthetic and real-world images, and can improve the performance of polarization-based vision applications such as image dehazing and reflection removal.


title: Manager Characteristics and SMEs' Restructuring Decisions: In-Court vs. Out-of-Court Restructuring

abstract: This study aims to empirically investigate the impact of managers' characteristics on their choice between in-court and out-of-court restructuring. Based on the theory of upper echelons, we tested the preferences of 342 managers of financially distressed French firms regarding restructuring decisions. The overall findings of this study provide empirical support for the upper echelons theory. Specifically, managers with a long tenure and those with a high level of education are less likely to restructure before the court and are more likely to restructure privately. The findings also indicate that managers' age and gender do not significantly affect their choice between in-court and out-of-court restructuring. This study contributes to the literature on bankruptcy and corporate restructuring by turning the focus from firm characteristics to manager characteristics to explain restructuring decisions.


title: A comparative computational study of different formulations of the compressible Euler equations for mesoscale atmospheric flows in a finite volume framework

abstract: We consider three conservative forms of the mildly compressible Euler equations, called CE1, CE2 and CE3, with the goal of understanding which leads to the most accurate and robust pressure-based solver in a finite volume environment. Forms CE1 and CE2 are both written in density, momentum, and specific enthalpy, but employ two different treatments of the buoyancy and pressure gradient terms: for CE1 it is the standard pressure splitting implemented in open-source finite volume solvers (e.g., OpenFOAM), while for CE2 it is the typical pressure splitting found in computational atmospheric studies. Form CE3 is written in density, momentum, and potential temperature, with the buoyancy and pressure terms addressed as in CE2. For each formulation, we adopt a computationally efficient splitting approach. The three formulations are thoroughly assessed and compared through six benchmark tests involving dry air flow over a flat terrain or orography. We found that all three models are able to provide accurate results for the tests with a flat terrain, although the solvers based on the CE2 and CE3 forms are more robust. As for the mountain tests, CE1 solutions become unstable, while the CE2 and CE3 models provide results in very good agreement with data in the literature, the CE3 model being the most accurate. Hence, the CE3 model is the most accurate, reliable, and robust for the simulation of mesoscale atmospheric flows when using a pressure-based approach and space discretization by a finite volume method.


title: DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning

abstract: Multimodal pretraining is an effective strategy for the trinity of goals of representation learning in autonomous robots: 1) extracting both local and global task progressions; 2) enforcing temporal consistency of visual representation; 3) capturing trajectory-level language grounding. Most existing methods approach these via separate objectives, which often reach sub-optimal solutions. In this paper, we propose a universal unified objective that can simultaneously extract meaningful task progression information from image sequences and seamlessly align them with language instructions. We discover that via implicit preferences, where a visual trajectory inherently aligns better with its corresponding language instruction than mismatched pairs, the popular Bradley-Terry model can transform into representation learning through proper reward reparameterizations. The resulted framework, DecisionNCE, mirrors an InfoNCE-style objective but is distinctively tailored for decision-making tasks, providing an embodied representation learning framework that elegantly extracts both local and global task progression features, with temporal consistency enforced through implicit time contrastive learning, while ensuring trajectory-level instruction grounding via multimodal joint encoding. Evaluation on both simulated and real robots demonstrates that DecisionNCE effectively facilitates diverse downstream policy learning tasks, offering a versatile solution for unified representation and reward learning. Project Page: https://2toinf.github.io/DecisionNCE/


title: Pulsed laser intensity dependence of crater formation and light reflection in the UDMA-TEGDMA copolymer nanocomposite, doped with resonant plasmonic gold nanorods

abstract: Plasmonic nanoparticles embedded into a solid matrix could play crucial role in laser-matter interactions. In this study, excess energy creation was observed during the single-shot irradiation of a polymer matrix containing plasmonic gold nanorods, resonant to the laser wavelength, with a high intensity femtosecond laser pulse. This effect was manifested in a 7-fold rise in the crater volume for a 1.7-fold increase of the laser intensity, and was absent in the pure polymer without the gold doping. It occurred at laser intensities > 1.5 x 1017 W/cm2, being the vanishing threshold of plasma mirror formation, resulting in a more than 80% increase of the amount of laser light entering the target. This threshold was found to be critical for the plasmonic effect of gold nanoantennas tuned to the wavelength of the laser on the crater formation.


title: Cause and Effect: Can Large Language Models Truly Understand Causality?

abstract: With the rise of Large Language Models(LLMs), it has become crucial to understand their capabilities and limitations in deciphering and explaining the complex web of causal relationships that language entails. Current methods use either explicit or implicit causal reasoning, yet there is a strong need for a unified approach combining both to tackle a wide array of causal relationships more effectively. This research proposes a novel architecture called Context Aware Reasoning Enhancement with Counterfactual Analysis(CARE CA) framework to enhance causal reasoning and explainability. The proposed framework incorporates an explicit causal detection module with ConceptNet and counterfactual statements, as well as implicit causal detection through LLMs. Our framework goes one step further with a layer of counterfactual explanations to accentuate LLMs understanding of causality. The knowledge from ConceptNet enhances the performance of multiple causal reasoning tasks such as causal discovery, causal identification and counterfactual reasoning. The counterfactual sentences add explicit knowledge of the not caused by scenarios. By combining these powerful modules, our model aims to provide a deeper understanding of causal relationships, enabling enhanced interpretability. Evaluation of benchmark datasets shows improved performance across all metrics, such as accuracy, precision, recall, and F1 scores. We also introduce CausalNet, a new dataset accompanied by our code, to facilitate further research in this domain.


title: OccTransformer: Improving BEVFormer for 3D camera-only occupancy prediction

abstract: This technical report presents our solution, "occTransformer" for the 3D occupancy prediction track in the autonomous driving challenge at CVPR 2023. Our method builds upon the strong baseline BEVFormer and improves its performance through several simple yet effective techniques. Firstly, we employed data augmentation to increase the diversity of the training data and improve the model's generalization ability. Secondly, we used a strong image backbone to extract more informative features from the input data. Thirdly, we incorporated a 3D unet head to better capture the spatial information of the scene. Fourthly, we added more loss functions to better optimize the model. Additionally, we used an ensemble approach with the occ model BevDet and SurroundOcc to further improve the performance. Most importantly, we integrated 3D detection model StreamPETR to enhance the model's ability to detect objects in the scene. Using these methods, our solution achieved 49.23 miou on the 3D occupancy prediction track in the autonomous driving challenge.


title: Urysohn 1-width for 4 and 5 manifolds with positive biRicci curvature

abstract: It was proved by Gromov-Lawson\cite{gl83} that complete three manifold with positive scalar curvature bounded below has finite Urysohn 1-width only depends on the uniform positive scalar curvature bounds. It is natural to ask the same question for the four manifolds. In this paper, we can show that closed four and five manifolds with positive biRicci curvature has finite Urysohn 1-width only depends on the curvature bounds. During the proof we can also observe that the fundamental group of those manifolds are virtually free. This gives a quick application that $T^{2}\times S^{2}$ can't admit positive biRicci curvature.


title: Enhanced micromotion compensation using a phase modulated light field

abstract: We investigate sideband spectroscopy of a trapped ion using a probe laser phase modulated at the trap drive frequency. The enhanced sensitivity of our technique over traditional sideband spectroscopy allows us to detect stray fields of $0.01\,\mathrm{V/m}$ on a timescale of a few minutes and detect differential phases of $5\,\mu\mathrm{rad}$ between applied ac potentials. We also demonstrate the ability suppress Doppler shifts from excess motion to well below the limit imposed by the intrinsic motion of the ion in the vibrational ground-state. The technique we introduce can be readily implemented in any ion trap system that utilizes sideband spectroscopy for micromotion compensation and can be seamlessly integrated into experiments in a fully automated way


title: Invariance principle and McKean-Vlasov limit for randomized load balancing in heavy traffic

abstract: We consider a load balancing model where a Poisson stream of jobs arrive at a system of many servers whose service time distribution possesses a finite second moment. A small fraction of arrivals pass through the so called power-of-choice algorithm, which assigns a job to the shortest among $\ell$, $\ell\ge 2$, randomly chosen queues, and the remaining jobs are assigned to queues chosen uniformly at random. The system is analyzed at critical load in an asymptotic regime where both the number of servers and the usual heavy traffic parameter associated with individual queue lengths grow to infinity. The first main result is a hydrodynamic limit, where the empirical measure of the diffusively normalized queue lengths is shown to converge to a path in measure space whose density is given by the unique solution of a parabolic PDE with nonlocal coefficients. Further, two forms of an invariance principle are proved, corresponding to two different assumptions on the initial distribution, where individual normalized queue lengths converge weakly to solutions of SDE. In one of these results, the limit is given by a McKean-Vlasov SDE, and propagation of chaos holds. The McKean-Vlasov limit is closely related to limit results for Brownian particles on $\mathbb{R}_+$ interacting through their rank (with a specific interaction). However, an entirely different set of tools is required, as the collection of $n$ prelimit particles does not obey a Markovian evolution on $\mathbb{R}_+^n$.


title: Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Information

abstract: Large language models exhibit societal biases associated with demographic information, including race, gender, and others. Endowing such language models with personalities based on demographic data can enable generating opinions that align with those of humans. Building on this idea, we propose "random silicon sampling," a method to emulate the opinions of the human population sub-group. Our study analyzed 1) a language model that generates the survey responses that correspond with a human group based solely on its demographic distribution and 2) the applicability of our methodology across various demographic subgroups and thematic questions. Through random silicon sampling and using only group-level demographic information, we discovered that language models can generate response distributions that are remarkably similar to the actual U.S. public opinion polls. Moreover, we found that the replicability of language models varies depending on the demographic group and topic of the question, and this can be attributed to inherent societal biases in the models. Our findings demonstrate the feasibility of mirroring a group's opinion using only demographic distribution and elucidate the effect of social biases in language models on such simulations.


title: Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis

abstract: Gradient-based explanation methods are increasingly used to interpret neural models in natural language processing (NLP) due to their high fidelity. Such methods determine word-level importance using dimension-level gradient values through a norm function, often presuming equal significance for all gradient dimensions. However, in the context of Aspect-based Sentiment Analysis (ABSA), our preliminary research suggests that only specific dimensions are pertinent. To address this, we propose the Information Bottleneck-based Gradient (\texttt{IBG}) explanation framework for ABSA. This framework leverages an information bottleneck to refine word embeddings into a concise intrinsic dimension, maintaining essential features and omitting unrelated information. Comprehensive tests show that our \texttt{IBG} approach considerably improves both the models' performance and interpretability by identifying sentiment-aware features.


title: 3DSFLabelling: Boosting 3D Scene Flow Estimation by Pseudo Auto-labelling

abstract: Learning 3D scene flow from LiDAR point clouds presents significant difficulties, including poor generalization from synthetic datasets to real scenes, scarcity of real-world 3D labels, and poor performance on real sparse LiDAR point clouds. We present a novel approach from the perspective of auto-labelling, aiming to generate a large number of 3D scene flow pseudo labels for real-world LiDAR point clouds. Specifically, we employ the assumption of rigid body motion to simulate potential object-level rigid movements in autonomous driving scenarios. By updating different motion attributes for multiple anchor boxes, the rigid motion decomposition is obtained for the whole scene. Furthermore, we developed a novel 3D scene flow data augmentation method for global and local motion. By perfectly synthesizing target point clouds based on augmented motion parameters, we easily obtain lots of 3D scene flow labels in point clouds highly consistent with real scenarios. On multiple real-world datasets including LiDAR KITTI, nuScenes, and Argoverse, our method outperforms all previous supervised and unsupervised methods without requiring manual labelling. Impressively, our method achieves a tenfold reduction in EPE3D metric on the LiDAR KITTI dataset, reducing it from $0.190m$ to a mere $0.008m$ error.