title: SST-GCN: The Sequential based Spatio-Temporal Graph Convolutional networks for Minute-level and Road-level Traffic Accident Risk Prediction

abstract: Traffic accidents are recognized as a major social issue worldwide, causing numerous injuries and significant costs annually. Consequently, methods for predicting and preventing traffic accidents have been researched for many years. With advancements in the field of artificial intelligence, various studies have applied Machine Learning and Deep Learning techniques to traffic accident prediction. Modern traffic conditions change rapidly by the minute, and these changes vary significantly across different roads. In other words, the risk of traffic accidents changes minute by minute in various patterns for each road. Therefore, it is desirable to predict traffic accident risk at the Minute-Level and Road-Level. However, because roads have close and complex relationships with adjacent roads, research on predicting traffic accidents at the Minute-Level and Road-Level is challenging. Thus, it is essential to build a model that can reflect the spatial and temporal characteristics of roads for traffic accident prediction. Consequently, recent attempts have been made to use Graph Convolutional Networks to capture the spatial characteristics of roads and Recurrent Neural Networks to capture their temporal characteristics for predicting traffic accident risk. This paper proposes the Sequential based Spatio-Temporal Graph Convolutional Networks (SST-GCN), which combines GCN and LSTM, to predict traffic accidents at the Minute-Level and Road-Level using a road dataset constructed in Seoul, the capital of South Korea. Experiments have demonstrated that SST-GCN outperforms other state-of-the-art models in Minute-Level predictions.


title: A constant rank theorem for special Lagrangian equations

abstract: Constant rank theorems are obtained for saddle solutions to the special Lagrangian equation and the quadratic Hessian equation. The argument also leads to Liouville type results for the special Lagrangian equation with subcritical phase, matching the known rigidity results for semiconvex entire solutions to the quadratic Hessian equation.


title: Metric Reconstruction in Kerr Spacetime

abstract: Metric reconstruction is the general problem of parameterizing GR in terms of its two ``true degrees of freedom'', e.g., by a complex scalar ``potential'' -- in practice mostly with the aim of simplifying the Einstein equation (EE) within perturbative approaches. In this paper, we re-analyze the metric reconstruction procedure by Green, Hollands, and Zimmerman (GHZ) [Class. Quant. Grav. \textbf{37}, 075001 (2020)], which is a generalization of the Chrzanowski-Cohen-Kegeles (CCK) approach. Contrary to the CCK method, that by GHZ is applicable not only to the vacuum, but also to the sourced linearized Einstein equation (EE). Our main innovation is a version of the GHZ method giving an efficient integration scheme for the initial value problem of the sourced linear EE. By iteration, our scheme gives the metric to as high an order in perturbation theory around Kerr as one might wish, in principle. At each order, the metric perturbation is a sum of a corrector, obtained by solving a triangular system of transport equations, a reconstructed piece, obtained from a Hertz potential as in the CCK approach, and an algebraically special perturbation, determined by the ADM quantities. As a by-product, we determine the precise relations between the asymptotic tail of the Hertz potential in the GHZ and CCK schemes, and the quantities relevant for gravitational radiation, namely, the energy flux, news- and memory tensors, and their associated BMS-supertranslations. We also discuss ways of transforming the metric perturbation to Lorenz gauge.


title: BioBERT-based Deep Learning and Merged ChemProt-DrugProt for Enhanced Biomedical Relation Extraction

abstract: This paper presents a methodology for enhancing relation extraction from biomedical texts, focusing specifically on chemical-gene interactions. Leveraging the BioBERT model and a multi-layer fully connected network architecture, our approach integrates the ChemProt and DrugProt datasets using a novel merging strategy. Through extensive experimentation, we demonstrate significant performance improvements, particularly in CPR groups shared between the datasets. The findings underscore the importance of dataset merging in augmenting sample counts and improving model accuracy. Moreover, the study highlights the potential of automated information extraction in biomedical research and clinical practice.


title: Track Initialization and Re-Identification for~3D Multi-View Multi-Object Tracking

abstract: We propose a 3D multi-object tracking (MOT) solution using only 2D detections from monocular cameras, which automatically initiates/terminates tracks as well as resolves track appearance-reappearance and occlusions. Moreover, this approach does not require detector retraining when cameras are reconfigured but only the camera matrices of reconfigured cameras need to be updated. Our approach is based on a Bayesian multi-object formulation that integrates track initiation/termination, re-identification, occlusion handling, and data association into a single Bayes filtering recursion. However, the exact filter that utilizes all these functionalities is numerically intractable due to the exponentially growing number of terms in the (multi-object) filtering density, while existing approximations trade-off some of these functionalities for speed. To this end, we develop a more efficient approximation suitable for online MOT by incorporating object features and kinematics into the measurement model, which improves data association and subsequently reduces the number of terms. Specifically, we exploit the 2D detections and extracted features from multiple cameras to provide a better approximation of the multi-object filtering density to realize the track initiation/termination and re-identification functionalities. Further, incorporating a tractable geometric occlusion model based on 2D projections of 3D objects on the camera planes realizes the occlusion handling functionality of the filter. Evaluation of the proposed solution on challenging datasets demonstrates significant improvements and robustness when camera configurations change on-the-fly, compared to existing multi-view MOT solutions. The source code is publicly available at https://github.com/linh-gist/mv-glmb-ab.


title: Optimizaci\'on del sistema de iluminaci\'on y proyecci\'on para un sensor multiparam\'etrico acusto-\'optico

abstract: In previous works we presented a novel multiparametric sensor to simultaneously measure the refractive index and the speed of sound in a liquid by means of the acousto-optic effect. The sensor requires an illumination system that expands the laser beam so that it interacts effectively with the liquid under study. Also, a projection system is necessary in order to adequately capture the diffraction pattern at the cell exit. In this article, we present the optimization of the sensor illumination and projection system using the optical design computational tool Zemax OpticStudio. The considered range of refractive indices of the liquid samples is between 1.33 and 1.51. The results show a correct expansion of the incident beam on the cell, and the projection system achieves an image with very few aberrations and an adequate angular separation between the maxima of the diffraction pattern. Based on the resulting dimensions of the sensor after optimizing the illumination and projection system, we confirm that it is compact and portable.


title: Estimates for smooth Weyl sums on major arcs

abstract: We present estimates for smooth Weyl sums of use on sets of major arcs in applications of the Hardy-Littlewood method. In particular, we derive mean value estimates on major arcs for smooth Weyl sums of degree $k$ delivering essentially optimal bounds for moments of order $u$ whenever $u>2\lfloor k/2\rfloor +4$.


title: Actuators \`A La Mode: Modal Actuations for Soft Body Locomotion

abstract: Traditional character animation specializes in characters with a rigidly articulated skeleton and a bipedal/quadripedal morphology. This assumption simplifies many aspects for designing physically based animations, like locomotion, but comes with the price of excluding characters of arbitrary deformable geometries. To remedy this, our framework makes use of a spatio-temporal actuation subspace built off of the natural vibration modes of the character geometry. The resulting actuation is coupled to a reduced fast soft body simulation, allowing us to formulate a locomotion optimization problem that is tractable for a wide variety of high resolution deformable characters.


title: DTR-Bench: An in silico Environment and Benchmark Platform for Reinforcement Learning Based Dynamic Treatment Regime

abstract: Reinforcement learning (RL) has garnered increasing recognition for its potential to optimise dynamic treatment regimes (DTRs) in personalised medicine, particularly for drug dosage prescriptions and medication recommendations. However, a significant challenge persists: the absence of a unified framework for simulating diverse healthcare scenarios and a comprehensive analysis to benchmark the effectiveness of RL algorithms within these contexts. To address this gap, we introduce \textit{DTR-Bench}, a benchmarking platform comprising four distinct simulation environments tailored to common DTR applications, including cancer chemotherapy, radiotherapy, glucose management in diabetes, and sepsis treatment. We evaluate various state-of-the-art RL algorithms across these settings, particularly highlighting their performance amidst real-world challenges such as pharmacokinetic/pharmacodynamic (PK/PD) variability, noise, and missing data. Our experiments reveal varying degrees of performance degradation among RL algorithms in the presence of noise and patient variability, with some algorithms failing to converge. Additionally, we observe that using temporal observation representations does not consistently lead to improved performance in DTR settings. Our findings underscore the necessity of developing robust, adaptive RL algorithms capable of effectively managing these complexities to enhance patient-specific healthcare. We have open-sourced our benchmark and code at https://github.com/GilesLuo/DTR-Bench.


title: A better bound on blow-up rate for the superconformal semilinear wave equation

abstract: We consider the semilinear wave equation in higher dimensions with superconformal power nonlinearity. The purpose of this paper is to give a new upper bound on the blow-up rate in some space-time integral, showing a $|\log(T-t)|^q$ improvement in comparison with previous results obtained in \cite{HZdcds13,KSVsurc12}.


title: A semilinear problem associated to the space-time fractional heat equation in $\mathbb{R}^N$

abstract: We study the fully nonlocal semilinear equation $\partial_t^\alpha u+(-\Delta)^\beta u=|u|^{p-1}u$, $p\ge1$, where $\partial_t^\alpha$ stands for the Caputo derivative of order $\alpha\in (0,1)$ and $(-\Delta)^\beta$, $\beta\in(0,1]$, is the usual $\beta$ power of the Laplacian. We prescribe an initial datum in $L^q(\mathbb{R}^N)$. We give conditions ensuring the existence and uniqueness of a solution living in $L^q(\mathbb{R}^N)$ up to a maximal existence time $T$ that may be finite or infinite. If~$T$ is finite, the $L^q$ norm of the solution becomes unbounded as time approaches $T$, and $u$ is said to blow up in $L^q$. Otherwise, the solution is global in time. For the case of nonnegative and nontrivial solutions, we give conditions on the initial datum that ensure either blow-up or global existence. It turns out that every nonnegative nontrivial solution in $L^q$ blows up in finite time if $1<p<p_f:=1+\frac{2\beta}N$ whereas if $p\ge p_f$ there are both solutions that blow up and global ones. The critical exponent $p_f$, which does not depend on $\alpha$, coincides with the Fujita exponent for the case $\alpha=1$, in which the time derivative is the standard (local) one. In contrast to the case $\alpha=1$, when $\alpha\in(0,1)$ the critical exponent $p=p_f$ falls within the situation in which global existence may occur. Our weakest condition for global existence and our condition for blow-up are both related to the size of the mean value of the initial datum in large balls.


title: GLOCON Database: Design Decisions and User Manual (v1.0)

abstract: GLOCON is a database of contentious events automatically extracted from national news sources from various countries in multiple languages. National news sources are utilized, and complete news archives are processed to create an event list for each source. Automation is achieved using a gold standard corpus sampled randomly from complete news archives (Y\"or\"uk et al. 2022) and all annotated by at least two domain experts based on the event definition provided in Duru\c{s}an et al. (2022).


title: Augmented Physics: A Machine Learning-Powered Tool for Creating Interactive Physics Simulations from Static Diagrams

abstract: We introduce Augmented Physics, a machine learning-powered tool designed for creating interactive physics simulations from static textbook diagrams. Leveraging computer vision techniques, such as Segment Anything and OpenCV, our web-based system enables users to semi-automatically extract diagrams from physics textbooks and then generate interactive simulations based on the extracted content. These interactive diagrams are seamlessly integrated into scanned textbook pages, facilitating interactive and personalized learning experiences across various physics concepts, including gravity, optics, circuits, and kinematics. Drawing on an elicitation study with seven physics instructors, we explore four key augmentation techniques: 1) augmented experiments, 2) animated diagrams, 3) bi-directional manipulatives, and 4) parameter visualization. We evaluate our system through technical evaluation, a usability study (N=12), and expert interviews (N=12). The study findings suggest that our system can facilitate more engaging and personalized learning experiences in physics education.


title: An Algorithm for the Euclidean Bounded Multiple Traveling Salesman Problem

abstract: In the Bounded Multiple Traveling Salesman Problem (BMTSP), a tour for each salesman, that starts and ends at the depot and that respects the bounds on the number of cities that a feasible salesman tour should satisfy, is to be constructed. The objective is to minimize the total length of all tours. Already Euclidean traveling salesman problem is NP-hard. We propose a 3-Phase heuristic algorithm for the Euclidean BMTSP. We tested the algorithm for the 22 benchmark instances and 168 new problem instances that we created. We report 19 best known solutions for the 22 benchmark instances including the 12 largest ones. For the newly created instances, we compared the performance of our algorithm with that of an ILP-solver CPLEX, which was able to construct a feasible solution for 71% of the instances within the time limit of two hours imposed by us. For about 10% of the smallest new instances, CPLEX delivered slightly better solutions, where our algorithm took less than 180 seconds for the largest of these instances. For the remaining 61% of the instances solved by CPLEX, the solutions by our heuristic were, on average, about 21.5% better than those obtained by CPLEX.


title: Wavelet-Based Image Tokenizer for Vision Transformers

abstract: Non-overlapping patch-wise convolution is the default image tokenizer for all state-of-the-art vision Transformer (ViT) models. Even though many ViT variants have been proposed to improve its efficiency and accuracy, little research on improving the image tokenizer itself has been reported in the literature. In this paper, we propose a new image tokenizer based on wavelet transformation. We show that ViT models with the new tokenizer achieve both higher training throughput and better top-1 precision for the ImageNet validation set. We present a theoretical analysis on why the proposed tokenizer improves the training throughput without any change to ViT model architecture. Our analysis suggests that the new tokenizer can effectively handle high-resolution images and is naturally resistant to adversarial attack. Furthermore, the proposed image tokenizer offers a fresh perspective on important new research directions for ViT-based model design, such as image tokens on a non-uniform grid for image understanding.


title: Unraveling the Spin-to-Charge Current Conversion Mechanism and Charge Transfer Dynamics at Interface of Graphene/WS$_2$ Heterostructures at Room Temperature

abstract: We report experimental investigations of spin-to-charge current conversion and charge transfer dynamics (CT) at the interface of graphene/WS$_2$ van der Waals heterostructure. Pure spin current was produced by the spin precession in the microwave-driven ferromagnetic resonance of a permalloy film (Py-Ni$_{81}$Fe$_{19}$) and injected into the graphene/WS$_2$ heterostructure through the spin pumping process. The observed spin-to-charge current conversion in the heterostructure is attributed to inverse Rashba-Edelstein effect (IREE) at the graphene/WS$_2$ interface. Interfacial CT dynamics in this heterostructure was investigated based on the framework of core-hole-clock (CHC) approach. The results obtained from spin pumping and CHC studies show that the spin-to-charge current conversion and charge transfer process are more efficient in the graphene/WS$_2$ heterostructure compared to isolated WS2 and graphene films. The results show that the presence of WS$_2$ flakes improves the current conversion efficiency. These experimental results are corroborated by density functional theory (DFT) calculations, which reveal (i) Rashba spin-orbit splitting of graphene orbitals and (ii) electronic coupling between graphene and WS$_2$ orbitals. This study provides valuable insights for optimizing the design and performance of spintronic devices.


title: Reanalyzing the Light Curves and Absolute Parameters of Twenty Contact Binary Stars Using TESS Data

abstract: Reanalyzing contact binaries with space-based photometric data and investigating possible parameter changes can yield accurate samples for theoretical studies. We investigated light curve solutions and fundamental parameters for twenty contact binary systems. The most recent Transiting Exoplanet Survey Satellite (TESS) data is used to analyze. The target systems in the investigation have an orbital period of less than 0.58 days. Light curve solutions were performed using the PHysics Of Eclipsing BinariEs (PHOEBE) Python code version 2.4.9. The results show that systems had various mass ratios from q=0.149 to q=3.915, fillout factors from f=0.072 to f=0.566, and inclinations from i=52.8deg to i=87.3deg. The effective temperature of the stars was less than 7016 K, which was expected given the features of most contact binary stars. Twelve of the target systems' light curves were asymmetrical in the maxima, showing the O'Connell effect, and a starspot was required for light curve solutions. The estimation of the absolute parameters of the binary systems was presented using the a-P empirical relationship and discussed. The orbital angular momentum (J_0) of the systems was calculated. The positions of the systems were also depicted on the M-L, M-R, q-L_ratio, M_tot-J_0, and T-M diagrams.


title: Stability of the Rao-Nakra sandwich beam with a dissipation of fractional derivative type: theoretical and numerical study

abstract: This paper is devoted to the solution and stability of a one-dimensional model depicting Rao--Nakra sandwich beams, incorporating damping terms characterized by fractional derivative types within the domain, specifically a generalized Caputo derivative with exponential weight. To address existence, uniqueness, stability, and numerical results, fractional derivatives are substituted by diffusion equations relative to a new independent variable, $\xi$, resulting in an augmented model with a dissipative semigroup operator. Polynomial decay of energy is achieved, with a decay rate depending on the fractional derivative parameters. Both the polynomial decay and its dependency on the parameters of the generalized Caputo derivative are numerically validated. To this end, an energy-conserving finite difference numerical scheme is employed.


title: RealitySummary: On-Demand Mixed Reality Document Enhancement using Large Language Models

abstract: We introduce RealitySummary, a mixed reality reading assistant that can enhance any printed or digital document using on-demand text extraction, summarization, and augmentation. While augmented reading tools promise to enhance physical reading experiences with overlaid digital content, prior systems have typically required pre-processed documents, which limits their generalizability and real-world use cases. In this paper, we explore on-demand document augmentation by leveraging large language models. To understand generalizable techniques for diverse documents, we first conducted an exploratory design study which identified five categories of document enhancements (summarization, augmentation, navigation, comparison, and extraction). Based on this, we developed a proof-of-concept system that can automatically extract and summarize text using Google Cloud OCR and GPT-4, then embed information around documents using a Microsoft Hololens 2 and Apple Vision Pro. We demonstrate real-time examples of six specific document augmentations: 1) summaries, 2) comparison tables, 3) timelines, 4) keyword lists, 5) summary highlighting, and 6) information cards. Results from a usability study (N=12) and in-the-wild study (N=11) highlight the potential benefits of on-demand MR document enhancement and opportunities for future research.


title: Multi-Armed Bandits with Network Interference

abstract: Online experimentation with interference is a common challenge in modern applications such as e-commerce and adaptive clinical trials in medicine. For example, in online marketplaces, the revenue of a good depends on discounts applied to competing goods. Statistical inference with interference is widely studied in the offline setting, but far less is known about how to adaptively assign treatments to minimize regret. We address this gap by studying a multi-armed bandit (MAB) problem where a learner (e-commerce platform) sequentially assigns one of possible $\mathcal{A}$ actions (discounts) to $N$ units (goods) over $T$ rounds to minimize regret (maximize revenue). Unlike traditional MAB problems, the reward of each unit depends on the treatments assigned to other units, i.e., there is interference across the underlying network of units. With $\mathcal{A}$ actions and $N$ units, minimizing regret is combinatorially difficult since the action space grows as $\mathcal{A}^N$. To overcome this issue, we study a sparse network interference model, where the reward of a unit is only affected by the treatments assigned to $s$ neighboring units. We use tools from discrete Fourier analysis to develop a sparse linear representation of the unit-specific reward $r_n: [\mathcal{A}]^N \rightarrow \mathbb{R} $, and propose simple, linear regression-based algorithms to minimize regret. Importantly, our algorithms achieve provably low regret both when the learner observes the interference neighborhood for all units and when it is unknown. This significantly generalizes other works on this topic which impose strict conditions on the strength of interference on a known network, and also compare regret to a markedly weaker optimal action. Empirically, we corroborate our theoretical findings via numerical simulations.


title: Biclustering a dataset using photonic quantum computing

abstract: Biclustering is a problem in machine learning and data mining that seeks to group together rows and columns of a dataset according to certain criteria. In this work, we highlight the natural relation that quantum computing models like boson and Gaussian boson sampling (GBS) have to this problem. We first explore the use of boson sampling to identify biclusters based on matrix permanents. We then propose a heuristic that finds clusters in a dataset using Gaussian boson sampling by (i) converting the dataset into a bipartite graph and then (ii) running GBS to find the densest sub-graph(s) within the larger bipartite graph. Our simulations for the above proposed heuristics show promising results for future exploration in this area.


title: I See You: Teacher Analytics with GPT-4 Vision-Powered Observational Assessment

abstract: This preliminary study explores the integration of GPT-4 Vision (GPT-4V) technology into teacher analytics, focusing on its applicability in observational assessment to enhance reflective teaching practice. This research is grounded in developing a Video-based Automatic Assessment System (VidAAS) empowered by GPT-4V. Our approach aims to revolutionize teachers' assessment of students' practices by leveraging Generative Artificial Intelligence (GenAI) to offer detailed insights into classroom dynamics. Our research methodology encompasses a comprehensive literature review, prototype development of the VidAAS, and usability testing with in-service teachers. The study findings provide future research avenues for VidAAS design, implementation, and integration in teacher analytics, underscoring the potential of GPT-4V to provide real-time, scalable feedback and a deeper understanding of the classroom.


title: Enhancing IoT Security with CNN and LSTM-Based Intrusion Detection Systems

abstract: Protecting Internet of things (IoT) devices against cyber attacks is imperative owing to inherent security vulnerabilities. These vulnerabilities can include a spectrum of sophisticated attacks that pose significant damage to both individuals and organizations. Employing robust security measures like intrusion detection systems (IDSs) is essential to solve these problems and protect IoT systems from such attacks. In this context, our proposed IDS model consists on a combination of convolutional neural network (CNN) and long short-term memory (LSTM) deep learning (DL) models. This fusion facilitates the detection and classification of IoT traffic into binary categories, benign and malicious activities by leveraging the spatial feature extraction capabilities of CNN for pattern recognition and the sequential memory retention of LSTM for discerning complex temporal dependencies in achieving enhanced accuracy and efficiency. In assessing the performance of our proposed model, the authors employed the new CICIoT2023 dataset for both training and final testing, while further validating the model's performance through a conclusive testing phase utilizing the CICIDS2017 dataset. Our proposed model achieves an accuracy rate of 98.42%, accompanied by a minimal loss of 0.0275. False positive rate(FPR) is equally important, reaching 9.17% with an F1-score of 98.57%. These results demonstrate the effectiveness of our proposed CNN-LSTM IDS model in fortifying IoT environments against potential cyber threats.


title: Higher Gauge Theory and Integrability

abstract: In recent years, significant progress has been made in the study of integrable systems from a gauge theoretic perspective. This development originated with the introduction of $4$d Chern-Simons theory with defects, which provided a systematic framework for constructing two-dimensional integrable systems. In this article, we propose a novel approach to studying higher-dimensional integrable models employing techniques from higher category theory. Starting with higher Chern-Simons theory on the $4$-manifold $\mathbb{R}\times Y$, we complexify and compactify the real line to $\mathbb{C}P^1$ and introduce the disorder defect $\omega=z^{-1}\mathrm{d} z $. This procedure defines a holomorphic five-dimensional variant of higher Chern-Simons theory, which, when endowed with suitable boundary conditions, allows for the localisation to a three-dimensional theory on $Y$. The equations of motion of the resulting model are equivalent to the flatness of a $2$-connection $(L,H)$, that we then use to construct the corresponding higher holonomies. We prove that these are invariants of homotopies relative boundary, which enables the construction of conserved quantities. The latter are labelled by both the categorical characters of a Lie crossed-module and the infinite number of homotopy classes of surfaces relative boundary in $Y$. Moreover, we also demonstrate that the $3$d theory has left and right acting symmetries whose current algebra is given by an infinite dimensional centrally extended affine Lie 2-algebra. Both of these conditions are direct higher homotopy analogues of the properties satisfied by the 2d Wess-Zumino-Witten CFT, which we therefore interpret as facets of integrable structures.


title: Causal Contextual Bandits with Adaptive Context

abstract: We study a variant of causal contextual bandits where the context is chosen based on an initial intervention chosen by the learner. At the beginning of each round, the learner selects an initial action, depending on which a stochastic context is revealed by the environment. Following this, the learner then selects a final action and receives a reward. Given $T$ rounds of interactions with the environment, the objective of the learner is to learn a policy (of selecting the initial and the final action) with maximum expected reward. In this paper we study the specific situation where every action corresponds to intervening on a node in some known causal graph. We extend prior work from the deterministic context setting to obtain simple regret minimization guarantees. This is achieved through an instance-dependent causal parameter, $\lambda$, which characterizes our upper bound. Furthermore, we prove that our simple regret is essentially tight for a large class of instances. A key feature of our work is that we use convex optimization to address the bandit exploration problem. We also conduct experiments to validate our theoretical results, and release our code at our project GitHub repository: https://github.com/adaptiveContextualCausalBandits/aCCB.


title: PureGen: Universal Data Purification for Train-Time Poison Defense via Generative Model Dynamics

abstract: Train-time data poisoning attacks threaten machine learning models by introducing adversarial examples during training, leading to misclassification. Current defense methods often reduce generalization performance, are attack-specific, and impose significant training overhead. To address this, we introduce a set of universal data purification methods using a stochastic transform, $\Psi(x)$, realized via iterative Langevin dynamics of Energy-Based Models (EBMs), Denoising Diffusion Probabilistic Models (DDPMs), or both. These approaches purify poisoned data with minimal impact on classifier generalization. Our specially trained EBMs and DDPMs provide state-of-the-art defense against various attacks (including Narcissus, Bullseye Polytope, Gradient Matching) on CIFAR-10, Tiny-ImageNet, and CINIC-10, without needing attack or classifier-specific information. We discuss performance trade-offs and show that our methods remain highly effective even with poisoned or distributionally shifted generative model training data.


title: Hardware-Aware Parallel Prompt Decoding for Memory-Efficient Acceleration of LLM Inference

abstract: The auto-regressive decoding of Large Language Models (LLMs) results in significant overheads in their hardware performance. While recent research has investigated various speculative decoding techniques for multi-token generation, these efforts have primarily focused on improving processing speed such as throughput. Crucially, they often neglect other metrics essential for real-life deployments, such as memory consumption and training cost. To overcome these limitations, we propose a novel parallel prompt decoding that requires only $0.0002$% trainable parameters, enabling efficient training on a single A100-40GB GPU in just 16 hours. Inspired by the human natural language generation process, $PPD$ approximates outputs generated at future timesteps in parallel by using multiple prompt tokens. This approach partially recovers the missing conditional dependency information necessary for multi-token generation, resulting in up to a 28% higher acceptance rate for long-range predictions. Furthermore, we present a hardware-aware dynamic sparse tree technique that adaptively optimizes this decoding scheme to fully leverage the computational capacities on different GPUs. Through extensive experiments across LLMs ranging from MobileLlama to Vicuna-13B on a wide range of benchmarks, our approach demonstrates up to 2.49$\times$ speedup and maintains a minimal runtime memory overhead of just $0.0004$%. More importantly, our parallel prompt decoding can serve as an orthogonal optimization for synergistic integration with existing speculative decoding, showing up to $1.22\times$ further speed improvement. Our code is available at https://github.com/hmarkc/parallel-prompt-decoding.


title: Structure and magnetic properties of (Fe2O3)n clusters (n = 1-5)

abstract: Global minimum structures of neutral (Fe2O3)n clusters with n = 1-5 were determined employing the genetic algorithm in combination with ab initio parameterized interatomic potentials and subsequent refinement at the density functional theory level. Systematic investigations of magnetic configurations of the clusters using a broken symmetry approach reveal antiferromagnetic and ferrimagnetic ground states. Whereas (Fe2O3)n clusters with n = 2-5 contain exclusively Fe3+, Fe2O3 was found to be a special case formally containing both Fe2+ and Fe3+. Calculated magnetic coupling constants revealed predominantly strong antiferromagnetic interactions, which exceed bulk values found in hematite. The precise magnetization (spin) state of the clusters has only small influence on their geometric structure. Starting from n = 4 also the relative energies of different cluster isomers are only weakly influenced by their magnetic configuration. These findings are important for simulations of larger (Fe2O3)n clusters and nanoparticles.


title: A linear bound for the size of the finite terminal assembly of a directed non-cooperative tile assembly system

abstract: The abstract tile assembly model (aTam) is a model of DNA self-assembly. Most of the studies focus on cooperative aTam where a form of synchronization between the tiles is possible. Simulating Turing machines is achievable in this context. Few results and constructions are known for the non-cooperative case (a variant of Wang tilings where assemblies do not need to cover the whole plane and some mismatches may occur). Introduced by P.E. Meunier and D. Regnault, efficient paths are a non-trivial construction for non-cooperative aTam. These paths of width nlog(n) are designed with n different tile types. Assembling them relies heavily on a form of ``non-determinism''. Indeed, the set of tiles may produced different finite terminal assemblies but they all contain the same efficient path. Directed non-cooperative aTam does not allow this non-determinism as only one assembly may be produced by a tile assembly system. This variant of aTam is the only one who was shown to be decidable. In this paper, we show that if the terminal assembly of a directed non-cooperative tile assembly system is finite then its width and length are of linear size according to the size of the tile assembly system. This result implies that the construction of efficient paths cannot be generalized to the directed case and that some computation must rely on a competition between different paths. It also implies that the construction of a square of width n using 2n-1 tiles types is asymptotically optimal. Moreover, we hope that the techniques introduced here will lead to a better comprehension of the non-directed case.


title: Semi-classical imprints on quasinormal mode spectra

abstract: We compute quasinormal mode frequencies for static limits of physical black holes -- semi-classical black hole solutions to Einstein-Hilbert gravity characterized by the finite formation time of an apparent horizon and its weak regularity. These assumptions lead to a highly constrained yet non-trivial form of the metric and components of the energy-momentum tensor near the horizon, which contain as a special case many known models of black holes. Using a two-point M-fraction approximation to construct an interpolating metric which captures the essential near-horizon and asymptotic properties of black holes, we explore a large part of the parameter space that characterizes the near-horizon geometry. We cast the perturbation problem as a discretized homogeneous eigensystem and compute the low-lying quasinormal mode frequencies for perturbations of a massless scalar field. Working in spherical symmetry, we provide rough constraints on leading and subleading deviations from the Schwarzschild solution which arise in a semi-classical setting, and demonstrate the potential for mimicking signatures of axially-symmetric geometries from a spherically-symmetric source.


title: Large Language Models as Partners in Student Essay Evaluation

abstract: As the importance of comprehensive evaluation in workshop courses increases, there is a growing demand for efficient and fair assessment methods that reduce the workload for faculty members. This paper presents an evaluation conducted with Large Language Models (LLMs) using actual student essays in three scenarios: 1) without providing guidance such as rubrics, 2) with pre-specified rubrics, and 3) through pairwise comparison of essays. Quantitative analysis of the results revealed a strong correlation between LLM and faculty member assessments in the pairwise comparison scenario with pre-specified rubrics, although concerns about the quality and stability of evaluations remained. Therefore, we conducted a qualitative analysis of LLM assessment comments, showing that: 1) LLMs can match the assessment capabilities of faculty members, 2) variations in LLM assessments should be interpreted as diversity rather than confusion, and 3) assessments by humans and LLMs can differ and complement each other. In conclusion, this paper suggests that LLMs should not be seen merely as assistants to faculty members but as partners in evaluation committees and outlines directions for further research.


title: Battery Degradation Heuristics for Predictive Energy Management in Shipboard Power Systems

abstract: The presence of Pulse Power Loads (PPLs) in the Notional Shipboard Power System (SPS) presents a challenge in the form of meeting their high ramp rate requirements. Considering the ramp rate limitations on the generators, this might hinder the power flow in the grid. Failure to meet the ramp rate requirements might cause instability. Aggregating generators with energy storage elements usually addresses the ramp requirements while ensuring the power demand is achieved. This paper proposes an energy management strategy that adaptively splits the power demand between the generators and the batteries while simultaneously considering the battery degradation and the generator's efficient operation. Since it is challenging to incorporate the battery degradation model directly into the optimization problem due to its complex structure and the degradation time scale which is not practical for real-time implementation, two reasonable heuristics in terms of minimizing the absolute battery power and minimizing the battery state of charge are proposed and compared to manage the battery degradation. A model predictive energy management strategy is then developed to coordinate the power split considering the generator efficiency and minimizing the battery degradation based on the two heuristic approaches. The designed strategy is tested via a simulation of a lumped notional shipboard power system. The results show the impact of the battery degradation heuristics for energy management strategy in mitigating battery degradation and its health management.


title: A Theoretical Understanding of Self-Correction through In-context Alignment

abstract: Going beyond mimicking limited human experiences, recent studies show initial evidence that, like humans, large language models (LLMs) are capable of improving their abilities purely by self-correction, i.e., correcting previous responses through self-examination, in certain circumstances. Nevertheless, little is known about how such capabilities arise. In this work, based on a simplified setup akin to an alignment task, we theoretically analyze self-correction from an in-context learning perspective, showing that when LLMs give relatively accurate self-examinations as rewards, they are capable of refining responses in an in-context way. Notably, going beyond previous theories on over-simplified linear transformers, our theoretical construction underpins the roles of several key designs of realistic transformers for self-correction: softmax attention, multi-head attention, and the MLP block. We validate these findings extensively on synthetic datasets. Inspired by these findings, we also illustrate novel applications of self-correction, such as defending against LLM jailbreaks, where a simple self-correction step does make a large difference. We believe that these findings will inspire further research on understanding, exploiting, and enhancing self-correction for building better foundation models.


title: When and How Does In-Distribution Label Help Out-of-Distribution Detection?

abstract: Detecting data points deviating from the training distribution is pivotal for ensuring reliable machine learning. Extensive research has been dedicated to the challenge, spanning classical anomaly detection techniques to contemporary out-of-distribution (OOD) detection approaches. While OOD detection commonly relies on supervised learning from a labeled in-distribution (ID) dataset, anomaly detection may treat the entire ID data as a single class and disregard ID labels. This fundamental distinction raises a significant question that has yet to be rigorously explored: when and how does ID label help OOD detection? This paper bridges this gap by offering a formal understanding to theoretically delineate the impact of ID labels on OOD detection. We employ a graph-theoretic approach, rigorously analyzing the separability of ID data from OOD data in a closed-form manner. Key to our approach is the characterization of data representations through spectral decomposition on the graph. Leveraging these representations, we establish a provable error bound that compares the OOD detection performance with and without ID labels, unveiling conditions for achieving enhanced OOD detection. Lastly, we present empirical results on both simulated and real datasets, validating theoretical guarantees and reinforcing our insights. Code is publicly available at https://github.com/deeplearning-wisc/id_label.


title: ChatGPT as the Marketplace of Ideas: Should Truth-Seeking Be the Goal of AI Content Governance?

abstract: As one of the most enduring metaphors within legal discourse, the marketplace of ideas has wielded considerable influence over the jurisprudential landscape for decades. A century after the inception of this theory, ChatGPT emerged as a revolutionary technological advancement in the twenty-first century. This research finds that ChatGPT effectively manifests the marketplace metaphor. It not only instantiates the promises envisaged by generations of legal scholars but also lays bare the perils discerned through sustained academic critique. Specifically, the workings of ChatGPT and the marketplace of ideas theory exhibit at least four common features: arena, means, objectives, and flaws. These shared attributes are sufficient to render ChatGPT historically the most qualified engine for actualizing the marketplace of ideas theory. The comparison of the marketplace theory and ChatGPT merely marks a starting point. A more meaningful undertaking entails reevaluating and reframing both internal and external AI policies by referring to the accumulated experience, insights, and suggestions researchers have raised to fix the marketplace theory. Here, a pivotal issue is: should truth-seeking be set as the goal of AI content governance? Given the unattainability of the absolute truth-seeking goal, I argue against adopting zero-risk policies. Instead, a more judicious approach would be to embrace a knowledge-based alternative wherein large language models (LLMs) are trained to generate competing and divergent viewpoints based on sufficient justifications. This research also argues that so-called AI content risks are not created by AI companies but are inherent in the entire information ecosystem. Thus, the burden of managing these risks should be distributed among different social actors, rather than being solely shouldered by chatbot companies.


title: Structure evolution of nanoparticulate Fe2O3

abstract: The atomic structure and properties of nanoparticulate Fe2O3 are characterized starting from its smallest Fe2O3 building unit through (Fe2O3)n clusters to nanometer-sized Fe2O3 particles. This is achieved by combining global structure optimizations at the density functional theory level, molecular dynamics simulations by employing tailored, ab initio parameterized interatomic potential functions and experiments. With the exception of nearly tetrahedral, adamantane-like (Fe2O3)2 small (Fe2O3)n clusters assume compact, virtually amorphous structures with little or no symmetry. For n = 2-5 (Fe2O3)n clusters consist mainly of two- and three-membered Fe-O rings. Starting from n = 5 they increasingly assume tetrahedral shape with the adamantane-like (Fe2O3)2 unit as the main building block. However, the small energy differences between different isomers of the same cluster-size make precise structural assignment for larger (Fe2O3)n clusters difficult. The tetrahedral morphology persists for Fe2O3 nanoparticles with up to 3 nm in diameter. Simulated crystallization of larger nanoparticles with diameters of about 5 nm demonstrates pronounced melting point depression and leads to formation of {\epsilon}-Fe2O3 single crystals with hexagonal morphology. This finding is in excellent agreement with the results obtained for Fe2O3 nanopowders generated by laser vaporization and provides the first direct indication that {\epsilon}-Fe2O3 may be thermodynamically the most stable phase in this size regime.


title: ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models

abstract: In this position paper, we argue that human evaluation of generative large language models (LLMs) should be a multidisciplinary undertaking that draws upon insights from disciplines such as user experience research and human behavioral psychology to ensure that the experimental design and results are reliable. The conclusions from these evaluations, thus, must consider factors such as usability, aesthetics, and cognitive biases. We highlight how cognitive biases can conflate fluent information and truthfulness, and how cognitive uncertainty affects the reliability of rating scores such as Likert. Furthermore, the evaluation should differentiate the capabilities and weaknesses of increasingly powerful large language models -- which requires effective test sets. The scalability of human evaluation is also crucial to wider adoption. Hence, to design an effective human evaluation system in the age of generative NLP, we propose the ConSiDERS-The-Human evaluation framework consisting of 6 pillars --Consistency, Scoring Critera, Differentiating, User Experience, Responsible, and Scalability.


title: Improving Speech Decoding from ECoG with Self-Supervised Pretraining

abstract: Recent work on intracranial brain-machine interfaces has demonstrated that spoken speech can be decoded with high accuracy, essentially by treating the problem as an instance of supervised learning and training deep neural networks to map from neural activity to text. However, such networks pay for their expressiveness with very large numbers of labeled data, a requirement that is particularly burdensome for invasive neural recordings acquired from human patients. On the other hand, these patients typically produce speech outside of the experimental blocks used for training decoders. Making use of such data, and data from other patients, to improve decoding would ease the burden of data collection -- especially onerous for dys- and anarthric patients. Here we demonstrate that this is possible, by reengineering wav2vec -- a simple, self-supervised, fully convolutional model that learns latent representations of audio using a noise-contrastive loss -- for electrocorticographic (ECoG) data. We train this model on unlabelled ECoG recordings, and subsequently use it to transform ECoG from labeled speech sessions into wav2vec's representation space, before finally training a supervised encoder-decoder to map these representations to text. We experiment with various numbers of labeled blocks; for almost all choices, the new representations yield superior decoding performance to the original ECoG data, and in no cases do they yield worse. Performance can also be improved in some cases by pretraining wav2vec on another patient's data. In the best cases, wav2vec's representations decrease word error rates over the original data by upwards of 50%.


title: Life on a closed timelike curve

abstract: We study the internal dynamics of a hypothetical spaceship traveling on a close timelike curve in a G\"{o}del-type universe. We choose the curve so that the generator of evolution in proper time is the angular momentum. Using Wigner's theorem, we prove that the energy levels internal to the spaceship must undergo spontaneous discretization. The level separation turns out to be finely tuned so that, after completing a roundtrip of the curve, all systems are back to their initial state. This implies, for example, that the memories of an observer inside the spaceship are necessarily erased by the end of the journey. More in general, if there is an increase in entropy, a Poincar\'{e} cycle will eventually reverse it by the end of the loop, forcing entropy to decrease back to its initial value. We show that such decrease in entropy is in agreement with the eigenstate thermalization hypothesis. The non-existence of time-travel paradoxes follows as a rigorous corollary of our analysis.


title: Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning

abstract: Recent studies show that Large Language Models (LLMs) with safety alignment can be jail-broken by fine-tuning on a dataset mixed with harmful data. First time in the literature, we show that the jail-broken effect can be mitigated by separating states in the finetuning stage to optimize the alignment and user datasets. Unfortunately, our subsequent study shows that this simple Bi-State Optimization (BSO) solution experiences convergence instability when steps invested in its alignment state is too small, leading to downgraded alignment performance. By statistical analysis, we show that the \textit{excess drift} towards consensus could be a probable reason for the instability. To remedy this issue, we propose \textbf{L}azy(\textbf{i}) \textbf{s}afety \textbf{a}lignment (\textbf{Lisa}), which introduces a proximal term to constraint the drift of each state. Theoretically, the benefit of the proximal term is supported by the convergence analysis, wherein we show that a sufficient large proximal factor is necessary to guarantee Lisa's convergence. Empirically, our results on four downstream finetuning tasks show that Lisa with a proximal term can significantly increase alignment performance while maintaining the LLM's accuracy on the user tasks. Code is available at \url{https://github.com/git-disl/Lisa}.


title: JADS: A Framework for Self-supervised Joint Aspect Discovery and Summarization

abstract: To generate summaries that include multiple aspects or topics for text documents, most approaches use clustering or topic modeling to group relevant sentences and then generate a summary for each group. These approaches struggle to optimize the summarization and clustering algorithms jointly. On the other hand, aspect-based summarization requires known aspects. Our solution integrates topic discovery and summarization into a single step. Given text data, our Joint Aspect Discovery and Summarization algorithm (JADS) discovers aspects from the input and generates a summary of the topics, in one step. We propose a self-supervised framework that creates a labeled dataset by first mixing sentences from multiple documents (e.g., CNN/DailyMail articles) as the input and then uses the article summaries from the mixture as the labels. The JADS model outperforms the two-step baselines. With pretraining, the model achieves better performance and stability. Furthermore, embeddings derived from JADS exhibit superior clustering capabilities. Our proposed method achieves higher semantic alignment with ground truth and is factual.


title: Temperature-Dependent Chirality in Halide Perovskites

abstract: Using chiral organic cations in two-dimensional metal halide perovskites, chirality can be induced in the metal halide layers, which results in semiconductors with intriguing chiral optical and spin-selective transport properties. The chiral properties strongly depend on temperature, despite the basic crystal symmetry not changing fundamentally. We identify a set of descriptors that characterize the chirality of metal halide perovskites such as MBA$_{2}$PbI$_{4}$, and study their temperature dependence using molecular dynamics simulations with on-the-fly machine-learning force fields obtained from density functional theory calculations. We find that, whereas the organic cations remain chiral upon increasing the temperature, the inorganic framework loses this property more rapidly. We ascribe this to the breaking of hydrogen bonds that link the organic with the inorganic substructures, which leads to a loss of chirality transfer.


title: Chiral magnon-polaron edge states in Heisenberg-Kitaev magnets

abstract: The interplay of spin and lattice fluctuations in two-dimensional magnets without inversion symmetry is investigated. We find a general form for the magnetoelastic coupling between magnons and existing chiral phonons based on the symmetries of the crystalline lattice. We show that in hexagonal lattices, the coupling of magnons and chiral phonons derives from an anisotropic exchange spin model containing topological phases of magnons. Using the Heisenberg-Kitaev-$\Gamma$ model, we show how magnon-polaron edge states with circular polarization arise from this interaction. Our findings exploit the polarization degrees of freedom in spin-lattice systems, thus setting the ground for the transfer of angular momentum between chiral phonons and magnons.


title: Facets of module theory over semirings

abstract: We set up some basic module theory over semirings, with particular attention to scheme theory over semirings. We show that while not all the usual definitions of vector bundle agree over semirings, all the usual definitions of line bundle do agree. We also show that the narrow class group of a number field can be recovered as a reflexive Picard group of its subsemiring of totally nonnegative algebraic integers.


title: Thermodynamic compatibility of actives encapsulated into PEG-PLA nanoparticles: In Silico predictions and experimental verification

abstract: Achieving optimal solubility of active substances in polymeric carriers is of fundamental importance for a number of industrial applications, including targeted drug delivery within the growing field of nanomedicine. However, its experimental optimization using a trial-and-error approach is cumbersome and time-consuming. Here, an approach based on molecular dynamics (MD) simulations and the Flory-Huggins theory is proposed for rapid prediction of thermodynamic compatibility between active species and copolymers comprising hydrophilic and hydrophobic segments. In contrast to similar methods, our approach offers high computational efficiency by employing MD simulations that avoid explicit consideration of the actual copolymer chains. The accuracy of the method is demonstrated for compatibility predictions between pyrene and nile red as model dyes as well as indomethacin as model drug and copolymers containing blocks of poly(ethylene glycol) and poly(lactic acid) in different ratios. The results of the simulations are directly verified by comparison with the observed encapsulation efficiency of nanoparticles prepared by nanoprecipitation.


title: Prominent phonon transmission across aperiodic superlattice through coherent mode-conversion

abstract: In both particle and wave descriptions of phonons, the dense, aperiodically arranged interfaces in aperiodic superlattices are expected to strongly attenuate thermal transport due to phonon-interface scattering or broken long-range coherence. However, considerable thermal conductivity is still observed in these structures. In this study, we reveal that incoherent modes propagating in the aperiodic superlattice can convert, through interference, into coherent modes defined by an approximate dispersion relation. This conversion leads to high transmission across the aperiodic superlattice structure, which contains hundreds of interfaces, ultimately resulting in significant thermal conductivity. Such incoherent-to-coherent mode conversion behavior is extensively observed in periodic superlattices. This work suggests an effective strategy to manipulate the phonon band structure through layer patterning or material choice, enabling precise control of phonon transmission across aperiodic superlattices.


title: Fast characterization of optically detected magnetic resonance spectra via data clustering

abstract: Optically detected magnetic resonance (ODMR) has become a well-established and powerful technique for measuring the spin state of solid-state quantum emitters, at room temperature. Relying on spin-dependent recombination processes involving the emitters ground, excited and metastable states, ODMR is enabling spin-based quantum sensing of nanoscale electric and magnetic fields, temperature, strain and pressure, as well as imaging of individual electron and nuclear spins. Central to many of these sensing applications is the ability to reliably analyze ODMR data, as the resonance frequencies in these spectra map directly onto target physical quantities acting on the spin sensor. However, this can be onerous, as relatively long integration times -- from milliseconds up to tens of seconds -- are often needed to reach a signal-to-noise level suitable to determine said resonances using traditional fitting methods. Here, we present an algorithm based on data clustering that overcome this limitation and allows determining the resonance frequencies of ODMR spectra with better accuracy (~1.3x factor), higher resolution (~4.7x factor) and/or overall fewer data points (~5x factor) than standard approaches based on statistical inference. The proposed clustering algorithm (CA) is thus a powerful tool for many ODMR-based quantum sensing applications, especially when dealing with noisy and scarce data sets.


title: Training LLMs to Better Self-Debug and Explain Code

abstract: In the domain of code generation, self-debugging is crucial. It allows LLMs to refine their generated code based on execution feedback. This is particularly important because generating correct solutions in one attempt proves challenging for complex tasks. Prior works on self-debugging mostly focus on prompting methods by providing LLMs with few-shot examples, which work poorly on small open-sourced LLMs. In this work, we propose a training framework that significantly improves self-debugging capability of LLMs. Intuitively, we observe that a chain of explanations on the wrong code followed by code refinement helps LLMs better analyze the wrong code and do refinement. We thus propose an automated pipeline to collect a high-quality dataset for code explanation and refinement by generating a number of explanations and refinement trajectories and filtering via execution verification. We perform supervised fine-tuning (SFT) and further reinforcement learning (RL) on both success and failure trajectories with a novel reward design considering code explanation and refinement quality. SFT improves the pass@1 by up to 15.92% and pass@10 by 9.30% over four benchmarks. RL training brings additional up to 3.54% improvement on pass@1 and 2.55% improvement on pass@10. The trained LLMs show iterative refinement ability, and can keep refining code continuously. Lastly, our human evaluation shows that the LLMs trained with our framework generate more useful code explanations and help developers better understand bugs in source code.


title: Approximating Human Models During Argumentation-based Dialogues

abstract: Explainable AI Planning (XAIP) aims to develop AI agents that can effectively explain their decisions and actions to human users, fostering trust and facilitating human-AI collaboration. A key challenge in XAIP is model reconciliation, which seeks to align the mental models of AI agents and humans. While existing approaches often assume a known and deterministic human model, this simplification may not capture the complexities and uncertainties of real-world interactions. In this paper, we propose a novel framework that enables AI agents to learn and update a probabilistic human model through argumentation-based dialogues. Our approach incorporates trust-based and certainty-based update mechanisms, allowing the agent to refine its understanding of the human's mental state based on the human's expressed trust in the agent's arguments and certainty in their own arguments. We employ a probability weighting function inspired by prospect theory to capture the relationship between trust and perceived probability, and use a Bayesian approach to update the agent's probability distribution over possible human models. We conduct a human-subject study to empirically evaluate the effectiveness of our approach in an argumentation scenario, demonstrating its ability to capture the dynamics of human belief formation and adaptation.


title: A semi-analytical thermal model for craters with application to the crater-induced YORP effect

abstract: Context. The YORP effect is the thermal torque generated by radiation from the surface of an asteroid. The effect is sensitive to surface topology, including small-scale roughness, boulders, and craters. Aims: The aim of this paper is to develop a computationally efficient semi-analytical model for the crater-induced YORP (CYORP) effect that can be used to investigate the functional dependence of this effect. Methods. This study obtains the temperature field in a crater over a rotational period in the form of a Fourier series, accounting for the effects of self-sheltering, self-radiation, and self-scattering. Results. We obtain the temperature field of a crater, accounting for the thermal inertia, crater shape, and crater location. We then find that the CYORP effect is negligible when the depth-to-diameter ratio is smaller than 0.05. In this case, it is reasonable to assume a convex shape for YORP calculations. Varying the thermal conductivity yields a consistent value of approximately 0.01 for the spin component of the CYORP coefficient, while the obliquity component is inversely related to thermal inertia, declining from 0.004 in basalt to 0.001 in metal. For a z-axis symmetric shape, the CYORP spin component vanishes, while the obliquity component persists. Our model confirms that the total YORP torque is damped by a few tens of percent by uniformly distributed small-scale surface roughness. Furthermore, for the first time, we calculate the change in the YORP torque at each impact on the surface of an asteroid explicitly and compute the resulting stochastic spin evolution more precisely. Conclusions. The semi-analytical method that we developed, which benefits from fast computation, offers new perspectives for future investigations of the YORP modeling of real asteroids and for the complete rotational and orbital evolution of asteroids accounting for collisions.


title: A Dynamical Systems Approach to Bots and Online Political Communication

abstract: Bots have become increasingly prevalent in the digital sphere and have taken up a proactive role in shaping democratic processes. While previous studies have focused on their influence at the individual level, their potential macro-level impact on communication dynamics is still little understood. This study adopts an information theoretic approach from dynamical systems theory to examine the role of political bots shaping the dynamics of an online political discussion on Twitter. We quantify the components of this dynamic process in terms of its complexity, predictability, and the remaining uncertainty. Our findings suggest that bot activity is associated with increased complexity and uncertainty in the structural dynamics of online political communication. This work serves as a showcase for the use of information-theoretic measures from dynamical systems theory in modeling human-bot dynamics as a computational process that unfolds over time.


title: Recent Advances of Foundation Language Models-based Continual Learning: A Survey

abstract: Recently, foundation language models (LMs) have marked significant achievements in the domains of natural language processing (NLP) and computer vision (CV). Unlike traditional neural network models, foundation LMs obtain a great ability for transfer learning by acquiring rich commonsense knowledge through pre-training on extensive unsupervised datasets with a vast number of parameters. However, they still can not emulate human-like continuous learning due to catastrophic forgetting. Consequently, various continual learning (CL)-based methodologies have been developed to refine LMs, enabling them to adapt to new tasks without forgetting previous knowledge. However, a systematic taxonomy of existing approaches and a comparison of their performance are still lacking, which is the gap that our survey aims to fill. We delve into a comprehensive review, summarization, and classification of the existing literature on CL-based approaches applied to foundation language models, such as pre-trained language models (PLMs), large language models (LLMs) and vision-language models (VLMs). We divide these studies into offline CL and online CL, which consist of traditional methods, parameter-efficient-based methods, instruction tuning-based methods and continual pre-training methods. Offline CL encompasses domain-incremental learning, task-incremental learning, and class-incremental learning, while online CL is subdivided into hard task boundary and blurry task boundary settings. Additionally, we outline the typical datasets and metrics employed in CL research and provide a detailed analysis of the challenges and future work for LMs-based continual learning.


title: Mitigating Object Hallucination via Data Augmented Contrastive Tuning

abstract: Despite their remarkable progress, Multimodal Large Language Models (MLLMs) tend to hallucinate factually inaccurate information. In this work, we address object hallucinations in MLLMs, where information is offered about an object that is not present in the model input. We introduce a contrastive tuning method that can be applied to a pretrained off-the-shelf MLLM for mitigating hallucinations while preserving its general vision-language capabilities. For a given factual token, we create a hallucinated token through generative data augmentation by selectively altering the ground-truth information. The proposed contrastive tuning is applied at the token level to improve the relative likelihood of the factual token compared to the hallucinated one. Our thorough evaluation confirms the effectiveness of contrastive tuning in mitigating hallucination. Moreover, the proposed contrastive tuning is simple, fast, and requires minimal training with no additional overhead at inference.


title: CAVACHON: a hierarchical variational autoencoder to integrate multi-modal single-cell data

abstract: Paired single-cell sequencing technologies enable the simultaneous measurement of complementary modalities of molecular data at single-cell resolution. Along with the advances in these technologies, many methods based on variational autoencoders have been developed to integrate these data. However, these methods do not explicitly incorporate prior biological relationships between the data modalities, which could significantly enhance modeling and interpretation. We propose a novel probabilistic learning framework that explicitly incorporates conditional independence relationships between multi-modal data as a directed acyclic graph using a generalized hierarchical variational autoencoder. We demonstrate the versatility of our framework across various applications pertinent to single-cell multi-omics data integration. These include the isolation of common and distinct information from different modalities, modality-specific differential analysis, and integrated cell clustering. We anticipate that the proposed framework can facilitate the construction of highly flexible graphical models that can capture the complexities of biological hypotheses and unravel the connections between different biological data types, such as different modalities of paired single-cell multi-omics data. The implementation of the proposed framework can be found in the repository https://github.com/kuijjerlab/CAVACHON.


title: Applications of the quaternionic Jordan form to hypercomplex geometry

abstract: We apply the quaternionic Jordan form to classify the hypercomplex nilpotent almost abelian Lie algebras in all dimensions and to carry out the complete classification of 12-dimensional hypercomplex almost abelian Lie algebras. Moreover, we determine which 12-dimensional simply connected hypercomplex almost abelian Lie groups admit lattices. Finally, for each integer $n>1$ we construct infinitely many, up to diffeomorphism, $(4n+4)$-dimensional hypercomplex almost abelian solvmanifolds which are completely solvable. These solvmanifolds arise from a distinguished family of monic integer polynomials of degree $n$.


title: The Efficacy of the Connect America Fund in Addressing US Internet Access Inequities

abstract: Residential fixed broadband internet access in the United States (US) has long been distributed inequitably, drawing significant attention from researchers and policymakers. This paper evaluates the efficacy of the Connect America Fund (CAF), a key policy intervention aimed at addressing disparities in US internet access. CAF subsidizes the creation of new regulated broadband monopolies in underserved areas, aiming to provide comparable internet access, in terms of price and speed, to that available in urban regions. Oversight of CAF largely relies on data self-reported by internet service providers (ISPs), which is often questionable. We use the broadband-plan querying tool (BQT) to curate a novel dataset that complements ISP-reported information with ISP-advertised broadband plan details (download speed and monthly cost) on publicly accessible websites. Specifically, we query advertised broadband plans for 687k residential addresses across 15 states, certified as served by ISPs to regulators. Our analysis reveals significant discrepancies between ISP-reported data and actual broadband availability. We find that the serviceability rate-defined as the fraction of addresses ISPs actively serve out of the total queried, weighted by the number of CAF addresses in a census block group-is only 55%, dropping to as low as 18% in some states. Additionally, the compliance rate-defined as the weighted fraction of addresses where ISPs actively serve and advertise download speeds above the FCC's 10 Mbps threshold-is only 33%. We also observe that in a subset of census blocks, CAF-funded addresses receive higher broadband speeds than their monopoly-served neighbors. These results indicate that while a few users have benefited from this multi-billion dollar program, it has largely failed to achieve its intended goal, leaving many targeted rural communities with inadequate or no broadband connectivity.


title: D-CoRP: Differentiable Connectivity Refinement for Functional Brain Networks

abstract: Brain network is an important tool for understanding the brain, offering insights for scientific research and clinical diagnosis. Existing models for brain networks typically primarily focus on brain regions or overlook the complexity of brain connectivities. MRI-derived brain network data is commonly susceptible to connectivity noise, underscoring the necessity of incorporating connectivities into the modeling of brain networks. To address this gap, we introduce a differentiable module for refining brain connectivity. We develop the multivariate optimization based on information bottleneck theory to address the complexity of the brain network and filter noisy or redundant connections. Also, our method functions as a flexible plugin that is adaptable to most graph neural networks. Our extensive experimental results show that the proposed method can significantly improve the performance of various baseline models and outperform other state-of-the-art methods, indicating the effectiveness and generalizability of the proposed method in refining brain network connectivity. The code will be released for public availability.


title: Structure and crystallization of SiO2 and B2O3 doped lithium disilicate glasses from theory and experiment

abstract: Solid solutions of SiO2 and B2O3 in Li2O 2SiO2 are synthesized and characterized for the first time. Their structure and crystallization mechanisms are investigated employing a combination of simulations at the density functional theory level and experiments on the crystallization of SiO2 and B2O3 doped lithium disilicate glasses. The remarkable agreement of calculated and experimentally determined cell parameters reveals the preferential, kinetically controlled incorporation of [SiO4] and [BO4] at the Li+ lattice sites of the Li2O 2SiO2 crystal structure. While the addition of SiO2 increases the glass viscosity resulting in lower crystal growth velocities, glasses containing B2O3 show a reduction of both viscosities and crystal growth velocities. These observations could be rationalized by a change of the chemical composition of the glass matrix surrounding the precipitated crystal phase during the course of crystallization, which leads to a deceleration of the attachment of building units required for further crystal growth at the liquid-crystal interface.


title: Weak (non)conservation and stochastic dynamics of angular momentum

abstract: Angular momentum conservation influences equilibrium statistical mechanics, leading to a generalized microcanonical density for an isolated system and a generalized Gibbs density for a weakly coupled system. We study the stochastic decay of angular momentum due to weakly imperfect rotational symmetry of the external potential that confines the isolated many-particle system. We present a mesoscopic description of the system, deriving Langevin and Fokker-Planck equations, which are consistent with equilibrium statistical mechanics when rotational symmetry is maintained. When the symmetry is weakly violated, we formulate a coarse-grained stochastic differential equation governing the decay of total angular momentum over time. To validate our analytical predictions, we conduct numerical simulations of the microcanonical ensemble, an isolated system undergoing thermalization due to weak two-body interactions. Our coarse-grained Langevin equation accurately characterizes both the decay of the angular momentum and its fluctuations in a steady state. Furthermore, we estimate the parameters of our mesoscopic model directly from simulations, providing insights into the dissipative phenomenological coefficients, such as friction. More generally, this study contributes to a deeper understanding of the behavior of the integrals of motion when the corresponding symmetry is weakly violated.


title: Stairway to discovery: a report on the CMS programme of cross section measurements from millibarns to femtobarns

abstract: The Large Hadron Collider at CERN, delivering proton-proton collisions at much higher energies and far higher luminosities than previous machines, has enabled a comprehensive programme of measurements of the standard model (SM) processes by the CMS experiment. These unprecedented capabilities facilitate precise measurements of the properties of a wide array of processes, the most fundamental being cross sections. The discovery of the Higgs boson and the measurement of its mass became the keystone of the SM. Knowledge of the mass of the Higgs boson allows precision comparisons of the predictions of the SM with the corresponding measurements. These measurements span the range from one of the most copious SM processes, the total inelastic cross section for proton-proton interactions, to the rarest ones, such as Higgs boson pair production. They cover the production of Higgs bosons, top quarks, single and multibosons, and hadronic jets. Associated parameters, such as coupling constants, are also measured. These cross section measurements can be pictured as a descending stairway, on which the lowest steps represent the rarest processes allowed by the SM, some never seen before.


title: Understanding Intrinsic Socioeconomic Biases in Large Language Models

abstract: Large Language Models (LLMs) are increasingly integrated into critical decision-making processes, such as loan approvals and visa applications, where inherent biases can lead to discriminatory outcomes. In this paper, we examine the nuanced relationship between demographic attributes and socioeconomic biases in LLMs, a crucial yet understudied area of fairness in LLMs. We introduce a novel dataset of one million English sentences to systematically quantify socioeconomic biases across various demographic groups. Our findings reveal pervasive socioeconomic biases in both established models such as GPT-2 and state-of-the-art models like Llama 2 and Falcon. We demonstrate that these biases are significantly amplified when considering intersectionality, with LLMs exhibiting a remarkable capacity to extract multiple demographic attributes from names and then correlate them with specific socioeconomic biases. This research highlights the urgent necessity for proactive and robust bias mitigation techniques to safeguard against discriminatory outcomes when deploying these powerful models in critical real-world applications.


title: Lifelong Learning and Selective Forgetting via Contrastive Strategy

abstract: Lifelong learning aims to train a model with good performance for new tasks while retaining the capacity of previous tasks. However, some practical scenarios require the system to forget undesirable knowledge due to privacy issues, which is called selective forgetting. The joint task of the two is dubbed Learning with Selective Forgetting (LSF). In this paper, we propose a new framework based on contrastive strategy for LSF. Specifically, for the preserved classes (tasks), we make features extracted from different samples within a same class compacted. And for the deleted classes, we make the features from different samples of a same class dispersed and irregular, i.e., the network does not have any regular response to samples from a specific deleted class as if the network has no training at all. Through maintaining or disturbing the feature distribution, the forgetting and memory of different classes can be or independent of each other. Experiments are conducted on four benchmark datasets, and our method acieves new state-of-the-art.


title: Fast Explainability via Feasible Concept Sets Generator

abstract: A long-standing dilemma prevents the broader application of explanation methods: general applicability and inference speed. On the one hand, existing model-agnostic explanation methods usually make minimal pre-assumptions about the prediction models to be explained. Still, they require additional queries to the model through propagation or back-propagation to approximate the models' behaviors, resulting in slow inference and hindering their use in time-sensitive tasks. On the other hand, various model-dependent explanations have been proposed that achieve low-cost, fast inference but at the expense of limiting their applicability to specific model structures. In this study, we bridge the gap between the universality of model-agnostic approaches and the efficiency of model-specific approaches by proposing a novel framework without assumptions on the prediction model's structures, achieving high efficiency during inference and allowing for real-time explanations. To achieve this, we first define explanations through a set of human-comprehensible concepts and propose a framework to elucidate model predictions via minimal feasible concept sets. Second, we show that a minimal feasible set generator can be learned as a companion explainer to the prediction model, generating explanations for predictions. Finally, we validate this framework by implementing a novel model-agnostic method that provides robust explanations while facilitating real-time inference. Our claims are substantiated by comprehensive experiments, highlighting the effectiveness and efficiency of our approach.


title: Refinement of global coronal and interplanetary magnetic field extrapolations constrained by remote-sensing and in-situ observations at the solar minimum

abstract: Solar magnetic fields are closely related to various physical phenomena on the sun, which can be extrapolated with different models from photospheric magnetograms. However, the Open Flux Problem (OFP), the underestimation of the magnetic field derived from the extrapolated model, is still unsolved. To minimize the impact of the OFP, we propose three evaluation parameters to quantitatively evaluate magnetic field models and determine the optimal free parameters in the models by constraining the coronal magnetic fields (CMFs) and the interplanetary magnetic fields (IMFs) with real observations. Although the OFP still exists, we find that magnetic field lines traced from the coronal models effectively capture the intricate topological configurations observed in the corona, including streamers and plumes. The OFP is lessened by using the HMI synoptic map instead of the GONG daily synoptic maps, and the PFSS+PFCS model instead of the CSSS model. For Carrington Rotation (CR) 2231 at the solar minimum, we suggest that the optimal parameters for the PFSS+PFCS model are $R_{\mathrm{ss}} = 2.2-2.5\ R_{\mathrm{sun}}$ and $R_{\mathrm{scs}} = 10.5-14.0\ R_{\mathrm{sun}}$, as well as for the CSSS model are $R_{\mathrm{cs}} = 2.0 - 2.4\ R_{\mathrm{sun}}$, $R_{\mathrm{ss}} = 11.0 - 14.7\ R_{\mathrm{sun}}$ and $a = 1.0\ R_{\mathrm{sun}}$. Despite the IMFs at 1 AU being consistent with the measurements by artificially increasing the polar magnetic fields, the IMFs near the sun are still underestimated. The OFP might be advanced by improving the accuracy of both the weak magnetic fields and polar magnetic fields, especially considering magnetic activities arising from interplanetary physical processes.


title: On-Chip Vectorial Structured Light Manipulation via Inverse Design

abstract: On-chip structured light, with potentially infinite complexity, has emerged as a linchpin in the realm of integrated photonics. However, the realization of arbitrarily tailoring a multitude of light field dimensions in complex media remains a challenge1, Through associating physical light fields and mathematical function spaces by introducing a mapping operator, we proposed a data-driven inverse design method to precisely manipulate between any two structured light fields in the on-chip high-dimensional Hilbert space. To illustrate, light field conversion in on-chip topological photonics was achieved. High-performance topological coupling devices with minimal insertion loss and customizable topological routing devices were designed and realized. Our method provides a new paradigm to enable precise manipulation over the on-chip vectorial structured light and paves the way for the realization of complex photonic functions.


title: Non-Driving-Related Tasks Influencing Drivers' Takeover Time: A Meta-Analysis

abstract: Before the era of fully automated vehicles, human is consistently an indispensable part of the driving system. Various studies have investigated drivers' cooperation with the vehicle under different conditions. In this article, we analyzed how non-driving-related tasks (NDRT) influence takeover time (TOT) by conducting a meta-analysis on 37 related papers. NDRTs were transcoded into combinations of five basic dimensions to unify and demonstrate their effects on drivers. In order to interpret experimental data comprehensively, we implemented three methods. A synthetical analysis was conducted to compare the effect size between each study and subgroup. Studies with eligible control groups have been examined by the two-group analysis, followed by moderator analysis on seven variables. The results from the two-group analysis showed that both visual-mental-motoric and visual-mental tasks have significant negative effects on the takeover time and the previous type had a larger effect than the latter one. Moreover, the subgroup comparison and meta-regression in the meta-analysis part revealed the correlation between moderators and the effect size, in which the Driving Experience and the Automation Level affected the relation between NDRT and TOT. The findings of this paper can contribute to the improvement and new directions for further scientific research and engineering design.


title: Gate-Tunable Multi-Band van der Waals Photodetector and Polarization Sensor

abstract: A single photodetector with tunable detection wavelengths and polarization sensitivity can potentially be harnessed for diverse optical applications ranging from imaging and sensing to telecommunications. Such a device will require the combination of multiple material systems with different structures, bandgaps, and photoelectrical responses, which is extremely difficult to engineer using traditional epitaxial films. Here, we develop a multi-functional and high-performance photosensor using all van der Waals materials. The device features a gate-tunable spectral response that is switchable between near-infrared/visible and short-/mid-wave infrared, as well as broadband operation, at room temperature. The linear polarization sensitivity in the telecommunications O-band can also be directly modulated between horizontal, vertical, and nonpolarizing modes. These effects originate from the balance of photocurrent generation in two of the active layers that can be manipulated by an electric field. The photodetector features high detectivity (>109 cmHz1/2W-1) together with fast operation speed (~ 1 MHz) and can be further exploited for dual visible and infrared imaging.


title: Zipper: A Multi-Tower Decoder Architecture for Fusing Modalities

abstract: Integrating multiple generative foundation models, especially those trained on different modalities, into something greater than the sum of its parts poses significant challenges. Two key hurdles are the availability of aligned data (concepts that contain similar meaning but is expressed differently in different modalities), and effectively leveraging unimodal representations in cross-domain generative tasks, without compromising their original unimodal capabilities. We propose Zipper, a multi-tower decoder architecture that addresses these concerns by using cross-attention to flexibly compose multimodal generative models from independently pre-trained unimodal decoders. In our experiments fusing speech and text modalities, we show the proposed architecture performs very competitively in scenarios with limited aligned text-speech data. We also showcase the flexibility of our model to selectively maintain unimodal (e.g., text-to-text generation) generation performance by freezing the corresponding modal tower (e.g. text). In cross-modal tasks such as automatic speech recognition (ASR) where the output modality is text, we show that freezing the text backbone results in negligible performance degradation. In cross-modal tasks such as text-to-speech generation (TTS) where the output modality is speech, we show that using a pre-trained speech backbone results in superior performance to the baseline.


title: Adapting Differentially Private Synthetic Data to Relational Databases

abstract: Existing differentially private (DP) synthetic data generation mechanisms typically assume a single-source table. In practice, data is often distributed across multiple tables with relationships across tables. In this paper, we introduce the first-of-its-kind algorithm that can be combined with any existing DP mechanisms to generate synthetic relational databases. Our algorithm iteratively refines the relationship between individual synthetic tables to minimize their approximation errors in terms of low-order marginal distributions while maintaining referential integrity. Finally, we provide both DP and theoretical utility guarantees for our algorithm.


title: Watermarking Counterfactual Explanations

abstract: The field of Explainable Artificial Intelligence (XAI) focuses on techniques for providing explanations to end-users about the decision-making processes that underlie modern-day machine learning (ML) models. Within the vast universe of XAI techniques, counterfactual (CF) explanations are often preferred by end-users as they help explain the predictions of ML models by providing an easy-to-understand & actionable recourse (or contrastive) case to individual end-users who are adversely impacted by predicted outcomes. However, recent studies have shown significant security concerns with using CF explanations in real-world applications; in particular, malicious adversaries can exploit CF explanations to perform query-efficient model extraction attacks on proprietary ML models. In this paper, we propose a model-agnostic watermarking framework (for adding watermarks to CF explanations) that can be leveraged to detect unauthorized model extraction attacks (which rely on the watermarked CF explanations). Our novel framework solves a bi-level optimization problem to embed an indistinguishable watermark into the generated CF explanation such that any future model extraction attacks that rely on these watermarked CF explanations can be detected using a null hypothesis significance testing (NHST) scheme, while ensuring that these embedded watermarks do not compromise the quality of the generated CF explanations. We evaluate this framework's performance across a diverse set of real-world datasets, CF explanation methods, and model extraction techniques, and show that our watermarking detection system can be used to accurately identify extracted ML models that are trained using the watermarked CF explanations. Our work paves the way for the secure adoption of CF explanations in real-world applications.


title: LLM-based Hierarchical Concept Decomposition for Interpretable Fine-Grained Image Classification

abstract: (Renyi Qu's Master's Thesis) Recent advancements in interpretable models for vision-language tasks have achieved competitive performance; however, their interpretability often suffers due to the reliance on unstructured text outputs from large language models (LLMs). This introduces randomness and compromises both transparency and reliability, which are essential for addressing safety issues in AI systems. We introduce \texttt{Hi-CoDe} (Hierarchical Concept Decomposition), a novel framework designed to enhance model interpretability through structured concept analysis. Our approach consists of two main components: (1) We use GPT-4 to decompose an input image into a structured hierarchy of visual concepts, thereby forming a visual concept tree. (2) We then employ an ensemble of simple linear classifiers that operate on concept-specific features derived from CLIP to perform classification. Our approach not only aligns with the performance of state-of-the-art models but also advances transparency by providing clear insights into the decision-making process and highlighting the importance of various concepts. This allows for a detailed analysis of potential failure modes and improves model compactness, therefore setting a new benchmark in interpretability without compromising the accuracy.


title: GAN: Dynamics

abstract: We study quantitatively the overparametrization limit of the original Wasserstein-GAN algorithm. Effectively, we show that the algorithm is a stochastic discretization of a system of continuity equations for the parameter distributions of the generator and discriminator. We show that parameter clipping to satisfy the Lipschitz condition in the algorithm induces a discontinuous vector field in the mean field dynamics, which gives rise to blow-up in finite time of the mean field dynamics. We look into a specific toy example that shows that all solutions to the mean field equations converge in the long time limit to time periodic solutions, this helps explain the failure to converge.


title: Deep Bayesian Filter for Bayes-faithful Data Assimilation

abstract: State estimation for nonlinear state space models is a challenging task. Existing assimilation methodologies predominantly assume Gaussian posteriors on physical space, where true posteriors become inevitably non-Gaussian. We propose Deep Bayesian Filtering (DBF) for data assimilation on nonlinear state space models (SSMs). DBF constructs new latent variables $h_t$ on a new latent (``fancy'') space and assimilates observations $o_t$. By (i) constraining the state transition on fancy space to be linear and (ii) learning a Gaussian inverse observation operator $q(h_t|o_t)$, posteriors always remain Gaussian for DBF. Quite distinctively, the structured design of posteriors provides an analytic formula for the recursive computation of posteriors without accumulating Monte-Carlo sampling errors over time steps. DBF seeks the Gaussian inverse observation operators $q(h_t|o_t)$ and other latent SSM parameters (e.g., dynamics matrix) by maximizing the evidence lower bound. Experiments show that DBF outperforms model-based approaches and latent assimilation methods in various tasks and conditions.


title: Light-induced topological phase transition with tunable layer Hall effect in axion antiferromagnets

abstract: The intricate interplay between light and matter provides effective tools for manipulating topological phenomena. Here, we theoretically propose and computationally show that circularly polarized light hold the potential to transform the axion insulating phase into quantum anomalous Hall state in MnBi2Te4 thin films, featuring tunable Chern numbers (ranging up to 2). In particular, we reveal the spatial rearrangement of the hidden layer-resolved anomalous Hall effect under light driven Floquet-engineering. Notably, upon Bi2Te3 layer intercalation, the anomalous Hall conductance predominantly localizes in the nonmagnetic Bi2Te3 layers that hold zero Berry curvature in the intact state, suggesting significant magnetic proximity effect. Additionally, we estimate variations in the magneto-optical Kerr effect, giving a contactless method for detecting topological transitions. Our work not only presents a strategy to investigate emergent topological phases, but also sheds light on the possible applications of the layer Hall effect in topological antiferromagnetic spintronics.


title: Exploring Automated Contouring Across Institutional Boundaries: A Deep Learning Approach with Mouse Micro-CT Datasets

abstract: Image-guided mouse irradiation is essential to understand interventions involving radiation prior to human studies. Our objective is to employ Swin UNEt Transformers (Swin UNETR) to segment native micro-CT and contrast-enhanced micro-CT scans and benchmark the results against 3D no-new-Net (nnU-Net). Swin UNETR reformulates mouse organ segmentation as a sequence-to-sequence prediction task, using a hierarchical Swin Transformer encoder to extract features at 5 resolution levels, and connects to a Fully Convolutional Neural Network (FCNN)-based decoder via skip connections. The models were trained and evaluated on open datasets, with data separation based on individual mice. Further evaluation on an external mouse dataset acquired on a different micro-CT with lower kVp and higher imaging noise was also employed to assess model robustness and generalizability. Results indicate that Swin UNETR consistently outperforms nnU-Net and AIMOS in terms of average dice similarity coefficient (DSC) and Hausdorff distance (HD95p), except in two mice of intestine contouring. This superior performance is especially evident in the external dataset, confirming the model's robustness to variations in imaging conditions, including noise and quality, thereby positioning Swin UNETR as a highly generalizable and efficient tool for automated contouring in pre-clinical workflows.


title: Zero-to-Hero: Enhancing Zero-Shot Novel View Synthesis via Attention Map Filtering

abstract: Generating realistic images from arbitrary views based on a single source image remains a significant challenge in computer vision, with broad applications ranging from e-commerce to immersive virtual experiences. Recent advancements in diffusion models, particularly the Zero-1-to-3 model, have been widely adopted for generating plausible views, videos, and 3D models. However, these models still struggle with inconsistencies and implausibility in new views generation, especially for challenging changes in viewpoint. In this work, we propose Zero-to-Hero, a novel test-time approach that enhances view synthesis by manipulating attention maps during the denoising process of Zero-1-to-3. By drawing an analogy between the denoising process and stochastic gradient descent (SGD), we implement a filtering mechanism that aggregates attention maps, enhancing generation reliability and authenticity. This process improves geometric consistency without requiring retraining or significant computational resources. Additionally, we modify the self-attention mechanism to integrate information from the source view, reducing shape distortions. These processes are further supported by a specialized sampling schedule. Experimental results demonstrate substantial improvements in fidelity and consistency, validated on a diverse set of out-of-distribution objects.