title: Feasible Space Monitoring for Multiple Control Barrier Functions with application to Large Scale Indoor Navigation

abstract: Quadratic programs (QP) subject to multiple time-dependent control barrier function (CBF) based constraints have been used to design safety-critical controllers. However, ensuring the existence of a solution at all times to the QP subject to multiple CBF constraints is non-trivial. We quantify the feasible solution space of the QP in terms of its volume. We introduce a novel feasible space volume monitoring control barrier function that promotes compatibility of barrier functions and, hence, existence of a solution at all times. We show empirically that our approach not only enhances feasibility but also exhibits reduced sensitivity to changes in the hyperparameters such as gains of nominal controller. Finally, paired with a global planner, we evaluate our controller for navigation among humans in the AWS Hospital gazebo environment. The proposed controller is demonstrated to outperform the standard CBF-QP controller in maintaining feasibility.


title: Uncertainty Visualization via Low-Dimensional Posterior Projections

abstract: In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is encoded in the posterior distribution. However, for high-dimensional data, this distribution is challenging to visualize. In this work, we introduce a new approach for estimating and visualizing posteriors by employing energy-based models (EBMs) over low-dimensional subspaces. Specifically, we train a conditional EBM that receives an input measurement and a set of directions that span some low-dimensional subspace of solutions, and outputs the probability density function of the posterior within that space. We demonstrate the effectiveness of our method across a diverse range of datasets and image restoration problems, showcasing its strength in uncertainty quantification and visualization. As we show, our method outperforms a baseline that projects samples from a diffusion-based posterior sampler, while being orders of magnitude faster. Furthermore, it is more accurate than a baseline that assumes a Gaussian posterior.


title: Theoretical developments on the initial state in relativistic particle collisions

abstract: We discuss recent progress towards developing accurate initial state descriptions for heavy ion collisions focusing on weak coupling based approaches, that enable one to constrain the high-energy structure of nuclei from deep inelastic scattering or proton-nucleus collisions. We review recent developments to determine the event-by-event fluctuating nuclear geometry, to describe gluon saturation phenomena at next-to-leading order accuracy, and to include longitudinal dynamics to the initial state descriptions.


title: Contextually Affinitive Neighborhood Refinery for Deep Clustering

abstract: Previous endeavors in self-supervised learning have enlightened the research of deep clustering from an instance discrimination perspective. Built upon this foundation, recent studies further highlight the importance of grouping semantically similar instances. One effective method to achieve this is by promoting the semantic structure preserved by neighborhood consistency. However, the samples in the local neighborhood may be limited due to their close proximity to each other, which may not provide substantial and diverse supervision signals. Inspired by the versatile re-ranking methods in the context of image retrieval, we propose to employ an efficient online re-ranking process to mine more informative neighbors in a Contextually Affinitive (ConAff) Neighborhood, and then encourage the cross-view neighborhood consistency. To further mitigate the intrinsic neighborhood noises near cluster boundaries, we propose a progressively relaxed boundary filtering strategy to circumvent the issues brought by noisy neighbors. Our method can be easily integrated into the generic self-supervised frameworks and outperforms the state-of-the-art methods on several popular benchmarks.


title: IPA. Class 0 Protostars Viewed in CO Emission Using JWST/NIRSpec

abstract: We investigate the bright CO fundamental emission in the central regions of five Class 0 protostars using the JWST's Near-Infrared Spectrograph (NIRSpec) and provide clues to what processes excite the gas. CO line emission images are extracted for a forest of $\sim$150 ro-vibrational transitions from two vibrational bands, $v=1-0$ and $v=2-1$. However, ${}^{13}$CO is not detected, and thus we can only statistically constrain the ${}^{12}$CO optical depth. Using noise measurements to determine upper limits to the ${}^{13}$CO emission, the flux ratio of ${}^{12}$CO/${}^{13}$CO indicates that the ${}^{12}$CO emission itself is not optically thick for ro-vibrational transitions with upper state rotational quantum number $J_u \geq 15$. We construct population diagrams to estimate the rotational temperature and number of molecules from extinction-corrected CO line fluxes assuming CO emission is optically thin. Two different temperature components are required for $v=1$ ($\sim600-1000$ K and $\sim1500-3500$ K), while one hotter component is required for $v=2$ ($\sim2000-6000$ K). The vibrational temperature is $\sim 900$ K among our sources and shows no trend with luminosity. Using vibrational temperatures and the inferred total amount of CO molecules for our sources, the total warm gas mass correlates strongly with luminosity ranging from $\sim$0.1 $\rm M_{Earth}$ for the low-mass protostars to $\sim$1 M$_{\rm sun}$ for the high-mass protostars. Interpreting the distribution of gas column densities and temperatures depends on radiative and chemical processes affecting CO. The presence of a $v=2$ population may indicate CO gas radiatively excited. Selective UV photodissociation of CO isotopologues around our high-mass sources may explain their depletion of ${}^{13}$CO.


title: A simplified Parisi Ansatz II: REM universality

abstract: In a previous work [A simplified Parisi Ansatz, Franchini, S., Commun. Theor. Phys., 73, 055601 (2021)] we introduced a simple method to compute the Random Overlap Structure of Aizenmann, Simm and Stars and the full-RSB Parisi formula for the Sherrington-Kirckpatrick Model without using replica theory. The method consists in partitioning the system into smaller sub-systems that we call layers, and iterate the Bayes rule. A central ansatz in our derivation was that these layers could be approximated by Random Energy Models of the Derrida type. In this paper we analyze the properties of the interface in detail, and show the equivalence with the Random Energy Model at any temperature.


title: Anchored spirals in the driven curvature flow approximation

abstract: We study existence, asymptotics, and stability of spiral waves in a driven curvature approximation, supplemented with an anchoring condition on a circle of finite radius. We analyze the motion of curves written as graphs in polar coordinates, finding spiral waves as rigidly rotating shapes. The existence analysis reduces to a planar ODE and asymptotics are given through center manifold expansions. In the limit of a large core, we find rotation frequencies and corrections starting form a problem without curvature corrections. Finally, we demonstrate orbital stability of spiral waves by exploiting a comparison principle inherent to curvature driven flow. \end{abstract}


title: Efficient Up-Conversion in CsPbBr3 Nanocrystals via Phonon-Driven Exciton-Polaron Formation

abstract: Lead halide perovskite nanocrystals demonstrate efficient up-conversion, although the precise mechanism remains a subject of active research. This study utilizes steady-state and time-resolved spectroscopy methods to unravel the mechanism driving the up-conversion process in CsPbBr3 nanocrystals. Employing above- and below-gap photoluminescence measurements, we extract a distinct phonon mode with an energy of ~7 meV and identify the Pb-Br-Pb bending mode as the phonon involved in the up-conversion process. This result was corroborated by Raman spectroscopy. We confirm an up-conversion efficiency reaching up to 75%. Transient absorption measurements under conditions of sub-gap excitation also unexpectedly reveal coherent phonons for the subset of nanocrystals undergoing up-conversion. This coherence implies that the up-conversion and subsequent relaxation is accompanied by a synchronized and phased lattice motion. This study reveals that efficient up-conversion in CsPbBr3 nanocrystals is powered by a unique interplay between the soft lattice structure, phonons, and excited states dynamics.


title: Asymptotic shape for subadditve processes on groups of polynomial growth

abstract: This study delves into the exploration of the limiting shape theorem for subadditive processes on finitely generated groups with polynomial growth, commonly referred to as virtually nilpotent groups. Investigating the algebraic structures underlying these processes, we present a generalized form of the asymptotic shape theorem within this framework. Extending subadditive ergodic theory in this context, we consider processes which exhibit both at most and at least linear random growth. We conclude with applications and illustrative examples.


title: Largest Eigenvalue of the Configuration Model and Breaking of Ensemble Equivalence

abstract: We analyse the largest eigenvalue of the adjacency matrix of the configuration model with large degrees, where the latter are treated as hard constraints. In particular, we compute the expectation of the largest eigenvalue for degrees that diverge as the number of vertices $n$ tends to infinity, uniformly on a scale between $1$ and $\sqrt{n}$, and show that a weak law of large numbers holds. We compare with what was derived in our earlier paper "Central limit theorem for the principal eigenvalue and eigenvector of Chung-Lu random graphs" for the Chung-Lu model, which in the regime considered represents the corresponding configuration model with soft constraints, and show that the expectation is shifted down by $1$ asymptotically. This shift is a signature of breaking of ensemble equivalence between the hard and soft (also known as micro-canonical and canonical) versions of the configuration model. The latter result generalizes a previous finding in "A spectral signature of breaking of ensemble equivalence for constrained random graphs" obtained in the case when all degrees are equal.


title: On a Foundation Model for Operating Systems

abstract: This paper lays down the research agenda for a domain-specific foundation model for operating systems (OSes). Our case for a foundation model revolves around the observations that several OS components such as CPU, memory, and network subsystems are interrelated and that OS traces offer the ideal dataset for a foundation model to grasp the intricacies of diverse OS components and their behavior in varying environments and workloads. We discuss a wide range of possibilities that then arise, from employing foundation models as policy agents to utilizing them as generators and predictors to assist traditional OS control algorithms. Our hope is that this paper spurs further research into OS foundation models and creating the next generation of operating systems for the evolving computing landscape.


title: A Foundational Multimodal Vision Language AI Assistant for Human Pathology

abstract: The field of computational pathology has witnessed remarkable progress in the development of both task-specific predictive models and task-agnostic self-supervised vision encoders. However, despite the explosive growth of generative artificial intelligence (AI), there has been limited study on building general purpose, multimodal AI assistants tailored to pathology. Here we present PathChat, a vision-language generalist AI assistant for human pathology using an in-house developed foundational vision encoder pretrained on 100 million histology images from over 100,000 patient cases and 1.18 million pathology image-caption pairs. The vision encoder is then combined with a pretrained large language model and the whole system is finetuned on over 250,000 diverse disease agnostic visual language instructions. We compare PathChat against several multimodal vision language AI assistants as well as GPT4V, which powers the commercially available multimodal general purpose AI assistant ChatGPT-4. When relevant clinical context is provided with the histology image, PathChat achieved a diagnostic accuracy of 87% on multiple-choice questions based on publicly available cases of diverse tissue origins and disease models. Additionally, using open-ended questions and human expert evaluation, we found that overall PathChat produced more accurate and pathologist-preferable responses to diverse queries related to pathology. As an interactive and general vision language AI assistant that can flexibly handle both visual and natural language inputs, PathChat can potentially find impactful applications in pathology education, research, and human-in-the-loop clinical decision making.


title: Dwarfs in nearby voids: results of SALT spectroscopy

abstract: In the framework of the ongoing project, aimed at the systematical studying galaxies in nearby voids, we conducted spectroscopy with the Southern African Large Telescope (SALT) of 62 objects from the Nearby Void Galaxy (NVG) sample. They include 8 remaining objects of the 60 preselected candidates to eXtremely Metal-Poor (XMP) dwarfs, two known void XMP dwarfs and 52 void dwarfs residing within the Local Volume. For 47 galaxies residing in the nearby voids, we obtained spectra of the diverse quality. For 42 of them, we detected the Hydrogen and Oxygen lines that allowed us to get estimates of O/H in the observed HII regions. For 12 of the 42 objects, we detected the faint line [Oiii]4363, that allowed us to directly derive the electron temperature T_e and obtain their gas O/H by the direct method. 14 objects with the undetected [Oiii]4363 line fall to the lowest metallicities range (12+log(O/H) < 7.5 dex). For them, we use a carefully checked new empirical 'Strong line' method of Izotov et al. For 14 other objects with only strong lines detected and with 12+log(O/H) of ~7.5-8.0 dex, we used the modified version of 'semi-empirical' method of Izotov and Thuan. It accounts for effect of the excitation parameter O32 on T_e. 16 new galaxies are found with parameter 12+log(O/H) < 7.39 dex. Of them, four have 12+log(O/H) = 7.07 - 7.20 dex. Of the 60 observed NVG objects, 15 have mistaken radial velocities in HyperLEDA. They do not reside in the nearby voids.


title: Planck CO revisited: Improved CO line emission maps from Planck space mission observations

abstract: The Planck space mission has observed the first three rotational lines of emission of Galactic CO. Those maps, however, are either noisy, or contaminated by astrophysical emissions from different origin. We revisit those data products to deliver new full-sky CO maps with low astrophysical contamination and significantly enhanced noise properties. To that effect, a specific pipeline is designed to evaluate and postprocess the existing Planck Galactic CO maps. Specifically, we use an extension of the Generalized Needlet Internal Linear Combination method to extract multi-component astrophysical emissions from multi-frequency observations. Well characterized, clean CO full-sky maps at $10^\prime$ angular resolution are produced. These maps are made available to the scientific community and can be used to trace CO emission over the entire sky, and to generate sky simulations in preparation for future CMB observations.


title: Appropriate State-Dependent Friction Coefficient Accelerates Kinetic Langevin Dynamics

abstract: We consider the convergence of kinetic Langevin dynamics to its ergodic invariant measure, which is Gibbs distribution. Instead of the standard setup where the friction coefficient is a constant scalar, we investigate position-dependent friction coefficient and the possible accelerated convergence it enables. We show that by choosing this coefficient matrix to be $2\sqrt{\text{Hess}V}$, convergence is accelerated in the sense that no constant scalar friction coefficient can lead to faster convergence for a large subset of (nonlinear) strongly-convex potential $V$'s. The speed of convergence is quantified in terms of chi-square divergence from the target distribution, and proved using a Lyapunov approach, based on viewing sampling as optimization in the infinite dimensional space of probability distributions.


title: Brain Computer Interface Technology for Future Battlefield

abstract: With the development of artificial intelligence and unmanned equipment, human-machine hybrid formations will be the main focus in future combat formations. With the development of big data and various situational awareness technologies, while enhancing the breadth and depth of information, decision-making has also become more complex. The operation mode of existing unmanned equipment often requires complex manual input, which is not conducive to the battlefield environment. How to reduce the cognitive load of information exchange between soldiers and various unmanned equipment is an important issue in future intelligent warfare. This paper proposes a brain computer interface communication system for soldier combat, which takes into account the characteristics of soldier combat scenarios in design. The stimulation paradigm is combined with helmets, portable computers, and firearms, and brain computer interface technology is used to achieve fast, barrier free, and hands-free communication between humans and machines. Intelligent algorithms are combined to assist decision-making in fully perceiving and fusing situational information on the battlefield, and a large amount of data is processed quickly, understanding and integrating a large amount of data from human and machine networks, achieving real-time perception of battlefield information, making intelligent decisions, and achieving the effect of direct control of drone swarms and other equipment by the human brain to assist in soldier scenarios.


title: Native Language Identification with Large Language Models

abstract: We present the first experiments on Native Language Identification (NLI) using LLMs such as GPT-4. NLI is the task of predicting a writer's first language by analyzing their writings in a second language, and is used in second language acquisition and forensic linguistics. Our results show that GPT models are proficient at NLI classification, with GPT-4 setting a new performance record of 91.7% on the benchmark TOEFL11 test set in a zero-shot setting. We also show that unlike previous fully-supervised settings, LLMs can perform NLI without being limited to a set of known classes, which has practical implications for real-world applications. Finally, we also show that LLMs can provide justification for their choices, providing reasoning based on spelling errors, syntactic patterns, and usage of directly translated linguistic patterns.


title: Celestial Leaf Amplitudes

abstract: Celestial amplitudes may be decomposed as weighted integrals of AdS$_3$-Witten diagrams associated to each leaf of a hyperbolic foliation of spacetime. We show, for the Kleinian three-point MHV amplitude, that each leaf subamplitude is smooth except for the expected light-cone singularities. Moreover, we find that the full translationally-invariant celestial amplitude is simply the residue of the pole in the leaf amplitude at the point where the total conformal weights of the gluons equals three. This full celestial amplitude vanishes up to light-cone contact terms, as required by spacetime translation invariance, and reduces to the expression previously derived by Mellin transformation of the Parke-Taylor formula.


title: Radio Signal Classification by Adversarially Robust Quantum Machine Learning

abstract: Radio signal classification plays a pivotal role in identifying the modulation scheme used in received radio signals, which is essential for demodulation and proper interpretation of the transmitted information. Researchers have underscored the high susceptibility of ML algorithms for radio signal classification to adversarial attacks. Such vulnerability could result in severe consequences, including misinterpretation of critical messages, interception of classified information, or disruption of communication channels. Recent advancements in quantum computing have revolutionized theories and implementations of computation, bringing the unprecedented development of Quantum Machine Learning (QML). It is shown that quantum variational classifiers (QVCs) provide notably enhanced robustness against classical adversarial attacks in image classification. However, no research has yet explored whether QML can similarly mitigate adversarial threats in the context of radio signal classification. This work applies QVCs to radio signal classification and studies their robustness to various adversarial attacks. We also propose the novel application of the approximate amplitude encoding (AAE) technique to encode radio signal data efficiently. Our extensive simulation results present that attacks generated on QVCs transfer well to CNN models, indicating that these adversarial examples can fool neural networks that they are not explicitly designed to attack. However, the converse is not true. QVCs primarily resist the attacks generated on CNNs. Overall, with comprehensive simulations, our results shed new light on the growing field of QML by bridging knowledge gaps in QAML in radio signal classification and uncovering the advantages of applying QML methods in practical applications.


title: Prototypical Self-Explainable Models Without Re-training

abstract: Explainable AI (XAI) has unfolded in two distinct research directions with, on the one hand, post-hoc methods that explain the predictions of a pre-trained black-box model and, on the other hand, self-explainable models (SEMs) which are trained directly to provide explanations alongside their predictions. While the latter is preferred in safety-critical scenarios, post-hoc approaches have received the majority of attention until now, owing to their simplicity and ability to explain base models without retraining. Current SEMs, instead, require complex architectures and heavily regularized loss functions, thus necessitating specific and costly training. To address this shortcoming and facilitate wider use of SEMs, we propose a simple yet efficient universal method called KMEx (K-Means Explainer), which can convert any existing pre-trained model into a prototypical SEM. The motivation behind KMEx is to enhance transparency in deep learning-based decision-making via class-prototype-based explanations that are diverse and trustworthy without retraining the base model. We compare models obtained from KMEx to state-of-the-art SEMs using an extensive qualitative evaluation to highlight the strengths and weaknesses of each model, further paving the way toward a more reliable and objective evaluation of SEMs (The code is available at https://github.com/SrishtiGautam/KMEx).


title: Semantic Lens: Instance-Centric Semantic Alignment for Video Super-Resolution

abstract: As a critical clue of video super-resolution (VSR), inter-frame alignment significantly impacts overall performance. However, accurate pixel-level alignment is a challenging task due to the intricate motion interweaving in the video. In response to this issue, we introduce a novel paradigm for VSR named Semantic Lens, predicated on semantic priors drawn from degraded videos. Specifically, video is modeled as instances, events, and scenes via a Semantic Extractor. Those semantics assist the Pixel Enhancer in understanding the recovered contents and generating more realistic visual results. The distilled global semantics embody the scene information of each frame, while the instance-specific semantics assemble the spatial-temporal contexts related to each instance. Furthermore, we devise a Semantics-Powered Attention Cross-Embedding (SPACE) block to bridge the pixel-level features with semantic knowledge, composed of a Global Perspective Shifter (GPS) and an Instance-Specific Semantic Embedding Encoder (ISEE). Concretely, the GPS module generates pairs of affine transformation parameters for pixel-level feature modulation conditioned on global semantics. After that, the ISEE module harnesses the attention mechanism to align the adjacent frames in the instance-centric semantic space. In addition, we incorporate a simple yet effective pre-alignment module to alleviate the difficulty of model training. Extensive experiments demonstrate the superiority of our model over existing state-of-the-art VSR methods.


title: A Deep Learning-Based System for Automatic Case Summarization

abstract: This paper presents a deep learning-based system for efficient automatic case summarization. Leveraging state-of-the-art natural language processing techniques, the system offers both supervised and unsupervised methods to generate concise and relevant summaries of lengthy legal case documents. The user-friendly interface allows users to browse the system's database of legal case documents, select their desired case, and choose their preferred summarization method. The system generates comprehensive summaries for each subsection of the legal text as well as an overall summary. This demo streamlines legal case document analysis, potentially benefiting legal professionals by reducing workload and increasing efficiency. Future work will focus on refining summarization techniques and exploring the application of our methods to other types of legal texts.


title: Dynamical substructures of local metal-poor halo

abstract: Based on 4,\,098 very metal-poor (VMP) stars with 6D phase-space and chemical information from \textit{Gaia} DR3 and LAMOST DR9 as tracers, we apply an unsupervised machine learning algorithm, Shared Nearest Neighbor (SNN), to identify stellar groups in the action-energy (\textbf{\textit{J}}-$E$) space. We detect seven previously known mergers in local samples, including Helmi Stream, Gaia-Sausage-Enceladus (GSE), Metal-weak Thick Disk (MWTD), Pontus, Wukong, Thamnos, and I'itoi+Sequoia+Arjuna. According to energy, we further divide GSE and Wukong into smaller parts to explore the orbital characteristics of individual fragments. Similarly, the division of Thamnos is based on action. It can be found that the apocentric distances of GSE parts of high and medium energy levels are located at $29.5\pm3.6\,{\rm kpc}$ and $13.0\pm2.7\,{\rm kpc}$, respectively, which suggests that GSE could account for breaks in the density profile of the Galactic halo at both $\approx30$\,kpc and $15\text{-}18$\,kpc. The VMP stars of MWTD move along prograde orbits with larger eccentricities than those of its more metal-rich stars, which indicates that the VMP part of MWTD may be formed by accreting with dwarf galaxies. Finally, we summarize all substructures discovered in our local VMP samples. Our results provide a reference for the formation and evolution of the inner halo of the Milky Way (MW).


title: Integrated Path Tracking with DYC and MPC using LSTM Based Tire Force Estimator for Four-wheel Independent Steering and Driving Vehicle

abstract: Active collision avoidance system plays a crucial role in ensuring the lateral safety of autonomous vehicles, and it is primarily related to path planning and tracking control algorithms. In particular, the direct yaw-moment control (DYC) system can significantly improve the lateral stability of a vehicle in environments with sudden changes in road conditions. In order to apply the DYC algorithm, it is very important to accurately consider the properties of tire forces with complex nonlinearity for control to ensure the lateral stability of the vehicle. In this study, longitudinal and lateral tire forces for safety path tracking were simultaneously estimated using a long short-term memory (LSTM) neural network based estimator. Furthermore, to improve path tracking performance in case of sudden changes in road conditions, a system has been developed by combining 4-wheel independent steering (4WIS) model predictive control (MPC) and 4-wheel independent drive (4WID) direct yaw-moment control (DYC). The estimation performance of the extended Kalman filter (EKF), which are commonly used for tire force estimation, was compared. In addition, the estimated longitudinal and lateral tire forces of each wheel were applied to the proposed system, and system verification was performed through simulation using a vehicle dynamics simulator. Consequently, the proposed method, the integrated path tracking algorithm with DYC and MPC using the LSTM based estimator, was validated to significantly improve the vehicle stability in suddenly changing road conditions.


title: Approximate Fully Dynamic Directed Densest Subgraph

abstract: We give a fully dynamic algorithm maintaining a $(1-\varepsilon)$-approximate directed densest subgraph in $\tilde{O}(\log^3(n)/\varepsilon^6)$ amortized time or $\tilde{O}(\log^4(n)/\varepsilon^7)$ worst-case time per edge update (where $\tilde{O}$ hides $\log\log$ factors), based on earlier work by Chekuri and Quanrud [arXiv:2210.02611, arXiv:2310.18146]. This result improves on earlier work done by Sawlani and Wang [arXiv:1907.03037], which guarantees $O(\log^5(n)/\varepsilon^7)$ worst case time for edge insertions and deletions.


title: Safe Exploration in Reinforcement Learning: Training Backup Control Barrier Functions with Zero Training Time Safety Violations

abstract: Safe reinforcement learning (RL) aims to satisfy safety constraints during training. However, guaranteeing safety during training remained a challenging problem. This paper presents a novel framework that integrates Backup Control Barrier Functions (BCBFs) with reinforcement learning (RL) to enable safe exploration called RLBUS: Reinforcement Learning Backup Shield. BCBFs incorporate backup controllers that predict a system's finite-time response, facilitating online optimization of a control policy that maintains the forward invariance of a safe subset, while satisfying actuator constraints. Building on the soft-minimum/soft-maximum CBF method from prior work, which ensures feasibility and continuity of the BCBF with multiple backup controllers, this paper proposes integrating these BCBFs with RL. This framework leverages RL to learn a better backup policy to enlarge the forward invariant set, while guaranteeing safety during training. By combining backup controllers and RL, the approach provides safety and feasibility guarantees during training and enables safe online exploration with zero training-time safety violations. The method is demonstrated on an inverted pendulum example, where expanding the forward invariant set through RL allows the pendulum to safely explore larger regions of state space.


title: Causal Covariate Selection for the Imputation-based Regression Calibration Method for Exposure Measurement Error Bias Correction

abstract: In this paper, we identify the criteria for the selection of the minimal and most efficient covariate adjustment sets for the regression calibration method developed by Carroll, Rupert and Stefanski (CRS, 1992), used to correct bias due to continuous exposure measurement error. We utilize directed acyclic graphs to illustrate how subject matter knowledge can aid in the selection of such adjustment sets. Valid measurement error correction requires the collection of data on any (1) common causes of true exposure and outcome and (2) common causes of measurement error and outcome, in both the main study and validation study. For the CRS regression calibration method to be valid, researchers need to minimally adjust for covariate set (1) in both the measurement error model (MEM) and the outcome model and adjust for covariate set (2) at least in the MEM. In practice, we recommend including the minimal covariate adjustment set in both the MEM and the outcome model. In contrast with the regression calibration method developed by Rosner, Spiegelman and Willet, it is valid and more efficient to adjust for correlates of the true exposure or of measurement error that are not risk factors in the MEM only under CRS method. We applied the proposed covariate selection approach to the Health Professional Follow-up Study, examining the effect of fiber intake on cardiovascular incidence. In this study, we demonstrated potential issues with a data-driven approach to building the MEM that is agnostic to the structural assumptions. We extend the originally proposed estimators to settings where effect modification by a covariate is allowed. Finally, we caution against the use of the regression calibration method to calibrate the true nutrition intake using biomarkers.


title: A new dose calculation system implemented in image domain -- A multi-institutional study

abstract: In this work, we propose a new computing process, named DeepBEVdose, which is essentially distinct to the previous deep learning-based dose calculation methods.We present a novel image-domain dose calculation algorithm to automatically compute dose distributions from the computer tomography images and radiation field fluence maps.


title: Abusive Span Detection for Vietnamese Narrative Texts

abstract: Abuse in its various forms, including physical, psychological, verbal, sexual, financial, and cultural, has a negative impact on mental health. However, there are limited studies on applying natural language processing (NLP) in this field in Vietnam. Therefore, we aim to contribute by building a human-annotated Vietnamese dataset for detecting abusive content in Vietnamese narrative texts. We sourced these texts from VnExpress, Vietnam's popular online newspaper, where readers often share stories containing abusive content. Identifying and categorizing abusive spans in these texts posed significant challenges during dataset creation, but it also motivated our research. We experimented with lightweight baseline models by freezing PhoBERT and XLM-RoBERTa and using their hidden states in a BiLSTM to assess the complexity of the dataset. According to our experimental results, PhoBERT outperforms other models in both labeled and unlabeled abusive span detection tasks. These results indicate that it has the potential for future improvements.


title: Denoising diffusion-based synthetic generation of three-dimensional (3D) anisotropic microstructures from two-dimensional (2D) micrographs

abstract: Integrated computational materials engineering (ICME) has significantly enhanced the systemic analysis of the relationship between microstructure and material properties, paving the way for the development of high-performance materials. However, analyzing microstructure-sensitive material behavior remains challenging due to the scarcity of three-dimensional (3D) microstructure datasets. Moreover, this challenge is amplified if the microstructure is anisotropic, as this results in anisotropic material properties as well. In this paper, we present a framework for reconstruction of anisotropic microstructures solely based on two-dimensional (2D) micrographs using conditional diffusion-based generative models (DGMs). The proposed framework involves spatial connection of multiple 2D conditional DGMs, each trained to generate 2D microstructure samples for three different orthogonal planes. The connected multiple reverse diffusion processes then enable effective modeling of a Markov chain for transforming noise into a 3D microstructure sample. Furthermore, a modified harmonized sampling is employed to enhance the sample quality while preserving the spatial connection between the slices of anisotropic microstructure samples in 3D space. To validate the proposed framework, the 2D-to-3D reconstructed anisotropic microstructure samples are evaluated in terms of both the spatial correlation function and the physical material behavior. The results demonstrate that the framework is capable of reproducing not only the statistical distribution of material phases but also the material properties in 3D space. This highlights the potential application of the proposed 2D-to-3D reconstruction framework in establishing microstructure-property linkages, which could aid high-throughput material design for future studies


title: Stable Rivers: A Case Study in the Application of Text-to-Image Generative Models for Earth Sciences

abstract: Text-to-image (TTI) generative models can be used to generate photorealistic images from a given text-string input. These models offer great potential to mitigate challenges to the uptake of machine learning in the earth sciences. However, the rapid increase in their use has raised questions about fairness and biases, with most research to-date focusing on social and cultural areas rather than domain-specific considerations. We conducted a case study for the earth sciences, focusing on the field of fluvial geomorphology, where we evaluated subject-area specific biases in the training data and downstream model performance of Stable Diffusion (v1.5). In addition to perpetuating Western biases, we found that the training data over-represented scenic locations, such as famous rivers and waterfalls, and showed serious under- and over-representation of many morphological and environmental terms. Despite biased training data, we found that with careful prompting, the Stable Diffusion model was able to generate photorealistic synthetic river images reproducing many important environmental and morphological characteristics. Furthermore, conditional control techniques, such as the use of condition maps with ControlNet were effective for providing additional constraints on output images. Despite great potential for the use of TTI models in the earth sciences field, we advocate for caution in sensitive applications, and advocate for domain-specific reviews of training data and image generation biases to mitigate perpetuation of existing biases.


title: Parameter Estimation for Intermediate-Mass Binary Black Holes through Gravitational Waves Observed by DECIGO

abstract: With the anticipated launch of space-based gravitational wave detectors, including LISA, TaiJi, TianQin, and DECIGO, expected around 2030, the detection of gravitational waves generated by intermediate-mass black hole binaries (IMBBHs) becomes a tangible prospect. However, due to the detector's reception of a substantial amount of non-Gaussian, non-stationary data, employing traditional Bayesian inference methods for parameter estimation would result in significant resource demands and limitations in the waveform template library. Therefore, in this paper, we simulated foreground noise induced by stellar-origin binary black holes (SOBBHs), which is non-Gaussian and non-stationary, and we explore the use of Gaussian process regression (GPR) and deep learning for parameter estimation of Intermediate Mass Binary Black Holes (IMBBHs) in the presence of such non-Gaussian, non-stationary background noise. By comparing these results from deep learning and GPR, we demonstrate that deep learning can offer improved precision in parameter estimation compared to traditional GPR. Furthermore, compared to GPR, deep learning can provide posterior distributions of the sample parameters faster.


title: Video Dynamics Prior: An Internal Learning Approach for Robust Video Enhancements

abstract: In this paper, we present a novel robust framework for low-level vision tasks, including denoising, object removal, frame interpolation, and super-resolution, that does not require any external training data corpus. Our proposed approach directly learns the weights of neural modules by optimizing over the corrupted test sequence, leveraging the spatio-temporal coherence and internal statistics of videos. Furthermore, we introduce a novel spatial pyramid loss that leverages the property of spatio-temporal patch recurrence in a video across the different scales of the video. This loss enhances robustness to unstructured noise in both the spatial and temporal domains. This further results in our framework being highly robust to degradation in input frames and yields state-of-the-art results on downstream tasks such as denoising, object removal, and frame interpolation. To validate the effectiveness of our approach, we conduct qualitative and quantitative evaluations on standard video datasets such as DAVIS, UCF-101, and VIMEO90K-T.


title: Stealth dark matter spectrum using LapH and Irreps

abstract: We present non-perturbative lattice calculations of the low-lying meson and baryon spectrum of the SU(4) gauge theory with fundamental fermion constituents. This theory is one instance of stealth dark matter, a class of strongly coupled theories, where the lowest mass stable baryon is the dark matter candidate. This work constitutes the first milestone in the program to study stealth dark matter self-interactions. Here, we focus on reducing excited state contamination in the single baryon channel by applying the Laplacian Heaviside method, as well as projecting our baryon operators onto the irreducible representations of the octahedral group. We compare our resulting spectrum to previous work involving Gaussian smeared non-projected operators and find good agreement with reduced statistical uncertainties. We also present the spectrum of the low-lying odd-parity baryons for the first time.


title: The Real Deal Behind the Artificial Appeal: Inferential Utility of Tabular Synthetic Data

abstract: Recent advances in generative models facilitate the creation of synthetic data to be made available for research in privacy-sensitive contexts. However, the analysis of synthetic data raises a unique set of methodological challenges. In this work, we highlight the importance of inferential utility and provide empirical evidence against naive inference from synthetic data, whereby synthetic data are treated as if they were actually observed. Before publishing synthetic data, it is essential to develop statistical inference tools for such data. By means of a simulation study, we show that the rate of false-positive findings (type 1 error) will be unacceptably high, even when the estimates are unbiased. Despite the use of a previously proposed correction factor, this problem persists for deep generative models, in part due to slower convergence of estimators and resulting underestimation of the true standard error. We further demonstrate our findings through a case study.


title: Conflict Transformation and Management. From Cognitive Maps to Value Trees

abstract: Conflict transformation and management are complex decision processes with extremely high stakes at hand and could greatly benefit from formal approaches to decision support. For this purpose we develop a general framework about how to use problem structuring methods for such purposes. More precisely we show how to transform cognitive maps to value trees in order to promote a more design-oriented approach to decision support aiming at constructing innovative solutions for conflict management purposes. We show that our findings have a much wider validity since they allow to move from a descriptive representation of a problem situation to a more prescriptive one using formal procedures and models.


title: Minimax-optimal estimation for sparse multi-reference alignment with collision-free signals

abstract: The Multi-Reference Alignment (MRA) problem aims at the recovery of an unknown signal from repeated observations under the latent action of a group of cyclic isometries, in the presence of additive noise of high intensity $\sigma$. It is a more tractable version of the celebrated cryo EM model. In the crucial high noise regime, it is known that its sample complexity scales as $\sigma^6$. Recent investigations have shown that for the practically significant setting of sparse signals, the sample complexity of the maximum likelihood estimator asymptotically scales with the noise level as $\sigma^4$. In this work, we investigate minimax optimality for signal estimation under the MRA model for so-called collision-free signals. In particular, this signal class covers the setting of generic signals of dilute sparsity (wherein the support size $s=O(L^{1/3})$, where $L$ is the ambient dimension. We demonstrate that the minimax optimal rate of estimation in for the sparse MRA problem in this setting is $\sigma^2/\sqrt{n}$, where $n$ is the sample size. In particular, this widely generalizes the sample complexity asymptotics for the restricted MLE in this setting, establishing it as the statistically optimal estimator. Finally, we demonstrate a concentration inequality for the restricted MLE on its deviations from the ground truth.


title: A Physics Lab Inside Your Head: Quantum Thought Experiments as an Educational Tool

abstract: Thought experiments are where logical reasoning meets storytelling, catalysing progress in quantum science and technology. Schr\"odinger's famous cat brought quantum science to the public consciousness, while Deutsch's thought experiment to test the many-worlds and Copenhagen interpretations involved the first conception of a quantum computer. I will show how presenting thought experiments using quantum circuits can demystify apparent quantum paradoxes, and provide fun, conceptually important activities for learners to implement themselves on near-term quantum devices. Additionally, I will explain how thought experiments can be used as a first introduction to quantum, and outline a workshop based on the "quantum bomb tester" for school students as young as 11. This paper draws upon my experience in developing and delivering quantum computing workshops in Oxford, and in creating a quantum paradoxes content series with IBM Quantum of videos, blogs and code tutorials.


title: On the Dynamics Under the Unhinged Loss and Beyond

abstract: Recent works have studied implicit biases in deep learning, especially the behavior of last-layer features and classifier weights. However, they usually need to simplify the intermediate dynamics under gradient flow or gradient descent due to the intractability of loss functions and model architectures. In this paper, we introduce the unhinged loss, a concise loss function, that offers more mathematical opportunities to analyze the closed-form dynamics while requiring as few simplifications or assumptions as possible. The unhinged loss allows for considering more practical techniques, such as time-vary learning rates and feature normalization. Based on the layer-peeled model that views last-layer features as free optimization variables, we conduct a thorough analysis in the unconstrained, regularized, and spherical constrained cases, as well as the case where the neural tangent kernel remains invariant. To bridge the performance of the unhinged loss to that of Cross-Entropy (CE), we investigate the scenario of fixing classifier weights with a specific structure, (e.g., a simplex equiangular tight frame). Our analysis shows that these dynamics converge exponentially fast to a solution depending on the initialization of features and classifier weights. These theoretical results not only offer valuable insights, including explicit feature regularization and rescaled learning rates for enhancing practical training with the unhinged loss, but also extend their applicability to other loss functions. Finally, we empirically demonstrate these theoretical results and insights through extensive experiments.


title: A hybrid finite element method for moving-habitat models in two spatial dimensions

abstract: Moving-habitat models track the density of a population whose suitable habitat shifts as a consequence of climate change. Whereas most previous studies in this area consider 1-dimensional space, we derive and study a spatially 2-dimensional moving-habitat model via reaction-diffusion equations. The population inhabits the whole space. The suitable habitat is a bounded region where population growth is positive; the unbounded complement of its closure is unsuitable with negative growth. The interface between the two habitat types moves, depicting the movement of the suitable habitat poleward. Detailed modelling of individual movement behaviour induces a nonstandard discontinuity in the density across the interface. For the corresponding semi-discretised system we prove well-posedness for a constant shifting velocity before constructing an implicit-explicit hybrid finite element method. In this method, a Lagrange multiplier weakly imposes the jump discontinuity across the interface. For a stationary interface, we derive optimal a priori error estimates over a conformal mesh with nonconformal discretisation. We demonstrate with numerical convergence tests that these results hold for the moving interface. Finally, we demonstrate the strength of our hybrid finite element method with two biologically motivated cases, one for a domain with a curved boundary and the other for non-constant shifting velocity.


title: Foundation Models in Robotics: Applications, Challenges, and the Future

abstract: We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In contrast, foundation models pretrained on internet-scale data appear to have superior generalization capabilities, and in some instances display an emergent ability to find zero-shot solutions to problems that are not present in the training data. Foundation models may hold the potential to enhance various components of the robot autonomy stack, from perception to decision-making and control. For example, large language models can generate code or provide common sense reasoning, while vision-language models enable open-vocabulary visual recognition. However, significant open research challenges remain, particularly around the scarcity of robot-relevant training data, safety guarantees and uncertainty quantification, and real-time execution. In this survey, we study recent papers that have used or built foundation models to solve robotics problems. We explore how foundation models contribute to improving robot capabilities in the domains of perception, decision-making, and control. We discuss the challenges hindering the adoption of foundation models in robot autonomy and provide opportunities and potential pathways for future advancements. The GitHub project corresponding to this paper (Preliminary release. We are committed to further enhancing and updating this work to ensure its quality and relevance) can be found here: https://github.com/robotics-survey/Awesome-Robotics-Foundation-Models


title: Regional profile of questionable publishing

abstract: Countries and authors in the academic periphery occasionally have been criticized for contributing to the expansion of questionable publishing because they share a major fraction of papers in questionable journals. On the other side, topics preferred by mainstream journals sometimes necessitate large-scale investigation, which is impossible for developing countries. Thus, local journals, commonly low-impacted, are essential to sustain the regional academia for such countries. In this study, we perform an in-depth analysis of the distribution of questionable publications and journals with their interplay with countries quantifying the influence of questionable publications regarding academia's inequality. We find that low-impact journals play a vital role in the regional academic environment, whereas questionable journals with equivalent impact publish papers from all over the world, both geographically and academically. The business model of questionable journals differs from that of regional journals, and may thus be detrimental to the broader academic community.


title: Gap Theorem on manifolds with small curvature concentration

abstract: In this work, we show that complete non-compact manifolds with non-negative Ricci curvature, Euclidean volume growth and sufficiently small curvature concentration are necessarily flat Euclidean space.


title: Prompted Contextual Transformer for Incomplete-View CT Reconstruction

abstract: Incomplete-view computed tomography (CT) can shorten the data acquisition time and allow scanning of large objects, including sparse-view and limited-angle scenarios, each with various settings, such as different view numbers or angular ranges. However, the reconstructed images present severe, varying artifacts due to different missing projection data patterns. Existing methods tackle these scenarios/settings separately and individually, which are cumbersome and lack the flexibility to adapt to new settings. To enjoy the multi-setting synergy in a single model, we propose a novel Prompted Contextual Transformer (ProCT) for incomplete-view CT reconstruction. The novelties of ProCT lie in two folds. First, we devise a projection view-aware prompting to provide setting-discriminative information, enabling a single ProCT to handle diverse incomplete-view CT settings. Second, we propose artifact-aware contextual learning to sense artifact pattern knowledge from in-context image pairs, making ProCT capable of accurately removing the complex, unseen artifacts. Extensive experimental results on two publicly available clinical CT datasets demonstrate the superior performance of ProCT over state-of-the-art methods -- including single-setting models -- on a wide range of incomplete-view CT settings, strong transferability to unseen datasets and scenarios, and improved performance when sinogram data is available. The code is available at: https://github.com/Masaaki-75/proct


title: Floer-type bipersistence modules and rectangle barcodes

abstract: In this paper, we show that the pointwise finite-dimensional two-parameter persistence module $\mathbb{HF}_*^{(\bullet,\bullet]}$, defined in terms of interlevel filtered Floer homology, is rectangle-decomposable. This allows for the definition of a barcode $\mathcal{B}_*^{(\bullet,\bullet]}$ consisting only of rectangles in $\mathbb{R}^2$ associated with $\mathbb{HF}_*^{(\bullet,\bullet]}$. We observe that this rectangle barcode contains information about Usher's boundary depth and spectral invariants developed by Oh, Schwarz, and Viterbo. Moreover, we establish relevant stability results, particularly concerning the bottleneck distance and Hofer's distance.


title: Finetuning an LLM on Contextual Knowledge of Classics for Q&A

abstract: The open-source publishing of large language models (LLMs) has created many possibilities for how anyone who understands language and has access to a computer can interact with significant tools of artificial intelligence, particularly in the context of learning and knowledge dissemination. However, the utility of these models in specialized fields like Classics is still largely unexplored. This project is an attempt to merge the knowledge of Classics with the capabilities of artificial intelligence by finetuning an LLM to cater to the specific needs of learners and professionals. The goal of this project is to develop an LLM that not only reproduces contextual knowledge accurately but also exhibits a consistent "personality" - and, indeed, has consistent propriety - to appeal to a diverse audience who possess differing levels of knowledge. A significant portion of this project was dedicated to refining the dataset, following the principle of "garbage in, garbage out," to ensure the model generates relevant, useful, and creative responses when given a prompt (a statement, question, or single word). After training and evaluation, my model's ability to handle a vast array of different types of inputs and prompting exceeded expectations for a 355M parameter model, though its occasional hallucinations (especially when set with a high temperature), particularly in its assertions about historical events or its own identity, make it seem somewhat capricious and more work in the form of continuous finetuning will be undertaken.


title: Encoder-minimal and Decoder-minimal Framework for Remote Sensing Image Dehazing

abstract: Haze obscures remote sensing images, hindering valuable information extraction. To this end, we propose RSHazeNet, an encoder-minimal and decoder-minimal framework for efficient remote sensing image dehazing. Specifically, regarding the process of merging features within the same level, we develop an innovative module called intra-level transposed fusion module (ITFM). This module employs adaptive transposed self-attention to capture comprehensive context-aware information, facilitating the robust context-aware feature fusion. Meanwhile, we present a cross-level multi-view interaction module (CMIM) to enable effective interactions between features from various levels, mitigating the loss of information due to the repeated sampling operations. In addition, we propose a multi-view progressive extraction block (MPEB) that partitions the features into four distinct components and employs convolution with varying kernel sizes, groups, and dilation factors to facilitate view-progressive feature learning. Extensive experiments demonstrate the superiority of our proposed RSHazeNet. We release the source code and all pre-trained models at \url{https://github.com/chdwyb/RSHazeNet}.


title: Large Language Model Enhanced Multi-Agent Systems for 6G Communications

abstract: The rapid development of the Large Language Model (LLM) presents huge opportunities for 6G communications, e.g., network optimization and management by allowing users to input task requirements to LLMs by nature language. However, directly applying native LLMs in 6G encounters various challenges, such as a lack of private communication data and knowledge, limited logical reasoning, evaluation, and refinement abilities. Integrating LLMs with the capabilities of retrieval, planning, memory, evaluation and reflection in agents can greatly enhance the potential of LLMs for 6G communications. To this end, we propose a multi-agent system with customized communication knowledge and tools for solving communication related tasks using natural language, comprising three components: (1) Multi-agent Data Retrieval (MDR), which employs the condensate and inference agents to refine and summarize communication knowledge from the knowledge base, expanding the knowledge boundaries of LLMs in 6G communications; (2) Multi-agent Collaborative Planning (MCP), which utilizes multiple planning agents to generate feasible solutions for the communication related task from different perspectives based on the retrieved knowledge; (3) Multi-agent Evaluation and Reflecxion (MER), which utilizes the evaluation agent to assess the solutions, and applies the reflexion agent and refinement agent to provide improvement suggestions for current solutions. Finally, we validate the effectiveness of the proposed multi-agent system by designing a semantic communication system, as a case study of 6G communications.


title: Noise in the reverse process improves the approximation capabilities of diffusion models

abstract: In Score based Generative Modeling (SGMs), the state-of-the-art in generative modeling, stochastic reverse processes are known to perform better than their deterministic counterparts. This paper delves into the heart of this phenomenon, comparing neural ordinary differential equations (ODEs) and neural stochastic differential equations (SDEs) as reverse processes. We use a control theoretic perspective by posing the approximation of the reverse process as a trajectory tracking problem. We analyze the ability of neural SDEs to approximate trajectories of the Fokker-Planck equation, revealing the advantages of stochasticity. First, neural SDEs exhibit a powerful regularizing effect, enabling $L^2$ norm trajectory approximation surpassing the Wasserstein metric approximation achieved by neural ODEs under similar conditions, even when the reference vector field or score function is not Lipschitz. Applying this result, we establish the class of distributions that can be sampled using score matching in SGMs, relaxing the Lipschitz requirement on the gradient of the data distribution in existing literature. Second, we show that this approximation property is preserved when network width is limited to the input dimension of the network. In this limited width case, the weights act as control inputs, framing our analysis as a controllability problem for neural SDEs in probability density space. This sheds light on how noise helps to steer the system towards the desired solution and illuminates the empirical success of stochasticity in generative modeling.


title: Recording provenance of workflow runs with RO-Crate

abstract: Recording the provenance of scientific computation results is key to the support of traceability, reproducibility and quality assessment of data products. Several data models have been explored to address this need, providing representations of workflow plans and their executions as well as means of packaging the resulting information for archiving and sharing. However, existing approaches tend to lack interoperable adoption across workflow management systems. In this work we present Workflow Run RO-Crate, an extension of RO-Crate (Research Object Crate) and Schema.org to capture the provenance of the execution of computational workflows at different levels of granularity and bundle together all their associated products (inputs, outputs, code, etc.). The model is supported by a diverse, open community that runs regular meetings, discussing development, maintenance and adoption aspects. Workflow Run RO-Crate is already implemented by several workflow management systems, allowing interoperable comparisons between workflow runs from heterogeneous systems. We describe the model, its alignment to standards such as W3C PROV, and its implementation in six workflow systems. Finally, we illustrate the application of Workflow Run RO-Crate in two use cases of machine learning in the digital image analysis domain. A corresponding RO-Crate for this article is at https://w3id.org/ro/doi/10.5281/zenodo.10368989


title: High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identification

abstract: Visible-infrared person re-identification (VI-ReID) aims to retrieve images of the same persons captured by visible (VIS) and infrared (IR) cameras. Existing VI-ReID methods ignore high-order structure information of features while being relatively difficult to learn a reasonable common feature space due to the large modality discrepancy between VIS and IR images. To address the above problems, we propose a novel high-order structure based middle-feature learning network (HOS-Net) for effective VI-ReID. Specifically, we first leverage a short- and long-range feature extraction (SLE) module to effectively exploit both short-range and long-range features. Then, we propose a high-order structure learning (HSL) module to successfully model the high-order relationship across different local features of each person image based on a whitened hypergraph network.This greatly alleviates model collapse and enhances feature representations. Finally, we develop a common feature space learning (CFL) module to learn a discriminative and reasonable common feature space based on middle features generated by aligning features from different modalities and ranges. In particular, a modality-range identity-center contrastive (MRIC) loss is proposed to reduce the distances between the VIS, IR, and middle features, smoothing the training process. Extensive experiments on the SYSU-MM01, RegDB, and LLCM datasets show that our HOS-Net achieves superior state-of-the-art performance. Our code is available at \url{https://github.com/Jaulaucoeng/HOS-Net}.


title: Diffusion Models Enable Zero-Shot Pose Estimation for Lower-Limb Prosthetic Users

abstract: The application of 2D markerless gait analysis has garnered increasing interest and application within clinical settings. However, its effectiveness in the realm of lower-limb amputees has remained less than optimal. In response, this study introduces an innovative zero-shot method employing image generation diffusion models to achieve markerless pose estimation for lower-limb prosthetics, presenting a promising solution to gait analysis for this specific population. Our approach demonstrates an enhancement in detecting key points on prosthetic limbs over existing methods, and enables clinicians to gain invaluable insights into the kinematics of lower-limb amputees across the gait cycle. The outcomes obtained not only serve as a proof-of-concept for the feasibility of this zero-shot approach but also underscore its potential in advancing rehabilitation through gait analysis for this unique population.


title: Exploring Popularity Bias in Session-based Recommendation

abstract: Existing work has revealed that large-scale offline evaluation of recommender systems for user-item interactions is prone to bias caused by the deployed system itself, as a form of closed loop feedback. Many adopt the \textit{propensity} concept to analyze or mitigate this empirical issue. In this work, we extend the analysis to session-based setup and adapted propensity calculation to the unique characteristics of session-based recommendation tasks. Our experiments incorporate neural models and KNN-based models, and cover both the music and the e-commerce domain. We study the distributions of propensity and different stratification techniques on different datasets and find that propensity-related traits are actually dataset-specific. We then leverage the effect of stratification and achieve promising results compared to the original models.


title: DTL: Disentangled Transfer Learning for Visual Recognition

abstract: When pre-trained models become rapidly larger, the cost of fine-tuning on downstream tasks steadily increases, too. To economically fine-tune these models, parameter-efficient transfer learning (PETL) is proposed, which only tunes a tiny subset of trainable parameters to efficiently learn quality representations. However, current PETL methods are facing the dilemma that during training the GPU memory footprint is not effectively reduced as trainable parameters. PETL will likely fail, too, if the full fine-tuning encounters the out-of-GPU-memory issue. This phenomenon happens because trainable parameters from these methods are generally entangled with the backbone, such that a lot of intermediate states have to be stored in GPU memory for gradient propagation. To alleviate this problem, we introduce Disentangled Transfer Learning (DTL), which disentangles the trainable parameters from the backbone using a lightweight Compact Side Network (CSN). By progressively extracting task-specific information with a few low-rank linear mappings and appropriately adding the information back to the backbone, CSN effectively realizes knowledge transfer in various downstream tasks. We conducted extensive experiments to validate the effectiveness of our method. The proposed method not only reduces a large amount of GPU memory usage and trainable parameters, but also outperforms existing PETL methods by a significant margin in accuracy, achieving new state-of-the-art on several standard benchmarks. The code is available at https://github.com/heekhero/DTL.


title: Selecting the Number of Sensor Scans in Surveillance Operations

abstract: Searching for concealed threats within a surveillance region is an important role for military sensors. One prominent case is the search for a submarine by a helicopter deploying a dipping sonar in anti-submarine warfare. Another is the utilisation of an uncrewed aerial vehicle for remote detection of land mines. These platforms will deploy an appropriate sensor to search within a given region for a potential threat. The sensors employed may not provide continuous surveillance, but may have active periods where the inherent sensor is scanning for threats. The reasons for disjoint activation periods may be both functional as well as tactical. Therefore, given a specified search pattern under which the surveillance platform operates, the question of the number of sensor scans required becomes relevant for search mission pre-planning. Hence it is not only important to develop a modelling framework to assess performance but it is of relevance to consider whether a minimum number of sensor scans can be determined to guarantee a desired level of performance. Consequently this paper introduces a framework for this and illustrates how it can be utilised in practice.


title: Non-myopic Beam Scheduling for Multiple Smart Target Tracking in Phased Array Radar Network

abstract: A smart target, also referred to as a reactive target, can take maneuvering motions to hinder radar tracking. We address beam scheduling for tracking multiple smart targets in phased array radar networks. We aim to mitigate the performance degradation in previous myopic tracking methods and enhance the system performance, which is measured by a discounted cost objective related to the tracking error covariance (TEC) of the targets. The scheduling problem is formulated as a restless multi-armed bandit problem (RMABP) with state variables, following the Markov decision process. In particular, the problem consists of parallel bandit processes. Each bandit process is associated with a target and evolves with different transition rules for different actions, i.e., either the target is tracked or not. We propose a non-myopic, scalable policy based on Whittle indices for selecting the targets to be tracked at each time. The proposed policy has a linear computational complexity in the number of targets and the truncated time horizon in the index computation, and is hence applicable to large networks with a realistic number of targets. We present numerical evidence that the model satisfies sufficient conditions for indexability (existence of the Whittle index) based upon partial conservation laws, and, through extensive simulations, we validate the effectiveness of the proposed policy in different scenarios.


title: Invariant Graph Transformer

abstract: Rationale discovery is defined as finding a subset of the input data that maximally supports the prediction of downstream tasks. In graph machine learning context, graph rationale is defined to locate the critical subgraph in the given graph topology, which fundamentally determines the prediction results. In contrast to the rationale subgraph, the remaining subgraph is named the environment subgraph. Graph rationalization can enhance the model performance as the mapping between the graph rationale and prediction label is viewed as invariant, by assumption. To ensure the discriminative power of the extracted rationale subgraphs, a key technique named "intervention" is applied. The core idea of intervention is that given any changing environment subgraphs, the semantics from the rationale subgraph is invariant, which guarantees the correct prediction result. However, most, if not all, of the existing rationalization works on graph data develop their intervention strategies on the graph level, which is coarse-grained. In this paper, we propose well-tailored intervention strategies on graph data. Our idea is driven by the development of Transformer models, whose self-attention module provides rich interactions between input nodes. Based on the self-attention module, our proposed invariant graph Transformer (IGT) can achieve fine-grained, more specifically, node-level and virtual node-level intervention. Our comprehensive experiments involve 7 real-world datasets, and the proposed IGT shows significant performance advantages compared to 13 baseline methods.


title: Data-Dependent Higher-Order Clique Selection for Artery-Vein Segmentation by Energy Minimization

abstract: We propose a novel segmentation method based on energy minimization of higher-order potentials. We introduce higher-order terms into the energy to incorporate prior knowledge on the shape of the segments. The terms encourage certain sets of pixels to be entirely in one segment or the other. The sets can for instance be smooth curves in order to help delineate pulmonary vessels, which are known to run in almost straight lines. The higher-order terms can be converted to submodular first-order terms by adding auxiliary variables, which can then be globally minimized using graph cuts. We also determine the weight of these terms, or the degree of the aforementioned encouragement, in a principled way by learning from training data with the ground truth. We demonstrate the effectiveness of the method in a real-world application in fully-automatic pulmonary artery-vein segmentation in CT images.


title: GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networks

abstract: The emergence of Graph Neural Networks (GNNs) in graph data analysis and their deployment on Machine Learning as a Service platforms have raised critical concerns about data misuse during model training. This situation is further exacerbated due to the lack of transparency in local training processes, potentially leading to the unauthorized accumulation of large volumes of graph data, thereby infringing on the intellectual property rights of data owners. Existing methodologies often address either data misuse detection or mitigation, and are primarily designed for local GNN models rather than cloud-based MLaaS platforms. These limitations call for an effective and comprehensive solution that detects and mitigates data misuse without requiring exact training data while respecting the proprietary nature of such data. This paper introduces a pioneering approach called GraphGuard, to tackle these challenges. We propose a training-data-free method that not only detects graph data misuse but also mitigates its impact via targeted unlearning, all without relying on the original training data. Our innovative misuse detection technique employs membership inference with radioactive data, enhancing the distinguishability between member and non-member data distributions. For mitigation, we utilize synthetic graphs that emulate the characteristics previously learned by the target model, enabling effective unlearning even in the absence of exact graph data. We conduct comprehensive experiments utilizing four real-world graph datasets to demonstrate the efficacy of GraphGuard in both detection and unlearning. We show that GraphGuard attains a near-perfect detection rate of approximately 100% across these datasets with various GNN models. In addition, it performs unlearning by eliminating the impact of the unlearned graph with a marginal decrease in accuracy (less than 5%).


title: Dynamic Information Manipulation Game

abstract: We propose a dynamic information manipulation game (DIMG) to investigate the incentives of an information manipulator (IM) to influence the observation rules of a partially observable Markov decision process (POMDP). DIMG is a hierarchical game where the upper-level IM stealthily designs the POMDP's joint state distributions to influence the lower-level controller's actions. DIMP's fundamental feature is characterized by a stage-wise constraint that ensures the consistency between the unobservable marginals of the designed and the original kernels. In an equilibrium of information distortion, the IM minimizes cumulative cost that depends on the controller's informationally manipulated actions generated by the optimal policy to the POMDP. We characterize ex ante and interim equilibria of information distortion and show their connections. The IM's impact is characterized by a tight upper-bound on the performance degradation of the POMDP, which consists of the stage-wise instantaneous informational differences scaled by the amplifications at subsequent stages.


title: The Right-Handed Slepton Bulk Regions for Dark Matter in the Generalized Minimal Supergravity (GmSUGRA)

abstract: We study the light right-handed slepton bulk regions for dark matter from the Generalized Minimal Supergravity (GmSUGRA) in the Minimal Supersymmetric Standard Model (MSSM). In our comprehensive numerical studies, we show that $\mathcal{R_{\tilde{\phi}}}\gtrsim10\%$ is a conservative criteria to formulate bulk region, where $\mathcal{R_{\tilde{\phi}}}\equiv({m_{\tilde{\phi}}-m_{\tilde{\chi}_1^0}})/{m_{\tilde{\chi}_1^0}}$. For right-handed stau as the Next to the Lightest Supersymmetric Partcile (NLSP), we find a large viable parameter space, consistent with the current LHC constraints, Planck2018 dark matter relic density bounds, and direct bounds on neutralino-nucleons scattering cross-section that naturally supports the right-handed stau bulk regions for dark matter. In particular, the upper bounds on the masses of the Lightest Supersymmetric Particle (LSP) neutralino and right-handed stau are about 120.4 GeV and 138 GeV, respectively. This bulk region may be beyond the current LHC reach and could be probed at LUX-ZEPLIN, a next-generation dark matter direct detection experiment, the Future Circular Collider (FCC-ee) at CERN, and the Circular Electron Positron Collider (CEPC). However, the scenario with the right-handed selectron as the NLSP is excluded by the LHC supersymmetry searches.


title: MMSE Design of RIS-aided Communications

abstract: Consider a communication system in which a single antenna user equipment exchanges information with a multi-antenna base station via a reconfigurable intelligent surface (RIS) in the presence of spatially correlated channels and electromagnetic interference (EMI). To exploit the attractive advantages of RIS technology, accurate configuration of its reflecting elements is crucial. In this paper, we use statistical knowledge of channels and EMI to optimize the RIS elements for i) accurate channel estimation and ii) reliable data transmission. In both cases, our goal is to determine the RIS coefficients that minimize the mean square error, resulting in the formulation of two non-convex problems that share the same structure. To solve these two problems, we present an alternating optimization approach that reliably converges to a locally optimal solution. The incorporation of the diagonally scaled steepest descent algorithm, derived from Newton's method, ensures fast convergence with manageable complexity. Numerical results demonstrate the effectiveness of the proposed method under various propagation conditions. Notably, it shows significant advantages over existing alternatives that depend on a sub-optimal configuration of the RIS and are derived on the basis of different criteria.


title: SimAC: A Simple Anti-Customization Method for Protecting Face Privacy against Text-to-Image Synthesis of Diffusion Models

abstract: Despite the success of diffusion-based customization methods on visual content creation, increasing concerns have been raised about such techniques from both privacy and political perspectives. To tackle this issue, several anti-customization methods have been proposed in very recent months, predominantly grounded in adversarial attacks. Unfortunately, most of these methods adopt straightforward designs, such as end-to-end optimization with a focus on adversarially maximizing the original training loss, thereby neglecting nuanced internal properties intrinsic to the diffusion model, and even leading to ineffective optimization in some diffusion time steps.In this paper, we strive to bridge this gap by undertaking a comprehensive exploration of these inherent properties, to boost the performance of current anti-customization approaches. Two aspects of properties are investigated: 1) We examine the relationship between time step selection and the model's perception in the frequency domain of images and find that lower time steps can give much more contributions to adversarial noises. This inspires us to propose an adaptive greedy search for optimal time steps that seamlessly integrates with existing anti-customization methods. 2) We scrutinize the roles of features at different layers during denoising and devise a sophisticated feature-based optimization framework for anti-customization.Experiments on facial benchmarks demonstrate that our approach significantly increases identity disruption, thereby protecting user privacy and copyright. Our code is available at: https://github.com/somuchtome/SimAC.


title: Easy bootstrap for the 3D Ising model

abstract: As a simple lattice model that exhibits a phase transition, the Ising model plays a fundamental role in statistical and condensed matter physics. Its continuum limit also furnishes a basic example of interacting quantum field theories and universality classes. Motivated by a recent bootstrap study of the quantum quartic oscillator, we revisit the conformal bootstrap approach to the 3D Ising model at criticality. Surprisingly, the low-lying properties are determined to good accuracy by simple asymptotic formulae and a few nonperturbative crossing constraints. For instance, the two relevant scaling dimensions $(\Delta_\sigma,\Delta_\epsilon)\approx (0.51810,1.4123)$ are close to the precise results from the bootstrap bounds.


title: BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering

abstract: Medical Visual Question Answering (Med-VQA) is a very important task in healthcare industry, which answers a natural language question with a medical image. Existing VQA techniques in information systems can be directly applied to solving the task. However, they often suffer from (i) the data insufficient problem, which makes it difficult to train the state of the arts (SOTAs) for the domain-specific task, and (ii) the reproducibility problem, that many existing models have not been thoroughly evaluated in a unified experimental setup. To address these issues, this paper develops a Benchmark Evaluation SysTem for Medical Visual Question Answering, denoted by BESTMVQA. Given self-collected clinical data, our system provides a useful tool for users to automatically build Med-VQA datasets, which helps overcoming the data insufficient problem. Users also can conveniently select a wide spectrum of SOTA models from our model library to perform a comprehensive empirical study. With simple configurations, our system automatically trains and evaluates the selected models over a benchmark dataset, and reports the comprehensive results for users to develop new techniques or perform medical practice. Limitations of existing work are overcome (i) by the data generation tool, which automatically constructs new datasets from unstructured clinical data, and (ii) by evaluating SOTAs on benchmark datasets in a unified experimental setup. The demonstration video of our system can be found at https://youtu.be/QkEeFlu1x4A. Our code and data will be available soon.


title: Graph vs. Sequence: An Empirical Study on Knowledge Forms for Knowledge-Grounded Dialogue

abstract: Knowledge-grounded dialogue is a task of generating an informative response based on both the dialogue history and external knowledge source. In general, there are two forms of knowledge: manually annotated knowledge graphs and knowledge text from website. From various evaluation viewpoints, each type of knowledge has advantages and downsides. To further distinguish the principles and determinants from the intricate factors, we conduct a thorough experiment and study on the task to answer three essential questions. The questions involve the choice of appropriate knowledge form, the degree of mutual effects between knowledge and the model selection, and the few-shot performance of knowledge. Supported by statistical shreds of evidence, we offer conclusive solutions and sensible suggestions for directions and standards of future research.


title: Thickness-dependent insulator-to-metal transition in epitaxial RuO2 films

abstract: Epitaxially grown RuO2 films on TiO2 (110) exhibit significant in-plane strain anisotropy, with a compressive strain of - 4.7% along the [001] crystalline direction and a tensile strain of +2.3% along [1-10]. As the film thickness increases, anisotropic strain relaxation is expected. By fabricating Hall bar devices with current channels along two in-plane directions <001> and <1-10>, we revealed anisotropic in-plane transport in RuO2/TiO2 (110) films grown via solid-source metal-organic molecular beam epitaxy approach. For film thicknesses (t_film) < 3.6 nm, the resistivity along <001> exceeds that along <1-10> direction at all temperatures. With further decrease in film thicknesses, we uncover a transition from metallic to insulating behavior at t_film <2.1 nm. Our combined temperature- and magnetic field-dependent electrical transport measurements reveal that this transition from metallic to insulating behavior is driven by electron-electron interactions.


title: Securing Graph Neural Networks in MLaaS: A Comprehensive Realization of Query-based Integrity Verification

abstract: The deployment of Graph Neural Networks (GNNs) within Machine Learning as a Service (MLaaS) has opened up new attack surfaces and an escalation in security concerns regarding model-centric attacks. These attacks can directly manipulate the GNN model parameters during serving, causing incorrect predictions and posing substantial threats to essential GNN applications. Traditional integrity verification methods falter in this context due to the limitations imposed by MLaaS and the distinct characteristics of GNN models. In this research, we introduce a groundbreaking approach to protect GNN models in MLaaS from model-centric attacks. Our approach includes a comprehensive verification schema for GNN's integrity, taking into account both transductive and inductive GNNs, and accommodating varying pre-deployment knowledge of the models. We propose a query-based verification technique, fortified with innovative node fingerprint generation algorithms. To deal with advanced attackers who know our mechanisms in advance, we introduce randomized fingerprint nodes within our design. The experimental evaluation demonstrates that our method can detect five representative adversarial model-centric attacks, displaying 2 to 4 times greater efficiency compared to baselines.


title: MLNet: Mutual Learning Network with Neighborhood Invariance for Universal Domain Adaptation

abstract: Universal domain adaptation (UniDA) is a practical but challenging problem, in which information about the relation between the source and the target domains is not given for knowledge transfer. Existing UniDA methods may suffer from the problems of overlooking intra-domain variations in the target domain and difficulty in separating between the similar known and unknown class. To address these issues, we propose a novel Mutual Learning Network (MLNet) with neighborhood invariance for UniDA. In our method, confidence-guided invariant feature learning with self-adaptive neighbor selection is designed to reduce the intra-domain variations for more generalizable feature representation. By using the cross-domain mixup scheme for better unknown-class identification, the proposed method compensates for the misidentified known-class errors by mutual learning between the closed-set and open-set classifiers. Extensive experiments on three publicly available benchmarks demonstrate that our method achieves the best results compared to the state-of-the-arts in most cases and significantly outperforms the baseline across all the four settings in UniDA. Code is available at https://github.com/YanzuoLu/MLNet.


title: {\alpha}-decay half-lives for even-even isotopes of W to U

abstract: We investigate {\alpha}-decay half-lives for 74 {\le} Z {\le} 92 even-even nuclei within the semiclassical WKB approximation in deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc). The {\alpha}-particle preformation factors are estimated from cluster-formation model using both empirical AME2020 binding energies and numerical ones obtained by a deep neural network (DNN) study in which available DRHBc binding energies are used as training set. We find that our estimated {\alpha}-decay half-lives are qualitatively in agree with experimental results. We also compare our results with the empirical formulae, ZZCW and UNIV. Based on these observation, we extend our predictions of {\alpha}-decay half-lives for the isotopes whose experimental data are not available.


title: Bayesian Estimation of Propensity Scores for Integrating Multiple Cohorts with High-Dimensional Covariates

abstract: Comparative meta-analyses of groups of subjects by integrating multiple observational studies rely on estimated propensity scores (PSs) to mitigate covariate imbalances. However, PS estimation grapples with the theoretical and practical challenges posed by high-dimensional covariates. Motivated by an integrative analysis of breast cancer patients across seven medical centers, this paper tackles the challenges associated with integrating multiple observational datasets. The proposed inferential technique, called Bayesian Motif Submatrices for Covariates (B-MSC), addresses the curse of dimensionality by a hybrid of Bayesian and frequentist approaches. B-MSC uses nonparametric Bayesian "Chinese restaurant" processes to eliminate redundancy in the high-dimensional covariates and discover latent motifs or lower-dimensional structure. With these motifs as potential predictors, standard regression techniques can be utilized to accurately infer the PSs and facilitate covariate-balanced group comparisons. Simulations and meta-analysis of the motivating cancer investigation demonstrate the efficacy of the B-MSC approach to accurately estimate the propensity scores and efficiently address covariate imbalance when integrating observational health studies with high-dimensional covariates.


title: Efficient Entropy-Stable Discontinuous Spectral-Element Methods Using Tensor-Product Summation-by-Parts Operators on Triangles and Tetrahedra

abstract: We present a new class of efficient and robust discontinuous spectral-element methods of arbitrary order for nonlinear hyperbolic systems of conservation laws on curved triangular and tetrahedral unstructured grids. Such discretizations employ a recently introduced family of sparse tensor-product summation-by-parts (SBP) operators in collapsed coordinates within an entropy-stable modal formulation. The proposed algorithms exploit the structure of such SBP operators alongside that of the Proriol-Koornwinder-Dubiner polynomial basis, and a weight-adjusted approximation is used to efficiently invert the local mass matrix for curvilinear elements. Using such techniques, the number of required entropy-conservative two-point flux evaluations between pairs of quadrature nodes is significantly reduced relative to existing entropy-stable formulations using (non-tensor-product) multidimensional SBP operators, particularly for high polynomial degrees, with an improvement in time complexity from $\mathcal{O}(p^{2d})$ to $\mathcal{O}(p^{d+1})$, where $p$ is the polynomial degree of the approximation and $d$ is the number of spatial dimensions. In numerical experiments involving smooth solutions to the compressible Euler equations, the proposed tensor-product schemes demonstrate similar levels of accuracy for a given mesh and polynomial degree to those using multidimensional SBP operators based on symmetric quadrature rules. Furthermore, both operator families are shown to give rise to entropy-stable methods which exhibit excellent robustness for under-resolved problems. Such results suggest that the algorithmic advantages resulting from the use of tensor-product operators are obtained without compromising accuracy or robustness, enabling the efficient extension of the benefits of entropy stability to higher polynomial degrees than previously considered for triangular and tetrahedral elements.


title: Enhance Sketch Recognition's Explainability via Semantic Component-Level Parsing

abstract: Free-hand sketches are appealing for humans as a universal tool to depict the visual world. Humans can recognize varied sketches of a category easily by identifying the concurrence and layout of the intrinsic semantic components of the category, since humans draw free-hand sketches based a common consensus that which types of semantic components constitute each sketch category. For example, an airplane should at least have a fuselage and wings. Based on this analysis, a semantic component-level memory module is constructed and embedded in the proposed structured sketch recognition network in this paper. The memory keys representing semantic components of each sketch category can be self-learned and enhance the recognition network's explainability. Our proposed networks can deal with different situations of sketch recognition, i.e., with or without semantic components labels of strokes. Experiments on the SPG and SketchIME datasets demonstrate the memory module's flexibility and the recognition network's explainability. The code and data are available at https://github.com/GuangmingZhu/SketchESC.


title: Causality Analysis for Evaluating the Security of Large Language Models

abstract: Large Language Models (LLMs) such as GPT and Llama2 are increasingly adopted in many safety-critical applications. Their security is thus essential. Even with considerable efforts spent on reinforcement learning from human feedback (RLHF), recent studies have shown that LLMs are still subject to attacks such as adversarial perturbation and Trojan attacks. Further research is thus needed to evaluate their security and/or understand the lack of it. In this work, we propose a framework for conducting light-weight causality-analysis of LLMs at the token, layer, and neuron level. We applied our framework to open-source LLMs such as Llama2 and Vicuna and had multiple interesting discoveries. Based on a layer-level causality analysis, we show that RLHF has the effect of overfitting a model to harmful prompts. It implies that such security can be easily overcome by `unusual' harmful prompts. As evidence, we propose an adversarial perturbation method that achieves 100\% attack success rate on the red-teaming tasks of the Trojan Detection Competition 2023. Furthermore, we show the existence of one mysterious neuron in both Llama2 and Vicuna that has an unreasonably high causal effect on the output. While we are uncertain on why such a neuron exists, we show that it is possible to conduct a ``Trojan'' attack targeting that particular neuron to completely cripple the LLM, i.e., we can generate transferable suffixes to prompts that frequently make the LLM produce meaningless responses.


title: Segment-Based Formal Verification of WiFi Fragmentation and Power Save Mode

abstract: The IEEE 802.11 family of standards, better known as WiFi, is a widely used protocol utilized by billions of users. Previous works on WiFi formal verification have mostly focused on the four-way handshake and other security aspects. However, recent works have uncovered severe vulnerabilities in functional aspects of WiFi, which can cause information leakage for billions of devices. No formal analysis method exists able to reason on the functional aspects of the WiFi protocol. In this paper, we take the first steps in addressing this gap and present an extensive formal analysis of the functional aspects of the WiFi protocol, more specifically, the fragmentation and the power-save-mode process. To achieve this, we design a novel segment-based formal verification process and introduce a practical threat model (i.e. MAC spoofing) in Tamarin to reason about the various capabilities of the attacker. To this end, we verify 68 properties extracted from WiFi protocol specification, find 3 vulnerabilities from the verification, verify 3 known attacks, and discover 2 new issues. These vulnerabilities and issues affect 14 commercial devices out of 17 tested cases, showing the prevalence and impact of the issues. Apart from this, we show that the proposed countermeasures indeed are sufficient to address the issues. We hope our results and analysis will help vendors adopt the countermeasures and motivate further research into the verification of the functional aspects of the WiFi protocol.


title: New Kids on the Block: On the impact of information retrieval on contextual resource integration patterns

abstract: The rise of new modes of interaction with AI skyrocketed the popularity, applicability, and amount of use cases. Despite this evolution, conceptual integration is falling behind. Studies suggest that there is hardly a systematization in using AI in organizations. Thus, by taking a service-dominant logic perspective, specifically, the concept of resource integration patterns, the most potent application of AI for organizational use - namely information retrieval - is analyzed. In doing so, we propose a systematization that can be applied to deepen understanding of core technical concepts, further investigate AI in contexts, and help explore research directions guided by SDL.


title: CoIE: Chain-of-Instruct Editing for Multi-Attribute Face Manipulation

abstract: Current text-to-image editing models often encounter challenges with smoothly manipulating multiple attributes using a single instruction. Taking inspiration from the Chain-of-Thought prompting technique utilized in language models, we present an innovative concept known as Chain-of-Instruct Editing (CoIE), which enhances the capabilities of these models through step-by-step editing using a series of instructions. In particular, in the context of face manipulation, we leverage the contextual learning abilities of a pretrained Large Language Model (LLM), such as GPT-4, to generate a sequence of instructions from the original input, utilizing a purpose-designed 1-shot template. To further improve the precision of each editing step, we conduct fine-tuning on the editing models using our self-constructed instruction-guided face editing dataset, Instruct-CelebA. And additionally, we incorporate a super-resolution module to mitigate the adverse effects of editability and quality degradation. Experimental results across various challenging cases confirm the significant boost in multi-attribute facial image manipulation using chain-of-instruct editing. This is evident in enhanced editing success rates, measured by CLIPSim and Coverage metrics, improved by 17.86% and 85.45% respectively, and heightened controllability indicated by Preserve L1 and Quality metrics, improved by 11.58% and 4.93% respectively.