title: A Novel Generative AI-Based Framework for Anomaly Detection in Multicast Messages in Smart Grid Communications

abstract: Cybersecurity breaches in digital substations can pose significant challenges to the stability and reliability of power system operations. To address these challenges, defense and mitigation techniques are required. Identifying and detecting anomalies in information and communication technology (ICT) is crucial to ensure secure device interactions within digital substations. This paper proposes a task-oriented dialogue (ToD) system for anomaly detection (AD) in datasets of multicast messages e.g., generic object oriented substation event (GOOSE) and sampled value (SV) in digital substations using large language models (LLMs). This model has a lower potential error and better scalability and adaptability than a process that considers the cybersecurity guidelines recommended by humans, known as the human-in-the-loop (HITL) process. Also, this methodology significantly reduces the effort required when addressing new cyber threats or anomalies compared with machine learning (ML) techniques, since it leaves the models complexity and precision unaffected and offers a faster implementation. These findings present a comparative assessment, conducted utilizing standard and advanced performance evaluation metrics for the proposed AD framework and the HITL process. To generate and extract datasets of IEC 61850 communications, a hardware-in-the-loop (HIL) testbed was employed.


title: Field-Based Formalism for Calculating Multi-Qubit Exchange Coupling Rates for Transmon Qubits

abstract: Superconducting qubits are one of the most mature platforms for quantum computing, but significant performance improvements are still needed. To improve the engineering of these systems, 3D full-wave computational electromagnetics analyses are increasingly being used. Unfortunately, existing analysis approaches often rely on full-wave simulations using eigenmode solvers that are typically cumbersome, not robust, and computationally prohibitive if devices with more than a few qubits are to be analyzed. To improve the characterization of superconducting circuits while circumventing these drawbacks, this work begins the development of an alternative framework that we illustrate in the context of evaluating the qubit-qubit exchange coupling rate between transmon qubits. This is a key design parameter that determines the entanglement rate for fast multi-qubit gate performance and also affects decoherence sources like qubit crosstalk. Our modeling framework uses a field-based formalism in the context of macroscopic quantum electrodynamics, which we use to show that the qubit-qubit exchange coupling rate can be related to the electromagnetic dyadic Green's function linking the qubits together. We further show how the quantity involving the dyadic Green's function can be related to the impedance response of the system that can be efficiently computed with classical computational electromagnetics tools. We demonstrate the validity and efficacy of this approach by simulating four practical multi-qubit superconducting circuits and evaluating their qubit-qubit exchange coupling rates. We validate our results against a 3D numerical diagonalization method and against experimental data where available. We also demonstrate the impact of the qubit-qubit exchange coupling rate on qubit crosstalk by simulating a multi-coupler device and identifying operating points where the qubit crosstalk becomes zero.


title: Accelerated Stochastic Gradient Method with Applications to Consensus Problem in Markov-Varying Networks

abstract: Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization algorithm designed for scenarios where Markovian noise is present, incorporating Nesterov acceleration for enhanced efficiency. The convergence analysis is performed using an assumption on noise depending on the distance to the solution. We also delve into the consensus problem over Markov-varying networks, exploring how this algorithm can be applied to achieve agreement among multiple agents with differing objectives during changes in the communication system. To show the performance of our method on the problem above, we conduct experiments to demonstrate the superiority over the classic approach.


title: HDRT: Infrared Capture for HDR Imaging

abstract: Capturing real world lighting is a long standing challenge in imaging and most practical methods acquire High Dynamic Range (HDR) images by either fusing multiple exposures, or boosting the dynamic range of Standard Dynamic Range (SDR) images. Multiple exposure capture is problematic as it requires longer capture times which can often lead to ghosting problems. The main alternative, inverse tone mapping is an ill-defined problem that is especially challenging as single captured exposures usually contain clipped and quantized values, and are therefore missing substantial amounts of content. To alleviate this, we propose a new approach, High Dynamic Range Thermal (HDRT), for HDR acquisition using a separate, commonly available, thermal infrared (IR) sensor. We propose a novel deep neural method (HDRTNet) which combines IR and SDR content to generate HDR images. HDRTNet learns to exploit IR features linked to the RGB image and the IR-specific parameters are subsequently used in a dual branch method that fuses features at shallow layers. This produces an HDR image that is significantly superior to that generated using naive fusion approaches. To validate our method, we have created the first HDR and thermal dataset, and performed extensive experiments comparing HDRTNet with the state-of-the-art. We show substantial quantitative and qualitative quality improvements on both over- and under-exposed images, showing that our approach is robust to capturing in multiple different lighting conditions.


title: Deformation localisation in stretched liquid crystal elastomers

abstract: We model within the framework of finite elasticity two inherent instabilities observed in liquid crystal elastomers under uniaxial tension. First is necking which occurs when a material sample suddenly elongates more in a small region where it appears narrower than the rest of the sample. Second is shear striping, which forms when the in-plane director rotates gradually to realign and become parallel with the applied force. These phenomena are due to the liquid crystal molecules rotating freely under mechanical loading. To capture necking, we assume that the uniaxial order parameter increases with tensile stretch, as reported experimentally during polydomain-monodomain transition. To account for shear striping, we maintain the uniaxial order parameter fixed, as suggested by experiments. Our finite element simulations capture well these phenomena. As necking in liquid crystal elastomers has not been satisfactorily modelled before, our theoretical and numerical findings related to this effect can be of wide interest. Shear striping has been well studied, yet our computed examples also show how optimal stripe width increases with the nematic penetration depth measuring the competition between the Frank elasticity of liquid crystals and polymer elasticity. Although known theoretically, this result has not been confirmed numerically by previous nonlinear elastic models.


title: Attri-Net: A Globally and Locally Inherently Interpretable Model for Multi-Label Classification Using Class-Specific Counterfactuals

abstract: Interpretability is crucial for machine learning algorithms in high-stakes medical applications. However, high-performing neural networks typically cannot explain their predictions. Post-hoc explanation methods provide a way to understand neural networks but have been shown to suffer from conceptual problems. Moreover, current research largely focuses on providing local explanations for individual samples rather than global explanations for the model itself. In this paper, we propose Attri-Net, an inherently interpretable model for multi-label classification that provides local and global explanations. Attri-Net first counterfactually generates class-specific attribution maps to highlight the disease evidence, then performs classification with logistic regression classifiers based solely on the attribution maps. Local explanations for each prediction can be obtained by interpreting the attribution maps weighted by the classifiers' weights. Global explanation of whole model can be obtained by jointly considering learned average representations of the attribution maps for each class (called the class centers) and the weights of the linear classifiers. To ensure the model is ``right for the right reason", we further introduce a mechanism to guide the model's explanations to align with human knowledge. Our comprehensive evaluations show that Attri-Net can generate high-quality explanations consistent with clinical knowledge while not sacrificing classification performance.


title: Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis

abstract: The field of image synthesis is currently flourishing due to the advancements in diffusion models. While diffusion models have been successful, their computational intensity has prompted the pursuit of more efficient alternatives. As a representative work, non-autoregressive Transformers (NATs) have been recognized for their rapid generation. However, a major drawback of these models is their inferior performance compared to diffusion models. In this paper, we aim to re-evaluate the full potential of NATs by revisiting the design of their training and inference strategies. Specifically, we identify the complexities in properly configuring these strategies and indicate the possible sub-optimality in existing heuristic-driven designs. Recognizing this, we propose to go beyond existing methods by directly solving the optimal strategies in an automatic framework. The resulting method, named AutoNAT, advances the performance boundaries of NATs notably, and is able to perform comparably with the latest diffusion models at a significantly reduced inference cost. The effectiveness of AutoNAT is validated on four benchmark datasets, i.e., ImageNet-256 & 512, MS-COCO, and CC3M. Our code is available at https://github.com/LeapLabTHU/ImprovedNAT.


title: Microscopic Dynamics of Particle Rearrangement and its Correlation with Stick-slip Behavior in Granular Shear

abstract: The link between the microscopic dynamics of particles and the macroscale response of granular materials has not been well established. To address this, we investigated the microscopic dynamics and fluctuations in the force network in a granular material subjected to plane shear. A two-dimensional discrete element model of a plane shear test was established, considering both sliding and rolling friction. We found that particle rearrangement originated from the reduction of inter-particle forces in an identifiable region, which we call the greatest reduction (GR) region, defined as a region containing inter-particle forces experiencing the greatest decrease in magnitude in a given time interval. Statistical analysis shows that not only the magnitude of the greatest non-affine deformation in the GR region but also dynamics of neighboring particles in the region are highly correlated with the macroscale shear stress drop. These trends were also observed for various sliding friction coefficients and for simulations containing many particles. However, the quantity and configuration of GR regions had minimal impact on macroscale stress drops. We expect that this study will shed new light on the relationship between microscopic dynamics and force network fluctuations in sheared granular media and contribute to developing a mesoscale elasto-plastic model for these materials.


title: Free algebras and coproducts in varieties of G\"odel algebras

abstract: G\"odel algebras are the Heyting algebras satisfying the axiom $(x \to y) \vee (y \to x)=1$. We utilize Priestley and Esakia dualities to dually describe free G\"odel algebras and coproducts of G\"odel algebras. In particular, we realize the Esakia space dual to a G\"odel algebra free over a distributive lattice as the, suitably topologized and ordered, collection of all nonempty closed chains of the Priestley dual of the lattice. This provides a dual description of free G\"odel algebras without any restriction on the number of free generators, which generalizes known results for the finitely generated case. A similar approach allows us to characterize the Esakia spaces dual to coproducts of arbitrary families of G\"odel algebras. We also establish analogous dual descriptions of free algebras and coproducts in every variety of G\"odel algebras. As consequences of these results, we obtain a formula to compute the depth of coproducts of G\"odel algebras and show that all free G\"odel algebras are bi-Heyting algebras.


title: Joint Cooperative Clustering and Power Control for Energy-Efficient Cell-Free XL-MIMO with Multi-Agent Reinforcement Learning

abstract: In this paper, we investigate the amalgamation of cell-free (CF) and extremely large-scale multiple-input multiple-output (XL-MIMO) technologies, referred to as a CF XL-MIMO, as a promising advancement for enabling future mobile networks. To address the computational complexity and communication power consumption associated with conventional centralized optimization, we focus on user-centric dynamic networks in which each user is served by an adaptive subset of access points (AP) rather than all of them. We begin our research by analyzing a joint resource allocation problem for energy-efficient CF XL-MIMO systems, encompassing cooperative clustering and power control design, where all clusters are adaptively adjustable. Then, we propose an innovative double-layer multi-agent reinforcement learning (MARL)-based scheme, which offers an effective strategy to tackle the challenges of high-dimensional signal processing. In the section of numerical results, we compare various algorithms with different network architectures. These comparisons reveal that the proposed MARL-based cooperative architecture can effectively strike a balance between system performance and communication overhead, thereby improving energy efficiency performance. It is important to note that increasing the number of user equipments participating in information sharing can effectively enhance SE performance, which also leads to an increase in power consumption, resulting in a non-trivial trade-off between the number of participants and EE performance.


title: Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

abstract: In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations of each node are learned by recursively aggregating features of its neighbors. However, this mechanism brings severe over-smoothing and efficiency issues over high-degree graphs (HDGs), wherein most nodes have dozens (or even hundreds) of neighbors, such as social networks, transaction graphs, power grids, etc. Additionally, such graphs usually encompass rich and complex structure semantics, which are hard to capture merely by feature aggregations in GNNs. Motivated by the above limitations, we propose TADA, an efficient and effective front-mounted data augmentation framework for GNNs on HDGs. Under the hood, TADA includes two key modules: (i) feature expansion with structure embeddings, and (ii) topology- and attribute-aware graph sparsification. The former obtains augmented node features and enhanced model capacity by encoding the graph structure into high-quality structure embeddings with our highly-efficient sketching method. Further, by exploiting task-relevant features extracted from graph structures and attributes, the second module enables the accurate identification and reduction of numerous redundant/noisy edges from the input graph, thereby alleviating over-smoothing and facilitating faster feature aggregations over HDGs. Empirically, TADA considerably improves the predictive performance of mainstream GNN models on 8 real homophilic/heterophilic HDGs in terms of node classification, while achieving efficient training and inference processes.


title: Component Matching Approach in Linking Business and Application Architecture

abstract: The development of an IT strategy and ensuring that it is the best possible one for business is a key problem many organizations face. This problem is that of linking business architecture to IT architecture in general and application architecture specifically. In our earlier work we proposed Category theory as the formal language to unify the business and IT worlds with the ability to represent the concepts and relations between the two in a unified way. We used rCOS as the underlying model for the specification of interfaces, contracts, and components. The concept of pseudo-category was then utilized to represent the business and application architecture specifications and the relationships contained within. The linkages between them now can be established using the matching of the business component contracts with the application component contracts. However the matching was based on manual process and in this paper we extend the work by considering automated component matching process. The ground work for a tool to support the matching process is laid out in this paper.


title: A Real-Valued Description of Quantum Mechanics with Schrodinger's 4th-order Matter-Wave Equation

abstract: Using a variational formulation, we show that Schrodinger's 4th-order, real-valued matter-wave equation which involves the spatial derivatives of the potential V(r), produces the precise eigenvalues of Schrodinger's 2nd-order, complex-valued matter-wave equation together with an equal number of negative, mirror eigenvalues. Accordingly, the paper concludes that there is a real-valued description of non-relativistic quantum mechanics in association with the existence of negative (repelling) energy levels. Schrodinger's classical 2nd-order, complex-valued matter-wave equation which was constructed upon factoring the 4th-order, real-valued differential operator and retaining only one of the two conjugate complex operators is a simpler description of the matter-wave, since it does not involve the derivatives of the potential V(r), at the expense of missing the negative (repelling) energy levels.


title: Training-Free Robust Interactive Video Object Segmentation

abstract: Interactive video object segmentation is a crucial video task, having various applications from video editing to data annotating. However, current approaches struggle to accurately segment objects across diverse domains. Recently, Segment Anything Model (SAM) introduces interactive visual prompts and demonstrates impressive performance across different domains. In this paper, we propose a training-free prompt tracking framework for interactive video object segmentation (I-PT), leveraging the powerful generalization of SAM. Although point tracking efficiently captures the pixel-wise information of objects in a video, points tend to be unstable when tracked over a long period, resulting in incorrect segmentation. Towards fast and robust interaction, we jointly adopt sparse points and boxes tracking, filtering out unstable points and capturing object-wise information. To better integrate reference information from multiple interactions, we introduce a cross-round space-time module (CRSTM), which adaptively aggregates mask features from previous rounds and frames, enhancing the segmentation stability. Our framework has demonstrated robust zero-shot video segmentation results on popular VOS datasets with interaction types, including DAVIS 2017, YouTube-VOS 2018, and MOSE 2023, maintaining a good tradeoff between performance and interaction time.


title: Artificial social influence via human-embodied AI agent interaction in immersive virtual reality (VR): Effects of similarity-matching during health conversations

abstract: Interactions with artificial intelligence (AI) based agents can positively influence human behavior and judgment. However, studies to date focus on text-based conversational agents (CA) with limited embodiment, restricting our understanding of how social influence principles, such as similarity, apply to AI agents (i.e., artificial social influence). We address this gap by leveraging the latest advances in AI (language models) and combining them with immersive virtual reality (VR). Specifically, we built VR-ECAs, or embodied conversational agents that can naturally converse with humans about health-related topics in a virtual environment. Then we manipulated human-agent similarity via gender matching and examined its effects on biobehavioral (i.e., gaze), social (e.g., agent likeability), and behavioral outcomes (i.e., healthy snack selection). We found that discussing health with opposite-gender agents enhanced gaze duration and the likelihood of healthy snack selection. In addition, female participants liked the VR-ECAs more than their male counterparts, regardless of the gender of the VR-ECAs. Finally, participants experienced greater presence while conversing with VR-embodied agents than chatting with text-only agents. Overall, our findings highlight embodiment as a crucial factor in how AI influences human behavior, and our paradigm enables new experimental research at the intersection of social influence, human-AI communication, and immersive virtual reality (VR).


title: SyDRA: An Approach to Understand Game Engine Architecture

abstract: Game engines are tools to facilitate video game development. They provide graphics, sound, and physics simulation features, which would have to be otherwise implemented by developers. Even though essential for modern commercial video game development, game engines are complex and developers often struggle to understand their architecture, leading to maintainability and evolution issues that negatively affect video game productions. In this paper, we present the Subsystem-Dependency Recovery Approach (SyDRA), which helps game engine developers understand game engine architecture and therefore make informed game engine development choices. By applying this approach to 10 open-source game engines, we obtain architectural models that can be used to compare game engine architectures and identify and solve issues of excessive coupling and folder nesting. Through a controlled experiment, we show that the inspection of the architectural models derived from SyDRA enables developers to complete tasks related to architectural understanding and impact analysis in less time and with higher correctness than without these models.


title: Online Policy Distillation with Decision-Attention

abstract: Policy Distillation (PD) has become an effective method to improve deep reinforcement learning tasks. The core idea of PD is to distill policy knowledge from a teacher agent to a student agent. However, the teacher-student framework requires a well-trained teacher model which is computationally expensive.In the light of online knowledge distillation, we study the knowledge transfer between different policies that can learn diverse knowledge from the same environment.In this work, we propose Online Policy Distillation (OPD) with Decision-Attention (DA), an online learning framework in which different policies operate in the same environment to learn different perspectives of the environment and transfer knowledge to each other to obtain better performance together. With the absence of a well-performance teacher policy, the group-derived targets play a key role in transferring group knowledge to each student policy. However, naive aggregation functions tend to cause student policies quickly homogenize. To address the challenge, we introduce the Decision-Attention module to the online policies distillation framework. The Decision-Attention module can generate a distinct set of weights for each policy to measure the importance of group members. We use the Atari platform for experiments with various reinforcement learning algorithms, including PPO and DQN. In different tasks, our method can perform better than an independent training policy on both PPO and DQN algorithms. This suggests that our OPD-DA can transfer knowledge between different policies well and help agents obtain more rewards.


title: On a class of multi-fidelity methods for the semiclassical Schr\"odinger equation with uncertainties

abstract: In this paper, we study the semiclassical Schr\"odinger equation with random parameters and develop several robust multi-fidelity methods. We employ the time-splitting Fourier pseudospectral (TSFP) method for the high-fidelity solver, and consider different low-fidelity solvers including the meshless method like frozen Gaussian approximation (FGA) and the level set (LS) method for the semiclassical limit of the Schr\"odinger equation. With a careful choice of the low-fidelity model, we obtain an error estimate for the bi-fidelity method. We conduct numerous numerical experiments and validate the accuracy and efficiency of our proposed multi-fidelity methods, by comparing the performance of a class of bi-fidelity and tri-fidelity approximations.


title: Beatnik: A Novel Global Communication Mini-Application

abstract: Beatnik is a novel open source mini-application that exercises the complex communication patterns often found in production codes but rarely found in benchmarks or mini-applications. It simulates 3D Raleigh-Taylor instabilities based on Pandya and Shkoller's Z-Model formulation using the Cabana performance portability framework. This paper presents both the high-level design and important implementation details about Beatnik along with four benchmark setups for evaluating different aspects of HPC communication system performance. Evaluation results demonstrate both Beatnik's scalability on modern accelerator-based systems using weak and strong scaling tests up to 1024 GPUs, along with Beatnik's ability to expose communication challenges in modern systems and solver libraries.


title: One Perturbation is Enough: On Generating Universal Adversarial Perturbations against Vision-Language Pre-training Models

abstract: Vision-Language Pre-training (VLP) models trained on large-scale image-text pairs have demonstrated unprecedented capability in many practical applications. However, previous studies have revealed that VLP models are vulnerable to adversarial samples crafted by a malicious adversary. While existing attacks have achieved great success in improving attack effect and transferability, they all focus on instance-specific attacks that generate perturbations for each input sample. In this paper, we show that VLP models can be vulnerable to a new class of universal adversarial perturbation (UAP) for all input samples. Although initially transplanting existing UAP algorithms to perform attacks showed effectiveness in attacking discriminative models, the results were unsatisfactory when applied to VLP models. To this end, we revisit the multimodal alignments in VLP model training and propose the Contrastive-training Perturbation Generator with Cross-modal conditions (C-PGC). Specifically, we first design a generator that incorporates cross-modal information as conditioning input to guide the training. To further exploit cross-modal interactions, we propose to formulate the training objective as a multimodal contrastive learning paradigm based on our constructed positive and negative image-text pairs. By training the conditional generator with the designed loss, we successfully force the adversarial samples to move away from its original area in the VLP model's feature space, and thus essentially enhance the attacks. Extensive experiments show that our method achieves remarkable attack performance across various VLP models and Vision-and-Language (V+L) tasks. Moreover, C-PGC exhibits outstanding black-box transferability and achieves impressive results in fooling prevalent large VLP models including LLaVA and Qwen-VL.


title: Shifted twisted Yangians and Slodowy slices in classical Lie algebras

abstract: In this paper we introduce the shifted twisted Yangian of type {\sf AI}, following the work of Lu--Wang--Zhang, and we study their semiclassical limits, a class of Poisson algebras. We demonstrate that they coincide with the Dirac reductions of the semiclassical shifted Yangian for $\gl_n$. We deduce that these shifted twisted Yangians admit truncations which are isomorphic to Slodowy slices for many non-rectangular nilpotent elements in types {\sf B}, {\sf C}, {\sf D}. As a direct consequence we obtain parabolic presentations of the semiclassical shifted twisted Yangian, analogous to those introduced by Brundan--Kleshchev for the Yangian of type {\sf A}. Finally we give Poisson presentations of Slodowy slices for all even nilpotent elements in types {\sf B}, {\sf C}, {\sf D}, generalising the recent work of the second author.


title: Highly Polarized Energetic Electrons via Intense Laser-Irradiated Tailored Targets

abstract: A method for the generation of ultrarelativistic electron beams with high spin polarization is put forward, where a tightly-focused linearly-polarized ultraintense laser pulse interacts with a nonprepolarized transverse-size-tailored solid target. The radiative spin polarization and angular separation is facilitated by the standing wave formed via the incident and reflected laser pulses at the overdense plasma surface. Strong electron heating caused by transverse instability enhances photon emission in the density spikes injected into the standing wave near the surface. Two groups of electrons with opposite transverse polarization emerge, anti-aligned to the magnetic field, which are angularly separated in the standing wave due to the phase-matched oscillation of the magnetic field and the vector potential. The polarized electrons propelled into the plasma slab, are focused at the exit by the self-generated quasistatic fields. Our particle-in-cell simulations demonstrate the feasibility of highly polarized electrons with a single 10 PW laser beam, e.g. with polarization of 60% and charge of 8 pC selected at energy of 200 MeV within 15 mrad angle and 10% energy spread.


title: Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation

abstract: Large Language Models (LLMs) have achieved remarkable performance across a wide variety of natural language tasks. However, they have been shown to suffer from a critical limitation pertinent to 'hallucination' in their output. Recent research has focused on investigating and addressing this problem for a variety of tasks such as biography generation, question answering, abstractive summarization, and dialogue generation. However, the crucial aspect pertaining to 'negation' has remained considerably underexplored. Negation is important because it adds depth and nuance to the understanding of language and is also crucial for logical reasoning and inference. In this work, we address the above limitation and particularly focus on studying the impact of negation in LLM hallucinations. Specifically, we study four tasks with negation: 'false premise completion', 'constrained fact generation', 'multiple choice question answering', and 'fact generation'. We show that open-source state-of-the-art LLMs such as LLaMA-2-chat, Vicuna, and Orca-2 hallucinate considerably on all these tasks involving negation which underlines a critical shortcoming of these models. Addressing this problem, we further study numerous strategies to mitigate these hallucinations and demonstrate their impact.


title: Dimension of Bernoulli Convolutions in $\mathbb{R}^{d}$

abstract: For $(\lambda_{1},...,\lambda_{d})=\lambda\in(0,1)^{d}$ with $\lambda_{1}>...>\lambda_{d}$, denote by $\mu_{\lambda}$ the Bernoulli convolution associated to $\lambda$. That is, $\mu_{\lambda}$ is the distribution of the random vector $\sum_{n\ge0}\pm\left(\lambda_{1}^{n},...,\lambda_{d}^{n}\right)$, where the $\pm$ signs are chosen independently and with equal weight. Assuming for each $1\le j\le d$ that $\lambda_{j}$ is not a root of a polynomial with coefficients $\pm1,0$, we prove that the dimension of $\mu_{\lambda}$ equals $\min\left\{ \dim_{L}\mu_{\lambda},d\right\} $, where $\dim_{L}\mu_{\lambda}$ is the Lyapunov dimension. More generally, we obtain this result in the context of homogeneous diagonal self-affine systems on $\mathbb{R}^{d}$ with rational translations. The proof extends to higher dimensions the works of Breuillard and Varj\'u and Varj\'u regarding Bernoulli convolutions on the real line. The main novelty and contribution of the present work lies in an extension of an entropy increase result, due to Varj\'u, in which the amount of increase in entropy is given explicitly. The extension of this result to the higher-dimensional non-conformal case requires significant new ideas.


title: Generalist Multimodal AI: A Review of Architectures, Challenges and Opportunities

abstract: Multimodal models are expected to be a critical component to future advances in artificial intelligence. This field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural language processing (NLP) and vision. It is widely hoped that further extending the foundation models to multiple modalities (e.g., text, image, video, sensor, time series, graph, etc.) will ultimately lead to generalist multimodal models, i.e. one model across different data modalities and tasks. However, there is little research that systematically analyzes recent multimodal models (particularly the ones that work beyond text and vision) with respect to the underling architecture proposed. Therefore, this work provides a fresh perspective on generalist multimodal models (GMMs) via a novel architecture and training configuration specific taxonomy. This includes factors such as Unifiability, Modularity, and Adaptability that are pertinent and essential to the wide adoption and application of GMMs. The review further highlights key challenges and prospects for the field and guide the researchers into the new advancements.


title: Holonomy of parabolic geometries near isolated higher-order fixed points

abstract: For Cartan geometries admitting automorphisms with isotropies satisfying a particular, loosely dynamical property on their model geometries, we demonstrate the existence of an open subset of the geometry with trivial holonomy. This property, which generalizes characteristics of isotropies corresponding to isolated higher-order fixed points in parabolic geometries that are known to require a nearby open subset to have vanishing curvature, only relies upon the behavior of the isotropy in the model geometry, and therefore applies regardless of initial curvature assumptions, such as regularity or normality. Along the way to proving our main results, we also derive a couple of results for working with holonomy, relating to limits of sequences of developments and the existence of antidevelopments, that are useful in their own right. To showcase the effectiveness of the techniques developed, we use them to completely characterize all almost c-projective and almost quaternionic structures that admit a nontrivial automorphism with a higher-order fixed point, as well as all nondegenerate partially integrable almost CR structures that admit a higher-order fixed point with non-null isotropy.


title: SelfDefend: LLMs Can Defend Themselves against Jailbreaking in a Practical Manner

abstract: Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs) and has evolved into four major categories: optimization-based attacks such as Greedy Coordinate Gradient (GCG), jailbreak template-based attacks such as "Do-Anything-Now", advanced indirect attacks like DrAttack, and multilingual jailbreaks. However, delivering a practical jailbreak defense is challenging because it needs to not only handle all the above jailbreak attacks but also incur negligible delay to user prompts, as well as be compatible with both open-source and closed-source LLMs. Inspired by how the traditional security concept of shadow stacks defends against memory overflow attacks, this paper introduces a generic LLM jailbreak defense framework called SelfDefend, which establishes a shadow LLM defense instance to concurrently protect the target LLM instance in the normal stack and collaborate with it for checkpoint-based access control. The effectiveness of SelfDefend builds upon our observation that existing LLMs (both target and defense LLMs) have the capability to identify harmful prompts or intentions in user queries, which we empirically validate using the commonly used GPT-3.5/4 models across all major jailbreak attacks. Our measurements show that SelfDefend enables GPT-3.5 to suppress the attack success rate (ASR) by 8.97-95.74% (average: 60%) and GPT-4 by even 36.36-100% (average: 83%), while incurring negligible effects on normal queries. To further improve the defense's robustness and minimize costs, we employ a data distillation approach to tune dedicated open-source defense models. These models outperform four SOTA defenses and match the performance of GPT-4-based SelfDefend, with significantly lower extra delays. We also empirically show that the tuned models are robust to targeted GCG and prompt injection attacks.


title: A Pixel-based Reconfigurable Antenna Design for Fluid Antenna Systems

abstract: Fluid Antenna Systems (FASs) have recently been proposed for enhancing the performance of wireless communication. Previous antenna designs to meet the requirements of FAS have been based on mechanically movable or liquid antennas and therefore have limited reconfiguration speeds. In this paper, we propose a design for a pixel-based reconfigurable antenna (PRA) that meets the requirements of FAS and the required switching speed. It can provide 12 FAS ports across 1/2 wavelength and consists of an E-slot patch antenna and an upper reconfigurable pixel layer with 6 RF switches. Simulation and experimental results from a prototype operating at 2.5 GHz demonstrate that the design can meet the requirements of FAS including port correlation with matched impedance.


title: Survival probability, particle imbalance, and their relationship in quadratic models

abstract: We argue that the dynamics of particle imbalance in quadratic fermionic models is, for the majority of initial many-body product states in site occupation basis, virtually indistinguishable from the dynamics of survival probabilities of single-particle states. We then generalize our statement to a similar relationship between the non-equal time and space density correlation functions in many-body states and the transition probabilities of single-particle states at nonzero distances. Finally, we study the equal time connected density-density correlation functions in many-body states, which exhibit certain qualitative analogies with the survival and transition probabilities of single-particle states. Our results are numerically tested for two paradigmatic models of single-particle localization: the 3D Anderson model and the 1D Aubry-Andr\'e model. This work gives affirmative answer to the question whether it is possible to measure features of the single-particle survival and transition probabilities by the dynamics of observables in many-body states.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.quant-gas quant-ph


title: Asymptotic normality of pattern occurrences in random maps

abstract: The purpose of this paper is to study the limiting distribution of special {\it additive functionals} on random planar maps, namely the number of occurrences of a given {\it pattern}. The main result is a central limit theorem for these pattern counts in the case of pattern with a simple boundary. The proof relies on a combination of analytic and combinatorial methods together with a moment method due to Gao and Wormald~\cite{GaoWormald}. It is an important issue to handle the overlap structure of two pattern which is the main difficulty in the proof.


title: Characterization of Recirculating Waveguide Meshes Based on an Optimization Method with a Parameter Space Reduction Technology

abstract: Fabrication imperfections must be considered during configuration to ensure that the setup is suitable for the actual fabricated programmable photonic integrated circuits (PPICs). Therefore, characterization of imperfections is crucial but difficult, especially for PPICs made from recirculating waveguide meshes. The flexibility required by these meshes demands a more complex topology and compact TBU structure, complicating the characterization. In this paper, we propose a characterization method applicable to recirculating waveguide meshes based on an optimization approach, along with a step-by-step procedure to reduce the parameter space of optimization, allowing for characterizing imperfect parameters of each individual component within the waveguide mesh. To the best of our knowledge, this method can greatly broaden the range of characterized parameters compared to currently reported methods. In order to verify the effectiveness of our method, we used the characterized parameters to build a multi-frequency model of a mesh with fabrication errors and successfully demonstrated accurate prediction of its behavior. Furthermore, we applied our method on implementations of 6 different kind of FIR/IRR filters, to further prove the effectiveness of our method in configuring applications on meshes with fabrication errors. At last, our method was carried out under various scenarios considering beam splitter splitting ratio variance, inaccurate measurements of mesh and imprecise TBU insertion loss characterization, to demonstrate its strong robustness under various practical scenarios.


title: Bottom of the spectrum for manifolds foliated by minimal leaves

abstract: We give a sharp estimate for the bottom of the spectrum of a Riemannian manifold which is foliated by minimal leaves and transversally negatively curved. Our proof, which uses probabilistic methods, also yields an estimate for the bottom of the sub-Riemannian spectrum.


title: G-Transformer: Counterfactual Outcome Prediction under Dynamic and Time-varying Treatment Regimes

abstract: In the context of medical decision making, counterfactual prediction enables clinicians to predict treatment outcomes of interest under alternative courses of therapeutic actions given observed patient history. Prior machine learning approaches for counterfactual predictions under time-varying treatments focus on static time-varying treatment regimes where treatments do not depend on previous covariate history. In this work, we present G-Transformer, a Transformer-based framework supporting g-computation for counterfactual prediction under dynamic and time-varying treatment strategies. G-Transfomer captures complex, long-range dependencies in time-varying covariates using a Transformer architecture. G-Transformer estimates the conditional distribution of relevant covariates given covariate and treatment history at each time point using an encoder architecture, then produces Monte Carlo estimates of counterfactual outcomes by simulating forward patient trajectories under treatment strategies of interest. We evaluate G-Transformer extensively using two simulated longitudinal datasets from mechanistic models, and a real-world sepsis ICU dataset from MIMIC-IV. G-Transformer outperforms both classical and state-of-the-art counterfactual prediction models in these settings. To the best of our knowledge, this is the first Transformer-based architecture for counterfactual outcome prediction under dynamic and time-varying treatment strategies.


title: I-SIRch: AI-Powered Concept Annotation Tool For Equitable Extraction And Analysis Of Safety Insights From Maternity Investigations

abstract: Maternity care is a complex system involving treatments and interactions between patients, providers, and the care environment. To improve patient safety and outcomes, understanding the human factors (e.g. individuals decisions, local facilities) influencing healthcare delivery is crucial. However, most current tools for analysing healthcare data focus only on biomedical concepts (e.g. health conditions, procedures and tests), overlooking the importance of human factors. We developed a new approach called I-SIRch, using artificial intelligence to automatically identify and label human factors concepts in maternity healthcare investigation reports describing adverse maternity incidents produced by England's Healthcare Safety Investigation Branch (HSIB). These incident investigation reports aim to identify opportunities for learning and improving maternal safety across the entire healthcare system. I-SIRch was trained using real data and tested on both real and simulated data to evaluate its performance in identifying human factors concepts. When applied to real reports, the model achieved a high level of accuracy, correctly identifying relevant concepts in 90\% of the sentences from 97 reports. Applying I-SIRch to analyse these reports revealed that certain human factors disproportionately affected mothers from different ethnic groups. Our work demonstrates the potential of using automated tools to identify human factors concepts in maternity incident investigation reports, rather than focusing solely on biomedical concepts. This approach opens up new possibilities for understanding the complex interplay between social, technical, and organisational factors influencing maternal safety and population health outcomes. By taking a more comprehensive view of maternal healthcare delivery, we can develop targeted interventions to address disparities and improve maternal outcomes.


title: Towards a Benchmark for Causal Business Process Reasoning with LLMs

abstract: Large Language Models (LLMs) are increasingly used for boosting organizational efficiency and automating tasks. While not originally designed for complex cognitive processes, recent efforts have further extended to employ LLMs in activities such as reasoning, planning, and decision-making. In business processes, such abilities could be invaluable for leveraging on the massive corpora LLMs have been trained on for gaining deep understanding of such processes. In this work, we plant the seeds for the development of a benchmark to assess the ability of LLMs to reason about causal and process perspectives of business operations. We refer to this view as Causally-augmented Business Processes (BP^C). The core of the benchmark comprises a set of BP^C related situations, a set of questions about these situations, and a set of deductive rules employed to systematically resolve the ground truth answers to these questions. Also with the power of LLMs, the seed is then instantiated into a larger-scale set of domain-specific situations and questions. Reasoning on BP^C is of crucial importance for process interventions and process improvement. Our benchmark could be used in one of two possible modalities: testing the performance of any target LLM and training an LLM to advance its capability to reason about BP^C.


title: Optical and HI observations of IC 443 and G189.6+3.3 in a complex environment

abstract: The supernova remnant (SNR) IC 443 is one of the best-studied Galactic SNRs at many wavelengths. It is interacting with a very complex environment, including the SNR G189.6+3.3 and HII regions. In this paper, we observed IC 443 and G189.6+3.3 using the 1.5- and 1-m telescopes to better understand the nature of these SNRs in the optical band. We perform H_alpha images showing both filamentary and diffuse structures, and long-slit spectra from many locations with Balmer and forbidden lines detected for IC 443 and G189.6+3.3. The [SII]/ H_alpha ratios confirm the SNR nature of G189.6+3.3. The ranges of our estimated electron density and pre-shock cloud density clearly indicate the complex structure surrounding IC 443 and G189.6+3.3. We also investigated the archival HI data and newly found some shell-like distributions of HI that are possibly associated with G189.6+3.3.


title: Exploring Bridges Between Creative Coding and Visual Generative AI

abstract: How to bridge generative procedural art and visual generative artificial intelligence (AI) for visual content creation is an under-explored topic. On the one hand, there are many cases where creative programmers can make use of generative AI, including stylizing canvas content and creating new content based on the existing styles of certain procedural art (style learning). On the other hand, existing approaches don't support creative programmers to flexibly leverage visual generative AI methods within the creative coding environment. In this work, we explore how to bridge generative procedural art creation and visual generative AI (specifically diffusion models) by programming functionalities integrated into the creative environment. Specifically, we want to explore methodologies to condition/stylize art content and perform style learning upon procedural art via accessible interactions for artists and programmers. We proposed two methods: GenP5, a novel p5.js library enabling generative procedural art creation with flexibly stylizing canvas content and conveniently condition art creation with pre-determined patterns; and P52Style, an extended library built upon p5.gui allowing flexible adjustment of art content and leverage of visual generative AI for style learning tasks.


title: TAR reconfiguration for vertex set parameters

abstract: This paper surveys results about token addition and removal (TAR) reconfiguration for several well-known vertex set parameters including domination, power domination, standard zero forcing, and PSD zero forcing. We also expand the range of parameters to which universal $X$-set TAR graph results apply, for $X$-sets and their TAR graphs introduced in [B. Bjorkman, C. Bozeman, D. Ferrero, M. Flagg, C. Grood, L. Hogben, B. Jacob, C. Reinhart, Power domination reconfiguration, arXiv:2201.01798] and [N.H. Bong, J. Carlson, B. Curtis, R. Haas, L. Hogben, Isomorphisms and properties of TAR reconfiguration graphs for zero forcing and other $X$-set parameters, \emph{Graphs Combin.} {39} (2023), Paper No. 86]. Here we examine which of the $X$-set axioms are needed for which results. The main results apply to skew zero forcing and vertex covering, and results about TAR reconfiguration graphs of these parameters are presented. While $X$-sets are defined for parameters that take the minimum cardinality over the $X$-sets of a graph, and $X$-set results are restricted to such minimizing parameters, our expansion of the universal perspective allows these results to be applied to parameters that take the maximum value among relevant sets, called $Y$-sets. Maximizing parameters to which the main results apply include independence number, (upper) irredundance number, and (upper) zero forcing irredundance number, and failed zero forcing number; TAR reconfiguration results are presented for these parameters. We also show that the equivalence of connectedness in certain token jumping reconfiguration graphs and certain TAR reconfiguration graphs for independent sets established in [M. Kami\'nski, P. Medvedev, M. Milani\v c. Complexity of independent set reconfiguration problems. {\em J. Theoretical Computer Science} 439 (2012), 9--15.] extends to $X$-set and $Y$-set parameters.


title: Representation Learning with Conditional Information Flow Maximization

abstract: This paper proposes an information-theoretic representation learning framework, named conditional information flow maximization, to extract noise-invariant sufficient representations for the input data and target task. It promotes the learned representations have good feature uniformity and sufficient predictive ability, which can enhance the generalization of pre-trained language models (PLMs) for the target task. Firstly, an information flow maximization principle is proposed to learn more sufficient representations by simultaneously maximizing both input-representation and representation-label mutual information. In contrast to information bottleneck, we handle the input-representation information in an opposite way to avoid the over-compression issue of latent representations. Besides, to mitigate the negative effect of potential redundant features, a conditional information minimization principle is designed to eliminate negative redundant features while preserve noise-invariant features from the input. Experiments on 13 language understanding benchmarks demonstrate that our method effectively improves the performance of PLMs for classification and regression. Extensive experiments show that the learned representations are more sufficient, robust and transferable.


title: Micromechanically motivated finite-strain phase-field fracture model to investigate damage in crosslinked elastomers

abstract: A micromechanically motivated phase-field damage model is proposed to investigate the fracture behaviour in crosslinked polyurethane adhesive. The crosslinked polyurethane adhesive typically show viscoelastic behaviour with geometric nonlinearity. The finite-strain viscoelastic behaviour is modelled using a micromechanical network model considering shorter and longer chain length distribution. The micromechanical viscoelastic network model also consider the softening due to breakage/debonding of the short chains with increase in deformation. The micromechanical model is coupled with the phase-field damage model to investigate the crack initiation and propagation. Critical energy release rate is needed as a material property to solve phase-field equation. The energy release rate is formulated based on the polymer chain network. The numerical investigation is performed using finite element method. The force-displacement curves from the numerical analysis and experiments are compared to validate the proposed material model.


title: Optimal k-centers of a graph: a control-theoretic approach

abstract: In a network consisting of n nodes, our goal is to identify the most central k nodes with respect to the proposed definitions of centrality. Depending on the specific application, there exist several metrics for quantifying k-centrality, and the subset of the best k nodes naturally varies based on the chosen metric. In this paper, we propose two metrics and establish connections to a well-studied metric from the literature (specifically for stochastic matrices). We prove these three notions match for path graphs. We then list a few more control-theoretic notions and compare these various notions for a general randomly generated graph. Our first metric involves maximizing the shift in the smallest eigenvalue of the Laplacian matrix. This shift can be interpreted as an improvement in the time constant when the RC circuit experiences leakage at certain k capacitors. The second metric focuses on minimizing the Perron root of a principal sub-matrix of a stochastic matrix, an idea proposed and interpreted in the literature as manufacturing consent. The third one explores minimizing the Perron root of a perturbed (now super-stochastic) matrix, which can be seen as minimizing the impact of added stubbornness. It is important to emphasize that we consider applications (for example, facility location) when the notions of central ports are such that the set of the best k ports does not necessarily contain the set of the best k-1 ports. We apply our k-port selection metric to various network structures. Notably, we prove the equivalence of three definitions for a path graph and extend the concept of central port linkage beyond Fiedler vectors to other eigenvectors associated with path graphs.


title: A Two-Stage Adverse Weather Semantic Segmentation Method for WeatherProof Challenge CVPR 2024 Workshop UG2+

abstract: This technical report presents our team's solution for the WeatherProof Dataset Challenge: Semantic Segmentation in Adverse Weather at CVPR'24 UG2+. We propose a two-stage deep learning framework for this task. In the first stage, we preprocess the provided dataset by concatenating images into video sequences. Subsequently, we leverage a low-rank video deraining method to generate high-fidelity pseudo ground truths. These pseudo ground truths offer superior alignment compared to the original ground truths, facilitating model convergence during training. In the second stage, we employ the InternImage network to train for the semantic segmentation task using the generated pseudo ground truths. Notably, our meticulously designed framework demonstrates robustness to degraded data captured under adverse weather conditions. In the challenge, our solution achieved a competitive score of 0.43 on the Mean Intersection over Union (mIoU) metric, securing a respectable rank of 4th.


title: RAG-Enhanced Commit Message Generation

abstract: Commit message is one of the most important textual information in software development and maintenance. However, it is time-consuming and labor-intensive to write commit messages manually. Commit Message Generation (CMG) has become a research hotspot in automated software engineering. Researchers have proposed several methods for CMG and achieved great results. In recent years, CodeBERT, CodeT5, and other Pre-trained Language Models (PLMs) for code have been proposed. These models can be easily transferred to code-related downstream tasks including CMG with simple fine-tuning and can achieve impressive performance. Moreover, Large Language Models (LLMs) with code capabilities (e.g., ChatGPT, Llama 3, Gemma) can be directly applied to various tasks by designing instruct prompts without training. This brings new possibilities to the CMG task. In this work, we propose REACT, a novel REtrieval-Augmented framework for CommiT message generation, which effectively integrates advanced retrieval techniques with different PLMs and LLMs and can broadly enhance the performance of various models on the CMG task. Specifically, we design and build a hybrid retriever to retrieve the most relevant code diff and commit message pair from the code base as an "exemplar". Then, the retrieved pair is utilized to guide and enhance the generation of commit messages by PLMs and LLMs through fine-tuning and in-context learning. Our approach is evaluated on a widely-used dataset. The experimental results show that REACT significantly enhances the performance of various models on the CMG task, improving the BLEU score of CodeT5 by up to 55%, boosting Llama 3's BLEU score by 102%, and substantially surpassing all baselines, achieving a new SOTA. This demonstrates the effectiveness and broad applicability of our framework that can enhance CMG by a large margin.


title: Mmm whatcha say? Uncovering distal and proximal context effects in first and second-language word perception using psychophysical reverse correlation

abstract: Acoustic context effects, where surrounding changes in pitch, rate or timbre influence the perception of a sound, are well documented in speech perception, but how they interact with language background remains unclear. Using a reverse-correlation approach, we systematically varied the pitch and speech rate in phrases around different pairs of vowels for second language (L2) speakers of English (/i/-/I/) and French (/u/-/y/), thus reconstructing, in a data-driven manner, the prosodic profiles that bias their perception. Testing English and French speakers (n=25), we showed that vowel perception is in fact influenced by conflicting effects from the surrounding pitch and speech rate: a congruent proximal effect 0.2s pre-target and a distal contrastive effect up to 1s before; and found that L1 and L2 speakers exhibited strikingly similar prosodic profiles in perception. We provide a novel method to investigate acoustic context effects across stimuli, timescales, and acoustic domain.


title: Verbalized Probabilistic Graphical Modeling with Large Language Models

abstract: Faced with complex problems, the human brain demonstrates a remarkable capacity to transcend sensory input and form latent understandings of perceived world patterns. However, this cognitive capacity is not explicitly considered or encoded in current large language models (LLMs). As a result, LLMs often struggle to capture latent structures and model uncertainty in complex compositional reasoning tasks. This work introduces a novel Bayesian prompting approach that facilitates training-free Bayesian inference with LLMs by using a verbalized Probabilistic Graphical Model (PGM). While traditional Bayesian approaches typically depend on extensive data and predetermined mathematical structures for learning latent factors and dependencies, our approach efficiently reasons latent variables and their probabilistic dependencies by prompting LLMs to adhere to Bayesian principles. We evaluated our model on several compositional reasoning tasks, both close-ended and open-ended. Our results indicate that the model effectively enhances confidence elicitation and text generation quality, demonstrating its potential to improve AI language understanding systems, especially in modeling uncertainty.


title: Blockchain Integrated Federated Learning in Edge-Fog-Cloud Systems for IoT based Healthcare Applications A Survey

abstract: Modern Internet of Things (IoT) applications generate enormous amounts of data, making data-driven machine learning essential for developing precise and reliable statistical models. However, data is often stored in silos, and strict user-privacy legislation complicates data utilization, limiting machine learning's potential in traditional centralized paradigms due to diverse data probability distributions and lack of personalization. Federated learning, a new distributed paradigm, supports collaborative learning while preserving privacy, making it ideal for IoT applications. By employing cryptographic techniques, IoT systems can securely store and transmit data, ensuring consistency. The integration of federated learning and blockchain is particularly advantageous for handling sensitive data, such as in healthcare. Despite the potential of these technologies, a comprehensive examination of their integration in edge-fog-cloud-based IoT computing systems and healthcare applications is needed. This survey article explores the architecture, structure, functions, and characteristics of federated learning and blockchain, their applications in various computing paradigms, and evaluates their implementations in healthcare.


title: Obstructions to almost complex structures following Massey

abstract: We provide proofs of two theorems stated by Massey in 1961, concerning the obstructions to finding complex structures on real vector bundles. In addition, we determine the second obstruction to a complex structure on a rank six orientable real vector bundle. The obstructions are fractional parts of integral Stiefel-Whitney classes, and a fourth of an appropriate combination of Pontryagin, Chern, and Euler classes.


title: Synergizing Deep Learning and Phase Change Materials for Four-state Broadband Multifunctional Metasurfaces in the Visible Range

abstract: In this article, we report, for the first time, broadband multifunctional metasurfaces with more than four distinct functionalities. The constituent meta-atoms combine two different phase change materials, $\mathrm{VO_2}$ and $\mathrm{Sb_2S_3}$ in a multi-stage configuration. FDTD simulations demonstrate a broadband reflection amplitude switching between the four states in visible range due to the enhanced cavity length modulation effect from the cascaded Fabry-Perot cavities, overcoming the inherent small optical contrast between the phase change material (PCM) states. This, along with the reflection phase control between the four states, allows us to incorporate both amplitude and phase-dependent properties in the same metasurface - achromatic deflection, wavelength beam splitting, achromatic focusing, and broadband absorption, overcoming the limitations of previous functionality switching mechanisms for the visible band. We have used a Tandem Neural network-based inverse design scheme to ensure the stringent requirements of different states are realized. We have used two forward networks for predicting the reflection amplitude and phase for a meta-atom within the pre-defined design space. The excellent prediction capability of these surrogate models is utilized to train the reverse network. The inverse design network, trained with a labeled data set, is capable of producing the optimized meta-units given the desired figure-of-merits in terms of reflection amplitude and phase for the four states. The optical characteristics of two inverse-designed metasurfaces have been evaluated as test cases for two different sets of design parameters in the four states. Both structures demonstrate the four desired broadband functionalities while closely matching the design requirements, suggesting their potential in visible-range portable medical imaging devices.


title: "Violation of my body:" Perceptions of AI-generated non-consensual (intimate) imagery

abstract: AI technology has enabled the creation of deepfakes: hyper-realistic synthetic media. We surveyed 315 individuals in the U.S. on their views regarding the hypothetical non-consensual creation of deepfakes depicting them, including deepfakes portraying sexual acts. Respondents indicated strong opposition to creating and, even more so, sharing non-consensually created synthetic content, especially if that content depicts a sexual act. However, seeking out such content appeared more acceptable to some respondents. Attitudes around acceptability varied further based on the hypothetical creator's relationship to the participant, the respondent's gender and their attitudes towards sexual consent. This study provides initial insight into public perspectives of a growing threat and highlights the need for further research to inform social norms as well as ongoing policy conversations and technical developments in generative AI.


title: Gaiotto Conjecture for $\mathrm{Rep}_q(\mathrm{F}(4))$

abstract: This paper is a part of the series proving the Gaiotto conjecture for basic classical quantum supergroups. The previous part arXiv:2107.02653 [math.RT] , arXiv:2306.09556 [math.RT], proved the Gaiotto conjecture for the general linear quantum supergroups $U_q(\mathfrak{gl}(N|M))$. Here we deal with the exceptional quantum supergroup $U_q(\mathfrak{f}(4))$.


title: A preprocessing-based planning framework for utilizing contacts in high-precision insertion tasks

abstract: In manipulation tasks like plug insertion or assembly that have low tolerance to errors in pose estimation (errors of the order of 2mm can cause task failure), the utilization of touch/contact modality can aid in accurately localizing the object of interest. Motivated by this, in this work we model high-precision insertion tasks as planning problems under pose uncertainty, where we effectively utilize the occurrence of contacts (or the lack thereof) as observations to reduce uncertainty and reliably complete the task. We present a preprocessing-based planning framework for high-precision insertion in repetitive and time-critical settings, where the set of initial pose distributions (identified by a perception system) is finite. The finite set allows us to enumerate the possible planning problems that can be encountered online and preprocess a database of policies. Due to the computational complexity of constructing this database, we propose a general experience-based POMDP solver, E-RTDP-Bel, that uses the solutions of similar planning problems as experience to speed up planning queries and use it to efficiently construct the database. We show that the developed algorithm speeds up database creation by over a factor of 100, making the process computationally tractable. We demonstrate the effectiveness of the proposed framework in a real-world plug insertion task in the presence of port position uncertainty and a pipe assembly task in simulation in the presence of pipe pose uncertainty.


title: Stochastic Calculus for the Theta Process

abstract: In this paper, we study the stochastic calculus for the theta process. The theta process is a stochastic process of number theoretical origin arising as a scaling limit of quadratic Weyl sums. It has several properties in common with Brownian motion such as its H\"older regularity, uncorrelated increments and quadratic variation. However, crucially, we show that the theta process is not a semimartingale, making It\^o calculus techniques inapplicable. Instead, we use the celebrated rough paths theory to develop the stochastic calculus for the theta process. We do so by constructing the iterated integrals - the ``rough path" - above the theta process. Rough paths theory takes a signal and its iterated integrals and produces a vast and robust theory of stochastic differential equations. In addition, the rough path we construct can be described in terms of higher rank theta sums.


title: Galois representations over function fields that are ramified at one prime

abstract: Let $\mathbb{F}_q$ be the finite field with $q$ elements, $F:=\mathbb{F}_q(T)$ and $F^{\operatorname{sep}}$ a separable closure of $F$. Set $A$ to denote the polynomial ring $\mathbb{F}_q[T]$. Let $\mathfrak{p}$ be a non-zero prime ideal of $A$, and $\mathscr{O}$ be the completion of $A$ at $\mathfrak{p}$. Given any integer $r\geq 2$, I construct a Galois representation $\rho:\operatorname{Gal}(F^{\operatorname{sep}}/F)\rightarrow \operatorname{GL}_r(\mathscr{O})$ which is unramified at all non-zero primes $\mathfrak{l}\neq \mathfrak{p}$ of $A$, and whose image is a finite index subgroup of $\operatorname{GL}_r(\mathscr{O})$. Moreover, if the degree of $\mathfrak{p}$ is $1$, then $\rho$ is also unramified at $\infty$.


title: Energy-Efficient Approximate Full Adders Applying Memristive Serial IMPLY Logic For Image Processing

abstract: Researchers and designers are facing problems with memory and power walls, considering the pervasiveness of Von-Neumann architecture in the design of processors and the problems caused by reducing the dimensions of deep sub-micron transistors. Memristive Approximate Computing (AC) and In-Memory Processing (IMP) can be promising solutions to these problems. We have tried to solve power and memory wall problems by presenting the implementation algorithm of four memristive approximate full adders applying the Material Implication (IMPLY) method. The proposed circuits reduce the number of computational steps by up to 40% compared to State-of-the-art (SOA). The energy consumption of the proposed circuits improves over the previous exact ones by 49%-75% and over the approximate full adders by up to 41%. Multiple error evaluation criteria evaluate the computational accuracy of the proposed approximate full adders in three scenarios in the 8-bit approximate adder structure. The proposed approximate full adders are evaluated in three image processing applications in three scenarios. The results of application-level simulation indicate that the four proposed circuits can be applied in all three scenarios, considering the acceptable image quality metrics of the output images (the Peak Signal to Noise Ratio (PSNR) of the output images is greater than 30 dB).


title: Optimal Storage Design: An $L^{\infty}$ infused Inventory Control

abstract: Inventory control typically considers controlling the price and the production rate. However, such systems have rigidity towards altering the physical storage capacity -- one can not easily alter the physical size after the initial design. The paper focuses on this critical aspect, consideration of which leads to a non-standard control problem. Here, the objective is a weighted combination of the classical integral term (formed by usual inventory costs) and an $L^{\infty}$ term (the maximum inventory level in the entire planning horizon). Our approach is to consider an additional state component to capture the `instantaneous' $L^{\infty}$ term (maximum inventory level till that instant) by virtue of which, we could convert the problem to the classical framework. For the direct ($L^{\infty}$) problem, we first identify a relation between the optimal price and the production rate policy, thereby reducing the dimensionality of the problem. By numerically solving a smooth variant of the converted problem, we obtain an optimal policy that illustrates a significant reduction in the storage capacity requirement. Interestingly, the loss in the revenue is negligible (less than $6\%$). As the importance of the $L^{\infty}$ component increases, the variations in the corresponding optimal inventory-level trajectory reduce. In the scenarios with partial/zero information about future demand curves, the above observation provides a guidance -- one should continually tune the policies to maintain instantaneous inventory-levels as close to zero as possible. With such a policy, the reduction in revenue is negligible, while having significant improvements for storage capacity. We theoretically establish certain interesting properties of the optimal policy, which also support the above guidance.


title: Ab-initio investigations of novel potential all-d metal Heusler alloys Co$_2$MnNb

abstract: In this study, we employ the Wien2k code to conduct ab-initio study of a novel potential all-d-metal Heusler alloy Co$_2$MnNb. The analysis utilizes the comparison of local spin density approximations (LDA) with Perdew-Burke-Ernzerh parameterized Generalized Gradient Approximation (PBE-GGA) for structural optimization while modified Becke-Jones potential (mBJ) exchange-correlation potentials to examine various characteristic properties of the alloy under study. Employing Birch-Murnaghan equation of state, we construct the energy-versus-volume curve, facilitating the determination of stable phases and structural parameters of the investigated alloys. Structural optimization in both non-magnetic (NM) and spin-polarized (FM) states reveals the stability of the alloy in the FM state. The compound exhibits metallic behavior in bulk, with notable anisotropic semiconducting behavior for down spin while pure metallic behavior for up spin electrons. Partial density of states of each element of the composition is also analysed to compare their respective contribution towards the observed band structure. The anisotropic behavior of Co$_2$MnNb for a specific spin state could be of importance in future spintronic and other thin films device applications.


title: Routing Algorithm for Software Defined Network Based on Boxcovering Algorithm

abstract: A routing algorithm is the most fundamental problem in complex network communication. In complex networks, the amount of computation increases as the number of nodes increases which reduces routing performance. In this paper, we propose a routing algorithm for software-defined networking (SDN) based on a box-covering (BC) algorithm. It is known that using the BC algorithm it is possible to increase performance in complex SDN. We partition the entire SDN network into subnets using three existing box-covering methods such as MEMB, GC, and CIEA, then we use Dijkstra\textquotesingle s algorithm to find the shortest path between subnets and within each subnet. We compared all box-covering algorithms and found that the GC algorithm has the highest performance for SDN routing.


title: Automatic modulation classification for MIMO system based on the mutual information feature extraction

abstract: Automatic Modulation Classification (AMC) is an essential technology that is widely applied into various communications scenarios. In recent years, many Machine Learning and Deep-Learning methods have been introduced into AMC, and a lot of them apply different approaches to eliminate interference in complex Multiple-Input and Multiple-Output (MIMO) signals and improve classification performance. However, in practical communication systems, the perfect elimination of MIMO signal interference is impossible, and therefore classification performance suffers. In this paper, we propose a new AMC algorithm for MIMO system based on mutual information (MI) features extraction, which does not require a large amount of training data and the elimination of MIMO signal interference. In this approach, features based on mutual information are extracted using In-Phase and Quadrature (IQ) constellation diagrams of MIMO signals, which have not been explored previously. Our method can be effective since mutual information considers the interdependencies among variables and measures how much information about one variable reduces uncertainty about another, providing a valuable perspective for extracting higher-level and interesting features from the data. The effectiveness of our method is evaluated on several model and real-world datasets, and its applicability is proven.


title: Effects of metals (X = Zn, Co) on structure, electronic bands and gravimetric capacity of KXH$_3$ hydrides

abstract: Using the WIEN2K code, the hydrogen storage capabilities of lithium-based KXH$_3$ (X = Zn, Co) hydrides perovskites are examined. To verify the stability of these hydrides, first-principles simulations are employed to examine their structural, electronic, and hydrogen storage capabilities. These compositions' structural investigation shows that the hydrides are stable and part of the cubic space group (221 Pm-3m). We have examined several aspects of these composition's features throughout, using the Perdew-Burke-Ernzerhof generalized gradient approximation. The study identifies stable phases and structural parameters of hydrides using B-E equations, assessing thermodynamic stability in terms of hydrogen storage capacities. The metallic nature of these hydrides is confirmed through band structure and density calculations using WIEN2K.


title: Enhancing Adversarial Transferability via Information Bottleneck Constraints

abstract: From the perspective of information bottleneck (IB) theory, we propose a novel framework for performing black-box transferable adversarial attacks named IBTA, which leverages advancements in invariant features. Intuitively, diminishing the reliance of adversarial perturbations on the original data, under equivalent attack performance constraints, encourages a greater reliance on invariant features that contributes most to classification, thereby enhancing the transferability of adversarial attacks. Building on this motivation, we redefine the optimization of transferable attacks using a novel theoretical framework that centers around IB. Specifically, to overcome the challenge of unoptimizable mutual information, we propose a simple and efficient mutual information lower bound (MILB) for approximating computation. Moreover, to quantitatively evaluate mutual information, we utilize the Mutual Information Neural Estimator (MINE) to perform a thorough analysis. Our experiments on the ImageNet dataset well demonstrate the efficiency and scalability of IBTA and derived MILB. Our code is available at https://github.com/Biqing-Qi/Enhancing-Adversarial-Transferability-via-Information-Bottleneck-Constraints.


title: Exploring Adversarial Robustness of Deep State Space Models

abstract: Deep State Space Models (SSMs) have proven effective in numerous task scenarios but face significant security challenges due to Adversarial Perturbations (APs) in real-world deployments. Adversarial Training (AT) is a mainstream approach to enhancing Adversarial Robustness (AR) and has been validated on various traditional DNN architectures. However, its effectiveness in improving the AR of SSMs remains unclear. While many enhancements in SSM components, such as integrating Attention mechanisms and expanding to data-dependent SSM parameterizations, have brought significant gains in Standard Training (ST) settings, their potential benefits in AT remain unexplored. To investigate this, we evaluate existing structural variants of SSMs with AT to assess their AR performance. We observe that pure SSM structures struggle to benefit from AT, whereas incorporating Attention yields a markedly better trade-off between robustness and generalization for SSMs in AT compared to other components. Nonetheless, the integration of Attention also leads to Robust Overfitting (RO) issues. To understand these phenomena, we empirically and theoretically analyze the output error of SSMs under AP. We find that fixed-parameterized SSMs have output error bounds strictly related to their parameters, limiting their AT benefits, while input-dependent SSMs may face the problem of error explosion. Furthermore, we show that the Attention component effectively scales the output error of SSMs during training, enabling them to benefit more from AT, but at the cost of introducing RO due to its high model complexity. Inspired by this, we propose a simple and effective Adaptive Scaling (AdS) mechanism that brings AT performance close to Attention-integrated SSMs without introducing the issue of RO.


title: PAPR in Motion: Seamless Point-level 3D Scene Interpolation

abstract: We propose the problem of point-level 3D scene interpolation, which aims to simultaneously reconstruct a 3D scene in two states from multiple views, synthesize smooth point-level interpolations between them, and render the scene from novel viewpoints, all without any supervision between the states. The primary challenge is on achieving a smooth transition between states that may involve significant and non-rigid changes. To address these challenges, we introduce "PAPR in Motion", a novel approach that builds upon the recent Proximity Attention Point Rendering (PAPR) technique, which can deform a point cloud to match a significantly different shape and render a visually coherent scene even after non-rigid deformations. Our approach is specifically designed to maintain the temporal consistency of the geometric structure by introducing various regularization techniques for PAPR. The result is a method that can effectively bridge large scene changes and produce visually coherent and temporally smooth interpolations in both geometry and appearance. Evaluation across diverse motion types demonstrates that "PAPR in Motion" outperforms the leading neural renderer for dynamic scenes. For more results and code, please visit our project website at https://niopeng.github.io/PAPR-in-Motion/ .


title: Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing

abstract: Direct Preference Optimization (DPO) improves the alignment of large language models (LLMs) with human values by training directly on human preference datasets, eliminating the need for reward models. However, due to the presence of cross-domain human preferences, direct continual training can lead to catastrophic forgetting, limiting DPO's performance and efficiency. Inspired by intraspecific competition driving species evolution, we propose a Online Fast-Slow chasing DPO (OFS-DPO) for preference alignment, simulating competition through fast and slow chasing among models to facilitate rapid adaptation. Specifically, we first derive the regret upper bound for online learning, validating our motivation with a min-max optimization pattern. Based on this, we introduce two identical modules using Low-rank Adaptive (LoRA) with different optimization speeds to simulate intraspecific competition, and propose a new regularization term to guide their learning. To further mitigate catastrophic forgetting in cross-domain scenarios, we extend the OFS-DPO with LoRA modules combination strategy, resulting in the Cross domain Online Fast-Slow chasing DPO (COFS-DPO). This method leverages linear combinations of fast modules parameters from different task domains, fully utilizing historical information to achive continual value alignment. Experimental results show that OFS-DPO outperforms DPO in in-domain alignment, while COFS-DPO excels in cross-domain continual learning scenarios.


title: Perturbation Towards Easy Samples Improves Targeted Adversarial Transferability

abstract: The transferability of adversarial perturbations provides an effective shortcut for black-box attacks. Targeted perturbations have greater practicality but are more difficult to transfer between models. In this paper, we experimentally and theoretically demonstrated that neural networks trained on the same dataset have more consistent performance in High-Sample-Density-Regions (HSDR) of each class instead of low sample density regions. Therefore, in the target setting, adding perturbations towards HSDR of the target class is more effective in improving transferability. However, density estimation is challenging in high-dimensional scenarios. Further theoretical and experimental verification demonstrates that easy samples with low loss are more likely to be located in HSDR. Perturbations towards such easy samples in the target class can avoid density estimation for HSDR location. Based on the above facts, we verified that adding perturbations to easy samples in the target class improves targeted adversarial transferability of existing attack methods. A generative targeted attack strategy named Easy Sample Matching Attack (ESMA) is proposed, which has a higher success rate for targeted attacks and outperforms the SOTA generative method. Moreover, ESMA requires only 5% of the storage space and much less computation time comparing to the current SOTA, as ESMA attacks all classes with only one model instead of seperate models for each class. Our code is available at https://github.com/gjq100/ESMA.


title: Output-Optimal Algorithms for Join-Aggregate Queries

abstract: The classic Yannakakis framework proposed in 1981 is still the state-of-the-art approach for tackling acyclic join-aggregate queries defined over commutative semi-rings. It has been shown that the time complexity of the Yannakakis framework is $O(N + \OUT)$ for any free-connex join-aggregate query, where $N$ is the input size of database and $\OUT$ is the output size of the query result. This is already output-optimal. However, only a general upper bound $O(N \cdot \OUT)$ on the time complexity of the Yannakakis framework is known for the remaining class of acyclic but non-free-connex queries. We first show a lower bound $\Omega\left(N \cdot \OUT^{1- \frac{1}{\outw}} + \OUT\right)$ for computing an acyclic join-aggregate query by {\em semi-ring algorithms}, where $\outw$ is identified as the {\em out-width} of the input query, $N$ is the input size of the database, and $\OUT$ is the output size of the query result. For example, $\outw =2$ for the chain matrix multiplication query, and $\outw=k$ for the star matrix multiplication query with $k$ relations. We give a tighter analysis of the Yannakakis framework and show that Yannakakis framework is already output-optimal on the class of {\em aggregate-hierarchical} queries. However, for the large remaining class of non-aggregate-hierarchical queries, such as chain matrix multiplication query, Yannakakis framework indeed requires $\Theta(N \cdot \OUT)$ time. We next explore a hybrid version of the Yannakakis framework and present an output-optimal algorithm for computing any general acyclic join-aggregate query within $\O\left(N\cdot \OUT^{1-\frac{1}{\outw}} + \OUT\right)$ time, matching the out-width-dependent lower bound up to a poly-logarithmic factor. To the best of our knowledge, this is the first polynomial improvement for computing acyclic join-aggregate queries since 1981.


title: Effects of metals (X = Pd, Ag, Cd ) on structural, electronic, mechanical, thermoelectric and hydrogen storage properties of LiXH$_3$ perovskites

abstract: Using the WIEN2K code, the hydrogen storage capabilities of lithium compositions like LiXH$_3$ (X = Pd, Ag, Cd) hydrides are examined. Structural, electrical, mechanical, thermoelectric, and hydrogen storage properties of these hydrides are analyzed using first-principles simulations to verify their stability. Structural analysis of these compositions reveals that the hydrides are stable and belong to the cubic space group number (221 Pm-3m). The thermodynamic stability of these hydrides are given in terms of gravimetric hydrogen storage capacities. The purpose of the study is to calculate heating of formation and breakdown temperature to determine stability of these hydrides. The metallic nature of all compositions are confirmed by band plots and density of states. The elastic properties such as elastic constant, Pugh's ratio, bulk modulus, Poisson's ratio and anisotropy factor are calculated to check the applicability of these compositions for applications involving hydrogen storage. The present paper represents the initial theoretical approach toward the future exploration of these materials for hydrogen storage applications.


title: First-principle screening of structural, electronic and hydrogen storage properties of Vanadium based hydride perovskites XVH$_3$ (X = Li, K)

abstract: V-based XVH$_3$ (X = Li,K) hydrides perovskites are investigated for their hydrogen storage capacity using the WIEN2K code. To verify the stability of these hydrides, first-principles investigations are employed to examine their structural, electronic and hydrogen storage properties. According to structural studies these compositions hydrides are stable and part of the cubic space group (221 Pm-3m). We have examined many aspects of these compositions throughout, using the PBE-GGA exchange correlation potential. We obtained the energy versus volume curve and found the stable phase and structural parameter of these hydrides using equation of state given by Birch-Murnaghan's. These hydrides thermodynamic stability is expressed in terms of their gravimetric hydrogen storage capacity.The goal of this study is to compute the standard enthalpy of formation and thermal desorption to ascertain the stability of these hydrides. Based on band structure and density of state plots it is found that these compositions are metallic in nature. The study presents a preliminary theoretical approach for hydrogen storage applications of thermoelectric compositions, revealing their strong thermoelectric responses and potential for green energy sources.


title: EUV polarimetric diagnostics of the solar corona: the Hanle effect of Ne VIII 770 \AA

abstract: Magnetic fields are the primary driver of the plasma thermodynamics in the upper solar atmosphere, especially in the corona. However, magnetic field measurements in the solar corona are sporadic, thereby limiting us from the complete understanding of physical processes occurring in the coronal plasma. In this paper, we explore the diagnostic potential of a coronal emission line in the extreme-ultraviolet (EUV), i.e., Ne VIII 770 \AA to probe the coronal magnetic fields. We utilize 3D 'Magneto-hydrodynamic Algorithm outside a Sphere' (MAS) models as input to the FORWARD code to model polarization in Ne VIII line produced due to resonance scattering, and interpret its modification due to collisions and the magnetic fields through the Hanle effect. The polarization maps are synthesized both on the disk as well as off-the-limb. The variation of this polarization signal through the different phases of solar cycle 24 and the beginning phase of solar cycle 25 is studied in order to understand the magnetic diagnostic properties of this line owing to different physical conditions in the solar atmosphere. The detectability of the linear polarization signatures of the Hanle effect significantly improves with increasing solar activity, consistently with the increase in the magnetic field strength and the intensity of the mean solar brightness at these wavelengths. We finally discuss the signal-to-noise ratio (SNR) requirements by considering realistic instrument designs.


title: A Fine-tuning Dataset and Benchmark for Large Language Models for Protein Understanding

abstract: The parallels between protein sequences and natural language in their sequential structures have inspired the application of large language models (LLMs) to protein understanding. Despite the success of LLMs in NLP, their effectiveness in comprehending protein sequences remains an open question, largely due to the absence of datasets linking protein sequences to descriptive text. Researchers have then attempted to adapt LLMs for protein understanding by integrating a protein sequence encoder with a pre-trained LLM. However, this adaptation raises a fundamental question: "Can LLMs, originally designed for NLP, effectively comprehend protein sequences as a form of language?" Current datasets fall short in addressing this question due to the lack of a direct correlation between protein sequences and corresponding text descriptions, limiting the ability to train and evaluate LLMs for protein understanding effectively. To bridge this gap, we introduce ProteinLMDataset, a dataset specifically designed for further self-supervised pretraining and supervised fine-tuning (SFT) of LLMs to enhance their capability for protein sequence comprehension. Specifically, ProteinLMDataset includes 17.46 billion tokens for pretraining and 893,000 instructions for SFT. Additionally, we present ProteinLMBench, the first benchmark dataset consisting of 944 manually verified multiple-choice questions for assessing the protein understanding capabilities of LLMs. ProteinLMBench incorporates protein-related details and sequences in multiple languages, establishing a new standard for evaluating LLMs' abilities in protein comprehension. The large language model InternLM2-7B, pretrained and fine-tuned on the ProteinLMDataset, outperforms GPT-4 on ProteinLMBench, achieving the highest accuracy score. The dataset and the benchmark are available at https://huggingface.co/datasets/tsynbio/ProteinLMBench.


title: Two stage decoherence of optical phonons in long oligomers

abstract: Intramolecular energy transport is generally responsible for chemical energy balance in molecular systems. The transport is fast and efficient if energy is transferred by optical phonons in periodic oligomers, but its efficiently is limited by decoherence emerging due to anharmonic interactions with acoustic phonons. We show that in the most common case of the optical phonon band being narrower than the acoustic bands decoherence takes place in two stages. The faster stage involves optical phonon multiple forward scattering due to absorption and emission of transverse acoustic phonons, i. e. collective bending modes with a quadratic spectrum; the transport remains ballistic and the speed can be altered. The subsequent slower stage involves phonon backscattering in multiphonon processes involving two or more acostic phonons resulting is a switch to diffusive transport. If the initially excited optical phonon possesses a relatively small group velocity, then its equilibration in the first stage is accompanied by its acceleration due to its transitions to states propagating faster. This theoretical expectation is consistent with the recent measurements of optical phonon transport in alkane chains, accelerating with increasing the chain length.


title: The Development of the Reproductive Healthcare Equity Algorithm (RHEA)

abstract: After the repeal of Roe vs. Wade in June 2022, women face long-distance travel across state lines to access abortion care. For women who also face socioeconomic hardship, travel for abortion care is a significant burden. To ease this burden, abortion access nonprofits are funding and/or supplying transportation to abortion clinics. However, due to the uneven distribution of demand and supply for abortions, these nonprofits do not have efficient logistical operations. As a result, low-income, underserved women may not have access to adequate reproductive healthcare, thus widening healthcare inequity gaps. Nonprofits may also risk not serving the needs of vulnerable women without access to adequate reproductive healthcare, and in doing so, waste resources, money, and volunteer hours. To address these challenges, we create an interactive, web-based planning tool, the Reproductive Healthcare Equity Algorithm (RHEA), to guide nonprofits in strategically allocating resources and serving demand. RHEA leverages an optimization model to determine the maximum flow and minimum transportation cost to route women across a network of counties and abortion clinics, subject to transportation supply, budget, and time constraints for one day of operations for a nonprofit. In doing so, we collaborate with abortion access nonprofits to cater our model design and interface development to their needs and considerations. Ultimately, we seek to optimize resource allocation for nonprofits providing abortion care logistics and improve abortion access for low-income, underserved women.


title: VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchification

abstract: Recent conditional 3D completion works have mainly relied on CLIP or BERT to encode textual information, which cannot support complex instruction. Meanwhile, large language models (LLMs) have shown great potential in multi-modal understanding and generation tasks. Inspired by the recent advancements of LLM, we present Volume Patch LLM (VP-LLM), which leverages LLMs to perform conditional 3D completion in a single-forward pass. To integrate a 3D model into the LLM tokenization configuration, the incomplete 3D object is first divided into small patches that can be encoded independently. These encoded patches are then fed into an LLM along with the text prompt, instructing the LLM to capture the relations between these patches as well as injecting semantic meanings into the 3D object. Our results demonstrate a strong ability of LLMs to interpret complex text instructions and understand 3D objects, surpassing state-of-the-art diffusion-based 3D completion models in generation quality.