title: Time-Reflection of Microwaves by a Fast Optically-Controlled Time-Boundary

abstract: When an electromagnetic (EM) wave is propagating in a medium whose properties are varied abruptly in time, the wave experiences refractions and reflections known as "time-refractions" and "time-reflections", both manifesting spectral translation as a consequence of the abrupt change of the medium and the conservation of momentum. However, while the time-refracted wave continues to propagate with the same wave-vector, the time-reflected wave is propagating backward with a conjugate phase, despite the lack of any spatial interface. Importantly, while time-refraction is always significant, observing time-reflection poses a major challenge - because it requires a large change in the medium occurring within a single cycle. For that reason, time-reflection of EM waves was observed only recently. Here, we present the observation of microwave pulses at the highest frequency ever observed (0.59 GHz), and the experimental evidence of the phase-conjugation nature of time-reflected waves. Our experiments are carried out in a periodically-loaded microstrip line with optically-controlled picosecond-switchable photodiodes. Our system paves the way to the experimental realization of Photonic Time-Crystals at GHz frequencies.


title: Human Protein Protein Interaction Networks: A Topological Comparison Review

abstract: Protein-Protein Interaction Networks aim to model the interactome, providing a powerful tool for understanding the complex relationships governing cellular processes. These networks have numerous applications, including functional enrichment, discovering cancer driver genes, identifying drug targets, and more. Various databases make protein-protein networks available for many species, including Homo sapiens. This work topologically compares four Homo sapiens networks using a coarse-to-fine approach, comparing global characteristics, sub-network topology, specific nodes centrality, and interaction significance. Results show that the four human protein networks share many common protein-encoding genes and some global measures, but significantly differ in the interactions and neighbourhood. Small sub-networks from cancer pathways performed better than the whole networks, indicating an improved topological consistency in functional pathways. The centrality analysis shows that the same genes play different roles in different networks. We discuss how studies and analyses that rely on protein-protein networks for humans should consider their similarities and distinctions.


title: Industry 4.0 and Beyond: The Role of 5G, WiFi 7, and TSN in Enabling Smart Manufacturing

abstract: This paper explores the role that 5G, WiFi-7, and Time-Sensitive Networking (TSN) can play in driving smart manufacturing as a fundamental part of the Industry 4.0 vision. The paper provides an in-depth analysis of each technology's application in industrial communications, with a focus on TSN and its key elements that enable reliable and secure communication in industrial networks. In addition, the paper includes a comparative study of these technologies, analyzing them based on a number of industrial use-cases, supported secondary applications, industry adoption, and current market trends. The paper concludes by highlighting the challenges and future directions for the adoption of these technologies in industrial networks and emphasizes their importance in realizing the Industry 4.0 vision within the context of smart manufacturing.


title: Non-blocking Dynamic Unbounded Graphs with Wait-Free Snapshot

abstract: Graphs are arguably one of the most fundamental data-structure used in many domains such as block-chain, networks etc. Theoretically and practically, improving Graph performance is one of the most studied and omnipresent research problems. In this paper, we have implemented a dynamic unbounded concurrent graph which can perform the add, delete or lookup operations on vertices and edges concurrently. All these methods are lock-free and linearizable. On top of this, we have also implemented the wait-free graph snapshot algorithm. To the best of knowledge this is first wait-free implementation of snapshot on concurrent graphs. We have used the snapshot of the algorithm to calculate the diameter and between centrality. We have compared our implementation with its counterparts and outperformed them by a good margin. This illustrates the efficiency of our snapshot method which is a generic method and can be used to perform other useful graph analytics operations.


title: Multi-Prompt Fine-Tuning of Foundation Models for Enhanced Medical Image Segmentation

abstract: The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical images, where multiple organs and tissues intertwine in a single image. In this study, we introduce a novel fine-tuning framework that leverages SAM's ability to bundle and process multiple prompts per image and seeks to improve SAM's performance in medical images. We first curated a medical image dataset that consists of CT scans of lesions in various organs, each with two annotations for organs and lesions respectively. Then, we fine-tuned SAM's mask decoder within our framework by batching both bounding boxes generated from ground truth masks as reference. The batched prompt strategy we introduced not only addresses the inherent complexity and ambiguity often found in medical images but also substantially enhances performance metrics when applied onto a wide range of segmentation tasks.


title: Unsupervised Speech Recognition with N-Skipgram and Positional Unigram Matching

abstract: Training unsupervised speech recognition systems presents challenges due to GAN-associated instability, misalignment between speech and text, and significant memory demands. To tackle these challenges, we introduce a novel ASR system, ESPUM. This system harnesses the power of lower-order N-skipgrams (up to N=3) combined with positional unigram statistics gathered from a small batch of samples. Evaluated on the TIMIT benchmark, our model showcases competitive performance in ASR and phoneme segmentation tasks. Access our publicly available code at https://github.com/lwang114/GraphUnsupASR.


title: Automatic Multi-Path Web Story Creation from a Structural Article

abstract: Web articles such as Wikipedia serve as one of the major sources of knowledge dissemination and online learning. However, their in-depth information--often in a dense text format--may not be suitable for mobile browsing, even in a responsive UI. We propose an automatic approach that converts a structural article of any length into a set of interactive Web Stories that are ideal for mobile experiences. We focused on Wikipedia articles and developed Wiki2Story, a pipeline based on language and layout models, to demonstrate the concept. Wiki2Story dynamically slices an article and plans one to multiple Story paths according to the document hierarchy. For each slice, it generates a multi-page summary Story composed of text and image pairs in visually-appealing layouts. We derived design principles from an analysis of manually-created Story practices. We executed our pipeline on 500 Wikipedia documents and conducted user studies to review selected outputs. Results showed that Wiki2Story effectively captured and presented salient content from the original articles and sparked interest in viewers.


title: Constrained Optimization with Decision-Dependent Distributions

abstract: In this paper we deal with stochastic optimization problems where the data distributions change in response to the decision variables. Traditionally, the study of optimization problems with decision-dependent distributions has assumed either the absence of constraints or fixed constraints. This work considers a more general setting where the constraints can also dynamically adjust in response to changes in the decision variables. Specifically, we consider linear constraints and analyze the effect of decision-dependent distributions in both the objective function and constraints. Firstly, we establish a sufficient condition for the existence of a constrained equilibrium point, at which the distributions remain invariant under retraining. Morevoer, we propose and analyze two algorithms: repeated constrained optimization and repeated dual ascent. For each algorithm, we provide sufficient conditions for convergence to the constrained equilibrium point. Furthermore, we explore the relationship between the equilibrium point and the optimal point for the constrained decision-dependent optimization problem. Notably, our results encompass previous findings as special cases when the constraints remain fixed. To show the effectiveness of our theoretical analysis, we provide numerical experiments on both a market problem and a dynamic pricing problem for parking based on real-world data.


title: The temporal concentration of travel demand in an urban transport network

abstract: Suppose $A$ and $B$ are two stations within the mass rapid transit network of a city. Both stations see approximately the same average daily number of passengers entering and exiting their gates. However, passengers are evenly distributed at $A$, whereas activity is concentrated mainly during peak hours at $B$. Although the daily travel demand is the same for both stations, $B$ requires more resources since the number of vehicles, station dimensions and staffing level must be tailored to meet the demands of peak hours. This hypothetical scenario underscores the need to quantify the concentration of travel demand for optimising resource allocation and planning efficiency in an urban transport network. To this end, we introduce a novel metric for assessing the temporal concentration of travel demand at different locations in a generic transport network. Our approach is validated using granular data sourced from smart travel cards, encompassing 272 London Underground (LU) stations. Additionally, we present a methodological framework based on Random Forests to identify attributes of the locations of interest within the transport network that contribute to varying levels of temporal concentration of travel demand. Our case study unveils that LU stations located in areas characterised by low residential, retail, and employment density, predominantly situated in outer London, exhibit the most pronounced temporal concentration of travel demand. Conversely, within inner London, stations servicing high-density employment zones, especially around the City of London, experience a greater temporal concentration of travel demand compared to those catering to commercial and residential districts, typically situated in West London.


title: ScaleNet: An Unsupervised Representation Learning Method for Limited Information

abstract: Although large-scale labeled data are essential for deep convolutional neural networks (ConvNets) to learn high-level semantic visual representations, it is time-consuming and impractical to collect and annotate large-scale datasets. A simple and efficient unsupervised representation learning method named ScaleNet based on multi-scale images is proposed in this study to enhance the performance of ConvNets when limited information is available. The input images are first resized to a smaller size and fed to the ConvNet to recognize the rotation degree. Next, the ConvNet learns the rotation-prediction task for the original size images based on the parameters transferred from the previous model. The CIFAR-10 and ImageNet datasets are examined on different architectures such as AlexNet and ResNet50 in this study. The current study demonstrates that specific image features, such as Harris corner information, play a critical role in the efficiency of the rotation-prediction task. The ScaleNet supersedes the RotNet by ~7% in the limited CIFAR-10 dataset. The transferred parameters from a ScaleNet model with limited data improve the ImageNet Classification task by about 6% compared to the RotNet model. This study shows the capability of the ScaleNet method to improve other cutting-edge models such as SimCLR by learning effective features for classification tasks.


title: Exponential Lower Bounds for Fictitious Play in Potential Games

abstract: Fictitious Play (FP) is a simple and natural dynamic for repeated play with many applications in game theory and multi-agent reinforcement learning. It was introduced by Brown (1949,1951) and its convergence properties for two-player zero-sum games was established later by Robinson (1951). Potential games Monderer and Shapley (1996b) is another class of games which exhibit the FP property (Monderer and Shapley (1996a)), i.e., FP dynamics converges to a Nash equilibrium if all agents follows it. Nevertheless, except for two-player zero-sum games and for specific instances of payoff matrices (Abernethy et al. (2021)) or for adversarial tie-breaking rules (Daskalakis and Pan (2014)), the convergence rate of FP is unknown. In this work, we focus on the rate of convergence of FP when applied to potential games and more specifically identical payoff games. We prove that FP can take exponential time (in the number of strategies) to reach a Nash equilibrium, even if the game is restricted to two agents and for arbitrary tie-breaking rules. To prove this, we recursively construct a two-player coordination game with a unique Nash equilibrium. Moreover, every approximate Nash equilibrium in the constructed game must be close to the pure Nash equilibrium in $\ell_1$-distance.


title: Computing a Sparse Approximate Inverse on Quantum Annealing Machines

abstract: Many engineering problems involve solving large linear systems of equations. Conjugate gradient (CG) is one of the most popular iterative methods for solving such systems. However, CG typically requires a good preconditioner to speed up convergence. One such preconditioner is the sparse approximate inverse (SPAI). In this paper, we explore the computation of an SPAI on quantum annealing machines by solving a series of quadratic unconstrained binary optimization (QUBO) problems. Numerical experiments are conducted using both well-conditioned and poorly-conditioned linear systems arising from a 2D finite difference formulation of the Poisson problem.


title: Impact of vector mesons polarization on its interaction with matter

abstract: The production of unstable particles on different nuclei provides the possibility to determine the total cross section of the interaction of vector mesons $V=\rho,\omega,\varphi, K^{*0}(892),J/\psi$ etc. with nucleons. This interaction is defined by a set of amplitudes that correspond to the transverse (helicity $\lambda=\pm 1$) or longitudinal ($\lambda=0$) polarization of the vector meson. The total cross section for the interaction of transversely polarized vector mesons with nucleon $\sigma_T=\sigma(V_T N)$ has been extracted from the coherent photoproduction of vector mesons off nuclei, while the vector meson production in charge exchange reactions as $\pi^\pm(K^\pm)+A\to V^0(K^{*0})+A'$ provides the unique opportunity to obtain the not yet measured total cross section for longitudinally polarized vector meson interacting with nucleon $\sigma_L=\sigma(V_L N)$. We shortly discuss the importance of the knowledge of $\sigma_L$ and possibility to extract its value from experiments on nuclear target.


title: Shared Sequencing and Latency Competition as a Noisy Contest

abstract: We study shared sequencing for different chains from an economic angle. We introduce a minimal non-trivial model that captures cross-domain arbitrageurs' behavior and compare the performance of shared sequencing to that of separate sequencing. While shared sequencing dominates separate sequencing trivially in the sense that it makes it more likely that cross-chain arbitrage opportunities are realized, the investment and revenue comparison is more subtle: In the simple latency competition induced by First Come First Serve ordering, shared sequencing creates more wasteful latency competition compared to separate sequencing. For bidding-based sequencing, the most surprising insight is that the revenue of shared sequencing is not always higher than that of separate sequencing and depends on the transaction ordering rule applied and the arbitrage value potentially realized.


title: SE(3)-Stochastic Flow Matching for Protein Backbone Generation

abstract: The computational design of novel protein structures has the potential to impact numerous scientific disciplines greatly. Toward this goal, we introduce FoldFlow, a series of novel generative models of increasing modeling power based on the flow-matching paradigm over $3\mathrm{D}$ rigid motions -- i.e. the group $\text{SE}(3)$ -- enabling accurate modeling of protein backbones. We first introduce FoldFlow-Base, a simulation-free approach to learning deterministic continuous-time dynamics and matching invariant target distributions on $\text{SE}(3)$. We next accelerate training by incorporating Riemannian optimal transport to create FoldFlow-OT, leading to the construction of both more simple and stable flows. Finally, we design FoldFlow-SFM, coupling both Riemannian OT and simulation-free training to learn stochastic continuous-time dynamics over $\text{SE}(3)$. Our family of FoldFlow, generative models offers several key advantages over previous approaches to the generative modeling of proteins: they are more stable and faster to train than diffusion-based approaches, and our models enjoy the ability to map any invariant source distribution to any invariant target distribution over $\text{SE}(3)$. Empirically, we validate FoldFlow, on protein backbone generation of up to $300$ amino acids leading to high-quality designable, diverse, and novel samples.


title: A 3D Mixed Reality Interface for Human-Robot Teaming

abstract: This paper presents a mixed-reality human-robot teaming system. It allows human operators to see in real-time where robots are located, even if they are not in line of sight. The operator can also visualize the map that the robots create of their environment and can easily send robots to new goal positions. The system mainly consists of a mapping and a control module. The mapping module is a real-time multi-agent visual SLAM system that co-localizes all robots and mixed-reality devices to a common reference frame. Visualizations in the mixed-reality device then allow operators to see a virtual life-sized representation of the cumulative 3D map overlaid onto the real environment. As such, the operator can effectively "see through" walls into other rooms. To control robots and send them to new locations, we propose a drag-and-drop interface. An operator can grab any robot hologram in a 3D mini map and drag it to a new desired goal pose. We validate the proposed system through a user study and real-world deployments. We make the mixed-reality application publicly available at https://github.com/cvg/HoloLens_ros.


title: Symbolic Automata: $\omega$-Regularity Modulo Theories

abstract: Symbolic automata are finite state automata that support potentially infinite alphabets, such as the set of rational numbers, generally applied to regular expressions/languages over finite words. In symbolic automata (or automata modulo theories), an alphabet is represented by an effective Boolean algebra, supported by a decision procedure for satisfiability. Regular languages over infinite words (so called $\omega$-regular languages) have a rich history paralleling that of regular languages over finite words, with well known applications to model checking via B\"uchi automata and temporal logics. We generalize symbolic automata to support $\omega$-regular languages via symbolic transition terms and symbolic derivatives, bringing together a variety of classic automata and logics in a unified framework that provides all the necessary ingredients to support symbolic model checking modulo $A$, $NBW_A$. In particular, we define: (1) alternating B\"uchi automata modulo $A$, $ABW_A$ as well (non-alternating) non-deterministic B\"uchi automata modulo $A$, $NBW_A$; (2) an alternation elimination algorithm that incrementally constructs an $NBW_A$ from an $ABW_A$, and can also be used for constructing the product of two $NBW_A$'s; (3) a definition of linear temporal logic (LTL) modulo $A$ that generalizes Vardi's construction of alternating B\"uchi automata from LTL, using (2) to go from LTL modulo $A$ to $NBW_A$ via $ABW_A$. Finally, we present a combination of LTL modulo $A$ with extended regular expressions modulo $A$ that generalizes the Property Specification Language (PSL). Our combination allows regex complement, that is not supported in PSL but can be supported naturally by using symbolic transition terms.


title: Estimating systemic importance with missing data in input-output graphs

abstract: In the context of the Cobb-Douglas productivity model we consider the $N \times N$ input-output linkage matrix $W$ for a network of $N$ firms $f_1, f_2, \cdots, f_N$. The associated influence vector $v_w$ of $W$ is defined in terms of the Leontief inverse $L_W$ of $W$ as $v_W = \frac{\alpha}{N} L_W \vec{\mathbf{1}}$ where $L_W = (I - (1-\alpha) W')^{-1}$, $W'$ denotes the transpose of $W$ and $I$ is the identity matrix. Here $\vec{\mathbf{1}}$ is the $N \times 1$ vector whose entries are all one. The influence vector is a metric of the importance for the firms in the production network. Under the realistic assumption that the data to compute the influence vector is incomplete, we prove bounds on the worst-case error for the influence vector that are sharp up to a constant factor. We also consider the situation where the missing data is binomially distributed and contextualize the bound on the influence vector accordingly. We also investigate how far off the influence vector can be when we only have data on nodes and connections that are within distance $k$ of some source node. A comparison of our results is juxtaposed against PageRank analogues. We close with a discussion on a possible extension beyond Cobb-Douglas to the Constant Elasticity of Substitution model, as well as the possibility of considering other probability distributions for missing data.


title: Detecting Semantic Conflicts with Unit Tests

abstract: Branching and merging are common practices in collaborative software development, increasing developer's productivity. Despite such benefits, developers need to merge software and resolve merge conflicts. While modern merge techniques can resolve textual conflicts automatically, they fail when the conflict arises at the semantic level. Although semantic merge tools have been proposed, they are usually based on heavyweight static analyses or need explicit specifications of program behavior. In this work, we take a different route and propose SAM (SemAntic Merge), a semantic merge tool based on the automated generation of unit tests that are used as partial specifications. To evaluate SAM's feasibility for detecting conflicts, we perform an empirical study analyzing more than 80 pairs of changes integrated into common class elements from 51 merge scenarios. Furthermore, we also assess how the four unit-test generation tools used by SAM contribute to conflict identification. We propose and assess the adoption of Testability Transformations and Serialization. Our results show that SAM best performs when combining only the tests generated by Differential EvoSuite and EvoSuite and using the proposed Testability Transformations (nine detected conflicts out of 28). These results reinforce previous findings about the potential of using test-case generation to detect test conflicts.


title: Implicit regularization of multi-task learning and finetuning: multiple regimes of feature reuse

abstract: In this work, we investigate the inductive biases that arise from learning multiple tasks, either simultaneously (multi-task learning, MTL) or sequentially (pretraining and subsequent finetuning, PT+FT). We describe novel implicit regularization penalties associated with MTL and PT+FT in diagonal linear networks and single-hidden-layer ReLU networks. These penalties indicate that MTL and PT+FT induce the network to reuse features in different ways. 1) Both MTL and PT+FT exhibit biases towards feature reuse between tasks, and towards sparsity in the set of learned features. We show a "conservation law" that implies a direct tradeoff between these two biases. Our results also imply that during finetuning, networks operate in a hybrid of the kernel (or "lazy") regime and the feature-learning ("rich") regime identified in prior work. 2) PT+FT exhibits a novel "nested feature selection" behavior not described by either the lazy or rich regimes, which biases it to extract a sparse subset of the features learned during pretraining. This regime is much narrower for MTL. 3) PT+FT (but not MTL) in ReLU networks benefits from features that are correlated between the auxiliary and main task. We confirm our insights empirically with teacher-student models. Finally, we validate our theory in deep neural networks trained on image classification tasks, finding that they may exhibit a nested feature selection regime. We also introduce a practical technique -- weight rescaling following pretraining -- and provide evidence that this method can improve finetuning performance by inducing the network to operate in the nested feature selection regime.


title: Quantifying errors of the electron-proton/muon correlation functionals through the Kohn-Sham inversion of a two-component model system

abstract: The multi-component density functional theory is faced with the challenge of capturing various types of inter- and intra-particle exchange-correlation effects beyond those introduced by the conventional electronic exchange-correlation functionals. Herein, we focus on evaluating the electron-proton/muon correlation functionals appearing in molecular/condensed-phase systems where a proton/muon is treated as a quantum particle on equal footing with electrons, beyond the Born-Oppenheimer paradigm. Five recently developed local correlation functionals, i.e., the epc series and e$\mu$c-1, are selected and their performances are analyzed by employing a two-particle model that includes an electron and a positively charged particle (PCP) with a variable mass, interacting through Coulombic forces, within a double harmonic trap. Using the Kohn-Sham (KS) inversion procedure, the exact two-component KS characterization of the model is deduced and its properties are compared to those derived from the considered functionals. The analysis demonstrates that these local functionals achieve their original parameterization objectives to reproduce the one-PCP densities and the electron-PCP correlation energies, but all fall short of reproducing the underlying PCP correlation potentials correctly. Moreover, a comprehensive error analysis reveals that the density-driven errors have a non-negligible contribution to the success of the considered functionals. Overall, the study shows the strengths as well as shortcomings of the considered functionals hopefully paving the way for designing more robust functionals in the future.


title: Reducing Intraspecies and Interspecies Covariate Shift in Traumatic Brain Injury EEG of Humans and Mice Using Transfer Euclidean Alignment

abstract: While analytics of sleep electroencephalography (EEG) holds certain advantages over other methods in clinical applications, high variability across subjects poses a significant challenge when it comes to deploying machine learning models for classification tasks in the real world. In such instances, machine learning models that exhibit exceptional performance on a specific dataset may not necessarily demonstrate similar proficiency when applied to a distinct dataset for the same task. The scarcity of high-quality biomedical data further compounds this challenge, making it difficult to evaluate the model's generality comprehensively. In this paper, we introduce Transfer Euclidean Alignment - a transfer learning technique to tackle the problem of the dearth of human biomedical data for training deep learning models. We tested the robustness of this transfer learning technique on various rule-based classical machine learning models as well as the EEGNet-based deep learning model by evaluating on different datasets, including human and mouse data in a binary classification task of detecting individuals with versus without traumatic brain injury (TBI). By demonstrating notable improvements with an average increase of 14.42% for intraspecies datasets and 5.53% for interspecies datasets, our findings underscore the importance of the use of transfer learning to improve the performance of machine learning and deep learning models when using diverse datasets for training.


title: Can 5G NR Sidelink communications support wireless augmented reality?

abstract: Smart glasses that support augmented reality (AR) have the potential to become the consumer's primary medium of connecting to the future internet. For the best quality of user experience, AR glasses must have a small form factor and long battery life, while satisfying the data rate and latency requirements of AR applications. To extend the AR glasses' battery life, the computation and processing involved in AR may be offloaded to a companion device, such as a smartphone, through a wireless connection. Sidelink (SL), i.e., the D2D communication interface of 5G NR, is a potential candidate for this wireless link. In this paper, we use system-level simulations to analyze the feasibility of NR SL for supporting AR. Our simulator incorporates the PHY layer structure and MAC layer resource scheduling of 3GPP SL, standard 3GPP channel models, and MCS configurations. Our results suggest that the current SL standard specifications are insufficient for high-end AR use cases with heavy interaction but can support simpler previews and file transfers. We further propose two enhancements to SL resource allocation, which have the potential to offer significant performance improvements for AR applications.


title: Crosslinker energy landscape effects on dynamic mechanical properties of ideal polymer hydrogels

abstract: Reversible crosslinkers can enable several desirable mechanical properties, such as improved toughness and self-healing, when incorporated in polymer networks for bioengineering and structural applications. In this work, we performed coarse-grained molecular dynamics to investigate the effect of the energy landscape of reversible crosslinkers on the dynamic mechanical properties of crosslinked polymer network hydrogels. We report that, for an ideal network, the energy potential of the crosslinker interaction drives the viscosity of the network, where a stronger potential results in a higher viscosity. Additional topographical analyses reveal a mechanistic understanding of the structural rearrangement of the network as it deforms and indicate that as the number of defects increases in the network, the viscosity of the network increases. As an important validation for the relationship between the energy landscape of a crosslinker chemistry and the resulting dynamic mechanical properties of a crosslinked ideal network hydrogel, this work enhances our understanding of deformation mechanisms in polymer networks that cannot easily be revealed by experiment and reveals design ideas that can lead to better performance of the polymer network at the macroscale.


title: FT-Shield: A Watermark Against Unauthorized Fine-tuning in Text-to-Image Diffusion Models

abstract: Text-to-image generative models, especially those based on latent diffusion models (LDMs), have demonstrated outstanding ability in generating high-quality and high-resolution images from textual prompts. With this advancement, various fine-tuning methods have been developed to personalize text-to-image models for specific applications such as artistic style adaptation and human face transfer. However, such advancements have raised copyright concerns, especially when the data are used for personalization without authorization. For example, a malicious user can employ fine-tuning techniques to replicate the style of an artist without consent. In light of this concern, we propose FT-Shield, a watermarking solution tailored for the fine-tuning of text-to-image diffusion models. FT-Shield addresses copyright protection challenges by designing new watermark generation and detection strategies. In particular, it introduces an innovative algorithm for watermark generation. It ensures the seamless transfer of watermarks from training images to generated outputs, facilitating the identification of copyrighted material use. To tackle the variability in fine-tuning methods and their impact on watermark detection, FT-Shield integrates a Mixture of Experts (MoE) approach for watermark detection. Comprehensive experiments validate the effectiveness of our proposed FT-Shield.


title: On the Parallel Complexity of Multilevel Monte Carlo in Stochastic Gradient Descent

abstract: In the stochastic gradient descent (SGD) for sequential simulations such as the neural stochastic differential equations, the Multilevel Monte Carlo (MLMC) method is known to offer better theoretical computational complexity compared to the naive Monte Carlo approach. However, in practice, MLMC scales poorly on massively parallel computing platforms such as modern GPUs, because of its large parallel complexity which is equivalent to that of the naive Monte Carlo method. To cope with this issue, we propose the delayed MLMC gradient estimator that drastically reduces the parallel complexity of MLMC by recycling previously computed gradient components from earlier steps of SGD. The proposed estimator provably reduces the average parallel complexity per iteration at the cost of a slightly worse per-iteration convergence rate. In our numerical experiments, we use an example of deep hedging to demonstrate the superior parallel complexity of our method compared to the standard MLMC in SGD.


title: 4-Strand Burau is Unfaithful Modulo 5

abstract: We introduce a new algorithm for finding kernel elements in the Burau representation. Our algorithm applies reservoir sampling to a statistic on matrices which is closely correlated with Garside length. Using this we exhibit an explicit kernel element in the Burau representation on 4-strands reduced modulo 5.


title: How to infer ocean freezing rates on icy satellites from measurements of ice thickness

abstract: Liquid water oceans are thought to underlie the ice shells of Europa and Enceladus. However, ocean properties can be challenging to measure due to the overlying ice cover. Here, we explore how measurements of ice shell thickness, which may be easier to obtain, could be used to infer information about the subsurface ocean. In particular, we consider lateral gravity-driven flow of the ice shells of icy satellites and relate this to ocean freeze and melt rates. We employ a first-principles approach applicable to conductive ice shells. We derive a scaling law under which ocean freeze and melt rates can be estimated from thickness measurements of a shell with a vertically-varying temperature-dependent viscosity. Under a steady-state assumption, ocean freeze and melt rates can be inferred from measurements of ice thickness; however, these rates depend on the basal viscosity, a key unknown. Depending on a characteristic thickness scale and basal viscosity, the characteristic freeze and melt rates range from about O(10$^{-1}$) to O(10$^{-5}$) mm/year. We validate our scaling in an Earth environment with ice-penetrating radar measurements of ice thickness and modelled snow accumulation for Roosevelt Island, Antarctica. Our model, coupled with the forthcoming observations of shell thickness from upcoming missions, may help bound the magnitudes of estimated ocean freeze and melt rates on icy satellites and shed light on potential ocean stratifications.


title: PCGPT: Procedural Content Generation via Transformers

abstract: The paper presents the PCGPT framework, an innovative approach to procedural content generation (PCG) using offline reinforcement learning and transformer networks. PCGPT utilizes an autoregressive model based on transformers to generate game levels iteratively, addressing the challenges of traditional PCG methods such as repetitive, predictable, or inconsistent content. The framework models trajectories of actions, states, and rewards, leveraging the transformer's self-attention mechanism to capture temporal dependencies and causal relationships. The approach is evaluated in the Sokoban puzzle game, where the model predicts items that are needed with their corresponding locations. Experimental results on the game Sokoban demonstrate that PCGPT generates more complex and diverse game content. Interestingly, it achieves these results in significantly fewer steps compared to existing methods, showcasing its potential for enhancing game design and online content generation. Our model represents a new PCG paradigm which outperforms previous methods.


title: One Clean Qubit Suffices for Quantum Communication Advantage

abstract: We study the one-clean-qubit model of quantum communication where one qubit is in a pure state and all other qubits are maximally mixed. We demonstrate a partial function that has a quantum protocol of cost $O(\log N)$ in this model, however, every interactive randomized protocol has cost $\Omega(\sqrt{N})$, settling a conjecture of Klauck and Lim. In contrast, all prior quantum versus classical communication separations required at least $\Omega(\log N)$ clean qubits. The function demonstrating our separation also has an efficient protocol in the quantum-simultaneous-with-entanglement model of cost $O(\log N )$. We thus recover the state-of-the-art separations between quantum and classical communication complexity. Our proof is based on a recent hypercontractivity inequality introduced by Ellis, Kindler, Lifshitz, and Minzer, in conjunction with tools from the representation theory of compact Lie groups.


title: Automated Bug Generation in the era of Large Language Models

abstract: Bugs are essential in software engineering; many research studies in the past decades have been proposed to detect, localize, and repair bugs in software systems. Effectiveness evaluation of such techniques requires complex bugs, i.e., those that are hard to detect through testing and hard to repair through debugging. From the classic software engineering point of view, a hard-to-repair bug differs from the correct code in multiple locations, making it hard to localize and repair. Hard-to-detect bugs, on the other hand, manifest themselves under specific test inputs and reachability conditions. These two objectives, i.e., generating hard-to-detect and hard-to-repair bugs, are mostly aligned; a bug generation technique can change multiple statements to be covered only under a specific set of inputs. However, these two objectives are conflicting for learning-based techniques: A bug should have a similar code representation to the correct code in the training data to challenge a bug prediction model to distinguish them. The hard-to-repair bug definition remains the same but with a caveat: the more a bug differs from the original code (at multiple locations), the more distant their representations are and easier to be detected. We propose BugFarm, to transform arbitrary code into multiple complex bugs. BugFarm leverages LLMs to mutate code in multiple locations (hard-to-repair). To ensure that multiple modifications do not notably change the code representation, BugFarm analyzes the attention of the underlying model and instructs LLMs to only change the least attended locations (hard-to-detect). Our comprehensive evaluation of 320k+ bugs from over 2.5M mutants generated by BugFarm and two alternative approaches demonstrates our superiority in generating bugs that are hard to detect by learning-based bug prediction approaches and hard to repair by SOTA learning-based program repair technique.


title: MindTheDApp: A Toolchain for Complex Network-Driven Structural Analysis of Ethereum-based Decentralised Applications

abstract: This paper presents MindTheDApp, a toolchain designed specifically for the structural analysis of Ethereum-based Decentralized Applications (DApps), with a distinct focus on a complex network-driven approach. Unlike existing tools, our toolchain combines the power of ANTLR4 and Abstract Syntax Tree (AST) traversal techniques to transform the architecture and interactions within smart contracts into a specialized bipartite graph. This enables advanced network analytics to highlight operational efficiencies within the DApp's architecture. The bipartite graph generated by the proposed tool comprises two sets of nodes: one representing smart contracts, interfaces, and libraries, and the other including functions, events, and modifiers. Edges in the graph connect functions to smart contracts they interact with, offering a granular view of interdependencies and execution flow within the DApp. This network-centric approach allows researchers and practitioners to apply complex network theory in understanding the robustness, adaptability, and intricacies of decentralized systems. Our work contributes to the enhancement of security in smart contracts by allowing the visualisation of the network, and it provides a deep understanding of the architecture and operational logic within DApps. Given the growing importance of smart contracts in the blockchain ecosystem and the emerging application of complex network theory in technology, our toolchain offers a timely contribution to both academic research and practical applications in the field of blockchain technology.


title: Dodo: Dynamic Contextual Compression for Decoder-only LMs

abstract: Transformer-based language models (LMs) are inefficient in long contexts. We propose Dodo, a solution for context compression. Instead of one vector per token in a standard transformer model, Dodo represents text with a dynamic number of hidden states at each layer, reducing the cost of self-attention to a fraction of typical time and space. Moreover, off-the-shelf models such as LLaMA can be adapted to Dodo by efficient parameter tuning methods such as LoRA. In use, Dodo can act as either an autoregressive LM or a context compressor for downstream tasks. We demonstrate through experiments in language modeling, question answering, and summarization that Dodo retains capabilities in these tasks, while drastically reducing the overhead during decoding. For example, in the autoencoding task, Dodo shrinks context at a 20x compression ratio with a BLEU score of 98% for reconstruction, achieving nearly lossless encoding.


title: Mixture of Quantized Experts (MoQE): Complementary Effect of Low-bit Quantization and Robustness

abstract: Large Mixture of Experts (MoE) models could achieve state-of-the-art quality on various language tasks, including machine translation task, thanks to the efficient model scaling capability with expert parallelism. However, it has brought a fundamental issue of larger memory consumption and increased memory bandwidth bottleneck at deployment time. In this paper, we propose Mixture of Quantized Experts (MoQE) which is a simple weight-only quantization method applying ultra low-bit down to 2-bit quantizations only to expert weights for mitigating the increased memory and latency issues of MoE models. We show that low-bit quantization together with the MoE architecture delivers a reliable model performance while reducing the memory size significantly even without any additional training in most cases. In particular, expert layers in MoE models are much more robust to the quantization than conventional feedforward networks (FFN) layers. In our comprehensive analysis, we show that MoE models with 2-bit expert weights can deliver better model performance than the dense model trained on the same dataset. As a result of low-bit quantization, we show the model size can be reduced by 79.6% of the original half precision floating point (fp16) MoE model. Combined with an optimized GPU runtime implementation, it also achieves 1.24X speed-up on A100 GPUs.


title: Pre-supernova outbursts by core magnetic activity

abstract: We conduct one-dimensional stellar evolutionary numerical simulations under the assumption that an efficient dynamo operates in the core of massive stars years to months before core collapse and find that the magnetic activity enhances mass loss rate and might trigger binary interaction that leads to outbursts. We assume that the magnetic flux tubes that the dynamo forms in the inner core buoy out to the outer core where there is a steep entropy rise and a molecular weight drop. There the magnetic fields turn to thermal energy, i.e., by reconnection. We simulate this energy deposition where the entropy steeply rises and find that for our simulated cases the envelope radius increases by a factor of 1.2-2 and luminosity by about an order of magnitude. These changes enhance the mass loss rate. The envelope expansion can trigger a binary interaction that powers an outburst. Because magnetic field amplification depends positively on the core rotation rate and operates in cycles, not in all cases the magnetic activity will be powerful enough to change envelope properties. Namely, only a fraction of core-collapse supernovae experiences pre-explosion outbursts.


title: Deflection of Coronal Mass Ejections in Unipolar Ambient Magnetic Fields

abstract: The trajectories of coronal mass ejections (CMEs) are often seen to substantially deviate from a purely radial propagation direction. Such deviations occur predominantly in the corona and have been attributed to "channeling" or deflection of the eruptive flux by asymmetric ambient magnetic fields. Here, we investigate an additional mechanism that does not require any asymmetry of the pre-eruptive ambient field. Using magnetohydrodynamic numerical simulations, we show that the trajectory of CMEs through the solar corona can significantly deviate from a radial direction when propagation takes place in a unipolar radial field. We demonstrate that the deviation is most prominent below ~15 solar radii and can be attributed to an "effective IxB force" that arises from the intrusion of a magnetic flux rope with a net axial electric current into a unipolar background field. These results are important for predictions of CME trajectories in the context of space weather forecasts, as well as for reaching a deeper understanding of the fundamental physics underlying CME interactions with the ambient fields in the extended solar corona.


title: A generalized spectral correspondence

abstract: We establish a strong categorical correspondence between isomorphism classes of sheaves of arbitrary rank on one algebraic curve and twisted pairs on another algebraic curve. In a particular application, we realize a generic elliptic curve as a spectral cover of the complex projective line $\mathbb{P}^1$ and then construct examples of semistable co-Higgs bundles over $\mathbb{P}^1$ as pushforwards of locally-free sheaves of certain small ranks over the elliptic curve. By appealing to a composite push-pull projection formula, we conjecture an iterated version of the spectral correspondence. We prove this conjecture for a particular class of spectral covers of $\mathbb {P}^1$. The proof relies upon a classification of Galois groups into primitive and imprimitive types. In this context, we revisit a century-old theorem of J.F. Ritt.


title: Sharp and Robust Estimation of Partially Identified Discrete Response Models

abstract: Semiparametric discrete choice models are widely used in a variety of practical applications. While these models are point identified in the presence of continuous covariates, they can become partially identified when covariates are discrete. In this paper we find that classical estimators, including the maximum score estimator, (Manski (1975)), loose their attractive statistical properties without point identification. First of all, they are not sharp with the estimator converging to an outer region of the identified set, (Komarova (2013)), and in many discrete designs it weakly converges to a random set. Second, they are not robust, with their distribution limit discontinuously changing with respect to the parameters of the model. We propose a novel class of estimators based on the concept of a quantile of a random set, which we show to be both sharp and robust. We demonstrate that our approach extends from cross-sectional settings to classical static and dynamic discrete panel data models.


title: The impact of electron inertia on collisional laser absorption for high energy density plasmas

abstract: High-power lasers are at the forefront of science in many domains. While their fields are still far from reaching the Schwinger limit, they have been used in extreme regimes, to successfully accelerate particles at high energies, or to reproduce phenomena observed in astrophysical settings. However, our understanding of laser plasma interactions is limited by numerical simulations, which are very expensive to run as short temporal and spatial scales need to be resolved explicitly. Under such circumstances, a non-collisional approach to model laser-plasma interactions becomes numerically expensive. Even a collisional approach, modeling the electrons and ions as independent fluids, is slow in practice. In both cases, the limitation comes from a direct computation of electron motion. In this work, we show how the generalized Ohm's law captures collisional absorption phenomena through the macroscopic interactions of laser fields, electron flows, and ion dynamics. This approach replicates several features usually associated with explicit electron motion, such as cut-off density, reflection and absorption. As the electron dynamics is now solved implicitly, the spatial and temporal scales of this model fit well between multi-fluid and standard magnetohydrodynamics scales, allowing to study a new class of problems that would be too expensive to solve numerically with other methods.


title: Bag of Tricks for Fully Test-Time Adaptation

abstract: Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest. Numerous tricks and techniques have been proposed to ensure robust learning on arbitrary streams of unlabeled data. However, assessing the true impact of each individual technique and obtaining a fair comparison still constitutes a significant challenge. To help consolidate the community's knowledge, we present a categorization of selected orthogonal TTA techniques, including small batch normalization, stream rebalancing, reliable sample selection, and network confidence calibration. We meticulously dissect the effect of each approach on different scenarios of interest. Through our analysis, we shed light on trade-offs induced by those techniques between accuracy, the computational power required, and model complexity. We also uncover the synergy that arises when combining techniques and are able to establish new state-of-the-art results.


title: Jailbreaker in Jail: Moving Target Defense for Large Language Models

abstract: Large language models (LLMs), known for their capability in understanding and following instructions, are vulnerable to adversarial attacks. Researchers have found that current commercial LLMs either fail to be "harmless" by presenting unethical answers, or fail to be "helpful" by refusing to offer meaningful answers when faced with adversarial queries. To strike a balance between being helpful and harmless, we design a moving target defense (MTD) enhanced LLM system. The system aims to deliver non-toxic answers that align with outputs from multiple model candidates, making them more robust against adversarial attacks. We design a query and output analysis model to filter out unsafe or non-responsive answers. %to achieve the two objectives of randomly selecting outputs from different LLMs. We evaluate over 8 most recent chatbot models with state-of-the-art adversarial queries. Our MTD-enhanced LLM system reduces the attack success rate from 37.5\% to 0\%. Meanwhile, it decreases the response refusal rate from 50\% to 0\%.


title: Tailoring electronic properties on Bi$_2$O$_2$Se under surface modification and magnetic doping

abstract: The search for a two-dimensional material that simultaneously fulfills some properties for its use in spintronics and optoelectronics, i.e., a suitable bandgap with high in-plane carrier mobility and good environmental stability, is the focus of intense current research. If magnetism is also present, its range of utility is considerably expanded. One of the promising materials fulfilling these features is Bi$_2$O$_2$Se, a non van-der-Waals system whose monolayer has been recently obtained. This study addresses the structure and electronic properties of different monolayers that could be obtained experimentally. It is observed that these monolayers are very sensitive to the introduction of "extra" electrons, changing their electronic character from semiconductor to conductor. Furthermore, we investigate how the properties of each studied monolayer change when the system is doped with magnetic atoms. The result is that the doping introduces bands of low dispersion caused by the d orbitals of the impurities that can hybridize with the oxygen and bismuth atoms in the monolayer. This strongly modifies the electronic properties of the material, producing changes in the valence of certain Bi atoms which can induce a symmetry breaking in the perpendicular plane. Such phenomena lead to metallic or semiconducting characteristics, depending of metal doping.


title: Control of particle transport driven by active noise: strategy of amplification via a periodic potential

abstract: We extend our previous studies on a counter-intuitive effect in which a directed transport of a free Brownian particle induced by active fluctuations can be significantly enhanced when the particle is placed in a periodic potential. It is in clear contrast to a common situation when the velocity of the Brownian particle is notably reduced if the periodic potential is switched on. As a model of active fluctuations we employ white Poissonian shot noise. We reconsider the case of the skew-normal amplitude distribution of shot noise and focus on the impact of statistical characteristics of its amplitude like mean, variance and skewness on the magnitude of free particle transport enhancement. in particular, we detect intriguing oscillations of the rescaled velocity of the particle as a function of the variance. Our findings can be corroborated experimentally in both biological and artificial microscopic systems.


title: FedL2P: Federated Learning to Personalize

abstract: Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data distribution. However, different FL problems may require different personalization strategies, and it may not even be possible to define an effective one-size-fits-all personalization strategy for all clients: depending on how similar each client's optimal predictor is to that of the global model, different personalization strategies may be preferred. In this paper, we consider the federated meta-learning problem of learning personalization strategies. Specifically, we consider meta-nets that induce the batch-norm and learning rate parameters for each client given local data statistics. By learning these meta-nets through FL, we allow the whole FL network to collaborate in learning a customized personalization strategy for each client. Empirical results show that this framework improves on a range of standard hand-crafted personalization baselines in both label and feature shift situations.


title: Can a student Large Language Model perform as well as it's teacher?

abstract: The burgeoning complexity of contemporary deep learning models, while achieving unparalleled accuracy, has inadvertently introduced deployment challenges in resource-constrained environments. Knowledge distillation, a technique aiming to transfer knowledge from a high-capacity "teacher" model to a streamlined "student" model, emerges as a promising solution to this dilemma. This paper provides a comprehensive overview of the knowledge distillation paradigm, emphasizing its foundational principles such as the utility of soft labels and the significance of temperature scaling. Through meticulous examination, we elucidate the critical determinants of successful distillation, including the architecture of the student model, the caliber of the teacher, and the delicate balance of hyperparameters. While acknowledging its profound advantages, we also delve into the complexities and challenges inherent in the process. Our exploration underscores knowledge distillation's potential as a pivotal technique in optimizing the trade-off between model performance and deployment efficiency.


title: OneAdapt: Fast Adaptation for Deep Learning Applications via Backpropagation

abstract: Deep learning inference on streaming media data, such as object detection in video or LiDAR feeds and text extraction from audio waves, is now ubiquitous. To achieve high inference accuracy, these applications typically require significant network bandwidth to gather high-fidelity data and extensive GPU resources to run deep neural networks (DNNs). While the high demand for network bandwidth and GPU resources could be substantially reduced by optimally adapting the configuration knobs, such as video resolution and frame rate, current adaptation techniques fail to meet three requirements simultaneously: adapt configurations (i) with minimum extra GPU or bandwidth overhead; (ii) to reach near-optimal decisions based on how the data affects the final DNN's accuracy, and (iii) do so for a range of configuration knobs. This paper presents OneAdapt, which meets these requirements by leveraging a gradient-ascent strategy to adapt configuration knobs. The key idea is to embrace DNNs' differentiability to quickly estimate the accuracy's gradient to each configuration knob, called AccGrad. Specifically, OneAdapt estimates AccGrad by multiplying two gradients: InputGrad (i.e. how each configuration knob affects the input to the DNN) and DNNGrad (i.e. how the DNN input affects the DNN inference output). We evaluate OneAdapt across five types of configurations, four analytic tasks, and five types of input data. Compared to state-of-the-art adaptation schemes, OneAdapt cuts bandwidth usage and GPU usage by 15-59% while maintaining comparable accuracy or improves accuracy by 1-5% while using equal or fewer resources.


title: Delta-AI: Local objectives for amortized inference in sparse graphical models

abstract: We present a new algorithm for amortized inference in sparse probabilistic graphical models (PGMs), which we call $\Delta$-amortized inference ($\Delta$-AI). Our approach is based on the observation that when the sampling of variables in a PGM is seen as a sequence of actions taken by an agent, sparsity of the PGM enables local credit assignment in the agent's policy learning objective. This yields a local constraint that can be turned into a local loss in the style of generative flow networks (GFlowNets) that enables off-policy training but avoids the need to instantiate all the random variables for each parameter update, thus speeding up training considerably. The $\Delta$-AI objective matches the conditional distribution of a variable given its Markov blanket in a tractable learned sampler, which has the structure of a Bayesian network, with the same conditional distribution under the target PGM. As such, the trained sampler recovers marginals and conditional distributions of interest and enables inference of partial subsets of variables. We illustrate $\Delta$-AI's effectiveness for sampling from synthetic PGMs and training latent variable models with sparse factor structure.


title: AXNav: Replaying Accessibility Tests from Natural Language

abstract: Developers and quality assurance testers often rely on manual testing to test accessibility features throughout the product lifecycle. Unfortunately, manual testing can be tedious, often has an overwhelming scope, and can be difficult to schedule amongst other development milestones. Recently, Large Language Models (LLMs) have been used for a variety of tasks including automation of UIs, however to our knowledge no one has yet explored their use in controlling assistive technologies for the purposes of supporting accessibility testing. In this paper, we explore the requirements of a natural language based accessibility testing workflow, starting with a formative study. From this we build a system that takes as input a manual accessibility test (e.g., ``Search for a show in VoiceOver'') and uses an LLM combined with pixel-based UI Understanding models to execute the test and produce a chaptered, navigable video. In each video, to help QA testers we apply heuristics to detect and flag accessibility issues (e.g., Text size not increasing with Large Text enabled, VoiceOver navigation loops). We evaluate this system through a 10 participant user study with accessibility QA professionals who indicated that the tool would be very useful in their current work and performed tests similarly to how they would manually test the features. The study also reveals insights for future work on using LLMs for accessibility testing.


title: Controlling the size and adhesion of DNA droplets using surface-active DNA molecules

abstract: Liquid droplets of biomolecules serve as organizers of the cellular interior and are of interest in biosensing and biomaterials applications. Here, we investigate means to tune the interfacial properties of a model biomolecular liquid consisting of multi-armed DNA 'nanostar' particles. We find that long DNA molecules that have binding affinity for the nanostars are preferentially enriched on the interface of nanostar droplets, thus acting as surfactants. Fluorescent measurements indicate that, in certain conditions, the interfacial density of the surfactant is around 20 per square micron, indicative of a sparse brush-like structure of the long, polymeric DNA. Increasing surfactant concentration leads to decreased droplet size, down to the sub-micron scale, consistent with arrest of droplet coalescence by the disjoining pressure created by the brush-like surfactant layer. Added DNA surfactant also keeps droplets from adhering to both hydrophobic and hydrophilic solid surfaces, apparently due to this same disjoining effect of the surfactant layer. We thus demonstrate control of the size and adhesive properties of droplets of a biomolecular liquid, with implications for basic biophysical understanding of such droplets, as well as for their applied use.


title: EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods

abstract: A plethora of text-guided image editing methods have recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models such as Imagen and Stable Diffusion. A standardized evaluation protocol, however, does not exist to compare methods across different types of fine-grained edits. To address this gap, we introduce EditVal, a standardized benchmark for quantitatively evaluating text-guided image editing methods. EditVal consists of a curated dataset of images, a set of editable attributes for each image drawn from 13 possible edit types, and an automated evaluation pipeline that uses pre-trained vision-language models to assess the fidelity of generated images for each edit type. We use EditVal to benchmark 8 cutting-edge diffusion-based editing methods including SINE, Imagic and Instruct-Pix2Pix. We complement this with a large-scale human study where we show that EditVall's automated evaluation pipeline is strongly correlated with human-preferences for the edit types we considered. From both the human study and automated evaluation, we find that: (i) Instruct-Pix2Pix, Null-Text and SINE are the top-performing methods averaged across different edit types, however {\it only} Instruct-Pix2Pix and Null-Text are able to preserve original image properties; (ii) Most of the editing methods fail at edits involving spatial operations (e.g., changing the position of an object). (iii) There is no `winner' method which ranks the best individually across a range of different edit types. We hope that our benchmark can pave the way to developing more reliable text-guided image editing tools in the future. We will publicly release EditVal, and all associated code and human-study templates to support these research directions in https://deep-ml-research.github.io/editval/.


title: Noise-induced synchronization and regularity in feed-forward-loop motifs

abstract: In complex systems, the interplay between network structure and noise often leads to emergent phenomena. This study explores the effects of uneven coupling and asymmetric noise on the dynamics of feed-forward loop (FFL) motifs, essential components of networks. We investigate how these variations in network motifs influence noise-induced synchrony and regularity. Using mathematical models and simulations, we uncover that the interaction of asymmetric noise and uneven coupling can significantly impact the behavior of FFL motifs, promoting synchronization and enhancing output regularity. These findings contribute to a deeper understanding of the role of network motifs in shaping network dynamics, shedding light on the intricate interplay between structure, noise, and emergent behavior in complex systems.


title: EGraFFBench: Evaluation of Equivariant Graph Neural Network Force Fields for Atomistic Simulations

abstract: Equivariant graph neural networks force fields (EGraFFs) have shown great promise in modelling complex interactions in atomic systems by exploiting the graphs' inherent symmetries. Recent works have led to a surge in the development of novel architectures that incorporate equivariance-based inductive biases alongside architectural innovations like graph transformers and message passing to model atomic interactions. However, thorough evaluations of these deploying EGraFFs for the downstream task of real-world atomistic simulations, is lacking. To this end, here we perform a systematic benchmarking of 6 EGraFF algorithms (NequIP, Allegro, BOTNet, MACE, Equiformer, TorchMDNet), with the aim of understanding their capabilities and limitations for realistic atomistic simulations. In addition to our thorough evaluation and analysis on eight existing datasets based on the benchmarking literature, we release two new benchmark datasets, propose four new metrics, and three challenging tasks. The new datasets and tasks evaluate the performance of EGraFF to out-of-distribution data, in terms of different crystal structures, temperatures, and new molecules. Interestingly, evaluation of the EGraFF models based on dynamic simulations reveals that having a lower error on energy or force does not guarantee stable or reliable simulation or faithful replication of the atomic structures. Moreover, we find that no model clearly outperforms other models on all datasets and tasks. Importantly, we show that the performance of all the models on out-of-distribution datasets is unreliable, pointing to the need for the development of a foundation model for force fields that can be used in real-world simulations. In summary, this work establishes a rigorous framework for evaluating machine learning force fields in the context of atomic simulations and points to open research challenges within this domain.


title: The directional flow generated by peristalsis in perivascular networks -- theoretical and numerical reduced-order descriptions

abstract: Directional fluid flow in perivascular spaces surrounding cerebral arteries is hypothesized to play a key role in brain solute transport and clearance. While various drivers for pulsatile flow, such as cardiac or respiratory pulsations, are well quantified, the question remains as to which mechanisms could induce directional flow within physiological regimes. To address this question, we develop theoretical and numerical reduced-order models to quantify the directional (net) flow induceable by peristaltic pumping in periarterial networks. Each periarterial element is modeled as a slender annular space bounded internally by a circular tube supporting a periodic traveling (peristaltic) wave. Under the reasonable assumptions of small Reynolds number flow, small radii, and small-amplitude peristaltic waves, we use lubrication theory and regular perturbation methods to derive theoretical expressions for the directional net flow and pressure distribution in the perivascular network. The reduced model is used to derive closed-form analytical expressions for the net flow for simple network configurations of interest, including single elements, two elements in tandem, and a three element bifurcation, with results compared with numerical predictions. In particular, we provide a computable theoretical estimate of the net flow induced by peristaltic motion in perivascular networks as a function of physiological parameters, notably wave length, frequency, amplitude and perivascular dimensions. Quantifying the maximal net flow for specific physiological regimes, we find that vasomotion may induce net pial periarterial flow velocities on the order of a few to tens of mum/s and that sleep-related changes in vasomotion pulsatility may drive a threefold flow increase.


title: Episodic Memory Theory for the Mechanistic Interpretation of Recurrent Neural Networks

abstract: Understanding the intricate operations of Recurrent Neural Networks (RNNs) mechanistically is pivotal for advancing their capabilities and applications. In this pursuit, we propose the Episodic Memory Theory (EMT), illustrating that RNNs can be conceptualized as discrete-time analogs of the recently proposed General Sequential Episodic Memory Model. To substantiate EMT, we introduce a novel set of algorithmic tasks tailored to probe the variable binding behavior in RNNs. Utilizing the EMT, we formulate a mathematically rigorous circuit that facilitates variable binding in these tasks. Our empirical investigations reveal that trained RNNs consistently converge to the variable binding circuit, thus indicating universality in the dynamics of RNNs. Building on these findings, we devise an algorithm to define a privileged basis, which reveals hidden neurons instrumental in the temporal storage and composition of variables, a mechanism vital for the successful generalization in these tasks. We show that the privileged basis enhances the interpretability of the learned parameters and hidden states of RNNs. Our work represents a step toward demystifying the internal mechanisms of RNNs and, for computational neuroscience, serves to bridge the gap between artificial neural networks and neural memory models.


title: Can Large Language Models Provide Security & Privacy Advice? Measuring the Ability of LLMs to Refute Misconceptions

abstract: Users seek security & privacy (S&P) advice from online resources, including trusted websites and content-sharing platforms. These resources help users understand S&P technologies and tools and suggest actionable strategies. Large Language Models (LLMs) have recently emerged as trusted information sources. However, their accuracy and correctness have been called into question. Prior research has outlined the shortcomings of LLMs in answering multiple-choice questions and user ability to inadvertently circumvent model restrictions (e.g., to produce toxic content). Yet, the ability of LLMs to provide reliable S&P advice is not well-explored. In this paper, we measure their ability to refute popular S&P misconceptions that the general public holds. We first study recent academic literature to curate a dataset of over a hundred S&P-related misconceptions across six different topics. We then query two popular LLMs (Bard and ChatGPT) and develop a labeling guide to evaluate their responses to these misconceptions. To comprehensively evaluate their responses, we further apply three strategies: query each misconception multiple times, generate and query their paraphrases, and solicit source URLs of the responses. Both models demonstrate, on average, a 21.3% non-negligible error rate, incorrectly supporting popular S&P misconceptions. The error rate increases to 32.6% when we repeatedly query LLMs with the same or paraphrased misconceptions. We also expose that models may partially support a misconception or remain noncommittal, refusing a firm stance on misconceptions. Our exploration of information sources for responses revealed that LLMs are susceptible to providing invalid URLs (21.2% for Bard and 67.7% for ChatGPT) or point to unrelated sources (44.2% returned by Bard and 18.3% by ChatGPT).


title: Beyond Dark Patterns: A Concept-Based Framework for Ethical Software Design

abstract: Current dark pattern research tells designers what not to do, but how do they know what to do? In contrast to prior approaches that focus on patterns to avoid and their underlying principles, we present a framework grounded in positive expected behavior against which deviations can be judged. To articulate this expected behavior, we use concepts -- abstract units of functionality that compose applications. We define a design as dark when its concepts violate users' expectations, and benefit the application provider at the user's expense. Though user expectations can differ, users tend to develop common expectations as they encounter the same concepts across multiple applications, which we can record in a concept catalog as standard concepts. We evaluate our framework and concept catalog through three studies, illustrating their ability to describe existing dark patterns, evaluate nuanced designs, and document common application functionality.


title: FunTuple: A new N-tuple component for offline data processing at the LHCb experiment

abstract: The offline software framework of the LHCb experiment has undergone a significant overhaul to tackle the data processing challenges that will arise in the upcoming Run 3 and Run 4 of the Large Hadron Collider. This paper introduces FunTuple, a novel component developed for offline data processing within the LHCb experiment. This component enables the computation and storage of a diverse range of observables for both reconstructed and simulated events by leveraging on the tools initially developed for the trigger system. This feature is crucial for ensuring consistency between trigger-computed and offline-analysed observables. The component and its tool suite offer users flexibility to customise stored observables, and its reliability is validated through a full-coverage set of rigorous unit tests. This paper comprehensively explores FunTuple's design, interface, interaction with other algorithms, and its role in facilitating offline data processing for the LHCb experiment for the next decade and beyond.


title: Subrelativistic Alternating Phase Focusing Dielectric Laser Accelerators

abstract: We demonstrate a silicon-based electron accelerator that uses laser optical near fields to both accelerate and confine electrons over extended distances. Two dielectric laser accelerator (DLA) designs were tested, each consisting of two arrays of silicon pillars pumped symmetrically by pulse front tilted laser beams, designed for average acceleration gradients 35 and 50 MeV/m respectively. The DLAs are designed to act as alternating phase focusing (APF) lattices, where electrons, depending on the electron-laser interaction phase, will alternate between opposing longitudinal and transverse focusing and defocusing forces. By incorporating fractional period drift sections that alter the synchronous phase between $\pm 60^\circ$ off crest, electrons captured in the designed acceleration bucket experience half the peak gradient as average gradient while also experiencing strong confinement forces that enable long interaction lengths. We demonstrate APF accelerators with interaction lengths up to 708 ${\mu}$m and energy gains up to 23.7 $\pm$ 1.07 keV FWHM, a 25$\%$ increase from starting energy, demonstrating the ability to achieve substantial energy gains with subrelativistic DLA.


title: Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control

abstract: Traffic signal control (TSC) is a challenging problem within intelligent transportation systems and has been tackled using multi-agent reinforcement learning (MARL). While centralized approaches are often infeasible for large-scale TSC problems, decentralized approaches provide scalability but introduce new challenges, such as partial observability. Communication plays a critical role in decentralized MARL, as agents must learn to exchange information using messages to better understand the system and achieve effective coordination. Deep MARL has been used to enable inter-agent communication by learning communication protocols in a differentiable manner. However, many deep MARL communication frameworks proposed for TSC allow agents to communicate with all other agents at all times, which can add to the existing noise in the system and degrade overall performance. In this study, we propose a communication-based MARL framework for large-scale TSC. Our framework allows each agent to learn a communication policy that dictates "which" part of the message is sent "to whom". In essence, our framework enables agents to selectively choose the recipients of their messages and exchange variable length messages with them. This results in a decentralized and flexible communication mechanism in which agents can effectively use the communication channel only when necessary. We designed two networks, a synthetic $4 \times 4$ grid network and a real-world network based on the Pasubio neighborhood in Bologna. Our framework achieved the lowest network congestion compared to related methods, with agents utilizing $\sim 47-65 \%$ of the communication channel. Ablation studies further demonstrated the effectiveness of the communication policies learned within our framework.


title: Bitcoin versus S&P 500 Index: Return and Risk Analysis

abstract: The S&P 500 index is considered the most popular trading instrument in financial markets. With the rise of cryptocurrencies over the past years, Bitcoin has also grown in popularity and adoption. The paper aims to analyze the daily return distribution of the Bitcoin and S&P 500 index and assess their tail probabilities through two financial risk measures. As a methodology, We use Bitcoin and S&P 500 Index daily return data to fit The seven-parameter General Tempered Stable (GTS) distribution using the advanced Fast Fractional Fourier transform (FRFT) scheme developed by combining the Fast Fractional Fourier (FRFT) algorithm and the 12-point rule Composite Newton-Cotes Quadrature. The findings show that peakedness is the main characteristic of the S&P 500 return distribution, whereas heavy-tailedness is the main characteristic of the Bitcoin return distribution. The GTS distribution shows that $80.05\%$ of S&P 500 returns are within $-1.06\%$ and $1.23\%$ against only $40.32\%$ of Bitcoin returns. At a risk level ($\alpha$), the severity of the loss ($AVaR_{\alpha}(X)$) on the left side of the distribution is larger than the severity of the profit ($AVaR_{1-\alpha}(X)$) on the right side of the distribution. Compared to the S&P 500 index, Bitcoin has $39.73\%$ more prevalence to produce high daily returns (more than $1.23\%$ or less than $-1.06\%$). The severity analysis shows that at a risk level ($\alpha$) the average value-at-risk ($AVaR(X)$) of the bitcoin returns at one significant figure is four times larger than that of the S&P 500 index returns at the same risk.


title: EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields

abstract: We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture with a standard camera. Event cameras register asynchronous per-pixel brightness changes at MHz rates with high dynamic range, making them ideal for observing fast motion with almost no motion blur. Neural radiance fields (NeRFs) offer visual-quality geometric-based learnable rendering, but prior work with events has only considered reconstruction of static scenes. Our EvDNeRF can predict eventstreams of dynamic scenes from a static or moving viewpoint between any desired timestamps, thereby allowing it to be used as an event-based simulator for a given scene. We show that by training on varied batch sizes of events, we can improve test-time predictions of events at fine time resolutions, outperforming baselines that pair standard dynamic NeRFs with event generators. We release our simulated and real datasets, as well as code for multi-view event-based data generation and the training and evaluation of EvDNeRF models (https://github.com/anish-bhattacharya/EvDNeRF).


title: Local and global questions "beyond endoscopy"

abstract: The near-completion of the program of endoscopy poses the question of what lies next. This article takes a broad view of ideas beyond the program of endoscopy, highlighting the connections among them, and emphasizing the relationship between local and global aspects. Central among those ideas is the one proposed in a 2000 lecture of R. P. Langlands, aiming to extract from the stable trace formula of a group G the bulk of those automorphic representations in the image of the conjectural functorial lift corresponding to a morphism of L-groups ${^LH} \to {^LG}$. With the extension of the problem of functoriality to the "relative" setting of spherical varieties and related spaces, some structure behind such comparisons has started to reveal itself. In a seemingly unrelated direction, a program initiated by Braverman--Kazhdan, also around 2000, to generalize the Godement--Jacquet proof of the functional equation to arbitrary L-functions, has received renewed attention in recent years. We survey ideas and developments in this direction, as well, and discuss the relationship between the two programs.


title: Novice Learner and Expert Tutor: Evaluating Math Reasoning Abilities of Large Language Models with Misconceptions

abstract: We propose novel evaluations for mathematical reasoning capabilities of Large Language Models (LLMs) based on mathematical misconceptions. Our primary approach is to simulate LLMs as a novice learner and an expert tutor, aiming to identify the incorrect answer to math question resulted from a specific misconception and to recognize the misconception(s) behind an incorrect answer, respectively. Contrary to traditional LLMs-based mathematical evaluations that focus on answering math questions correctly, our approach takes inspirations from principles in educational learning sciences. We explicitly ask LLMs to mimic a novice learner by answering questions in a specific incorrect manner based on incomplete knowledge; and to mimic an expert tutor by identifying misconception(s) corresponding to an incorrect answer to a question. Using simple grade-school math problems, our experiments reveal that, while LLMs can easily answer these questions correctly, they struggle to identify 1) the incorrect answer corresponding to specific incomplete knowledge (misconceptions); 2) the misconceptions that explain particular incorrect answers. Our study indicates new opportunities for enhancing LLMs' math reasoning capabilities, especially on developing robust student simulation and expert tutoring models in the educational applications such as intelligent tutoring systems.


title: Learning Diverse Skills for Local Navigation under Multi-constraint Optimality

abstract: Despite many successful applications of data-driven control in robotics, extracting meaningful diverse behaviors remains a challenge. Typically, task performance needs to be compromised in order to achieve diversity. In many scenarios, task requirements are specified as a multitude of reward terms, each requiring a different trade-off. In this work, we take a constrained optimization viewpoint on the quality-diversity trade-off and show that we can obtain diverse policies while imposing constraints on their value functions which are defined through distinct rewards. In line with previous work, further control of the diversity level can be achieved through an attract-repel reward term motivated by the Van der Waals force. We demonstrate the effectiveness of our method on a local navigation task where a quadruped robot needs to reach the target within a finite horizon. Finally, our trained policies transfer well to the real 12-DoF quadruped robot, Solo12, and exhibit diverse agile behaviors with successful obstacle traversal.


title: Finding the dispersing siblings of young open clusters. Dynamical traceback simulations using Gaia DR3

abstract: Context. Stars tend to form in clusters, but many escape their birth clusters very early. Identifying the escaped members of clusters can inform us about the dissolution of star clusters, but also about the stellar dynamics in the galaxy. Methods capable of finding escaped stars from many clusters are required to fully exploit the large amounts of data in the Gaia era. Aims. We present a new method of identifying escaped members of nearby clusters and apply it to ten young clusters. Methods. We assumed the escaped stars were close to the cluster in the past and performed traceback computations based on the Gaia DR3 radial velocity subsample. For each individual star, our method produces a probability estimate that it is an escaped member of a cluster, and for each cluster it also estimates the field star contamination rate of the identified fugitives. Results. Our method is capable of finding fugitives that have escaped from their cluster in the last few ten million years. In many cases the fugitives form an elongated structure that covers a large volume. Conclusions. The results presented here show that traceback computations using Gaia DR3 data can identify stars that have recently escaped their cluster. Our method will be even more useful when applied to future Gaia data releases that contain more radial velocity measurements.


title: GenCO: Generating Diverse Designs with Combinatorial Constraints

abstract: Deep generative models like GAN and VAE have shown impressive results in generating unconstrained objects like images. However, many design settings arising in industrial design, material science, computer graphics and more require that the generated objects satisfy hard combinatorial constraints or meet objectives in addition to modeling a data distribution. To address this, we propose GenCO, a generative framework that guarantees constraint satisfaction throughout training by leveraging differentiable combinatorial solvers to enforce feasibility. GenCO imposes the generative loss on provably feasible solutions rather than intermediate soft solutions, meaning that the deep generative network can focus on ensuring the generated objects match the data distribution without having to also capture feasibility. This shift enables practitioners to enforce hard constraints on the generated outputs during end-to-end training, enabling assessments of their feasibility and introducing additional combinatorial loss components to deep generative training. We demonstrate the effectiveness of our approach on a variety of generative combinatorial tasks, including game level generation, map creation for path planning, and photonic device design, consistently demonstrating its capability to yield diverse, high-quality solutions that verifiably adhere to user-specified combinatorial properties.


title: Improving photon blockade, entanglement and mechanical-cat-state generation in a generalized cross-Kerr optomechanical circuit

abstract: We propose a feasible experimental scheme to improve the few-photon optomechanical effects, including photon blockade and mechanical-Schrodinger cat-state generation, as well as photon-phonon entanglement in a tripartite microwave optomechanical circuit. The system under consideration is formed by a single-Cooper-pair transistor, a microwave LC resonator, and a micromechanical resonator. Our scheme is based on an additional higher-order (generalized) nonlinear cross-Kerr type of coupling, linearly dependent on photon number while quadratically dependent on mechanical phonon one, which can be realized via adjusting the gate charge of the Cooper-pair transistor. We show, both analytically and numerically, that the presence of both cross-Kerr and generalized cross-Kerr nonlinearities not only may give rise to the enhancement of one- and two-photon blockades as well as photon induced tunneling but can also provide more controllability over them. Furthermore, it is shown that in the regime of zero optomechanical coupling, with the aid of generalized cross-Kerr nonlinearity, one can generate multi-components mechanical superposition states which exhibit robustness against system dissipations. We also study the steady-state entanglement between the microwave and mechanical modes, the results of which signify the role of generalized cross-Kerr nonlinearity in enhancing the entanglement in the regime of large-red detuning. The proposed generalized cross-Kerr optomechanical system can be found potential applications in microwave quantum sensing, quantum telecommunication, and quantum information protocols.


title: Philosophy within Data Science Ethics Courses

abstract: There is wide agreement that ethical considerations are a valuable aspect of a data science curriculum, and to that end, many data science programs offer courses in data science ethics. There are not always, however, explicit connections between data science ethics and the centuries-old work on ethics within the discipline of philosophy. Here, we present a framework for bringing together key data science practices with ethics topics. The ethics topics were collated from sixteen data science ethics courses with public-facing syllabi and reading lists. We encourage individuals who are teaching data science ethics to engage with the philosophical literature and its connection to current data science practices, which are rife with potentially morally charged decision points.


title: Quantum tunneling from Schwarzschild black hole in non-commutative gauge theory of gravity

abstract: In this letter, we present the first study of Hawking radiation as a tunneling process within the framework of non-commutative (NC) gauge theory of gravity. First, we reconstruct the non-commutative Schwarzschild black hole (NC SBH) within the gauge theory of gravity, employing the Seiberg-Witten (SW) map and the star product. Then, we compute the emission spectrum of outgoing massless particles using the quantum tunneling mechanism. In the first scenario, we calculate the tunneling rate of massless particles crossing the event horizon of the NC SBH with lower frequencies. Our results reveal pure thermal radiation. Notably, we find that the Hawking temperature remains consistent in both the classical thermodynamics and the quantum tunneling approach, suggesting equivalence between these two approaches in NC spacetime. However, in the case of massless particle emission with higher frequencies, we account for energy conservation resulting in the tunneling rate to deviate from pure thermal radiation. This tunneling rate remains consistent with an underlying unitary quantum theory. We establish a relationship between this deviation and the change in the black hole entropy, revealing a logarithmic correction to the entropy within this geometry. Furthermore, we demonstrate that non-commutativity enhances the correlations between two successively emitted particles. Additionally, we determine the NC density number of particle emission and conclude by discussing the implications of our findings.


title: Low-Resource Languages Jailbreak GPT-4

abstract: AI safety training and red-teaming of large language models (LLMs) are measures to mitigate the generation of unsafe content. Our work exposes the inherent cross-lingual vulnerability of these safety mechanisms, resulting from the linguistic inequality of safety training data, by successfully circumventing GPT-4's safeguard through translating unsafe English inputs into low-resource languages. On the AdvBenchmark, GPT-4 engages with the unsafe translated inputs and provides actionable items that can get the users towards their harmful goals 79% of the time, which is on par with or even surpassing state-of-the-art jailbreaking attacks. Other high-/mid-resource languages have significantly lower attack success rate, which suggests that the cross-lingual vulnerability mainly applies to low-resource languages. Previously, limited training on low-resource languages primarily affects speakers of those languages, causing technological disparities. However, our work highlights a crucial shift: this deficiency now poses a risk to all LLMs users. Publicly available translation APIs enable anyone to exploit LLMs' safety vulnerabilities. Therefore, our work calls for a more holistic red-teaming efforts to develop robust multilingual safeguards with wide language coverage.


title: Machine learning assist nyc subway navigation safer and faster

abstract: Mainstream navigation software, like Google and Apple Maps, often lacks the ability to provide routes prioritizing safety. However, safety remains a paramount concern for many. Our aim is to strike a balance between safety and efficiency. To achieve this, we're devising an Integer Programming model that takes into account both the shortest path and the safest route. We will harness machine learning to derive safety coefficients, employing methodologies such as generalized linear models, linear regression, and recurrent neural networks. Our evaluation will be based on the Root Mean Square Error (RMSE) across various subway stations, helping us identify the most accurate model for safety coefficient estimation. Furthermore, we'll conduct a comprehensive review of different shortest-path algorithms, assessing them based on time complexity and real-world data to determine their appropriateness in merging both safety and time efficiency.


title: Feather: An Elegant Solution to Effective DNN Sparsification

abstract: Neural Network pruning is an increasingly popular way for producing compact and efficient models, suitable for resource-limited environments, while preserving high performance. While the pruning can be performed using a multi-cycle training and fine-tuning process, the recent trend is to encompass the sparsification process during the standard course of training. To this end, we introduce Feather, an efficient sparse training module utilizing the powerful Straight-Through Estimator as its core, coupled with a new thresholding operator and a gradient scaling technique, enabling robust, out-of-the-box sparsification performance. Feather's effectiveness and adaptability is demonstrated using various architectures on the CIFAR dataset, while on ImageNet it achieves state-of-the-art Top-1 validation accuracy using the ResNet-50 architecture, surpassing existing methods, including more complex and computationally heavy ones, by a considerable margin. Code is publicly available at https://github.com/athglentis/feather .


title: Impact of geography on the importance of parameters in infectious disease models

abstract: Agent-based models are widely used to predict infectious disease spread. For these predictions, one needs to understand how each input parameter affects the result. Here, some parameters may affect the sensitivities of others, requiring the analysis of higher order coefficients through e.g. Sobol sensitivity analysis. The geographical structures of real-world regions are distinct in that they are difficult to reduce to single parameter values, making a unified sensitivity analysis intractable. Yet analyzing the importance of geographical structure on the sensitivity of other input parameters is important because a strong effect would justify the use of models with real-world geographical representations, as opposed to stylized ones. Here we perform a grouped Sobol's sensitivity analysis on COVID-19 spread simulations across a set of three diverse real-world geographical representations. We study the differences in both results and the sensitivity of non-geographical parameters across these geographies. By comparing Sobol indices of parameters across geographies, we find evidence that infection rate could have more sensitivity in regions where the population is segregated, while parameters like recovery period of mild cases are more sensitive in regions with mixed populations. We also show how geographical structure affects parameter sensitivity changes over time.