title: Latent Skill Discovery for Chain-of-Thought Reasoning

abstract: Recent advances in Large Language Models (LLMs) have led to an emergent ability of chain-of-thought (CoT) prompting, a prompt reasoning strategy that adds intermediate rationale steps between questions and answers to construct prompts. Conditioned on these prompts, LLMs can effectively learn in context to generate rationales that lead to more accurate answers than when answering the same question directly. To design LLM prompts, one important setting, called demonstration selection, considers selecting demonstrations from an example bank. Existing methods use various heuristics for this selection, but for CoT prompting, which involves unique rationales, it is essential to base the selection upon the intrinsic skills that CoT rationales need, for instance, the skills of addition or subtraction for math word problems. To address this requirement, we introduce a novel approach named Reasoning Skill Discovery (RSD) that use unsupervised learning to create a latent space representation of rationales, called a reasoning skill. Simultaneously, RSD learns a reasoning policy to determine the required reasoning skill for a given question. This can then guide the selection of examples that demonstrate the required reasoning skills. Our approach offers several desirable properties: it is (1) theoretically grounded, (2) sample-efficient, requiring no LLM inference or manual prompt design, and (3) LLM-agnostic. Empirically, RSD outperforms existing methods by up to 6% in terms of the answer accuracy across multiple reasoning tasks.


title: Properties and special filters of pseudocomplemented posets

abstract: Investigating the structure of pseudocomplemented lattices started ninety years ago with papers by V. Glivenko, G. Birkhoff and O. Frink and this structure was essentially developed by G. Gr\"atzer. In recent years, some special filters in pseudocomplemented and Stone lattices have been studied by M. Sambasiva Rao. However, in some applications, in particular in non-classical logics with unsharp logical connectives, pseudocomplemented posets instead of lattices are used. This motivated us to develop an algebraic theory of pseudocomplemented posets, i.e. we derive identities and inequalities holding in such posets and we use them in order to characterize the so-called Stone posets. Then we adopt several concepts of special filters and we investigate their properties in pseudocomplemented posets. Moreover, we show how properties of these filters influence algebraic properties of the underlying pseudocomplemented posets.


title: The Gonality of Queen's Graphs

abstract: In this paper we study queen's graphs, which encode the moves by a queen on an $m\times n$ chess board, through the lens of chip-firing games. We prove that their gonality is equal to $mn$ minus the independence number of the graph, and give a one-to-one correspondence between maximum independent sets and classes of positive rank divisors achieving gonality. We also prove an identical result for toroidal queen's graphs.


title: LLM4TDD: Best Practices for Test Driven Development Using Large Language Models

abstract: In today's society, we are becoming increasingly dependent on software systems. However, we also constantly witness the negative impacts of buggy software. Program synthesis aims to improve software correctness by automatically generating the program given an outline of the expected behavior. For decades, program synthesis has been an active research field, with recent approaches looking to incorporate Large Language Models to help generate code. This paper explores the concept of LLM4TDD, where we guide Large Language Models to generate code iteratively using a test-driven development methodology. We conduct an empirical evaluation using ChatGPT and coding problems from LeetCode to investigate the impact of different test, prompt and problem attributes on the efficacy of LLM4TDD.


title: Federated Learning for 6G: Paradigms, Taxonomy, Recent Advances and Insights

abstract: Artificial Intelligence (AI) is expected to play an instrumental role in the next generation of wireless systems, such as sixth-generation (6G) mobile network. However, massive data, energy consumption, training complexity, and sensitive data protection in wireless systems are all crucial challenges that must be addressed for training AI models and gathering intelligence and knowledge from distributed devices. Federated Learning (FL) is a recent framework that has emerged as a promising approach for multiple learning agents to build an accurate and robust machine learning models without sharing raw data. By allowing mobile handsets and devices to collaboratively learn a global model without explicit sharing of training data, FL exhibits high privacy and efficient spectrum utilization. While there are a lot of survey papers exploring FL paradigms and usability in 6G privacy, none of them has clearly addressed how FL can be used to improve the protocol stack and wireless operations. The main goal of this survey is to provide a comprehensive overview on FL usability to enhance mobile services and enable smart ecosystems to support novel use-cases. This paper examines the added-value of implementing FL throughout all levels of the protocol stack. Furthermore, it presents important FL applications, addresses hot topics, provides valuable insights and explicits guidance for future research and developments. Our concluding remarks aim to leverage the synergy between FL and future 6G, while highlighting FL's potential to revolutionize wireless industry and sustain the development of cutting-edge mobile services.


title: Finite-to-one equivariant maps and mean dimension

abstract: We show that a minimal dynamical system $(X,\mathbb{Z})$ on a compact metric $X$ with mdim$X=d$ admits for every natural $k>d$ an equivariant map to the shift $([0,1]^k)^{\mathbb{Z}}$ such that each fiber of this map contains at most $[k/(k-d)]k/(k-d)$ points.


title: SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

abstract: Synthesizers are powerful tools that allow musicians to create dynamic and original sounds. Existing commercial interfaces for synthesizers typically require musicians to interact with complex low-level parameters or to manage large libraries of premade sounds. To address these challenges, we implement SynthScribe -- a fullstack system that uses multimodal deep learning to let users express their intentions at a much higher level. We implement features which address a number of difficulties, namely 1) searching through existing sounds, 2) creating completely new sounds, 3) making meaningful modifications to a given sound. This is achieved with three main features: a multimodal search engine for a large library of synthesizer sounds; a user centered genetic algorithm by which completely new sounds can be created and selected given the users preferences; a sound editing support feature which highlights and gives examples for key control parameters with respect to a text or audio based query. The results of our user studies show SynthScribe is capable of reliably retrieving and modifying sounds while also affording the ability to create completely new sounds that expand a musicians creative horizon.


title: Simul-LLM: A Framework for Exploring High-Quality Simultaneous Translation with Large Language Models

abstract: Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural machine translation (NMT) is one such task that LLMs have been applied to with great success. However, little research has focused on applying LLMs to the more difficult subset of NMT called simultaneous translation (SimulMT), where translation begins before the entire source context is available to the model. In this paper, we address key challenges facing LLMs fine-tuned for SimulMT, validate classical SimulMT concepts and practices in the context of LLMs, explore adapting LLMs that are fine-tuned for NMT to the task of SimulMT, and introduce Simul-LLM, the first open-source fine-tuning and evaluation pipeline development framework for LLMs focused on SimulMT.


title: Diffence: Fencing Membership Privacy With Diffusion Models

abstract: Deep learning models, while achieving remarkable performance across various tasks, are vulnerable to member inference attacks, wherein adversaries identify if a specific data point was part of a model's training set. This susceptibility raises substantial privacy concerns, especially when models are trained on sensitive datasets. Current defense methods often struggle to provide robust protection without hurting model utility, and they often require retraining the model or using extra data. In this work, we introduce a novel defense framework against membership attacks by leveraging generative models. The key intuition of our defense is to remove the differences between member and non-member inputs which can be used to perform membership attacks, by re-generating input samples before feeding them to the target model. Therefore, our defense works \emph{pre-inference}, which is unlike prior defenses that are either training-time (modify the model) or post-inference time (modify the model's output). A unique feature of our defense is that it works on input samples only, without modifying the training or inference phase of the target model. Therefore, it can be cascaded with other defense mechanisms as we demonstrate through experiments. Through extensive experimentation, we show that our approach can serve as a robust plug-n-play defense mechanism, enhancing membership privacy without compromising model utility in both baseline and defended settings. For example, our method enhanced the effectiveness of recent state-of-the-art defenses, reducing attack accuracy by an average of 5.7\% to 12.4\% across three datasets, without any impact on the model's accuracy. By integrating our method with prior defenses, we achieve new state-of-the-art performance in the privacy-utility trade-off.


title: GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Experts

abstract: Graph data are inherently complex and heterogeneous, leading to a high natural diversity of distributional shifts. However, it remains unclear how to build machine learning architectures that generalize to complex non-synthetic distributional shifts naturally occurring in the real world. Here we develop GraphMETRO, a Graph Neural Network architecture, that reliably models natural diversity and captures complex distributional shifts. GraphMETRO employs a Mixture-of-Experts (MoE) architecture with a gating model and multiple expert models, where each expert model targets a specific distributional shift to produce a shift-invariant representation, and the gating model identifies shift components. Additionally, we design a novel objective that aligns the representations from different expert models to ensure smooth optimization. GraphMETRO achieves state-of-the-art results on four datasets from GOOD benchmark comprised of complex and natural real-world distribution shifts, improving by 67% and 4.2% on WebKB and Twitch datasets.


title: Effects of electrostatic interaction on clustering and collision of bidispersed inertial particles in homogeneous and isotropic turbulence

abstract: In sandstorms and thunderclouds, turbulence-induced collisions between solid particles and ice crystals lead to inevitable triboelectrification. The charge segregation is usually size-dependent, with small particles charged negatively and large particles charged positively. In this work, we perform numerical simulations to study the influence of charge segregation on the dynamics of bidispersed inertial particles in turbulence. Direct numerical simulations of homogeneous isotropic turbulence are performed with the Taylor Reynolds number $\mathrm{Re}_{\lambda}=147.5$, while particles are subjected to both electrostatic interactions and fluid drag, with Stokes number of 1 and 10 for small and large particles, respectively. Coulomb repulsion/attraction are shown to effectively inhibit/enhance particle clustering within a short range. Besides, the mean relative velocity between same-size particles is found to rise as the particle charge increases because of the exclusion of low-velocity pairs, while the relative velocity between different-size particles is almost unaffected, emphasizing the dominant roles of differential inertia. The mean Coulomb-turbulence parameter, $\mathrm{Ct}_0$, is then defined to characterize the competition between the Coulomb potential energy and the mean relative kinetic energy. In addition, a model is proposed to quantify the rate at which charged particles approach each other and captures the transition of the particle relative motion from the turbulence-dominated regime to the electrostatic-dominated regime. Finally, the probability distribution function of the approaching rate between particle pairs are examined, and its dependence on the Coulomb force is further discussed using the extended Coulomb-turbulence parameter.


title: Foreign Capital and Economic Growth: Evidence from Bangladesh

abstract: This study aims to examine the relationship between Foreign Direct Investment (FDI), personal remittances received, and official development assistance (ODA) in the economic growth of Bangladesh. The study utilizes time series data on Bangladesh from 1976 to 2021. Additionally, this research contributes to the existing literature by introducing the Foreign Capital Depthless Index (FCDI) and exploring its impact on Bangladesh's economic growth. The results of the Vector Error Correction Model (VECM) suggest that the economic growth of Bangladesh depends on FDI, remittances, and aid in the long run. However, these variables do not exhibit a causal relationship with GDP in the short run. The relationship between FCDI and economic growth is positive in the long run. Nevertheless, the presence of these three variables has a more significant impact on the economic growth of Bangladesh


title: Bow varieties as symplectic reductions of $T^*(G/P)$

abstract: Cherkis bow varieties were introduced as ADHM type description of moduli space of instantons on the Taub-NUT space equivariant under a cyclic group action. They are also models of Coulomb branches of quiver gauge theories of affine type A. In this paper, we realize each bow variety with torus fixed points as a symplectic reduction of a cotangent bundle of a partial flag variety by a unipotent group, and find a slice of this action. By this description, we calculate the equivariant cohomology (and ordinary cohomology) of some of them and answer some questions raisedbefore. This also uses a new result about circle-equivariant cohomology proven in an appendix. We also give an explicit generalized Mirkovic-Vybornov isomorphism for bow varieties in the appendix.


title: Geometric Analysis of the Generalized Surface Quasi-Geostrophic Equations

abstract: We investigate the geometry of a family of equations in two dimensions which interpolate between the Euler equations of ideal hydrodynamics and the inviscid surface quasi-geostrophic equation. This family can be realised as geodesic equations on groups of diffeomorphisms. We show precisely when the corresponding Riemannian exponential map is non-linear Fredholm of index 0. We further illustrate this by examining the distribution of conjugate points in these settings via a Morse theoretic approach.


title: Positive scalar curvature metrics and aspherical summands

abstract: We prove for $n\in\{3,4,5\}$ that the connected sum of a closed aspherical $n$-manifold with an arbitrary non-compact manifold does not admit a complete metric with nonnegative scalar curvature. In particular, a special case of our result answers a question of Gromov. More generally, we generalize the partial classification result of Chodosh, Li, and Liokumovich to the non-compact domination case with our newly-developed technique. Our result unifies all previous results of this type, and confirms the validity of Gromov's non-compact domination conjecture for closed aspherical manifolds of dimensions 3, 4, and 5.


title: Simulations of Non-Integer Upconversion in Resonant Six-Wave Scattering

abstract: Resonant upconversion through a sixth order relativistic nonlinearity resulting in a unique resonance was recently proposed [V. M. Malkin and N. J. Fisch, Physical Review E 108, 045208 (2023)]. The high order resonance is a unique non-integer multiple of a driving pump frequency resulting in a frequency upshift by a factor of $\approx 3.73$. We demonstrate the presence, unique requirements, and growth of this mode numerically. Through tuning waves to high amplitude, in a mildly underdense plasma, the six-photon process may grow more than other non-resonant, but lower order processes. The growth of the high frequency mode remains below the nonlinear growth regime. However, extending current numerical results to more strongly coupled resonances with longer pulse propagation distances suggests a pathway to significant upconversion.


title: Radiation Reaction Kinetics and Collective QED Signatures

abstract: Observing collective effects originating from the interplay between quantum electrodynamics and plasma physics might be achieved in upcoming experiments. In particular, the generation of electron-positron pairs and the observation of their collective dynamics could be simultaneously achieved in a collision between an intense laser and a highly relativistic electron beam through a laser frequency shift driven by an increase in the plasma density increase. In this collision, the radiation of high energy photons will serve a dual purpose: first, in seeding the cascade of pair generation; and, second, in decelerating the created pairs for detection. The deceleration results in a detectable shift in the plasma frequency. This deceleration was previously studied considering only a small sample of individual pair particles. However, the highly stochastic nature of the quantum radiation reaction in the strong field regime limits the descriptive power of the average behavior to the dynamics of pair particles. Here, we examine the full kinetic evolution of generated pairs in order to more accurately model the relativistically adjusted plasma density. As we show, the most effective pair energy for creating observable signatures occurs at a local minimum, obtained at finite laser field strength due to the tradeoff between pair deceleration and the relativistic particle oscillation at increasing laser intensity. For a small number of laser cycles, the quantum radiation reaction may re-arrange the generated pairs into anisotropic distributions in momentum space, although, in the one dimensional simulations considered here, this anisotropy quickly decreases.


title: Locality in the Schroedinger Picture of Quantum Mechanics

abstract: We explain how the so-called Einstein locality is to be understood in the Schr\"odinger picture of quantum mechanics. This notion is perfectly compatible with the Bell non-locality exhibited by entangled states. Contrary to some beliefs that quantum mechanics is incomplete, it is, in fact, its overcompleteness as exemplified by different pictures of quantum physics, that points to the same underlying reality.


title: A type III$_1$ factor with the smallest outer automorphism group

abstract: The canonical modular homomorphism provides an embedding of $\mathbb{R}$ into the outer automorphism group Out($M$) of any type III$_{1}$ factor $M$. We provide an explicit construction of a full factor of type III$_{1}$ with separable predual such that the outer automorphism group is minimal, i.e. this embedding is an isomorphism. We obtain such a III$_{1}$ factor by using an amalgamated free product construction.


title: Solving the Lipkin model using quantum computers with two qubits only with a hybrid quantum-classical technique based on the Generator Coordinate Method

abstract: The possibility of using the generator coordinate method (GCM) using hybrid quantum-classical algorithms with reduced quantum resources is discussed. The task of preparing the basis states and calculating the various kernels involved in the GCM is assigned to the quantum computer, while the remaining tasks, such as finding the eigenvalues of a many-body problem, are delegated to classical computers for post-processing the generated kernels. This strategy reduces the quantum resources required to treat a quantum many-body problem. We apply the method to the Lipkin model. Using the permutation symmetry of the Hamiltonian, we show that, ultimately, only two qubits is enough to solve the problem regardless of the particle number. The classical computing post-processing leading to the full energy spectrum can be made using standard generalized eigenvalues techniques by diagonalizing the so-called Hill-Wheeler equation. As an alternative to this technique, we also explored how the quantum state deflation method can be adapted to the GCM problem. In this method, variational principles are iteratively designed to access the different excited states with increasing energies. The methodology proposed here is successfully applied to the Lipkin model with a minimal size of two qubits for the quantum register. The performances of the two classical post-processing approaches with respect to the statistical noise induced by the finite number of measurements and quantum devices noise are analyzed. Very satisfactory results for the full energy spectra are obtained once noise correction techniques are employed.


title: Efficient Parallel Reinforcement Learning Framework using the Reactor Model

abstract: Parallel Reinforcement Learning (RL) frameworks are essential for mapping RL workloads to multiple computational resources, allowing for faster generation of samples, estimation of values, and policy improvement. These computational paradigms require a seamless integration of training, serving, and simulation workloads. Existing frameworks, such as Ray, are not managing this orchestration efficiently, especially in RL tasks that demand intensive input/output and synchronization between actors on a single node. In this study, we have proposed a solution implementing the reactor model, which enforces a set of actors to have a fixed communication pattern. This allows the scheduler to eliminate work needed for synchronization, such as acquiring and releasing locks for each actor or sending and processing coordination-related messages. Our framework, Lingua Franca (LF), a coordination language based on the reactor model, also supports true parallelism in Python and provides a unified interface that allows users to automatically generate dataflow graphs for RL tasks. In comparison to Ray on a single-node multi-core compute platform, LF achieves 1.21x and 11.62x higher simulation throughput in OpenAI Gym and Atari environments, reduces the average training time of synchronized parallel Q-learning by 31.2%, and accelerates multi-agent RL inference by 5.12x.


title: Equivariant algebraic $K$-theory of symmetric monoidal Mackey functors

abstract: We provide a unifying approach to different constructions of the algebraic $K$-theory of equivariant symmetric monoidal categories. A consequence of our work is that every connective genuine $G$-spectrum is equivalent to the equivariant algebraic $K$-theory of categorical Mackey functors of Bohmann-Osorno.


title: The upwelling source depth distribution and its response to wind stress and stratification

abstract: Coastal upwelling, driven by alongshore winds and characterized by cold sea surface temperatures and high upper-ocean nutrient content, is an important physical process sustaining some of the oceans' most productive ecosystems. To fully understand the ocean properties in eastern boundary upwelling systems, it is important to consider the depth of the source waters being upwelled, as it affects both the SST and the transport of nutrients toward the surface. Here, we construct an upwelling source depth distribution for parcels at the surface in the upwelling zone. We do so using passive tracers forced at the domain boundary for every model depth level to quantify their contributions to the upwelled waters. We test the dependence of this distribution on the strength of the wind stress and stratification using high-resolution regional ocean simulations of an idealized coastal upwelling system. We also present an efficient method for estimating the mean upwelling source depth. Furthermore, we show that the standard deviation of the upwelling source depth distribution increases with increasing wind stress and decreases with increasing stratification. These results can be applied to better understand and predict how coastal upwelling sites and their surface properties have and will change in past and future climates.


title: Fault-tolerant one-way noiseless amplification for microwave bosonic quantum information processing

abstract: Microwave quantum information networks require reliable transmission of single photon propagating modes over lossy channels. In this article we propose a microwave noise-less linear amplifier (NLA) suitable to circumvent the losses incurred by a flying photon undergoing an amplitude damping channel (ADC). The proposed model is constructed by engineering a simple one-dimensional four node cluster state. Contrary to conventional NLAs based on quantum scissors (QS), single photon amplification is realized without the need for photon number resolving detectors (PNRDs). Entanglement between nodes comprising the device's cluster is achieved by means of a controlled phase gate (CPHASE). Furthermore, photon measurements are implemented by quantum non demolition detectors (QNDs), which are currently available as a part of circuit quantum electrodynamics (cQED) toolbox. We analyze the performance of our device practically by considering detection inefficiency and dark count probability. We further examine the potential usage of our device in low power quantum sensing applications and remote secret key generation (SKG). Specifically, we demonstrate the device's ability to prepare loss-free resources offline, and its capacity to overcome the repeater-less bound of SKG. We compare the performance of our device against a QS-NLA for the aforementioned applications, and highlight explicitly the operating conditions under which our device can outperform a QS-NLA. The proposed device is also suitable for applications in the optical domain.


title: Integrated Design of Aluminum-Containing High-entropy Refractory B2 Alloys with Synergy of High Strength and Ductility

abstract: Refractory high-entropy alloys, RHEAs, are promising high-temperature structural materials. Their large compositional space poses great design challenges for phase control and high strength-ductility synergy. The present research pioneers using integrated high-throughput machine learning with Monte Carlo simulations to effectively navigate phase-selection and mechanical-properties predictions, developing aluminum-containing RHEAs in single-phase ordered B2 alloys demonstrating both high strength and ductility. These aluminum-containing RHEAs achieve remarkable mechanical properties, including compressive yield strengths up to 1.6 GPa, fracture strains exceeding 50 percent, and significant high-temperature strength retention. They also demonstrate a tensile yield strength of 1.1 GPa with a tension ductility of 6.3 percent. Besides, we identify a valence-electron-count domain for alloy brittleness with the explanation from density-functional theory and provide crucial insights into elements' influence on atomic ordering and mechanical performance. The work sets forth a strategic blueprint for high-throughput alloy design and reveals fundamental principles that govern the mechanical properties of advanced structural alloys.


title: How to guess a gradient

abstract: How much can you say about the gradient of a neural network without computing a loss or knowing the label? This may sound like a strange question: surely the answer is "very little." However, in this paper, we show that gradients are more structured than previously thought. Gradients lie in a predictable low-dimensional subspace which depends on the network architecture and incoming features. Exploiting this structure can significantly improve gradient-free optimization schemes based on directional derivatives, which have struggled to scale beyond small networks trained on toy datasets. We study how to narrow the gap in optimization performance between methods that calculate exact gradients and those that use directional derivatives. Furthermore, we highlight new challenges in overcoming the large gap between optimizing with exact gradients and guessing the gradients.


title: Experimental Demonstration of Fermionic QAOA with One-Dimensional Cyclic Driver Hamiltonian

abstract: Quantum approximate optimization algorithm (QAOA) has attracted much attention as an algorithm that has the potential to efficiently solve combinatorial optimization problems. Among them, a fermionic QAOA (FQAOA) for solving constrained optimization problems has been developed [Yoshioka, Sasada, Nakano, and Fujii, Phys. Rev. Research vol. 5, 023071, 2023]. In this algorithm, the constraints are essentially imposed as fermion number conservation at arbitrary approximation level. We take the portfolio optimization problem as an application example and propose a new driver Hamiltonian on an one-dimensional cyclic lattice. Our FQAOA with the new driver Hamiltonian reduce the number of gate operations in quantum circuits. Experiments on a trapped-ion quantum computer using 16 qubits on Amazon Braket demonstrates that the proposed driver Hamiltonian effectively suppresses noise effects compared to the previous FQAOA.


title: Luck, skill, and depth of competition in games and social hierarchies

abstract: Patterns of wins and losses in pairwise contests, such as occur in sports and games, consumer research and paired comparison studies, and human and animal social hierarchies, are commonly analyzed using probabilistic models that allow one to quantify the strength of competitors or predict the outcome of future contests. Here we generalize this approach to incorporate two additional features: an element of randomness or luck that leads to upset wins, and a "depth of competition" variable that measures the complexity of a game or hierarchy. Fitting the resulting model to a large collection of data sets we estimate depth and luck in a range of games, sports, and social situations. In general, we find that social competition tends to be "deep," meaning it has a pronounced hierarchy with many distinct levels, but also that there is often a nonzero chance of an upset victory, meaning that dominance challenges can be won even by significant underdogs. Competition in sports and games, by contrast, tends to be shallow and in most cases there is little evidence of upset wins, beyond those already implied by the shallowness of the hierarchy.


title: Error Discovery by Clustering Influence Embeddings

abstract: We present a method for identifying groups of test examples -- slices -- on which a model under-performs, a task now known as slice discovery. We formalize coherence -- a requirement that erroneous predictions, within a slice, should be wrong for the same reason -- as a key property that any slice discovery method should satisfy. We then use influence functions to derive a new slice discovery method, InfEmbed, which satisfies coherence by returning slices whose examples are influenced similarly by the training data. InfEmbed is simple, and consists of applying K-Means clustering to a novel representation we deem influence embeddings. We show InfEmbed outperforms current state-of-the-art methods on 2 benchmarks, and is effective for model debugging across several case studies.


title: gcDLSeg: Integrating Graph-cut into Deep Learning for Binary Semantic Segmentation

abstract: Binary semantic segmentation in computer vision is a fundamental problem. As a model-based segmentation method, the graph-cut approach was one of the most successful binary segmentation methods thanks to its global optimality guarantee of the solutions and its practical polynomial-time complexity. Recently, many deep learning (DL) based methods have been developed for this task and yielded remarkable performance, resulting in a paradigm shift in this field. To combine the strengths of both approaches, we propose in this study to integrate the graph-cut approach into a deep learning network for end-to-end learning. Unfortunately, backward propagation through the graph-cut module in the DL network is challenging due to the combinatorial nature of the graph-cut algorithm. To tackle this challenge, we propose a novel residual graph-cut loss and a quasi-residual connection, enabling the backward propagation of the gradients of the residual graph-cut loss for effective feature learning guided by the graph-cut segmentation model. In the inference phase, globally optimal segmentation is achieved with respect to the graph-cut energy defined on the optimized image features learned from DL networks. Experiments on the public AZH chronic wound data set and the pancreas cancer data set from the medical segmentation decathlon (MSD) demonstrated promising segmentation accuracy, and improved robustness against adversarial attacks.


title: The Potential Impact of AI Innovations on U.S. Occupations

abstract: An occupation is comprised of interconnected tasks, and it is these tasks, not occupations themselves, that are affected by AI. To evaluate how tasks may be impacted, previous approaches utilized manual annotations or coarse-grained matching. Leveraging recent advancements in machine learning, we replace coarse-grained matching with more precise deep learning approaches. Introducing the AI Impact (AII) measure, we employ Deep Learning Natural Language Processing to automatically identify AI patents that may impact various occupational tasks at scale. Our methodology relies on a comprehensive dataset of 17,879 task descriptions and quantifies AI's potential impact through analysis of 24,758 AI patents filed with the United States Patent and Trademark Office (USPTO) between 2015 and 2022. Our results reveal that some occupations will potentially be impacted, and that impact is intricately linked to specific skills. These include not only routine tasks (codified as a series of steps), as previously thought, but also non-routine ones (e.g., diagnosing health conditions, programming computers, and tracking flight routes). Furthermore, AI's impact on labour is limited by the fact that some of the occupations affected are augmented rather than replaced (e.g., neurologists, software engineers, air traffic controllers), and the sectors affected are experiencing labour shortages (e.g., IT, Healthcare, Transport).


title: Deep Emotions Across Languages: A Novel Approach for Sentiment Propagation in Multilingual WordNets

abstract: Sentiment analysis involves using WordNets enriched with emotional metadata, which are valuable resources. However, manual annotation is time-consuming and expensive, resulting in only a few WordNet Lexical Units being annotated. This paper introduces two new techniques for automatically propagating sentiment annotations from a partially annotated WordNet to its entirety and to a WordNet in a different language: Multilingual Structured Synset Embeddings (MSSE) and Cross-Lingual Deep Neural Sentiment Propagation (CLDNS). We evaluated the proposed MSSE+CLDNS method extensively using Princeton WordNet and Polish WordNet, which have many inter-lingual relations. Our results show that the MSSE+CLDNS method outperforms existing propagation methods, indicating its effectiveness in enriching WordNets with emotional metadata across multiple languages. This work provides a solid foundation for large-scale, multilingual sentiment analysis and is valuable for academic research and practical applications.


title: From Yoneda to Topoi morphisms

abstract: In this note we show how two fundamental results in Topos theory follow by repeated use of Yoneda's Lemma, the formalism of natural transformations and very basic category theory. In Lemma 9.4, we show the fundamental result SGA4 EXPOSE IV Proposition 4.9.4, which says that for any site $\cc{C}$, the canonical functor $\cc{C} \mr{\varepsilon} Sh(\cc{C})$ into the category of sheaves, classifies sites morphisms $\cc{C} \mr{} \cc{Z}$ into any topos $\cc{Z}$. After the usual Yoneda's Lemma, Lemma 3.1, we show that the Yoneda functor $\cc{C} \mr{h} \Eop{C}$ classifies functors $\cc{C} \mr{} \cc{Z}$ into any cocomplete category $\cc{Z}$, via a cocontinuos extension $\Eop{C} \mr{} \cc{Z}$, Lemma 5.2. Then we reach Lemma 9.4 by an step by step enrichment of 5.2. All we use is Yoneda's Lemma, over and over again, and the Yoga of natural transformations. In Lemma 10.1 we show the equivalence between \emph{flatness} and \emph{left exactness} for functors from finitely complete categories into any topos. Our proof is elementary, we show how basic exactness properties of sets prove the result for set valued functors, then we generalize to functors valued in any topos utilizing results of the previous sections and the Yoga of natural transformations. Besides the thread we follow,nothing here is new, although we haven't seen 10.1 proved this way before.


title: A kinetic Monte Carlo Approach for Boolean Logic Functionality in Gold Nanoparticle Networks

abstract: Nanoparticles interconnected by insulating organic molecules exhibit nonlinear switching behavior at low temperatures. By assembling these switches into a network and manipulating charge transport dynamics through surrounding electrodes, the network can be reconfigurably functionalized to act as any Boolean logic gate. This work introduces a kinetic Monte Carlo-based simulation tool, applying established principles of single electronics to model charge transport dynamics in nanoparticle networks. We functionalize nanoparticle networks as Boolean logic gates and assess their quality using a fitness function. Based on the definition of fitness, we derive new metrics to quantify essential nonlinear properties of the network, including negative differential resistance and nonlinear separability. These nonlinear properties are crucial not only for functionalizing the network as Boolean logic gates but also when our networks are functionalized for brain-inspired computing applications in the future. We address fundamental questions about the dependence of fitness and nonlinear properties on system size, number of surrounding electrodes, and electrode positioning. We assert the overall benefit of having more electrodes, with proximity to the network's output being pivotal for functionality and nonlinearity. Additionally, we demonstrate a optimal system size and argue for breaking symmetry in electrode positioning to favor nonlinear properties.

categories: cs.ET cs.AR cs.NE physics.comp-ph stat.ME


title: Dynamic Online Modulation Recognition using Incremental Learning

abstract: Modulation recognition is a fundamental task in communication systems as the accurate identification of modulation schemes is essential for reliable signal processing, interference mitigation for coexistent communication technologies, and network optimization. Incorporating deep learning (DL) models into modulation recognition has demonstrated promising results in various scenarios. However, conventional DL models often fall short in online dynamic contexts, particularly in class incremental scenarios where new modulation schemes are encountered during online deployment. Retraining these models on all previously seen modulation schemes is not only time-consuming but may also not be feasible due to storage limitations. On the other hand, training solely on new modulation schemes often results in catastrophic forgetting of previously learned classes. This issue renders DL-based modulation recognition models inapplicable in real-world scenarios because the dynamic nature of communication systems necessitate the effective adaptability to new modulation schemes. This paper addresses this challenge by evaluating the performance of multiple Incremental Learning (IL) algorithms in dynamic modulation recognition scenarios, comparing them against conventional DL-based modulation recognition. Our results demonstrate that modulation recognition frameworks based on IL effectively prevent catastrophic forgetting, enabling models to perform robustly in dynamic scenarios.


title: Distributed Optimization via Kernelized Multi-armed Bandits

abstract: Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed bandit problem with a heterogeneous reward setting. In this setup, the agents collaboratively aim to maximize a global objective function which is an average of local objective functions. The agents can access only bandit feedback (noisy reward) obtained from the associated unknown local function with a small norm in reproducing kernel Hilbert space (RKHS). We present a fully decentralized algorithm, Multi-agent IGP-UCB (MA-IGP-UCB), which achieves a sub-linear regret bound for popular classes for kernels while preserving privacy. It does not necessitate the agents to share their actions, rewards, or estimates of their local function. In the proposed approach, the agents sample their individual local functions in a way that benefits the whole network by utilizing a running consensus to estimate the upper confidence bound on the global function. Furthermore, we propose an extension, Multi-agent Delayed IGP-UCB (MAD-IGP-UCB) algorithm, which reduces the dependence of the regret bound on the number of agents in the network. It provides improved performance by utilizing a delay in the estimation update step at the cost of more communication.


title: From Big to Small Without Losing It All: Text Augmentation with ChatGPT for Efficient Sentiment Analysis

abstract: In the era of artificial intelligence, data is gold but costly to annotate. The paper demonstrates a groundbreaking solution to this dilemma using ChatGPT for text augmentation in sentiment analysis. We leverage ChatGPT's generative capabilities to create synthetic training data that significantly improves the performance of smaller models, making them competitive with, or even outperforming, their larger counterparts. This innovation enables models to be both efficient and effective, thereby reducing computational cost, inference time, and memory usage without compromising on quality. Our work marks a key advancement in the cost-effective development and deployment of robust sentiment analysis models.


title: The Gaia-ESO Survey: new spectroscopic binaries in the Milky Way

abstract: The Gaia-ESO Survey (GES) is a large public spectroscopic survey which acquired spectra for more than 100000 stars across all major components of the Milky Way. In addition to atmospheric parameters and stellar abundances that have been derived in previous papers of this series, the GES spectra allow us to detect spectroscopic binaries with one (SB1), two (SB2) or more (SBn $\ge$ 3) components. Cross-correlation functions (CCFs) have been re-computed thanks to a dozen spectral masks probing a range of effective temperatures, surface gravities and metallicities. By optimising the mask choice for a given spectrum, the new computed so-called Nacre (Narrow cross-correlation experiment) CCFs are narrower and allow to unblend more stellar components than standard masks. The Doe (Detection of Extrema) extremum-finding code then selects the individual components and provides their radial velocities. From the sample of HR10 and HR21 spectra corresponding to 37565 objects, the present study leads to the detection of 322 SB2, ten (three of them being tentative) SB3, and two tentative SB4. In particular, compared to our previous study, the Nacre CCFs allow us to multiply the number of SB2 candidates by $\approx$ 1.5. The colour-magnitude diagram reveals, as expected, the shifted location of the SB2 main sequence. A comparison between the SB identified in Gaia DR3 and the ones detected in the present work is performed and the complementarity of the two censuses is discussed. An application to mass-ratio determination is presented, and the mass-ratio distribution of the GES SB2 is discussed. When accounting for the SB2 detection rate, an SB2 frequency of $\approx$ 1.4% is derived within the present stellar sample of mainly FGK-type stars. As primary outliers identified within the GES data, SBn spectra produce a wealth of information and useful constraints for the binary population synthesis studies.


title: Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations

abstract: Large-scale discrete fracture network (DFN) simulators are standard fare for studies involving the sub-surface transport of particles since direct observation of real world underground fracture networks is generally infeasible. While these simulators have seen numerous successes over several engineering applications, estimations on quantities of interest (QoI) - such as breakthrough time of particles reaching the edge of the system - suffer from a two distinct types of uncertainty. A run of a DFN simulator requires several parameter values to be set that dictate the placement and size of fractures, the density of fractures, and the overall permeability of the system; uncertainty on the proper parameter choices will lead to some amount of uncertainty in the QoI, called epistemic uncertainty. Furthermore, since DFN simulators rely on stochastic processes to place fractures and govern flow, understanding how this randomness affects the QoI requires several runs of the simulator at distinct random seeds. The uncertainty in the QoI attributed to different realizations (i.e. different seeds) of the same random process leads to a second type of uncertainty, called aleatoric uncertainty. In this paper, we perform a Sensitivity Analysis, which directly attributes the uncertainty observed in the QoI to the epistemic uncertainty from each input parameter and to the aleatoric uncertainty. We make several design choices to handle an observed heteroskedasticity in DFN simulators, where the aleatoric uncertainty changes for different inputs, since the quality makes several standard statistical methods inadmissible. Beyond the specific takeaways on which input variables affect uncertainty the most for DFN simulators, a major contribution of this paper is the introduction of a statistically rigorous workflow for characterizing the uncertainty in DFN flow simulations that exhibit heteroskedasticity.


title: Kantoswki-Sachs model with a running cosmological constant and radiation

abstract: The simplest anisotropic model of the early Universe is the one with two conformal factors, which can be identified as Kantowski-Sachs metric, or the reduced version of the Bianchi-I metric. To fit the existing observational data, it is important that the anisotropy is washed out in the early stage of the evolution. We explore the possible effect of the running cosmological constant (RCC) on the dynamics of isotropy, in the case of the space filled by radiation.


title: Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models

abstract: This paper presents CyberSecEval, a comprehensive benchmark developed to help bolster the cybersecurity of Large Language Models (LLMs) employed as coding assistants. As what we believe to be the most extensive unified cybersecurity safety benchmark to date, CyberSecEval provides a thorough evaluation of LLMs in two crucial security domains: their propensity to generate insecure code and their level of compliance when asked to assist in cyberattacks. Through a case study involving seven models from the Llama 2, Code Llama, and OpenAI GPT large language model families, CyberSecEval effectively pinpointed key cybersecurity risks. More importantly, it offered practical insights for refining these models. A significant observation from the study was the tendency of more advanced models to suggest insecure code, highlighting the critical need for integrating security considerations in the development of sophisticated LLMs. CyberSecEval, with its automated test case generation and evaluation pipeline covers a broad scope and equips LLM designers and researchers with a tool to broadly measure and enhance the cybersecurity safety properties of LLMs, contributing to the development of more secure AI systems.


title: Values and derivative values at nonpositive integers of generalized multiple Hurwitz zeta functions, applications to Witten zeta functions

abstract: We aim to provide explicit formulas for values and derivative values along a direction of some generalized Hurwitz multizeta functions at nonpositive integers. We will express these values in terms of Bernoulli polynomials, and the derivative values in terms of Bernoulli polynomials, of derivative values at nonpositive integers of the Hurwitz zeta function, and of derivative values at nonpositive integers of some generalized Barnes zeta functions. Then we will apply these formulas in order to compute the values and the derivative values at $s=0$ of the Witten zeta functions $\zeta_{\mathfrak{g}_2}$ and $\zeta_{\mathfrak{so}(5)}$. As an application, we will find an explicit asymptotic formula for the number of representations of dimension $n$ of the exceptional Lie algebra $\mathfrak{g}_2$ using a generalized Meinardus-type theorem proved by Bridges, Brindle, Bringmann, and Franke.


title: MR-conditional Robotic Actuation of Concentric Tendon-Driven Cardiac Catheters

abstract: Atrial fibrillation (AF) and ventricular tachycardia (VT) are two of the sustained arrhythmias that significantly affect the quality of life of patients. Treatment of AF and VT often requires radiofrequency ablation of heart tissues using an ablation catheter. Recent progress in ablation therapy leverages magnetic resonance imaging (MRI) for higher contrast visual feedback, and additionally utilizes a guiding sheath with an actively deflectable tip to improve the dexterity of the catheter inside the heart. This paper presents the design and validation of an MR-conditional robotic module for automated actuation of both the ablation catheter and the sheath. The robotic module features a compact design for improved accessibility inside the MR scanner bore and is driven by piezoelectric motors to ensure MR-conditionality. The combined catheter-sheath mechanism is essentially a concentric tendon-driven continuum robot and its kinematics is modeled by the constant curvature model for closed-loop position control. Path following experiments were conducted to validate the actuation module and control scheme, achieving < 2 mm average tip position error.


title: E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation

abstract: Deep neural networks have evolved as the leading approach in 3D medical image segmentation due to their outstanding performance. However, the ever-increasing model size and computation cost of deep neural networks have become the primary barrier to deploying them on real-world resource-limited hardware. In pursuit of improving performance and efficiency, we propose a 3D medical image segmentation model, named Efficient to Efficient Network (E2ENet), incorporating two parametrically and computationally efficient designs. i. Dynamic sparse feature fusion (DSFF) mechanism: it adaptively learns to fuse informative multi-scale features while reducing redundancy. ii. Restricted depth-shift in 3D convolution: it leverages the 3D spatial information while keeping the model and computational complexity as 2D-based methods. We conduct extensive experiments on BTCV, AMOS-CT and Brain Tumor Segmentation Challenge, demonstrating that E2ENet consistently achieves a superior trade-off between accuracy and efficiency than prior arts across various resource constraints. E2ENet achieves comparable accuracy on the large-scale challenge AMOS-CT, while saving over 68\% parameter count and 29\% FLOPs in the inference phase, compared with the previous best-performing method. Our code has been made available at: https://github.com/boqian333/E2ENet-Medical.


title: Taming Subnet-Drift in D2D-Enabled Fog Learning: A Hierarchical Gradient Tracking Approach

abstract: Federated learning (FL) encounters scalability challenges when implemented over fog networks. Semi-decentralized FL (SD-FL) proposes a solution that divides model cooperation into two stages: at the lower stage, device-to-device (D2D) communications is employed for local model aggregations within subnetworks (subnets), while the upper stage handles device-server (DS) communications for global model aggregations. However, existing SD-FL schemes are based on gradient diversity assumptions that become performance bottlenecks as data distributions become more heterogeneous. In this work, we develop semi-decentralized gradient tracking (SD-GT), the first SD-FL methodology that removes the need for such assumptions by incorporating tracking terms into device updates for each communication layer. Analytical characterization of SD-GT reveals convergence upper bounds for both non-convex and strongly-convex problems, for a suitable choice of step size. We employ the resulting bounds in the development of a co-optimization algorithm for optimizing subnet sampling rates and D2D rounds according to a performance-efficiency trade-off. Our subsequent numerical evaluations demonstrate that SD-GT obtains substantial improvements in trained model quality and communication cost relative to baselines in SD-FL and gradient tracking on several datasets.


title: The Internet of Responsibilities-Connecting Human Responsibilities using Big Data and Blockchain

abstract: Accountability in the workplace is critically important and remains a challenging problem, especially with respect to workplace safety management. In this paper, we introduce a novel notion, the Internet of Responsibilities, for accountability management. Our method sorts through the list of responsibilities with respect to hazardous positions. The positions are interconnected using directed acyclic graphs (DAGs) indicating the hierarchy of responsibilities in the organization. In addition, the system detects and collects responsibilities, and represents risk areas in terms of the positions of the responsibility nodes. Finally, an automatic reminder and assignment system is used to enforce a strict responsibility control without human intervention. Using blockchain technology, we further extend our system with the capability to store, recover and encrypt responsibility data. We show that through the application of the Internet of Responsibility network model driven by Big Data, enterprise and government agencies can attain a highly secured and safe workplace. Therefore, our model offers a combination of interconnected responsibilities, accountability, monitoring, and safety which is crucial for the protection of employees and the success of organizations.


title: DeceptPrompt: Exploiting LLM-driven Code Generation via Adversarial Natural Language Instructions

abstract: With the advancement of Large Language Models (LLMs), significant progress has been made in code generation, enabling LLMs to transform natural language into programming code. These Code LLMs have been widely accepted by massive users and organizations. However, a dangerous nature is hidden in the code, which is the existence of fatal vulnerabilities. While some LLM providers have attempted to address these issues by aligning with human guidance, these efforts fall short of making Code LLMs practical and robust. Without a deep understanding of the performance of the LLMs under the practical worst cases, it would be concerning to apply them to various real-world applications. In this paper, we answer the critical issue: Are existing Code LLMs immune to generating vulnerable code? If not, what is the possible maximum severity of this issue in practical deployment scenarios? In this paper, we introduce DeceptPrompt, a novel algorithm that can generate adversarial natural language instructions that drive the Code LLMs to generate functionality correct code with vulnerabilities. DeceptPrompt is achieved through a systematic evolution-based algorithm with a fine grain loss design. The unique advantage of DeceptPrompt enables us to find natural prefix/suffix with totally benign and non-directional semantic meaning, meanwhile, having great power in inducing the Code LLMs to generate vulnerable code. This feature can enable us to conduct the almost-worstcase red-teaming on these LLMs in a real scenario, where users are using natural language. Our extensive experiments and analyses on DeceptPrompt not only validate the effectiveness of our approach but also shed light on the huge weakness of LLMs in the code generation task. When applying the optimized prefix/suffix, the attack success rate (ASR) will improve by average 50% compared with no prefix/suffix applying.


title: STraceBERT: Source Code Retrieval using Semantic Application Traces

abstract: Software reverse engineering is an essential task in software engineering and security, but it can be a challenging process, especially for adversarial artifacts. To address this challenge, we present STraceBERT, a novel approach that utilizes a Java dynamic analysis tool to record calls to core Java libraries, and pretrain a BERT-style model on the recorded application traces for effective method source code retrieval from a candidate set. Our experiments demonstrate the effectiveness of STraceBERT in retrieving the source code compared to existing approaches. Our proposed approach offers a promising solution to the problem of code retrieval in software reverse engineering and opens up new avenues for further research in this area.


title: Optimal Routes to Ultrafast Polarization Reversal in Ferroelectric LiNbO3

abstract: We use the frozen phonon method to calculate the anharmonic potential energy surface and to model the ultrafast ferroelectric polarization reversal in LiNbO3 driven by intense pulses of THz light. Before stable switching of the polarization occurs, there exists a region of excitation field-strengths where transient switching can occur, as observed experimentally [Physical Review Letters 118, 197601 (2017)]. By varying the excitation frequency from 4 to 20 THz, our modeling suggests that more efficient, permanent polarization switching can occur by directly exciting the soft mode at 7 THz, compared to nonlinear phononic-induced switching driven by exciting a high frequency mode at 18 THz. We also show that neglecting anharmonic coupling pathways in the modeled experiment can lead to significant differences in the modeled switching field strengths.


title: Neighboring Extremal Optimal Control Theory for Parameter-Dependent Closed-loop Laws

abstract: This study introduces an approach to obtain a neighboring extremal optimal control (NEOC) solution for a closed-loop optimal control problem, applicable to a wide array of nonlinear systems and not necessarily quadratic performance indices. The approach involves investigating the variation incurred in the functional form of a known closed-loop optimal control law due to small, known parameter variations in the system equations or the performance index. The NEOC solution can formally be obtained by solving a linear partial differential equation, akin to those encountered in the iterative solution of a nonlinear Hamilton-Jacobi equation. Motivated by numerical procedures for solving these latter equations, we also propose a numerical algorithm based on the Galerkin algorithm, leveraging the use of basis functions to solve the underlying Hamilton-Jacobi equation of the original optimal control problem. The proposed approach simplifies the NEOC problem by reducing it to the solution of a simple set of linear equations, thereby eliminating the need for a full re-solution of the adjusted optimal control problem. Furthermore, the variation to the optimal performance index can be obtained as a function of both the system state and small changes in parameters, allowing the determination of the adjustment to an optimal control law given a small adjustment of parameters in the system or the performance index. Moreover, in order to handle large known parameter perturbations, we propose a homotopic approach that breaks down the single calculation of NEOC into a finite set of multiple steps. Finally, the validity of the claims and theory is supported by theoretical analysis and numerical simulations.


title: Cycling Signatures: Identifying Oscillations from Time Series using Algebraic Topology

abstract: Recurrence is a fundamental characteristic of complicated deterministic dynamical systems. Understanding its structure is challenging, especially if the system of interest has many degrees of freedom so that visualizations of trajectories are of limited use. To analyze recurrent phenomena, we propose a computational method to identify oscillations and the transitions between them. To this end, we introduce the concept of cycling signature, which is a topological descriptor of a trajectory segment. The advantage of a topological approach, in particular in an application setting, is that it is robust to noise. Cycling signatures are computable from data and provide a comprehensive global description of oscillations through their statistics over many trajectory segments. We demonstrate this through three examples. In particular, we identify and analyze six oscillations in a four-dimensional system with a hyperchaotic attractor.


title: Influence of Trotterization error on single-particle tunneling

abstract: Simulation of the single-particle tunneling problem by means of the Suzuki-Trotter approximation (STA) is analyzed. Considered is a particle hopping across a chain of sites in presence of a smooth position-dependent potential profile with several local minima that arrange a tunneling problem between the localized states in different minima. The STA error is found to manifest itself in three ways: i) perturbative energy shifts, ii) nonperturbartive renormalization of the tunneling rates, and iii) perturbative leakage of the total probability to other states. Generally, the first type of error is the most essential, as detuning of the tunneling resonance has to be compared with exponentially small tunneling rates. In absence of detuning (e.g. if the resonance is protected by symmetry), STA leads to exponential enhancement of the tunneling rates. The last type of error classifies the overall defect in the wave function and delineates the region of sufficiently weak distortion of the wave function due to STA. The conducted analysis confirms the naive criteria of applicability $\max\{T,P\}\ll\delta t^{-1}$ (with $T,P$ being the typical scales of kinetic and potential terms, respectively), while also revealing the structure of error and its behavior with system parameters. Analysis of the case of large Trotter step is also performed, with the main result being the reconstruction of low-energy spectrum due to coupling between states with energy difference close to $2\pi/\delta t$. The connection of the obtained results with rigorous upper error bounds on the STA error is discussed, with particular emphasis on why these rigorous bounds are not always saturated. We also point out that the proposed problem can be directly implemented on existing quantum devices [arXiv:2012.00921]. In particular, we give a detailed description of an experimental design that demonstrates the described physics.


title: Is Feedback All You Need? Leveraging Natural Language Feedback in Goal-Conditioned Reinforcement Learning

abstract: Despite numerous successes, the field of reinforcement learning (RL) remains far from matching the impressive generalisation power of human behaviour learning. One possible way to help bridge this gap be to provide RL agents with richer, more human-like feedback expressed in natural language. To investigate this idea, we first extend BabyAI to automatically generate language feedback from the environment dynamics and goal condition success. Then, we modify the Decision Transformer architecture to take advantage of this additional signal. We find that training with language feedback either in place of or in addition to the return-to-go or goal descriptions improves agents' generalisation performance, and that agents can benefit from feedback even when this is only available during training, but not at inference.


title: Efficient Large Language Models Fine-Tuning On Graphs

abstract: Learning from Text-Attributed Graphs (TAGs) has attracted significant attention due to its wide range of real-world applications. The rapid evolution of large language models (LLMs) has revolutionized the way we process textual data, which indicates a strong potential to replace shallow text embedding generally used in Graph Neural Networks (GNNs). However, we find that existing LLM approaches that exploit text information in graphs suffer from inferior computation and data efficiency. In this work, we introduce a novel and efficient approach for the end-to-end fine-tuning of Large Language Models (LLMs) on TAGs, named LEADING. The proposed approach maintains computation cost and memory overhead comparable to the graph-less fine-tuning of LLMs. Moreover, it transfers the rick knowledge in LLMs to downstream graph learning tasks effectively with limited labeled data in semi-supervised learning. Its superior computation and data efficiency are demonstrated through comprehensive experiments, offering a promising solution for a wide range of LLMs and graph learning tasks on TAGs.


title: DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming

abstract: Streaming data, crucial for applications like crowdsourcing analytics, behavior studies, and real-time monitoring, faces significant privacy risks due to the large and diverse data linked to individuals. In particular, recent efforts to release data streams, using the rigorous privacy notion of differential privacy (DP), have encountered issues with unbounded privacy leakage. This challenge limits their applicability to only a finite number of time slots (''finite data stream'') or relaxation to protecting the events (''event or $w$-event DP'') rather than all the records of users. A persistent challenge is managing the sensitivity of outputs to inputs in situations where users contribute many activities and data distributions evolve over time. In this paper, we present a novel technique for Differentially Private data streaming over Infinite disclosure (DPI) that effectively bounds the total privacy leakage of each user in infinite data streams while enabling accurate data collection and analysis. Furthermore, we also maximize the accuracy of DPI via a novel boosting mechanism. Finally, extensive experiments across various streaming applications and real datasets (e.g., COVID-19, Network Traffic, and USDA Production), show that DPI maintains high utility for infinite data streams in diverse settings. Code for DPI is available at https://github.com/ShuyaFeng/DPI.


title: Unnatural Algorithms in Machine Learning

abstract: Natural gradient descent has a remarkable property that in the small learning rate limit, it displays an invariance with respect to network reparameterizations, leading to robust training behavior even for highly covariant network parameterizations. We show that optimization algorithms with this property can be viewed as discrete approximations of natural transformations from the functor determining an optimizer's state space from the diffeomorphism group if its configuration manifold, to the functor determining that state space's tangent bundle from this group. Algorithms with this property enjoy greater efficiency when used to train poorly parameterized networks, as the network evolution they generate is approximately invariant to network reparameterizations. More specifically, the flow generated by these algorithms in the limit as the learning rate vanishes is invariant under smooth reparameterizations, the respective flows of the parameters being determined by equivariant maps. By casting this property a natural transformation, we allow for generalizations beyond equivariance with respect to group actions; this framework can account for non-invertible maps such as projections, creating a framework for the direct comparison of training behavior across non-isomorphic network architectures, and the formal examination of limiting behavior as network size increases by considering inverse limits of these projections, should they exist. We introduce a simple method of introducing this naturality more generally and examine a number of popular machine learning training algorithms, finding that most are unnatural.


title: Train 'n Trade: Foundations of Parameter Markets

abstract: Organizations typically train large models individually. This is costly and time-consuming, particularly for large-scale foundation models. Such vertical production is known to be suboptimal. Inspired by this economic insight, we ask whether it is possible to leverage others' expertise by trading the constituent parts in models, i.e., sets of weights, as if they were market commodities. While recent advances in aligning and interpolating models suggest that doing so may be possible, a number of fundamental questions must be answered to create viable parameter markets. In this work, we address these basic questions, propose a framework containing the infrastructure necessary for market operations to take place, study strategies for exchanging parameters, and offer means for agents to monetize parameters. Excitingly, compared to agents who train siloed models from scratch, we show that it is possible to mutually gain by using the market, even in competitive settings. This suggests that the notion of parameter markets may be a useful paradigm for improving large-scale model training in the future.


title: Computability in infinite Galois theory and algorithmically random algebraic fields

abstract: We introduce a notion of algorithmic randomness for algebraic fields. We prove the existence of a continuum of algebraic extensions of $\mathbb{Q}$ that are random according to our definition. We show that there are noncomputable algebraic fields which are not random. We also partially characterize the index set, relative to an oracle, of the set of random algebraic fields computable relative to that oracle. In order to carry out this investigation of randomness for fields, we develop computability in the context of infinite Galois theory (where the relevant Galois groups are uncountable), including definitions of computable and computably enumerable Galois groups and computability of Haar measure on the Galois groups.


title: Reinforcement Learning Based Dynamic Power Control for UAV Mobility Management

abstract: Modern communication systems need to fulfill multiple and often conflicting objectives at the same time. In particular, new applications require high reliability while operating at low transmit powers. Moreover, reliability constraints may vary over time depending on the current state of the system. One solution to address this problem is to use joint transmissions from a number of base stations (BSs) to meet the reliability requirements. However, this approach is inefficient when considering the overall total transmit power. In this work, we propose a reinforcement learning-based power allocation scheme for an unmanned aerial vehicle (UAV) communication system with varying communication reliability requirements. In particular, the proposed scheme aims to minimize the total transmit power of all BSs while achieving an outage probability that is less than a tolerated threshold. This threshold varies over time, e.g., when the UAV enters a critical zone with high-reliability requirements. Our results show that the proposed learning scheme uses dynamic power allocation to meet varying reliability requirements, thus effectively conserving energy.


title: Hiding Functions within Functions: Steganography by Implicit Neural Representations

abstract: Deep steganography utilizes the powerful capabilities of deep neural networks to embed and extract messages, but its reliance on an additional message extractor limits its practical use due to the added suspicion it can raise from steganalyzers. To address this problem, we propose StegaINR, which utilizes Implicit Neural Representation (INR) to implement steganography. StegaINR embeds a secret function into a stego function, which serves as both the message extractor and the stego media for secure transmission on a public channel. Recipients need only use a shared key to recover the secret function from the stego function, allowing them to obtain the secret message. Our approach makes use of continuous functions, enabling it to handle various types of messages. To our knowledge, this is the first work to introduce INR into steganography. We performed evaluations on image and climate data to test our method in different deployment contexts.


title: Fine-Grained Extraction of Road Networks via Joint Learning of Connectivity and Segmentation

abstract: Road network extraction from satellite images is widely applicated in intelligent traffic management and autonomous driving fields. The high-resolution remote sensing images contain complex road areas and distracted background, which make it a challenge for road extraction. In this study, we present a stacked multitask network for end-to-end segmenting roads while preserving connectivity correctness. In the network, a global-aware module is introduced to enhance pixel-level road feature representation and eliminate background distraction from overhead images; a road-direction-related connectivity task is added to ensure that the network preserves the graph-level relationships of the road segments. We also develop a stacked multihead structure to jointly learn and effectively utilize the mutual information between connectivity learning and segmentation learning. We evaluate the performance of the proposed network on three public remote sensing datasets. The experimental results demonstrate that the network outperforms the state-of-the-art methods in terms of road segmentation accuracy and connectivity maintenance.


title: A Brief Tutorial on Sample Size Calculations for Fairness Audits

abstract: In fairness audits, a standard objective is to detect whether a given algorithm performs substantially differently between subgroups. Properly powering the statistical analysis of such audits is crucial for obtaining informative fairness assessments, as it ensures a high probability of detecting unfairness when it exists. However, limited guidance is available on the amount of data necessary for a fairness audit, lacking directly applicable results concerning commonly used fairness metrics. Additionally, the consideration of unequal subgroup sample sizes is also missing. In this tutorial, we address these issues by providing guidance on how to determine the required subgroup sample sizes to maximize the statistical power of hypothesis tests for detecting unfairness. Our findings are applicable to audits of binary classification models and multiple fairness metrics derived as summaries of the confusion matrix. Furthermore, we discuss other aspects of audit study designs that can increase the reliability of audit results.


title: Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videos

abstract: Diagnosis in histopathology requires a global whole slide images (WSIs) analysis, requiring pathologists to compound evidence from different WSI patches. The gigapixel scale of WSIs poses a challenge for histopathology multi-modal models. Training multi-model models for histopathology requires instruction tuning datasets, which currently contain information for individual image patches, without a spatial grounding of the concepts within each patch and without a wider view of the WSI. Therefore, they lack sufficient diagnostic capacity for histopathology. To bridge this gap, we introduce Quilt-Instruct, a large-scale dataset of 107,131 histopathology-specific instruction question/answer pairs, grounded within diagnostically relevant image patches that make up the WSI. Our dataset is collected by leveraging educational histopathology videos from YouTube, which provides spatial localization of narrations by automatically extracting the narrators' cursor positions. Quilt-Instruct supports contextual reasoning by extracting diagnosis and supporting facts from the entire WSI. Using Quilt-Instruct, we train Quilt-LLaVA, which can reason beyond the given single image patch, enabling diagnostic reasoning across patches. To evaluate Quilt-LLaVA, we propose a comprehensive evaluation dataset created from 985 images and 1283 human-generated question-answers. We also thoroughly evaluate Quilt-LLaVA using public histopathology datasets, where Quilt-LLaVA significantly outperforms SOTA by over 10% on relative GPT-4 score and 4% and 9% on open and closed set VQA. Our code, data, and model are publicly accessible at quilt-llava.github.io.


title: MetaDetect: Metamorphic Testing Based Anomaly Detection for Multi-UAV Wireless Networks

abstract: The reliability of wireless Ad Hoc Networks (WANET) communication is much lower than wired networks. WANET will be impacted by node overload, routing protocol, weather, obstacle blockage, and many other factors, all those anomalies cannot be avoided. Accurate prediction of the network entirely stopping in advance is essential after people could do networking re-routing or changing to different bands. In the present study, there are two primary goals. Firstly, design anomaly events detection patterns based on Metamorphic Testing (MT) methodology. Secondly, compare the performance of evaluation metrics, such as Transfer Rate, Occupancy rate, and the Number of packets received. Compared to other studies, the most significant advantage of mathematical interpretability, as well as not requiring dependence on physical environmental information, only relies on the networking physical layer and Mac layer data. The analysis of the results demonstrates that the proposed MT detection method is helpful for automatically identifying incidents/accident events on WANET. The physical layer transfer Rate metric could get the best performance.


title: Forcing Generative Models to Degenerate Ones: The Power of Data Poisoning Attacks

abstract: Growing applications of large language models (LLMs) trained by a third party raise serious concerns on the security vulnerability of LLMs.It has been demonstrated that malicious actors can covertly exploit these vulnerabilities in LLMs through poisoning attacks aimed at generating undesirable outputs. While poisoning attacks have received significant attention in the image domain (e.g., object detection), and classification tasks, their implications for generative models, particularly in the realm of natural language generation (NLG) tasks, remain poorly understood. To bridge this gap, we perform a comprehensive exploration of various poisoning techniques to assess their effectiveness across a range of generative tasks. Furthermore, we introduce a range of metrics designed to quantify the success and stealthiness of poisoning attacks specifically tailored to NLG tasks. Through extensive experiments on multiple NLG tasks, LLMs and datasets, we show that it is possible to successfully poison an LLM during the fine-tuning stage using as little as 1\% of the total tuning data samples. Our paper presents the first systematic approach to comprehend poisoning attacks targeting NLG tasks considering a wide range of triggers and attack settings. We hope our findings will assist the AI security community in devising appropriate defenses against such threats.


title: Make out like a (Multi-Armed) Bandit: Improving the Odds of Fuzzer Seed Scheduling with T-Scheduler

abstract: Fuzzing is a highly-scalable software testing technique that uncovers bugs in a target program by executing it with mutated inputs. Over the life of a fuzzing campaign, the fuzzer accumulates inputs inducing new and interesting target behaviors, drawing from these inputs for further mutation. This rapidly results in a large number of inputs to select from, making it challenging to quickly and accurately select the "most promising" input for mutation. Reinforcement learning (RL) provides a natural solution to this "seed scheduling" problem: the fuzzer dynamically adapts its selection strategy by learning from past results. However, existing RL approaches are (a) computationally expensive (reducing fuzzer throughput) and/or (b) require hyperparameter tuning (reducing generality across targets and input types). To this end, we propose T-Scheduler, a seed scheduler built on multi-armed bandit theory that automatically adapts to the target without any hyperparameter tuning. We evaluate T-Scheduler over 35 CPU-yr of fuzzing, comparing it to 11 state-of-the-art schedulers. Our results show that T-Scheduler improves on these 11 schedulers on both bug-finding and coverage-expansion abilities.


title: Cryogenic platform to investigate strong microwave cavity-spin coupling in correlated magnetic materials

abstract: We present a comprehensive exploration of loop-gap resonators (LGRs) for electron spin resonance (ESR) studies, enabling investigations into the hybridization of solid-state magnetic materials with microwave polariton modes. The experimental setup, implemented in a Physical Property Measurement System by Quantum Design, allows for ESR spectra at temperatures as low as 2 Kelvin. The versatility of continuous wave ESR spectroscopy is demonstrated through experiments on CuSO4.5H2O and MgCr2O4, showcasing the g-tensor and magnetic susceptibilities of these materials. The study delves into the challenges of fitting spectra under strong hybridization conditions and underscores the significance of proper calibration and stabilization. The detailed guide provided serves as a valuable resource for laboratories interested in exploring hybrid quantum systems through microwave resonators.


title: The 3D Kinematics of the Orion Nebula Cluster II: Mass-dependent Kinematics of the Inner Cluster

abstract: We present the kinematic anaylsis of $246$ stars within $4^\prime$ from the center of Orion Nebula Cluster (ONC), the closest massive star cluster with active star formation across the full mass range, which provides valuable insights in the the formation and evolution of star cluster on an individual-star basis. High-precision radial velocities and surface temperatures are retrieved from spectra acquired by the NIRSPEC instrument used with adaptive optics (NIRSPAO) on the Keck II 10-m telescope. A three-dimensional kinematic map is then constructed by combining with the proper motions previously measured by the Hubble Space Telescope (HST) ACS/WFPC2/WFC3IR and Keck II NIRC2. The measured root-mean-squared velocity dispersion is $2.26\pm0.08~\mathrm{km}\,\mathrm{s}^{-1}$, significantly higher than the virial equilibrium's requirement of $1.73~\mathrm{km}\,\mathrm{s}^{-1}$, suggesting that the ONC core is supervirial, consistent with previous findings. Energy equipartition is not detected in the cluster. Most notably, the velocity of each star relative to its neighbors is found to be negatively correlated with stellar mass. Low-mass stars moving faster than their surrounding stars in a supervirial cluster suggests that the initial masses of forming stars may be related to their initial kinematic states. Additionally, a clockwise rotation preference is detected. A weak sign of inverse mass segregation is also identified among stars excluding the Trapezium stars, though it could be a sample bias. Finally, this study reports the discovery of four new candidate spectroscopic binary systems.


title: A Test-Time Learning Approach to Reparameterize the Geophysical Inverse Problem with a Convolutional Neural Network

abstract: Regularization is critical in solving the ill-posed geo-physical inversion problems. Explicit regularization is often used, but there are opportunities to explore the implicit regularization effect inherently from a Neural Network structure. Researchers in Computer Vision (CV) have discovered that the Convolutional Neural Network (CNN) architecture inherently enforces a regularization that is advantageous for addressing diverse CV inverse problems, including de-noising and in-painting. In this study, we examine the applicability of this implicit regularization to geophysical inversions. The CNN maps an arbitrary vector to the model space (e.g. log-conductivity on the simulation mesh). The predicted subsurface model is then fed into a forward numerical simulation process to generate corresponding predicted measurements. Subsequently, the objective function value is computed by comparing these predicted measurements with the observed field measurements. The backpropagation algorithm is employed to update the trainable parameters of the CNN during the inversion. Note that the CNN in our proposed method does not require training before the inversion, rather, the CNN weights are estimated in the inversion algorithm, hence this is a test-time learning (TTL) approach. The results demonstrate that the implicit regularization provided by the CNN can be useful in DC resistivity inversions. We also provide a detailed discussion of the potential sources of this implicit regularization and some practical guides for applying the proposed method to other geophysical scenarios. The proposed approach for reparameterizing the inverse problem can be adapted to other Tikhonov-style geophysical inversions.


title: Pulsed voltage cold atmospheric plasma jet and gold nanoparticles enhance cytotoxic anticancer effect

abstract: Efficient and biologically safe mode of cold atmospheric plasma jet (CAPJ) is crucial for the development of CAPJ-based anticancer therapy. In the experiment and numerical simulations, by changing the pulse duration of a positive-pulsed voltage, we found the optimal CAPJ mode with regular streamer propagation. CAPJ regimes with a maximum discharge current at a temperature T<42 C substantially suppressed the viability of cancer cells. To enhance cell killing, gold nanoparticles (NPs) were added to the cells before and after the CAPJ exposure. Combination of CAPJ, generated with positive pulsed voltage, and gold nanoparticles decreased viability of NCI-H23 epithelial-like lung adenocarcinoma, A549 lung adenocarcinoma, BrCCh4e-134 breast adenocarcinoma and uMel1 uveal melanoma cells. Polyethylene glycol-modified nanoparticles with attached fluorescent label were used to visualize the uptake of NPs. We demonstrated that NPs efficiently entered the cells when were added to the cells just before CAPJ exposure or up to two hours afterwards. The efficiency ofNPs penetration into cells positively correlated with the induced cytotoxic effect: it was maximal when NPs was added to cells right before or immediately after CAPJ exposure. Summarizing, the treatment with optimal CAPJ modes in combination with modified NPs, bearing the cancer-addressed molecules and therapeutics may be next strategy of strengthening the CAPJ-based antitumor approaches.


title: A Learning-based Distributed Algorithm for Scheduling in Multi-hop Wireless Networks

abstract: We address the joint problem of learning and scheduling in multi-hop wireless network without a prior knowledge on link rates. Previous scheduling algorithms need the link rate information, and learning algorithms often require a centralized entity and polynomial complexity. These become a major obstacle to develop an efficient learning-based distributed scheme for resource allocation in large-scale multi-hop networks. In this work, by incorporating with learning algorithm, we develop provably efficient scheduling scheme under packet arrival dynamics without a priori link rate information. We extend the results to distributed implementation and evaluation their performance through simulations.


title: Robust approximation rules for critical electric field of dielectric gas mixtures

abstract: A semi-analytic method for quickly approximating the density-reduced critical electric field for arbitrary mixtures of gases is proposed and validated. Determination of this critical electric field is crucial for designing and testing alternatives to SF$_6$ for insulating high voltage electrical equipment. We outline the theoretical basis of the approximation formula from electron fluid conservation equations, and demonstrate how for binary mixtures the critical electric field can be computed from the transport data of electrons in the pure gases. We demonstrate validity of the method in mixtures of N$_2$ and O$_2$, and SF$_6$ and O$_2$. We conclude with an application of the method to approximate the critical electric field for mixtures of SF$_6$ and HFO1234ze(E), which is a high interest mixture being actively studied for high voltage insulation applications.


title: Anomalies of 4d $Spin_G$ Theories

abstract: We consider 't Hooft anomalies of four-dimensional gauge theories whose fermion matter content admits $Spin_G(4)$ generalized spin structure, with $G$ either gauged or a global symmetry. We discuss methods to directly compute $w_2\cup w_3$ 't Hooft anomalies involving Stiefel-Whitney classes of gauge and flavor symmetry bundles that such theories can have on non-spin manifolds, e.g. $M_4=\mathbb{CP}^2$. Such anomalies have been discussed for $SU(2)$ gauge theory with adjoint fermions, where they were shown to give an effect that was originally found in the Donaldson-Witten topological twist of ${\cal N}=2$ SYM theory. We directly compute these anomalies for a variety of theories, including general $G$ gauge theories with adjoint fermions, $SU(2)$ gauge theory with fermions in general representations, and $Spin(N)$ gauge theories with fundamental matter. We discuss aspects of matching these and other 't Hooft anomalies in the IR phase where global symmetries are spontaneously broken, in particular for general $G_{\rm gauge}$ theory with $N_f$ adjoint Weyl fermions. For example, in the case of $N_f=2$ we discuss anomaly matching in the IR phase consisting of $h^\vee _{G_{\rm gauge}}$ copies of a $\mathbb{CP}^1$ non-linear sigma model, including for the $w_2w_3$ anomalies when formulated with $Spin_{SU(2)_{\rm global}}(4)$ structure.


title: Induced Generative Adversarial Particle Transformers

abstract: In high energy physics (HEP), machine learning methods have emerged as an effective way to accurately simulate particle collisions at the Large Hadron Collider (LHC). The message-passing generative adversarial network (MPGAN) was the first model to simulate collisions as point, or ``particle'', clouds, with state-of-the-art results, but suffered from quadratic time complexity. Recently, generative adversarial particle transformers (GAPTs) were introduced to address this drawback; however, results did not surpass MPGAN. We introduce induced GAPT (iGAPT) which, by integrating ``induced particle-attention blocks'' and conditioning on global jet attributes, not only offers linear time complexity but is also able to capture intricate jet substructure, surpassing MPGAN in many metrics. Our experiments demonstrate the potential of iGAPT to simulate complex HEP data accurately and efficiently.


title: Physics-Informed Convolutional Autoencoder for Cyber Anomaly Detection in Power Distribution Grids

abstract: The growing trend toward the modernization of power distribution systems has facilitated the installation of advanced measurement units and promotion of the cyber communication systems. However, these infrastructures are still prone to stealth cyber attacks. The existing data-driven anomaly detection methods suffer from a lack of knowledge about the system's physics, lack of interpretability, and scalability issues hindering their practical applications in real-world scenarios. To address these concerns, physics-informed neural networks (PINNs) were introduced. This paper proposes a multivariate physics-informed convolutional autoencoder (PIConvAE) to detect stealthy cyber-attacks in power distribution grids. The proposed model integrates the physical principles into the loss function of the neural network by applying Kirchhoff's law. Simulations are performed on the modified IEEE 13-bus and 123-bus systems using OpenDSS software to validate the efficacy of the proposed model for stealth attacks. The numerical results prove the superior performance of the proposed PIConvAE in three aspects: a) it provides more accurate results compared to the data-driven ConvAE model, b) it requires less training time to converge c) the model excels in effectively detecting a wide range of attack magnitudes making it powerful in detecting stealth attacks.


title: Photometric Determination of Main-Sequence Binaries with Gaia

abstract: Since its launch in 2013, the Gaia space telescope has provided precise measurements of the positions and magnitudes of over 1 billion stars. This has enabled extensive searches for stellar and sub-stellar companions through astrometric and radial velocity measurements. However, these surveys require a prior knowledge of any unresolved companion affecting the results which can be identified using photometry. In this work, Gaia's magnitude measurements are combined with near-infrared observations from 2MASS and WISE and simulation-based inference is applied to constrain astrophysical parameters and search for hidden companions. This method is first tested on simulated sets of binary stars before expanding to Gaia's non-single star catalogue. Using this test, a region is identified on the H-R diagram in which the method is the most accurate and all Gaia sources within that region are analysed. This analysis reproduces a known anti-correlation between metallicity and binary fraction. Finally, the method is applied to the nearby star cluster M67 and, using previous studies of the metallicity distribution, it is possible to improve constraints on binary fraction. From this the binary fraction in the cluster is calculated to vary from 30% in the outer cluster to 45% near the core. This is found to be significantly higher the 23% binary fraction calculated for the wider stellar neighbourhood.


title: Far-off-equilibrium early-stage dynamics in high-energy nuclear collisions

abstract: We explore the far-off-equilibrium aspects of the (1+1)-dimensional early-stage evolution of a weakly-coupled quark-gluon plasma using kinetic theory and hydrodynamics. For a large set of far-off-equilibrium initial conditions the system exhibits a peculiar phenomenon where its total equilibrium entropy decreases with time. Using a non-equilibrium definition of entropy based on Boltzmann's H-function, we demonstrate how this apparently anomalous behavior is consistent with the second law of thermodynamics. We also use the H-function to formulate `maximum-entropy' hydrodynamics, a far-off-equilibrium macroscopic theory that can describe both free-streaming and near-equilibrium regimes of quark-gluon plasma in a single framework.


title: Exploratory Simulation of Thrombosis in a Temporary LVAD Catheter Pump within a Virtual In-vivo Left Heart Environment

abstract: Percutaneous catheter pumps are intraventricular temporary mechanical circulatory support (MCS) devices that are positioned across the aortic valve into the left ventricle (LV) and provide continuous antegrade blood flow from the LV into the ascending aorta (AA). MCS devices are most often computationally evaluated as isolated devices subject to idealized steady-state blood flow conditions. In clinical practice, MCS devices operate connected to or within diseased pulsatile native hearts and are often complicated by hemocompatibility related adverse events such as stroke, bleeding, and thrombosis. Whereas aspects of the human circulation are increasingly being simulated via computational methods, the precise interplay of pulsatile LV hemodynamics with MCS pump hemocompatibility remains mostly unknown and not well characterized. Technologies are rapidly converging such that next-generation MCS devices will soon be evaluated in virtual physiological environments that increasingly mimic clinical settings. The purpose of this brief communication is to report results and lessons learned from an exploratory CFD simulation of hemodynamics and thrombosis for a catheter pump situated within a virtual in-vivo left heart environment.


title: The Graph Lottery Ticket Hypothesis: Finding Sparse, Informative Graph Structure

abstract: Graph learning methods help utilize implicit relationships among data items, thereby reducing training label requirements and improving task performance. However, determining the optimal graph structure for a particular learning task remains a challenging research problem. In this work, we introduce the Graph Lottery Ticket (GLT) Hypothesis - that there is an extremely sparse backbone for every graph, and that graph learning algorithms attain comparable performance when trained on that subgraph as on the full graph. We identify and systematically study 8 key metrics of interest that directly influence the performance of graph learning algorithms. Subsequently, we define the notion of a "winning ticket" for graph structure - an extremely sparse subset of edges that can deliver a robust approximation of the entire graph's performance. We propose a straightforward and efficient algorithm for finding these GLTs in arbitrary graphs. Empirically, we observe that performance of different graph learning algorithms can be matched or even exceeded on graphs with the average degree as low as 5.