title: Demonstrating Reinforcement Learning and Run Time Assurance for Spacecraft Inspection Using Unmanned Aerial Vehicles

abstract: On-orbit spacecraft inspection is an important capability for enabling servicing and manufacturing missions and extending the life of spacecraft. However, as space operations become increasingly more common and complex, autonomous control methods are needed to reduce the burden on operators to individually monitor each mission. In order for autonomous control methods to be used in space, they must exhibit safe behavior that demonstrates robustness to real world disturbances and uncertainty. In this paper, neural network controllers (NNCs) trained with reinforcement learning are used to solve an inspection task, which is a foundational capability for servicing missions. Run time assurance (RTA) is used to assure safety of the NNC in real time, enforcing several different constraints on position and velocity. The NNC and RTA are tested in the real world using unmanned aerial vehicles designed to emulate spacecraft dynamics. The results show this emulation is a useful demonstration of the capability of the NNC and RTA, and the algorithms demonstrate robustness to real world disturbances.


title: Space Processor Computation Time Analysis for Reinforcement Learning and Run Time Assurance Control Policies

abstract: As the number of spacecraft on orbit continues to grow, it is challenging for human operators to constantly monitor and plan for all missions. Autonomous control methods such as reinforcement learning (RL) have the power to solve complex tasks while reducing the need for constant operator intervention. By combining RL solutions with run time assurance (RTA), safety of these systems can be assured in real time. However, in order to use these algorithms on board a spacecraft, they must be able to run in real time on space grade processors, which are typically outdated and less capable than state-of-the-art equipment. In this paper, multiple RL-trained neural network controllers (NNCs) and RTA algorithms were tested on commercial-off-the-shelf (COTS) and radiation tolerant processors. The results show that all NNCs and most RTA algorithms can compute optimal and safe actions in well under 1 second with room for further optimization before deploying in the real world.


title: CANAL -- Cyber Activity News Alerting Language Model: Empirical Approach vs. Expensive LLM

abstract: In today's digital landscape, where cyber attacks have become the norm, the detection of cyber attacks and threats is critically imperative across diverse domains. Our research presents a new empirical framework for cyber threat modeling, adept at parsing and categorizing cyber-related information from news articles, enhancing real-time vigilance for market stakeholders. At the core of this framework is a fine-tuned BERT model, which we call CANAL - Cyber Activity News Alerting Language Model, tailored for cyber categorization using a novel silver labeling approach powered by Random Forest. We benchmark CANAL against larger, costlier LLMs, including GPT-4, LLaMA, and Zephyr, highlighting their zero to few-shot learning in cyber news classification. CANAL demonstrates superior performance by outperforming all other LLM counterparts in both accuracy and cost-effectiveness. Furthermore, we introduce the Cyber Signal Discovery module, a strategic component designed to efficiently detect emerging cyber signals from news articles. Collectively, CANAL and Cyber Signal Discovery module equip our framework to provide a robust and cost-effective solution for businesses that require agile responses to cyber intelligence.


title: A Monotone Circuit Construction for Individually-Secure Multi-Secret Sharing

abstract: In this work, we introduce a new technique for taking a single-secret sharing scheme with a general access structure and transforming it into an individually secure multi-secret sharing scheme where every secret has the same general access structure. To increase the information rate, we consider Individual Security which guarantees zero mutual information with each secret individually, for any unauthorized subsets. Our approach involves identifying which shares of the single-secret sharing scheme can be replaced by linear combinations of messages. When $m-1$ shares are replaced, our scheme obtains an information rate of $m/|S|$, where $S$ is the set of shares. This provides an improvement over the information rate of $1/|S|$ in the original single-secret sharing scheme.


title: Hedging American Put Options with Deep Reinforcement Learning

abstract: This article leverages deep reinforcement learning (DRL) to hedge American put options, utilizing the deep deterministic policy gradient (DDPG) method. The agents are first trained and tested with Geometric Brownian Motion (GBM) asset paths and demonstrate superior performance over traditional strategies like the Black-Scholes (BS) Delta, particularly in the presence of transaction costs. To assess the real-world applicability of DRL hedging, a second round of experiments uses a market calibrated stochastic volatility model to train DRL agents. Specifically, 80 put options across 8 symbols are collected, stochastic volatility model coefficients are calibrated for each symbol, and a DRL agent is trained for each of the 80 options by simulating paths of the respective calibrated model. Not only do DRL agents outperform the BS Delta method when testing is conducted using the same calibrated stochastic volatility model data from training, but DRL agents achieves better results when hedging the true asset path that occurred between the option sale date and the maturity. As such, not only does this study present the first DRL agents tailored for American put option hedging, but results on both simulated and empirical market testing data also suggest the optimality of DRL agents over the BS Delta method in real-world scenarios. Finally, note that this study employs a model-agnostic Chebyshev interpolation method to provide DRL agents with option prices at each time step when a stochastic volatility model is used, thereby providing a general framework for an easy extension to more complex underlying asset processes.


title: On linear stability of supersonic flow over a short compression corner at large ramp angles

abstract: Linear stability of supersonic flow over a short compression corner with ramp angles 30 and 42 is investigated using Direct Simulation Monte Carlo (DSMC) and Linear Stability Theory (LST) at Mach number 3, Reynolds number 11,200 and low Knudsen number, O(10$^{-4}$). The two-dimensional base flows feature nonzero velocity slip and temperature jump and were found to be steady and laminar at both ramp angles. Modal analysis revealed a previously unknown traveling three-dimensional global mode, the amplitude functions of which peak at the leading-edge and separation shocks and extend within the shear layer of the large laminar separation bubble formed on the short compression corner. This mode is linearly unstable at the higher ramp angle and stable at the lower one, while the known stationary three-dimensional global mode which peaks at the laminar separation is also present in the spectrum, but is (strongly) damped at both ramp angles. Three-dimensional DSMC simulations have fully confirmed the LST results, underlined (again) the significance of modeling the shock contribution in linear stability analyses of high-speed flow, and predicted the nonlinear evolution of the flow up to the generation of lambda vortices on the ramp, for the first time in the context of kinetic theory simulations.


title: Combining complex conjugation, time-reversal, and spin symmetry projection of coupled cluster wave functions

abstract: Complex conjugation symmetry breaking and restoration generate two non-orthogonal configurations at the Hartree-Fock level that can capture static correlation naturally. In conjunction with broken spin-symmetry coupled cluster theory, the symmetry-projected wave function shows good agreement with full configuration interaction in beryllium hydride insertion, lithium fluoride dissociation, and symmetric stretching of tetrahedral H$_4$. By adding spin flip projection, we can also recover time reversal symmetry in the same coupled cluster framework.


title: Multiple magnetic interactions and large inverse magnetocaloric effect in TbSi and TbSi$_{0.6}$Ge$_{0.4}$

abstract: We present a comprehensive investigation of the electronic structure, magnetization, specific heat, and crystallography of TbSi (FeB structure type) and TbSi$_{0.6}$Ge$_{0.4}$ (CrB structure type) compounds. Both TbSi and TbSi$_{0.6}$Ge$_{0.4}$ exhibit two antiferromagnetic (AFM) transitions at T$_{\rm N1}\approx$ 58~K and 57~K, and T$_{\rm N2}\approx$ 36~K and 44~K, respectively, along with an onset of weak metamagnetic-like transition around 6~T between T$_{\rm N1}$ and T$_{\rm N2}$. High-resolution specific heat (C$_{\rm P}$) measurements show the second- and first-order nature of the magnetic transition at T$_{\rm N1}$ and T$_{\rm N2}$, respectively, for both samples. However, in the case of TbSi, the low-temperature (LT) AFM to high-temperature (HT) AFM transition takes place via an additional AFM phase at the intermediate temperature (IT), where both LT to IT AFM and IT to HT AFM phase transitions exhibit a first-order nature. Both TbSi and TbSi$_{0.6}$Ge$_{0.4}$ manifest significant magnetic entropy changes ($\Delta S_{\rm M}$) of 9.6 and 11.6~J/kg-K, respectively, for $\Delta \mu_0H$=7~T, at T$_{\rm N2}$. The HT AFM phase of TbSi$_{0.6}$Ge$_{0.4}$ is found to be more susceptible to the external magnetic field, causing a significant broadening in the peaks of $\Delta S_{\rm M}$ curves at higher magnetic fields. Temperature and field-dependent specific heat data have been utilized to construct the complex H-T phase diagram of these compounds. Furthermore, temperature-dependent x-ray diffraction measurements demonstrate substantial magnetostriction and anisotropic thermal expansion of the unit cell in both samples.


title: Shape Conditioned Human Motion Generation with Diffusion Model

abstract: Human motion synthesis is an important task in computer graphics and computer vision. While focusing on various conditioning signals such as text, action class, or audio to guide the generation process, most existing methods utilize skeleton-based pose representation, requiring additional skinning to produce renderable meshes. Given that human motion is a complex interplay of bones, joints, and muscles, considering solely the skeleton for generation may neglect their inherent interdependency, which can limit the variability and precision of the generated results. To address this issue, we propose a Shape-conditioned Motion Diffusion model (SMD), which enables the generation of motion sequences directly in mesh format, conditioned on a specified target mesh. In SMD, the input meshes are transformed into spectral coefficients using graph Laplacian, to efficiently represent meshes. Subsequently, we propose a Spectral-Temporal Autoencoder (STAE) to leverage cross-temporal dependencies within the spectral domain. Extensive experimental evaluations show that SMD not only produces vivid and realistic motions but also achieves competitive performance in text-to-motion and action-to-motion tasks when compared to state-of-the-art methods.


title: Generalization Problems in Experiments Involving Multidimensional Decisions

abstract: Can the causal effects estimated in experiment be generalized to real-world scenarios? This question lies at the heart of social science studies. External validity primarily assesses whether experimental effects persist across different settings, implicitly presuming the experiment's ecological validity-that is, the consistency of experimental effects with their real-life counterparts. However, we argue that this presumed consistency may not always hold, especially in experiments involving multidimensional decision processes, such as conjoint experiments. We introduce a formal model to elucidate how attention and salience effects lead to three types of inconsistencies between experimental findings and real-world phenomena: amplified effect magnitude, effect sign reversal, and effect importance reversal. We derive testable hypotheses from each theoretical outcome and test these hypotheses using data from various existing conjoint experiments and our own experiments. Drawing on our theoretical framework, we propose several recommendations for experimental design aimed at enhancing the generalizability of survey experiment findings.


title: Deep MMD Gradient Flow without adversarial training

abstract: We propose a gradient flow procedure for generative modeling by transporting particles from an initial source distribution to a target distribution, where the gradient field on the particles is given by a noise-adaptive Wasserstein Gradient of the Maximum Mean Discrepancy (MMD). The noise-adaptive MMD is trained on data distributions corrupted by increasing levels of noise, obtained via a forward diffusion process, as commonly used in denoising diffusion probabilistic models. The result is a generalization of MMD Gradient Flow, which we call Diffusion-MMD-Gradient Flow or DMMD. The divergence training procedure is related to discriminator training in Generative Adversarial Networks (GAN), but does not require adversarial training. We obtain competitive empirical performance in unconditional image generation on CIFAR10, MNIST, CELEB-A (64 x64) and LSUN Church (64 x 64). Furthermore, we demonstrate the validity of the approach when MMD is replaced by a lower bound on the KL divergence.


title: Induced matching, ordered matching and Castelnuovo-Mumford regularity of bipartite graphs

abstract: Let G be a finite simple graph and let indm(G) and ordm(G) denote the induced matching number and the ordered matching number of G, respectively. We characterize all bipartite graphs G with indm(G) = ordm(G). We establish the Castelnuovo-Mumford regularity of powers of edge ideals and depth of powers of cover ideals for such graphs. We also give formulas for the count of connected non-isomorphic spanning subgraphs of the complete bipartite graph K_{m,n} for which indm(G) = ordm(G) = 2, with an explicit expression for the count when m = 2,3,4 and m <= n.


title: GraphRelate3D: Context-Dependent 3D Object Detection with Inter-Object Relationship Graphs

abstract: Accurate and effective 3D object detection is critical for ensuring the driving safety of autonomous vehicles. Recently, state-of-the-art two-stage 3D object detectors have exhibited promising performance. However, these methods refine proposals individually, ignoring the rich contextual information in the object relationships between the neighbor proposals. In this study, we introduce an object relation module, consisting of a graph generator and a graph neural network (GNN), to learn the spatial information from certain patterns to improve 3D object detection. Specifically, we create an inter-object relationship graph based on proposals in a frame via the graph generator to connect each proposal with its neighbor proposals. Afterward, the GNN module extracts edge features from the generated graph and iteratively refines proposal features with the captured edge features. Ultimately, we leverage the refined features as input to the detection head to obtain detection results. Our approach improves upon the baseline PV-RCNN on the KITTI validation set for the car class across easy, moderate, and hard difficulty levels by 0.82%, 0.74%, and 0.58%, respectively. Additionally, our method outperforms the baseline by more than 1% under the moderate and hard levels BEV AP on the test server.


title: BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies

abstract: Digital technologies have positively transformed society, but they have also led to undesirable consequences not anticipated at the time of design or development. We posit that insights into past undesirable consequences can help researchers and practitioners gain awareness and anticipate potential adverse effects. To test this assumption, we introduce BLIP, a system that extracts real-world undesirable consequences of technology from online articles, summarizes and categorizes them, and presents them in an interactive, web-based interface. In two user studies with 15 researchers in various computer science disciplines, we found that BLIP substantially increased the number and diversity of undesirable consequences they could list in comparison to relying on prior knowledge or searching online. Moreover, BLIP helped them identify undesirable consequences relevant to their ongoing projects, made them aware of undesirable consequences they "had never considered," and inspired them to reflect on their own experiences with technology.


title: Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare

abstract: This survey explores the transformative impact of foundation models (FMs) in artificial intelligence, focusing on their integration with federated learning (FL) for advancing biomedical research. Foundation models such as ChatGPT, LLaMa, and CLIP, which are trained on vast datasets through methods including unsupervised pretraining, self-supervised learning, instructed fine-tuning, and reinforcement learning from human feedback, represent significant advancements in machine learning. These models, with their ability to generate coherent text and realistic images, are crucial for biomedical applications that require processing diverse data forms such as clinical reports, diagnostic images, and multimodal patient interactions. The incorporation of FL with these sophisticated models presents a promising strategy to harness their analytical power while safeguarding the privacy of sensitive medical data. This approach not only enhances the capabilities of FMs in medical diagnostics and personalized treatment but also addresses critical concerns about data privacy and security in healthcare. This survey reviews the current applications of FMs in federated settings, underscores the challenges, and identifies future research directions including scaling FMs, managing data diversity, and enhancing communication efficiency within FL frameworks. The objective is to encourage further research into the combined potential of FMs and FL, laying the groundwork for groundbreaking healthcare innovations.


title: On Almost-Type Special Structured Tensor Classes Associated with Semi-Positive Tensors

abstract: In this paper, we introduce almost (strictly) semi-positive tensors, which extend the concept of almost (strictly) semimonotone matrices. Furthermore, we provide insights into the characteristics of the entries within these almost (strictly) semi-positive tensors and establish a condition that is both necessary and sufficient for categorizing the underlying tensor as an almost semi-positive tensor. Drawing inspiration from H. V\"{a}liaho's work on copositivity, we present the concept of almost (strictly) copositive tensors, which extends the notion of almost (strictly) copositive matrices to tensors. It is shown that a real symmetric tensor is almost (strictly) semi-positive if and only if it is almost (strictly) copositive and a symmetric almost (strictly) semi-positive tensor has a (nonpositive) negative $H^{++}$-eigenvalue. We also establish a relationship between (strictly) diagonally dominant and (strong) $\mathcal{M}$-tensors with (strictly) semi-positive tensors.


title: SAM3D: Zero-Shot Semi-Automatic Segmentation in 3D Medical Images with the Segment Anything Model

abstract: We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy comprising: volume slicing along non-orthogonal axes, efficient prompting in 3D, slice-wise inference using the pretrained SAM, and recoposition and refinement in 3D. We evaluated SAM3D performance qualitatively on an array of imaging modalities and anatomical structures and quantify performance for specific organs in body CT and tumors in brain MRI. By enabling users to create 3D segmentations of unseen data quickly and with dramatically reduced manual input, these methods have the potential to aid surgical planning and education, diagnostic imaging, and scientific research.


title: A computational test of quantum contextuality, and even simpler proofs of quantumness

abstract: Bell non-locality is a fundamental feature of quantum mechanics whereby measurements performed on "spatially separated" quantum systems can exhibit correlations that cannot be understood as revealing predetermined values. This is a special case of the more general phenomenon of "quantum contextuality", which says that such correlations can occur even when the measurements are not necessarily on separate quantum systems, but are merely "compatible" (i.e. commuting). Crucially, while any non-local game yields an experiment that demonstrates quantum advantage by leveraging the "spatial separation" of two or more devices (and in fact several such demonstrations have been conducted successfully in recent years), the same is not true for quantum contextuality: finding the contextuality analogue of such an experiment is arguably one of the central open questions in the foundations of quantum mechanics. In this work, we show that an arbitrary contextuality game can be compiled into an operational "test of contextuality" involving a single quantum device, by only making the assumption that the device is computationally bounded. Our work is inspired by the recent work of Kalai et al. (STOC '23) that converts any non-local game into a classical test of quantum advantage with a single device. The central idea in their work is to use cryptography to enforce spatial separation within subsystems of a single quantum device. Our work can be seen as using cryptography to enforce "temporal separation", i.e. to restrict communication between sequential measurements. Beyond contextuality, we employ our ideas to design a "proof of quantumness" that, to the best of our knowledge, is arguably even simpler than the ones proposed in the literature so far.


title: An asymmetric Myers-Nakai theorem for non-reversible Finsler manifolds

abstract: In this work we provide a generalization of the celebrated Myers-Nakai Theorem for Riemannian manifolds to the framework of non-reversible Finsler manifolds, based on the ideas used in a previous generalization for reversible Finsler manifolds proved in \cite{GJR-13}. In the reversible (i.e. metric) case, the function space used to characterize Finsler isometries is the normed algebra $C^1_b(M)$, of bounded and $C^1$-smooth real valued functions with bounded derivative on a Finsler manifold $M$, endowed with its natural norm. This function space had to be adapted in order for it to reflect the quasi-metric structure of non-reversible Finsler manifolds, resulting in a partial loss of the normed space structure. In order to achieve the desired result, we define new algebraic/quasi-metric structures to model the behavior of the aforementioned function space. The construction is based on the cone of smooth semi-Lipschitz functions.


title: Self-Consistent Recursive Diffusion Bridge for Medical Image Translation

abstract: Denoising diffusion models (DDM) have gained recent traction in medical image translation given improved training stability over adversarial models. DDMs learn a multi-step denoising transformation to progressively map random Gaussian-noise images onto target-modality images, while receiving stationary guidance from source-modality images. As this denoising transformation diverges significantly from the task-relevant source-to-target transformation, DDMs can suffer from weak source-modality guidance. Here, we propose a novel self-consistent recursive diffusion bridge (SelfRDB) for improved performance in medical image translation. Unlike DDMs, SelfRDB employs a novel forward process with start- and end-points defined based on target and source images, respectively. Intermediate image samples across the process are expressed via a normal distribution with mean taken as a convex combination of start-end points, and variance from additive noise. Unlike regular diffusion bridges that prescribe zero variance at start-end points and high variance at mid-point of the process, we propose a novel noise scheduling with monotonically increasing variance towards the end-point in order to boost generalization performance and facilitate information transfer between the two modalities. To further enhance sampling accuracy in each reverse step, we propose a novel sampling procedure where the network recursively generates a transient-estimate of the target image until convergence onto a self-consistent solution. Comprehensive analyses in multi-contrast MRI and MRI-CT translation indicate that SelfRDB offers superior performance against competing methods.


title: Constraints on the long-term existence of dilute cores in giant planets

abstract: Ring seismology has recently revealed the presence of internal gravity waves inside Saturn that extend up to 60% of Saturn's radius starting from the center, in what is recognized today as Saturn's stably-stratified dilute core. Similarly, gravity measurements on Jupiter suggest the existence of a dilute core of still poorly constrained radial extent. These cores are likely in a double-diffusive regime, which prompt the question of their long-term stability. Indeed, previous DNS (Direct Numerical Simulations) studies in triply-periodic domains have shown that, in some regimes, double-diffusive convection tends to spontaneously form shallow convective layers, which coarsen until the region becomes fully convective. In this letter, we study the conditions for layering in double-diffusive convection using different boundary conditions, in which temperature and composition fluxes are fixed at the domain boundaries. We run a suite of DNS varying microscopic diffusivities of the fluid and the strength of the initial stratification. We find that convective layers still form as a result of the previously discovered gamma-instability which takes place whenever the local stratification drops below a critical threshold that only depends on the fluid diffusivities. We also find that the layers grow once formed, eventually occupying the entire domain. Our work thus recovers the results of previous studies, despite the new boundary conditions, suggesting that this behavior is universal. The existence of Saturn's stably-stratified core, today, therefore suggests that this threshold has never been reached, which places a new constraint on scenarios for the planet's formation and evolution.


title: Tunable Spike-Timing-Dependent Plasticity in Magnetic Skyrmion Manipulation Chambers

abstract: Magnetic skyrmions, as scalable and non-volatile spin textures, can dynamically interact with fields and currents, making them promising for unconventional computing. This paper presents a neuromorphic device based on skyrmion manipulation chambers to implement spike-timing-dependent plasticity (STDP), a mechanism for unsupervised learning in brain-inspired computing. STDP adjusts synaptic weights based on the timing of pre- and post-synaptic spikes. The proposed three-chamber design encodes synaptic weight in the number of skyrmions in the center chamber, with left and right chambers for pre-synaptic and post-synaptic spikes. Micromagnetic simulations demonstrate that the timing between applied currents across the chambers controls the final skyrmion count (weight). The device exhibits adaptability and learning capabilities by manipulating chamber parameters, mimicking Hebbian and dendritic location-based plasticity. The device's ability to maintain state post-write highlights its potential for advancing adaptable neuromorphic devices.


title: Interactions between fractional solitons in bimodal fiber cavities

abstract: We introduce a system of fractional nonlinear Schroedinger equations (FNLSEs) which model the copropagation of optical waves carried by different wavelengths or mutually orthogonal circular polarizations in fiber-laser cavities with the effective fractional group-velocity dispersion (FGVD), which were recently made available to the experiment. In the FNLSE system, the FGVD terms are represented by the Riesz derivatives, with the respective Levy index (LI). The FNLSEs, which include the nonlinear self-phase-modulation (SPM) nonlinearity, are coupled by the cross-phase modulation (XPM) terms, and separated by a group-velocity (GV) mismatch (rapidity). By means of systematic simulations, we analyze collisions and bound states of solitons in the XPM-coupled system, varying the LI and GV mismatch. Outcomes of collisions between the solitons include rebound, conversion of the colliding single-component solitons into a pair of two-component ones, merger of the solitons into a breather, their mutual passage leading to excitation of intrinsic vibrations, and the elastic interaction. Families of stable two-component soliton bound states are constructed too, featuring a rapidity which is intermediate between those of the two components.


title: Quasiparticle and superfluid dynamics in Magic-Angle Graphene

abstract: Magic-Angle Twisted Bilayer Graphene shows a wide range of correlated phases which are electrostatically tunable. Despite a growing knowledge of the material, there is yet no consensus on the microscopic mechanisms driving its superconducting phase. In particular, elucidating the symmetry and formation mechanism of the superconducting phase may provide key insights for the understanding of unconventional, strongly coupled and topological superconductivity. A major obstacle to progress in this direction is that key thermodynamic properties, such as specific heat, electron-phonon coupling and superfluid stiffness, are extremely challenging to measure due to the 2D nature of the material and its relatively low energy scales. Here, we use a gate-defined, radio frequency-biased, Josephson junction to probe the electronic dynamics of magic-angle twisted bilayer graphene (MATBG). We reveal both the electronic quasiparticle dynamics, driven by their thermalization through phonon scattering, as well as the condensate dynamics, driven by the inertia of Cooper pairs. From these properties we recover the evolution of thermalization rates, and the superfluid stiffness across the phase diagram. Our findings favor an anisotropic or nodal pairing state and allow to estimate the strength of electron-phonon coupling. These results contribute to understanding the underlying mechanisms of superconductivity in MATBG while establishing an easy-to-implement method for characterizing thermal and superfluid properties of superconducting 2D materials.


title: Site-dependent Solutions of Wave Energy Converter Farms with Surrogate Models, Control Co-design, and Layout Optimization

abstract: Design of wave energy converter farms entails multiple domains that are coupled, and thus, their concurrent representation and consideration in early-stage design optimization has the potential to offer new insights and promising solutions with improved performance. Concurrent optimization of physical attributes (e.g., plant) and the control system design is often known as control co-design or CCD. To further improve performance, the layout of the farm must be carefully optimized in order to ensure that constructive effects from hydrodynamic interactions are leveraged, while destructive effects are avoided. The variations in the joint probability distribution of waves, stemming from distinct site locations, affect the farm's performance and can potentially influence decisions regarding optimal plant selection, control strategies, and layout configurations. Therefore, this paper undertakes a concurrent exploration of control co-design and layout optimization for a farm comprising five devices, modeled as heaving cylinders in the frequency domain, situated across four distinct site locations: Alaskan Coasts, East Coast, Pacific Islands, and West Coast. The challenge of efficiently and accurately estimating hydrodynamic coefficients within the optimization loop was mitigated through the application of surrogate modeling and many-body expansion principles. Results indicate the optimized solutions exhibit variations in plant, control, and layout for each candidate site, signifying the importance of system-level design with environmental considerations from the early stages of the design process.


title: Quantum Error Correction for Kids

abstract: No one should wait until college to get acquainted with core concepts of quantum information. Given the human bias of favouring the familiar over the unknown, early exposure to concepts of quantum information helps learners build stronger appetence for the field, as well as allowing them to develop an intuitive approach to it. In this work, I present an intuitive gamified approach to one of the core concepts in quantum error correction: the stabiliser formalism.


abstract: A manuscript version of the chapter "The Multiple Change-in-Gaussian-Mean Problem" from the book "Change-Point Detection and Data Segmentation" by Fearnhead and Fryzlewicz, currently in preparation. All R code and data to accompany this chapter and the book are gradually being made available through https://github.com/pfryz/cpdds.


title: Exponential Lower Bounds on the Double Oracle Algorithm in Zero-Sum Games

abstract: The double oracle algorithm is a popular method of solving games, because it is able to reduce computing equilibria to computing a series of best responses. However, its theoretical properties are not well understood. In this paper, we provide exponential lower bounds on the performance of the double oracle algorithm in both partially-observable stochastic games (POSGs) and extensive-form games (EFGs). Our results depend on what is assumed about the tiebreaking scheme -- that is, which meta-Nash equilibrium or best response is chosen, in the event that there are multiple to pick from. In particular, for EFGs, our lower bounds require adversarial tiebreaking, whereas for POSGs, our lower bounds apply regardless of how ties are broken.


title: Estimating Value at Risk and Expected Shortfall: A Brief Review and Some New Developments

abstract: Value-at-risk (VaR) and expected shortfall (ES) are two commonly utilized metrics for quantifying financial risk. In this study, we review the widely employed Generalized Autoregressive Conditional Heteroskedasticity (GARCH) models. These models are explored with diverse distributional assumptions on innovation, including parametric, non-parametric, and `semi-parametric' that incorporates a parametric tail distribution based on extreme value theory. Additionally, we introduce a non-parametric local linear quantile autoregression (LLQAR) with kernel weights depending on the distance between the current loss and past losses, and decreasing in the time lag. To evaluate the performance of different methods for VaR and ES estimation, we employ a multi-criteria approach. This involves mean squared error assessment using simulated data, backtesting on both simulated data and US stocks, and application of the ESBootstrap test. The LLQAR method, which does not necessarily require stationarity assumptions, seems to perform better for simulated non-stationary data as well as real-world data, for estimating VaR and ES.


title: Riemannian Statistics for Any Type of Data

abstract: This paper introduces a novel approach to statistics and data analysis, departing from the conventional assumption of data residing in Euclidean space to consider a Riemannian Manifold. The challenge lies in the absence of vector space operations on such manifolds. Pennec X. et al. in their book Riemannian Geometric Statistics in Medical Image Analysis proposed analyzing data on Riemannian manifolds through geometry, this approach is effective with structured data like medical images, where the intrinsic manifold structure is apparent. Yet, its applicability to general data lacking implicit local distance notions is limited. We propose a solution to generalize Riemannian statistics for any type of data.


title: LLM-Generated Black-box Explanations Can Be Adversarially Helpful

abstract: Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and outputs of these problems, i.e., in a ``black-box'' approach. However, our research uncovers a hidden risk tied to this approach, which we call *adversarial helpfulness*. This happens when an LLM's explanations make a wrong answer look right, potentially leading people to trust incorrect solutions. In this paper, we show that this issue affects not just humans, but also LLM evaluators. Digging deeper, we identify and examine key persuasive strategies employed by LLMs. Our findings reveal that these models employ strategies such as reframing the questions, expressing an elevated level of confidence, and cherry-picking evidence to paint misleading answers in a credible light. To examine if LLMs are able to navigate complex-structured knowledge when generating adversarially helpful explanations, we create a special task based on navigating through graphs. Most LLMs are not able to find alternative paths along simple graphs, indicating that their misleading explanations aren't produced by only logical deductions using complex knowledge. These findings shed light on the limitations of the black-box explanation setting and allow us to provide advice on the safe usage of LLMs.


title: LEO Satellite Network Access in the Wild: Potentials, Experiences, and Challenges

abstract: In the past three years, working with the Pacific Salmon Foundation and various First Nations groups, we have established Starlink-empowered wild salmon monitoring sites in remote Northern British Columbia, Canada. We report our experiences with the network services in these challenging environments, including deep woods and deep valleys, that lack infrastructural support with some close to Starlink's service boundary at the far north. We assess the portability and mobility of the satellite dishes and the quality of existing network access in underdeveloped countries that Starlink expects to cover. Our experiences suggest that network access based on LEO satellite constellations holds promise but faces hurdles such as energy supply constraints and environmental factors like temperature, precipitation, and solar storms. The presence of wildlife and respecting local residents' culture and heritage pose further complications. We envision several technical solutions addressing the challenges and believe that further regulations will be necessary.


title: Summarizing Radiology Reports Findings into Impressions

abstract: Patient hand-off and triage are two fundamental problems in health care. Often doctors must painstakingly summarize complex findings to efficiently communicate with specialists and quickly make decisions on which patients have the most urgent cases. In pursuit of these challenges, we present (1) a model with state-of-art radiology report summarization performance using (2) a novel method for augmenting medical data, and (3) an analysis of the model limitations and radiology knowledge gain. We also provide a data processing pipeline for future models developed on the the MIMIC CXR dataset. Our best performing model was a fine-tuned BERT-to-BERT encoder-decoder with 58.75/100 ROUGE-L F1, which outperformed specialized checkpoints with more sophisticated attention mechanisms. We investigate these aspects in this work.


title: Continuous-Time and Discrete-Time Quasilinear Systems with Asymptotically Unpredictable Solutions

abstract: A novel type of trajectory on semiflows, called asymptotically unpredictable, was proposed by Fen and Tokmak Fen [15]. The presence of sensitivity, which is an indispensable feature of chaotic dynamics, is a crucial property that arises from such trajectories. In the present paper, we show the existence and uniqueness of asymptotically unpredictable solutions for quasilinear systems with delay making benefit of the contraction mapping principle. Additionally, we introduce the notion of an asymptotically unpredictable sequence. It is verified that there exist asymptotically unpredictable sequences which are not unpredictable. Discrete-time equations possessing asymptotically unpredictable orbits are also under investigation. Examples of continuous-time and discrete-time systems with asymptotically unpredictable solutions are provided.


title: Time-of-arrival Estimation and Phase Unwrapping of Head-related Transfer Functions With Integer Linear Programming

abstract: In binaural audio synthesis, aligning head-related impulse responses (HRIRs) in time has been an important pre-processing step, enabling accurate spatial interpolation and efficient data compression. The maximum correlation time delay between spatially nearby HRIRs has previously been used to get accurate and smooth alignment by solving a matrix equation in which the solution has the minimum Euclidean distance to the time delay. However, the Euclidean criterion could lead to an over-smoothing solution in practice. In this paper, we solve the smoothing issue by formulating the task as solving an integer linear programming problem equivalent to minimising an $L^1$-norm. Moreover, we incorporate 1) the cross-correlation of inter-aural HRIRs, and 2) HRIRs with their minimum-phase responses to have more reference measurements for optimisation. We show the proposed method can get more accurate alignments than the Euclidean-based method by comparing the spectral reconstruction loss of time-aligned HRIRs using spherical harmonics representation on seven HRIRs consisting of human and dummy heads. The extra correlation features and the $L^1$-norm are also beneficial in extremely noisy conditions. In addition, this method can be applied to phase unwrapping of head-related transfer functions, where the unwrapped phase could be a compact feature for downstream tasks.


title: A (Weakly) Polynomial Algorithm for AIVF Coding

abstract: It is possible to improve upon Tunstall coding using a collection of multiple parse trees. The best such results so far are Iwata and Yamamoto's maximum cost AIVF codes. The most efficient algorithm for designing such codes is an iterative one that could run in exponential time. In this paper, we show that this problem fits into the framework of a newly developed technique that uses linear programming with the Ellipsoid method to solve the minimum cost Markov chain problem. This permits constructing maximum cost AIVF codes in (weakly) polynomial time.


title: An Empirical Study on the Effectiveness of Large Language Models for SATD Identification and Classification

abstract: Self-Admitted Technical Debt (SATD), a concept highlighting sub-optimal choices in software development documented in code comments or other project resources, poses challenges in the maintainability and evolution of software systems. Large language models (LLMs) have demonstrated significant effectiveness across a broad range of software tasks, especially in software text generation tasks. Nonetheless, their effectiveness in tasks related to SATD is still under-researched. In this paper, we investigate the efficacy of LLMs in both identification and classification of SATD. For both tasks, we investigate the performance gain from using more recent LLMs, specifically the Flan-T5 family, across different common usage settings. Our results demonstrate that for SATD identification, all fine-tuned LLMs outperform the best existing non-LLM baseline, i.e., the CNN model, with a 4.4% to 7.2% improvement in F1 score. In the SATD classification task, while our largest fine-tuned model, Flan-T5-XL, still led in performance, the CNN model exhibited competitive results, even surpassing four of six LLMs. We also found that the largest Flan-T5 model, i.e., Flan-T5-XXL, when used with a zero-shot in-context learning (ICL) approach for SATD identification, provides competitive results with traditional approaches but performs 6.4% to 9.2% worse than fine-tuned LLMs. For SATD classification, few-shot ICL approach, incorporating examples and category descriptions in prompts, outperforms the zero-shot approach and even surpasses the fine-tuned smaller Flan-T5 models. Moreover, our experiments demonstrate that incorporating contextual information, such as surrounding code, into the SATD classification task enables larger fine-tuned LLMs to improve their performance.


title: Tackling Execution-Based Evaluation for NL2Bash

abstract: Given recent advancement of Large Language Models (LLMs), the task of translating from natural language prompts to different programming languages (code generation) attracts immense attention for wide application in different domains. Specially code generation for Bash (NL2Bash) is widely used to generate Bash scripts for automating different tasks, such as performance monitoring, compilation, system administration, system diagnostics, etc. Besides code generation, validating synthetic code is critical before using them for any application. Different methods for code validation are proposed, both direct (execution evaluation) and indirect validations (i.e. exact/partial match, BLEU score). Among these, Execution-based Evaluation (EE) can validate the predicted code by comparing the execution output of model prediction and expected output in system. However, designing and implementing such an execution-based evaluation system for NL2Bash is not a trivial task. In this paper, we present a machinery for execution-based evaluation for NL2Bash. We create a set of 50 prompts to evaluate some popular LLMs for NL2Bash. We also analyze several advantages and challenges of EE such as syntactically different yet semantically equivalent Bash scripts generated by different LLMs, or syntactically correct but semantically incorrect Bash scripts, and how we capture and process them correctly.


title: Large Language Model in Financial Regulatory Interpretation

abstract: This study explores the innovative use of Large Language Models (LLMs) as analytical tools for interpreting complex financial regulations. The primary objective is to design effective prompts that guide LLMs in distilling verbose and intricate regulatory texts, such as the Basel III capital requirement regulations, into a concise mathematical framework that can be subsequently translated into actionable code. This novel approach aims to streamline the implementation of regulatory mandates within the financial reporting and risk management systems of global banking institutions. A case study was conducted to assess the performance of various LLMs, demonstrating that GPT-4 outperforms other models in processing and collecting necessary information, as well as executing mathematical calculations. The case study utilized numerical simulations with asset holdings -- including fixed income, equities, currency pairs, and commodities -- to demonstrate how LLMs can effectively implement the Basel III capital adequacy requirements.


title: Spectral parameter power series representation for regular solutions of the radial Dirac system

abstract: A spectral parameter power series (SPPS) representation for the regular solution of the radial Dirac system with complex coefficients is obtained, as well as a SPPS representation for the (entire) characteristic function of the corresponding spectral problem on a finite interval. Based on the SPPS representation, a numerical method for solving spectral problems is developed. It is shown that the method is also applicable to solving spectral problems for perturbed Bessel equations. We exhibit that the proposed numerical method delivers excellent results. Additionally, an application of the method to find the energy values of hydrogen-like atoms with a finite radius is presented.


title: Simulating Light Propagation through Biological Media Using Monte-Carlo Method

abstract: Biological tissues are complex structures composed of many elements which make light-based tissue diagnostics challenging. Over the past decades, Monte Carlo technique has been used as a fundamental and versatile approach toward modeling photon-tissue interactions. This report first describes a MC simulation of steady-state light transport in an absorbing and diffusing multi-layered structure. Further, a parallel processing solution is implemented to reduce execution time and memory requirements. Then, the nonparametric phase function, which is a discretized version of the phase function, has been discussed where the integration of the phase function is a numerical process, instead of an analytical operation. Finally, to simulate more realistic structures of biological systems, simulations are modified to incorporate objects of various shapes (sphere, ellipsoid, or cylinder) with a refractive-index mismatched boundary. The output files mainly contain 2D reflection matrix, 2D transmission matrix, and 3D absorption matrix.


title: Shared Virtual Memory: Its Design and Performance Implications for Diverse Applications

abstract: Discrete GPU accelerators, while providing massive computing power for supercomputers and data centers, have their separate memory domain. Explicit memory management across device and host domains in programming is tedious and error-prone. To improve programming portability and productivity, Unified Memory (UM) integrates GPU memory into the host virtual memory systems, and provides transparent data migration between them and GPU memory oversubscription. Nevertheless, current UM technologies cause significant performance loss for applications. With AMD GPUs increasingly being integrated into the world's leading supercomputers, it is necessary to understand their Shared Virtual Memory (SVM) and mitigate the performance impacts. In this work, we delve into the SVM design, examine its interactions with applications' data accesses at fine granularity, and quantitatively analyze its performance effects on various applications and identify the performance bottlenecks. Our research reveals that SVM employs an aggressive prefetching strategy for demand paging. This prefetching is efficient when GPU memory is not oversubscribed. However, in tandem with the eviction policy, it causes excessive thrashing and performance degradation for certain applications under oversubscription. We discuss SVM-aware algorithms and SVM design changes to mitigate the performance impacts. To the best of our knowledge, this work is the first in-depth and comprehensive study for SVM technologies.


title: A generation theorem for the perturbation of strongly continuous semigroups by unbounded operators

abstract: In this paper we study the well-posedness of the evolution equation of the form $u'(t)=Au(t)+Cu(t)$, $t\ge 0$, where $A$ is the generator of a $C_0$- semigroup and $C$ is a (possibly unbounded) linear operator in a Banach space $\mathbb{X}$. We prove that if $A$ generates a $C_0$-semigroup $\left (T_A(t)\right )_{t \geq 0}$ with $\|T(t)\| \le Me^{\omega t}$ in a Banach space $\mathbb{X}$ and $C$ is a linear operator in $\mathbb{X}$ such that $D(A)\subset D(C)$ and $\| CR(\mu ,A)\| \le K/(\mu -\omega)$ for each $\mu>\omega$, then, the above-mentioned evolution equation is well-posed, that is, $A+C$ generates a $C_0$-semigroup $\left (T_{A+C}(t)\right )_{t \geq 0}$ satisfying $\| T_{A+C}(t)\| \le Me^{(\omega +MK)t}$. Our approach is to use the Hille-Yosida Theorem. Discussions on the persistence of asymptotic behavior of the perturbed equations such as the roughness of exponential dichotomy are also given. The obtained results seem to be new.


title: A note on distance variance for categorical variables

abstract: This study investigates the extension of distance variance, a validated spread metric for continuous and binary variables [Edelmann et al., 2020, Ann. Stat., 48(6)], to quantify the spread of general categorical variables. We provide both geometric and algebraic characterizations of distance variance, revealing its connections to some commonly used entropy measures, and the variance-covariance matrix of the one-hot encoded representation. However, we demonstrate that distance variance fails to satisfy the Schur-concavity axiom for categorical variables with more than two categories, leading to counterintuitive results. This limitation hinders its applicability as a universal measure of spread.


title: Dual-Task Vision Transformer for Rapid and Accurate Intracerebral Hemorrhage Classification on CT Images

abstract: Intracerebral hemorrhage (ICH) is a severe and sudden medical condition caused by the rupture of blood vessels in the brain, leading to permanent damage to brain tissue and often resulting in functional disabilities or death in patients. Diagnosis and analysis of ICH typically rely on brain CT imaging. Given the urgency of ICH conditions, early treatment is crucial, necessitating rapid analysis of CT images to formulate tailored treatment plans. However, the complexity of ICH CT images and the frequent scarcity of specialist radiologists pose significant challenges. Therefore, we built a dataset for ICH and normal classification and three types of ICH image classification based on the hemorrhage location, i.e., Deep, Subcortical, and Lobar. In addition, we propose a dual-task vision transformer (DTViT) for the automated classification and diagnosis of ICH images. This neural network utilizes the encoder from ViT, employing attention mechanisms for feature extraction from CT images. We incorporated two multilayer perception (MLP)-based decoders within the network to simultaneously identify the presence of ICH and classify three types of hemorrhage locations. Experimental results demonstrate that our proposed multi-classification network performs well on the built real-world test dataset. The code and dataset for this study will be made publicly available upon paper acceptance at: https://github.com/Jialiangfan/ICH-classification.


title: Exploring Large-Volume GAGG Scintillators for use in MeV Gamma-Ray Astrophysics

abstract: Gamma-ray astrophysics in the MeV band is an exciting field in astronomy due to its potential for multi-messenger astrophysics. It has, however, remained under-explored when compared to other wavelengths. One reason for this observational gap is the difficulties with measuring these high-energy photons and the requirement of large amounts of detection material. In this work, we investigate the usage of large-volume GAGG scintillators for use as a calorimeter in future MeV telescopes. We developed a $5\times5$ array calorimeter utilizing $1\times1\times6 \ \mathrm{cm}^3$ GAGG crystals with C-series SiPM readout. The calorimeter was tested at the High Intensity Gamma-ray Facility (HIGS) with monoenergetic beams ranging from $2-25 \ \mathrm{MeV}$. Finally, we also investigated larger $1\times1\times8 \ \mathrm{cm}^3$ crystals and characterized their response across their depth when their surface treatment is either polished or frosted.


title: Non-stationary Domain Generalization: Theory and Algorithm

abstract: Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with such an issue and it aims to learn a model from multiple source domains that can be generalized to unseen target domains. Existing studies on DG have largely focused on stationary settings with homogeneous source domains. However, in many applications, domains may evolve along a specific direction (e.g., time, space). Without accounting for such non-stationary patterns, models trained with existing methods may fail to generalize on OOD data. In this paper, we study domain generalization in non-stationary environment. We first examine the impact of environmental non-stationarity on model performance and establish the theoretical upper bounds for the model error at target domains. Then, we propose a novel algorithm based on adaptive invariant representation learning, which leverages the non-stationary pattern to train a model that attains good performance on target domains. Experiments on both synthetic and real data validate the proposed algorithm.


title: Coherent Design of Wind Turbine Controllers Considering Transitions between Operating Regions using Fuzzy Membership Functions

abstract: This paper presents a coherent design of wind turbine controllers with explicit consideration of transitions between operating regions by fuzzy membership functions. In improving the design process of wind turbines, the transitions between partial-load operation by torque control and full-load operation by pitch control need to be systematically considered. From the first view, fuzzy methods for blending separately designed control laws are an obvious choice. However, valid design rules must be developed to ensure stability and performance during the transition. A model-based control design procedure in the Takagi-Sugeno fuzzy framework using the sector nonlinearity method is proposed to achieve the above control design objectives. In addition to a detailed mathematical analysis of the design, the method's applicability is verified by simulation studies using a high-fidelity reference wind turbine model.


title: The Ghanaian NLP Landscape: A First Look

abstract: Despite comprising one-third of global languages, African languages are critically underrepresented in Artificial Intelligence (AI), threatening linguistic diversity and cultural heritage. Ghanaian languages, in particular, face an alarming decline, with documented extinction and several at risk. This study pioneers a comprehensive survey of Natural Language Processing (NLP) research focused on Ghanaian languages, identifying methodologies, datasets, and techniques employed. Additionally, we create a detailed roadmap outlining challenges, best practices, and future directions, aiming to improve accessibility for researchers. This work serves as a foundational resource for Ghanaian NLP research and underscores the critical need for integrating global linguistic diversity into AI development.


title: Black Hole-Neutron Star Binaries near Neutron Star Disruption Limit in the Mass Regime of Event GW230529

abstract: In May 2023, the LIGO Livingston observatory detected the likely black hole-neutron star (BHNS) merger GW230529_181500. That event is expected to be the merger of a 2.5-4.5 $M_{\odot}$ primary with a secondary compact object of mass between 1.2-2.0 $M_{\odot}$. This makes it the first BHNS merger with a significant potential for the production of electromagnetic (EM) counterparts, and provides further evidence for compact objects existing within the suspected lower mass gap. To produce post-merger EM transients, the component of the black hole spin aligned with the orbital angular momentum must be sufficiently high, allowing the neutron star to be tidally disrupted. The disrupting BHNS binary may then eject a few percent of a solar mass of matter, leading to an observable kilonova driven by radioactive decays in ejecta, and/or a compact-binary GRB (cbGRB) resulting from the formation of an accretion disk and relativistic jet. Determining which mergers lead to disruption of the neutron star is necessary to predict the prevalence of EM signals from BHNS mergers, yet most BHNS simulations so far have been performed far from the minimum spin required for tidal disruption. Here, we use the Spectral Einstein Code (SpEC) to explore the behavior of BHNS mergers in a mass range consistent with GW230529_181500 close to that critical spin, and compare our results against the mass remnant model currently used by the LVK collaboration to predict the probability of tidal disruption. Our numerical results reveal the emergence of non-zero accretion disks even below the predicted NS disruption limit, of low mass but capable of powering cbGRBs. Our results also demonstrate that the remnant mass model underpredicts the disk mass for the DD2 EOS, while they are within expected modeling errors for SFHo. In all of our simulations, any kilonova signal would be dim and dominated by post-merger disk outflows.


title: CMB-PAInT: An inpainting tool for the cosmic microwave background

abstract: The presence of astrophysical emissions in microwave observations forces us to perform component separation to extract the Cosmic Microwave Background (CMB) signal. However, even in the most optimistic cases, there are still strongly contaminated regions, such as the Galactic plane or those with emission from extragalactic point sources, which require the use of a mask. Since many CMB analyses, especially the ones working in harmonic space, need the whole sky map, it is crucial to develop a reliable inpainting algorithm that replaces the values of the excluded pixels by others statistically compatible with the rest of the sky. This is especially important when working with $Q$ and $U$ sky maps in order to obtain $E$- and $B$-mode maps which are free from $E$-to-$B$ leakage. In this work we study a method based on Gaussian Constrained Realizations (GCR), that can deal with both intensity and polarization. Several tests have been performed to asses the validation of the method, including the study of the one-dimensional probability distribution function (1-PDF), E- and B-mode map reconstruction, and power spectra estimation. We have considered two scenarios for the input simulation: one case with only CMB signal and a second one including also Planck PR4 semi-realistic noise. Even if we are limited to low resolution maps, $N_{\mathrm{side}} = $ 64 if $T$, $Q$ and $U$ are considered, we believe that this is a useful approach to be applied to future missions such as LiteBIRD, where the target are the largest scales.


title: Synchronized Object Detection for Autonomous Sorting, Mapping, and Quantification of Medical Materials

abstract: The circular economy paradigm is gaining interest as a solution to reduce both material supply uncertainties and waste generation. One of the main challenges is monitoring materials, since in general, something that is not measured cannot be effectively managed. In this paper, we propose real-time synchronized object detection to enable, at the same time, autonomous sorting, mapping, and quantification of end-of-life medical materials. Dataset, code, and demo videos are publicly available.


title: MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis

abstract: Federated learning is widely used in medical applications for training global models without needing local data access. However, varying computational capabilities and network architectures (system heterogeneity), across clients pose significant challenges in effectively aggregating information from non-independently and identically distributed (non-IID) data. Current federated learning methods using knowledge distillation require public datasets, raising privacy and data collection issues. Additionally, these datasets require additional local computing and storage resources, which is a burden for medical institutions with limited hardware conditions. In this paper, we introduce a novel federated learning paradigm, named Model Heterogeneous personalized Federated Learning via Injection and Distillation (MH-pFLID). Our framework leverages a lightweight messenger model that carries concentrated information to collect the information from each client. We also develop a set of receiver and transmitter modules to receive and send information from the messenger model, so that the information could be injected and distilled with efficiency.


title: PLeak: Prompt Leaking Attacks against Large Language Model Applications

abstract: Large Language Models (LLMs) enable a new ecosystem with many downstream applications, called LLM applications, with different natural language processing tasks. The functionality and performance of an LLM application highly depend on its system prompt, which instructs the backend LLM on what task to perform. Therefore, an LLM application developer often keeps a system prompt confidential to protect its intellectual property. As a result, a natural attack, called prompt leaking, is to steal the system prompt from an LLM application, which compromises the developer's intellectual property. Existing prompt leaking attacks primarily rely on manually crafted queries, and thus achieve limited effectiveness. In this paper, we design a novel, closed-box prompt leaking attack framework, called PLeak, to optimize an adversarial query such that when the attacker sends it to a target LLM application, its response reveals its own system prompt. We formulate finding such an adversarial query as an optimization problem and solve it with a gradient-based method approximately. Our key idea is to break down the optimization goal by optimizing adversary queries for system prompts incrementally, i.e., starting from the first few tokens of each system prompt step by step until the entire length of the system prompt. We evaluate PLeak in both offline settings and for real-world LLM applications, e.g., those on Poe, a popular platform hosting such applications. Our results show that PLeak can effectively leak system prompts and significantly outperforms not only baselines that manually curate queries but also baselines with optimized queries that are modified and adapted from existing jailbreaking attacks. We responsibly reported the issues to Poe and are still waiting for their response. Our implementation is available at this repository: https://github.com/BHui97/PLeak.


title: A Quasi-Newton Primal-Dual Algorithm with Line Search

abstract: Quasi-Newton methods refer to a class of algorithms at the interface between first and second order methods. They aim to progress as substantially as second order methods per iteration, while maintaining the computational complexity of first order methods. The approximation of second order information by first order derivatives can be expressed as adopting a variable metric, which for (limited memory) quasi-Newton methods is of type ``identity $\pm$ low rank''. This paper continues the effort to make these powerful methods available for non-smooth systems occurring, for example, in large scale Machine Learning applications by exploiting this special structure. We develop a line search variant of a recently introduced quasi-Newton primal-dual algorithm, which adds significant flexibility, admits larger steps per iteration, and circumvents the complicated precalculation of a certain operator norm. We prove convergence, including convergence rates, for our proposed method and outperform related algorithms in a large scale image deblurring application.


title: Inverse Cluster Magnification Problem and Cluster Towers

abstract: Inspired from the work of M Krithika and P Vanchinathan on Cluster Magnification, we state the Inverse Cluster Magnification Problem in this article and establish an equivalent criterion for that. We provide an important example answering a question about Cluster Towers. We also provide some generalisations and alternate proofs of results of Perlis and results of Krithika and Vanchinathan on Cluster Size.


title: A Nominal Approach to Probabilistic Separation Logic

abstract: Currently, there is a gap between the tools used by probability theorists and those used in formal reasoning about probabilistic programs. On the one hand, a probability theorist decomposes probabilistic state along the simple and natural product of probability spaces. On the other hand, recently developed probabilistic separation logics decompose state via relatively unfamiliar measure-theoretic constructions for computing unions of sigma-algebras and probability measures. We bridge the gap between these two perspectives by showing that these two methods of decomposition are equivalent up to a suitable equivalence of categories. Our main result is a probabilistic analog of the classic equivalence between the category of nominal sets and the Schanuel topos. Through this equivalence, we validate design decisions in prior work on probabilistic separation logic and create new connections to nominal-set-like models of probability.


title: Acceleration of Power System Dynamic Simulations using a Deep Equilibrium Layer and Neural ODE Surrogate

abstract: The dominant paradigm for power system dynamic simulation is to build system-level simulations by combining physics-based models of individual components. The sheer size of the system along with the rapid integration of inverter-based resources exacerbates the computational burden of running time domain simulations. In this paper, we propose a data-driven surrogate model based on implicit machine learning -- specifically deep equilibrium layers and neural ordinary differential equations -- to learn a reduced order model of a portion of the full underlying system. The data-driven surrogate achieves similar accuracy and reduction in simulation time compared to a physics-based surrogate, without the constraint of requiring detailed knowledge of the underlying dynamic models. This work also establishes key requirements needed to integrate the surrogate into existing simulation workflows; the proposed surrogate is initialized to a steady state operating point that matches the power flow solution by design.


title: G-FARS: Gradient-Field-based Auto-Regressive Sampling for 3D Part Grouping

abstract: This paper proposes a novel task named "3D part grouping". Suppose there is a mixed set containing scattered parts from various shapes. This task requires algorithms to find out every possible combination among all the parts. To address this challenge, we propose the so called Gradient Field-based Auto-Regressive Sampling framework (G-FARS) tailored specifically for the 3D part grouping task. In our framework, we design a gradient-field-based selection graph neural network (GNN) to learn the gradients of a log conditional probability density in terms of part selection, where the condition is the given mixed part set. This innovative approach, implemented through the gradient-field-based selection GNN, effectively captures complex relationships among all the parts in the input. Upon completion of the training process, our framework becomes capable of autonomously grouping 3D parts by iteratively selecting them from the mixed part set, leveraging the knowledge acquired by the trained gradient-field-based selection GNN. Our code is available at: https://github.com/J-F-Cheng/G-FARS-3DPartGrouping.


title: Model Reference Control for Wind Turbine Systems in Full Load Region based on Takagi-Sugeno Fuzzy Systems

abstract: This paper presents a novel Model Reference Control (MRC) approach for wind turbine (WT) systems in the full load region employing a fuzzy Parallel Distribution Compensation Controller (PDC-C) derived using a Takagi-Sugeno (TS) fuzzy System approach. Through first-order Taylor series expansion, local linear submodels are generated and combined via triangular membership functions to develop a TS descriptor model. From here, the MRC PDC-C is synthesized by a constrained LMI optimization procedure, including damping characteristics of the elastic drive train, to track the desired rotor speed and generator torque based on the reference model dynamics. The controller is tested on the nonlinear WT model in simulation studies under various wind conditions, such as turbulent wind, wind gusts, and a Fault Ride Through (FRT) scenario where the generator torque is set to 0 p.u. for 150 ms.


title: Towards Browser Controls to Protect Cookies from Malicious Extensions

abstract: Cookies provide a state management mechanism for the web and are often used for authentication, storing a user's session ID, and replacing their credentials in subsequent requests. These ``session cookies'' are valuable targets of attacks such as Session Hijacking and Fixation that attempt to steal them and gain unauthorized access to user accounts. Multiple controls such as the Secure and HttpOnly cookie attributes restrict cookie accessibility, effectively mitigating attacks from the network or malicious websites, but often ignoring untrusted extensions within the user's browser. Extensions are third-party HTML/JavaScript add-ons with access to several privileged APIs and can run on multiple websites at once. Unfortunately, this can provide malicious/compromised extensions with unrestricted access to session cookies. In this work, we first conduct a study assessing the prevalence of extensions with these ``risky'' APIs (i.e., those enabling cookie modification and theft) and find that they are currently used by hundreds of millions of users. Motivated by this, we propose browser controls based on two new cookie attributes that protect cookies from malicious extensions: BrowserOnly and Tracked. The BrowserOnly attribute prevents accessing cookies from extensions altogether. While effective, not all cookies can be inaccessible. Cookies with the Tracked attribute remain accessible, are tied to a single browser, and record any modifications made by extensions. Thus, stolen Tracked cookies become unusable outside their original browser and servers can verify any modifications. To demonstrate these features' practicality, we implement CREAM (Cookie Restrictions for Extension Abuse Mitigation): a modified version of Chromium realizing these controls. Our evaluation indicates that CREAM controls effectively protect cookies from malicious extensions while incurring small run-time overheads.


title: Better Algorithms for Constructing Minimum Cost Markov Chains and AIFV Codes

abstract: The problem of constructing optimal AIFV codes is a special case of that of constructing minimum cost Markov Chains. This paper provides the first complete proof of correctness for the previously known iterative algorithm for constructing such Markov chains. A recent work describes how to efficiently solve the Markov Chain problem by first constructing a Markov Chain Polytope and then running the Ellipsoid algorithm for linear programming on it. This paper's second result is that, in the AIFV case, a special property of the polytope instead permits solving the corresponding linear program using simple binary search


title: Concolic Testing of JavaScript using Sparkplug

abstract: JavaScript is prevalent in web and server apps, handling sensitive data. JS testing methods lag behind other languages. Insitu concolic testing for JS is effective but slow and complex. Our method enhances tracing with V8 Sparkplug baseline compiler and remill libraries for assembly to LLVM IR conversion. Evaluation on 160 Node.js libraries reveals comparable coverage and bug detection in significantly less time than the in-situ method.


title: Impact of pulse exposure on chimera state in ensemble of FitzHugh-Nagumo systems

abstract: In this article we consider the influence of a periodic sequence of Gaussian pulses on a chimera state in a ring of coupled FitzHugh-Nagumo systems. We found that on the way to complete spatial synchronization one can observe a number of variations of chimera states that are not typical for the parameter range under consideration. For example, the following modes were found: breathing chimera, chimera with intermittency in the incoherent part, traveling chimera with strong intermittency, and others. For comparison, here we also consider the impact of a harmonic influence on the same chimera, and to preserve the generality of the conclusions, we compare the regimes caused by both a purely positive harmonic influence and a positive-negative one.


title: Memory-induced long-range order in dynamical systems

abstract: Time non-locality, or memory, is a non-equilibrium property shared by all physical systems. It means that when a system's state is perturbed, it is still affected by the perturbation at a later time. Here, we show that such a memory effect is sufficient to induce a phase of spatial long-range order (LRO) even if the system's dynamical variables are coupled locally. This occurs when the memory degrees of freedom have slower dynamics than the system's degrees of freedom. In addition, such a LRO phase is non-perturbative and attractive to the system, but its existence does not necessarily imply criticality. When the two degrees of freedom have comparable time scales, the length of the effective long-range interaction shortens. We exemplify this behavior with a model of locally coupled spins and a single dynamic memory variable, but our analysis is sufficiently general to suggest that memory could induce a phase of LRO in a much wider variety of physical systems.


title: Automating Code Adaptation for MLOps -- A Benchmarking Study on LLMs

abstract: This paper explores the possibilities of the current generation of Large Language Models for incorporating Machine Learning Operations (MLOps) functionalities into ML training code bases. We evaluate the performance of OpenAI (gpt-3.5-turbo) and WizardCoder (open-source, 15B parameters) models on the automated accomplishment of various MLOps functionalities in different settings. We perform a benchmarking study that assesses the ability of these models to: (1) adapt existing code samples (Inlining) with component-specific MLOps functionality such as MLflow and Weights & Biases for experiment tracking, Optuna for hyperparameter optimization etc., and (2) perform the task of Translation from one component of an MLOps functionality to another, e.g., translating existing GitPython library based version control code to Data Version Control library based. We also propose three different approaches that involve teaching LLMs to comprehend the API documentation of the components as a reference while accomplishing the Translation tasks. In our evaluations, the gpt-3.5-turbo model significantly outperforms WizardCoder by achieving impressive Pass@3 accuracy in model optimization (55% compared to 0% by WizardCoder), experiment tracking (100%, compared to 62.5% by WizardCoder), model registration (92% compared to 42% by WizardCoder) and hyperparameter optimization (83% compared to 58% by WizardCoder) on average, in their best possible settings, showcasing its superior code adaptability performance in complex MLOps tasks.


title: Improving Targeted Molecule Generation through Language Model Fine-Tuning Via Reinforcement Learning

abstract: Developing new drugs is laborious and costly, demanding extensive time investment. In this study, we introduce an innovative de-novo drug design strategy, which harnesses the capabilities of language models to devise targeted drugs for specific proteins. Employing a Reinforcement Learning (RL) framework utilizing Proximal Policy Optimization (PPO), we refine the model to acquire a policy for generating drugs tailored to protein targets. Our method integrates a composite reward function, combining considerations of drug-target interaction and molecular validity. Following RL fine-tuning, our approach demonstrates promising outcomes, yielding notable improvements in molecular validity, interaction efficacy, and critical chemical properties, achieving 65.37 for Quantitative Estimation of Drug-likeness (QED), 321.55 for Molecular Weight (MW), and 4.47 for Octanol-Water Partition Coefficient (logP), respectively. Furthermore, out of the generated drugs, only 0.041\% do not exhibit novelty.


title: Regular Ring Properties Degraded Through Inverse Limits

abstract: We give a number of constructions where inverse limits seriously degrade properties of regular rings, such as unit-regularity, diagonalisation of matrices, and finite stable rank. This raises the possibility of using inverse limits to answer the long standing Separativity Problem (in the negative).


title: Merging Point Data for InSAR Deformation Processing

abstract: Given a collection of points $S \subset \mathbb{R}^N$, which is partitioned into $M$ overlapping subsets $\{S_i\}_{i=1}^M$, and approximate data $\{D_i\}_{i=1}^M$ associated with the subsets, one may seek a consistent merged dataset $D$ that is derived from $\{S_i\}_{i=1}^M$ and $\{D_i\}_{i=1}^M$. This note presents a method for constructing $D$ under the assumption that $D$ represents discrete samples of a suitably smooth function $f:\mathbb{R}^N \rightarrow \mathbb{R}$ evaluated at the points in $S$. The method has two steps. The first step uses a least-squares solve to approximate the constant offsets for each $D_i$. The second step uses a sequence of discrete Dirichlet problems to resolve any remaining differences. We include a two dimensional example of this method applied to deformation measurements derived from Interferometric Synthetic Aperture Radar (InSAR).


title: Results from the CsI Calorimeter onboard the 2023 ComPair Balloon Flight

abstract: The ComPair gamma-ray telescope is a technology demonstrator for a future gamma-ray telescope called the All-sky Medium Energy Gamma-ray Observatory (AMEGO). The instrument is composed of four subsystems, a double-sided silicon strip detector, a virtual Frisch grid CdZnTe calorimeter, a CsI:Tl based calorimeter, and an anti-coincidence detector (ACD). The CsI calorimeter's goal is to measure the position and energy deposited from high-energy events. To demonstrate the technological readiness, the calorimeter has flown onboard a NASA scientific balloon as part of the GRAPE-ComPair mission and accumulated around 3 hours of float time at an altitude of 40 km. During the flight, the CsI calorimeter observed background radiation, Regener-Pfotzer Maximum, and several gamma-ray activation lines originating from aluminum.


title: MEIC: Re-thinking RTL Debug Automation using LLMs

abstract: The deployment of Large Language Models (LLMs) for code debugging (e.g., C and Python) is widespread, benefiting from their ability to understand and interpret intricate concepts. However, in the semiconductor industry, utilising LLMs to debug Register Transfer Level (RTL) code is still insufficient, largely due to the underrepresentation of RTL-specific data in training sets. This work introduces a novel framework, Make Each Iteration Count (MEIC), which contrasts with traditional one-shot LLM-based debugging methods that heavily rely on prompt engineering, model tuning, and model training. MEIC utilises LLMs in an iterative process to overcome the limitation of LLMs in RTL code debugging, which is suitable for identifying and correcting both syntax and function errors, while effectively managing the uncertainties inherent in LLM operations. To evaluate our framework, we provide an open-source dataset comprising 178 common RTL programming errors. The experimental results demonstrate that the proposed debugging framework achieves fix rate of 93% for syntax errors and 78% for function errors, with up to 48x speedup in debugging processes when compared with experienced engineers. The Repo. of dataset and code: https://anonymous.4open.science/r/Verilog-Auto-Debug-6E7F/.


title: Bridging the Gap: Protocol Towards Fair and Consistent Affect Analysis

abstract: The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across diverse subpopulation groups, including age, gender, and race, becomes paramount. Automatic affect analysis, at the intersection of physiology, psychology, and machine learning, has seen significant development. However, existing databases and methodologies lack uniformity, leading to biased evaluations. This work addresses these issues by analyzing six affective databases, annotating demographic attributes, and proposing a common protocol for database partitioning. Emphasis is placed on fairness in evaluations. Extensive experiments with baseline and state-of-the-art methods demonstrate the impact of these changes, revealing the inadequacy of prior assessments. The findings underscore the importance of considering demographic attributes in affect analysis research and provide a foundation for more equitable methodologies. Our annotations, code and pre-trained models are available at: https://github.com/dkollias/Fair-Consistent-Affect-Analysis


title: BitVMX: A CPU for Universal Computation on Bitcoin

abstract: BitVMX is a new design for a virtual CPU to optimistically execute arbitrary programs on Bitcoin based on a challenge response game introduced in BitVM. Similar to BitVM1 we create a general-purpose CPU to be verified in Bitcoin script. Our design supports common architectures, such as RISC-V or MIPS. Our main contribution to the state of the art is a design that uses hash chains of program traces, memory mapped registers, and a new challenge-response protocol. We present a new message linking protocol as a means to allow authenticated communication between the participants. This protocol emulates stateful smart contracts by sharing state between transactions. This provides a basis for our verification game which uses a graph of pre-signed transactions to support challenge-response interactions. In case of a dispute, the hash chain of program trace is used with selective pre-signed transactions to locate (via $n$-ary search) and then recover the precise nature of errors in the computation. Unlike BitVM1, our approach does not require the creation of Merkle trees for CPU instructions or memory words. Additionally, it does not rely on signature equivocations. These differences help avoid complexities associated with BitVM1 and make BitVMX a compelling alternative to BitVM2. Our approach is quite flexible, BitVMX can be instantiated to balance transaction cost vs round complexity, prover cost vs verifier cost, and precomputations vs round complexity.


title: New Procedure for Evaluation of U(3) Coupling and Recoupling Coefficients

abstract: A simple method to calculate Wigner coupling coefficients and Racah recoupling coefficients for U(3) in two group-subgroup chains is presented. While the canonical U(3)->U(2)->U(1) coupling and recoupling coefficients are applicable to any system that respects U(3) symmetry, the U(3)->SO(3) coupling coefficients are more specific to nuclear structure studies. This new procedure precludes the use of binomial coefficients and alternating sums which were used in the 1973 formulation of Draayer and Akiyama, and hence provides faster and more accurate output of requested results. The resolution of the outer multiplicity is based on the null space concept of the U(3) generators proposed by Arne Alex et al., whereas the inner multiplicity in the angular momentum subgroup chain is obtained from the dimension of the null space of the SO(3) raising operator. A C++ library built on this new methodology will be published in a complementary journal that specializes in the management and distribution of such programs.


title: On semidirect products of quantale enriched monoids

abstract: We consider monoids equipped with a compatible quantale valued relation, to which we call quantale enriched monoids, and study semidirect products of such structures. It is well-known that semidirect products of monoids are closely related to Schreier split extensions which, in the setting of monoids, play the role of split extensions of groups. We will thus introduce certain split extensions of quantale enriched monoids, which generalize the classical Schreier split extensions of monoids, and investigate their connections with semidirect products. We then restrict our study to a class of quantale enriched monoids whose behavior mimics the fact that the preorder on a preordered group is completely determined by its cone of positive elements. Finally, we instantiate our results for preordered monoids and compare them with existing literature.


title: CasCalib: Cascaded Calibration for Motion Capture from Sparse Unsynchronized Cameras

abstract: It is now possible to estimate 3D human pose from monocular images with off-the-shelf 3D pose estimators. However, many practical applications require fine-grained absolute pose information for which multi-view cues and camera calibration are necessary. Such multi-view recordings are laborious because they require manual calibration, and are expensive when using dedicated hardware. Our goal is full automation, which includes temporal synchronization, as well as intrinsic and extrinsic camera calibration. This is done by using persons in the scene as the calibration objects. Existing methods either address only synchronization or calibration, assume one of the former as input, or have significant limitations. A common limitation is that they only consider single persons, which eases correspondence finding. We attain this generality by partitioning the high-dimensional time and calibration space into a cascade of subspaces and introduce tailored algorithms to optimize each efficiently and robustly. The outcome is an easy-to-use, flexible, and robust motion capture toolbox that we release to enable scientific applications, which we demonstrate on diverse multi-view benchmarks. Project website: https://github.com/jamestang1998/CasCalib.


title: Dominion: A New Frontier for AI Research

abstract: In recent years, machine learning approaches have made dramatic advances, reaching superhuman performance in Go, Atari, and poker variants. These games, and others before them, have served not only as a testbed but have also helped to push the boundaries of AI research. Continuing this tradition, we examine the tabletop game Dominion and discuss the properties that make it well-suited to serve as a benchmark for the next generation of reinforcement learning (RL) algorithms. We also present the Dominion Online Dataset, a collection of over 2,000,000 games of Dominion played by experienced players on the Dominion Online webserver. Finally, we introduce an RL baseline bot that uses existing techniques to beat common heuristic-based bots, and shows competitive performance against the previously strongest bot, Provincial.


title: Larmor Power Limit for Cyclotron Radiation of Relativistic Particles in a Waveguide

abstract: Cyclotron radiation emission spectroscopy (CRES) is a modern technique for high-precision energy spectroscopy, in which the energy of a charged particle in a magnetic field is measured via the frequency of the emitted cyclotron radiation. The He6-CRES collaboration aims to use CRES to probe beyond the standard model physics at the TeV scale by performing high-resolution and low-background beta-decay spectroscopy of ${}^6\textrm{He}$ and ${}^{19}\textrm{Ne}$. Having demonstrated the first observation of individual, high-energy (0.1 -- 2.5 MeV) positrons and electrons via their cyclotron radiation, the experiment provides a novel window into the radiation of relativistic charged particles in a waveguide via the time-derivative (slope) of the cyclotron radiation frequency, $\mathrm{d}f_\textrm{c}/\mathrm{d}t$. We show that analytic predictions for the total cyclotron radiation power emitted by a charged particle in circular and rectangular waveguides are approximately consistent with the Larmor formula, each scaling with the Lorentz factor of the underlying $e^\pm$ as $\gamma^4$. This hypothesis is corroborated with experimental CRES slope data.


title: ISR: Invertible Symbolic Regression

abstract: We introduce an Invertible Symbolic Regression (ISR) method. It is a machine learning technique that generates analytical relationships between inputs and outputs of a given dataset via invertible maps (or architectures). The proposed ISR method naturally combines the principles of Invertible Neural Networks (INNs) and Equation Learner (EQL), a neural network-based symbolic architecture for function learning. In particular, we transform the affine coupling blocks of INNs into a symbolic framework, resulting in an end-to-end differentiable symbolic invertible architecture that allows for efficient gradient-based learning. The proposed ISR framework also relies on sparsity promoting regularization, allowing the discovery of concise and interpretable invertible expressions. We show that ISR can serve as a (symbolic) normalizing flow for density estimation tasks. Furthermore, we highlight its practical applicability in solving inverse problems, including a benchmark inverse kinematics problem, and notably, a geoacoustic inversion problem in oceanography aimed at inferring posterior distributions of underlying seabed parameters from acoustic signals.


title: GreedyViG: Dynamic Axial Graph Construction for Efficient Vision GNNs

abstract: Vision graph neural networks (ViG) offer a new avenue for exploration in computer vision. A major bottleneck in ViGs is the inefficient k-nearest neighbor (KNN) operation used for graph construction. To solve this issue, we propose a new method for designing ViGs, Dynamic Axial Graph Construction (DAGC), which is more efficient than KNN as it limits the number of considered graph connections made within an image. Additionally, we propose a novel CNN-GNN architecture, GreedyViG, which uses DAGC. Extensive experiments show that GreedyViG beats existing ViG, CNN, and ViT architectures in terms of accuracy, GMACs, and parameters on image classification, object detection, instance segmentation, and semantic segmentation tasks. Our smallest model, GreedyViG-S, achieves 81.1% top-1 accuracy on ImageNet-1K, 2.9% higher than Vision GNN and 2.2% higher than Vision HyperGraph Neural Network (ViHGNN), with less GMACs and a similar number of parameters. Our largest model, GreedyViG-B obtains 83.9% top-1 accuracy, 0.2% higher than Vision GNN, with a 66.6% decrease in parameters and a 69% decrease in GMACs. GreedyViG-B also obtains the same accuracy as ViHGNN with a 67.3% decrease in parameters and a 71.3% decrease in GMACs. Our work shows that hybrid CNN-GNN architectures not only provide a new avenue for designing efficient models, but that they can also exceed the performance of current state-of-the-art models.


title: Identifying Peer Effects in Networks with Unobserved Effort and Isolated Students

abstract: Peer influence on effort devoted to some activity is often studied using proxy variables when actual effort is unobserved. For instance, in education, academic effort is often proxied by GPA. We propose an alternative approach that circumvents this approximation. Our framework distinguishes unobserved shocks to GPA that do not affect effort from preference shocks that do affect effort levels. We show that peer effects estimates obtained using our approach can differ significantly from classical estimates (where effort is approximated) if the network includes isolated students. Applying our approach to data on high school students in the United States, we find that peer effect estimates relying on GPA as a proxy for effort are 40% lower than those obtained using our approach.


title: Nonlinear classification of neural manifolds with contextual information

abstract: Understanding how neural systems efficiently process information through distributed representations is a fundamental challenge at the interface of neuroscience and machine learning. Recent approaches analyze the statistical and geometrical attributes of neural representations as population-level mechanistic descriptors of task implementation. In particular, manifold capacity has emerged as a promising framework linking population geometry to the separability of neural manifolds. However, this metric has been limited to linear readouts. Here, we propose a theoretical framework that overcomes this limitation by leveraging contextual input information. We derive an exact formula for the context-dependent capacity that depends on manifold geometry and context correlations, and validate it on synthetic and real data. Our framework's increased expressivity captures representation untanglement in deep networks at early stages of the layer hierarchy, previously inaccessible to analysis. As context-dependent nonlinearity is ubiquitous in neural systems, our data-driven and theoretically grounded approach promises to elucidate context-dependent computation across scales, datasets, and models.

categories: q-bio.NC cond-mat.dis-nn cond-mat.stat-mech cs.NE stat.ML


title: Possibility Semantics

abstract: In traditional semantics for classical logic and its extensions, such as modal logic, propositions are interpreted as subsets of a set, as in discrete duality, or as clopen sets of a Stone space, as in topological duality. A point in such a set can be viewed as a "possible world," with the key property of a world being primeness--a world makes a disjunction true only if it makes one of the disjuncts true--which classically implies totality--for each proposition, a world either makes the proposition true or makes its negation true. This chapter surveys a more general approach to logical semantics, known as possibility semantics, which replaces possible worlds with possibly partial "possibilities." In classical possibility semantics, propositions are interpreted as regular open sets of a poset, as in set-theoretic forcing, or as compact regular open sets of an upper Vietoris space, as in the recent theory of "choice-free Stone duality." The elements of these sets, viewed as possibilities, may be partial in the sense of making a disjunction true without settling which disjunct is true. We explain how possibilities may be used in semantics for classical logic and modal logics and generalized to semantics for intuitionistic logics. The goals are to overcome or deepen incompleteness results for traditional semantics, to avoid the nonconstructivity of traditional semantics, and to provide richer structures for the interpretation of new languages.