title: NoiSec: Harnessing Noise for Security against Adversarial and Backdoor Attacks

abstract: The exponential adoption of machine learning (ML) is propelling the world into a future of intelligent automation and data-driven solutions. However, the proliferation of malicious data manipulation attacks against ML, namely adversarial and backdoor attacks, jeopardizes its reliability in safety-critical applications. The existing detection methods against such attacks are built upon assumptions, limiting them in diverse practical scenarios. Thus, motivated by the need for a more robust and unified defense mechanism, we investigate the shared traits of adversarial and backdoor attacks and propose NoiSec that leverages solely the noise, the foundational root cause of such attacks, to detect any malicious data alterations. NoiSec is a reconstruction-based detector that disentangles the noise from the test input, extracts the underlying features from the noise, and leverages them to recognize systematic malicious manipulation. Experimental evaluations conducted on the CIFAR10 dataset demonstrate the efficacy of NoiSec, achieving AUROC scores exceeding 0.954 and 0.852 under white-box and black-box adversarial attacks, respectively, and 0.992 against backdoor attacks. Notably, NoiSec maintains a high detection performance, keeping the false positive rate within only 1\%. Comparative analyses against MagNet-based baselines reveal NoiSec's superior performance across various attack scenarios.


title: PIPPIN: Generating variable length full events from partons

abstract: This paper presents a novel approach for directly generating full events at detector-level from parton-level information, leveraging cutting-edge machine learning techniques. To address the challenge of multiplicity variations between parton and reconstructed object spaces, we employ transformers, score-based models and normalizing flows. Our method tackles the inherent complexities of the stochastic transition between these two spaces and achieves remarkably accurate results. The combination of innovative techniques and the achieved accuracy demonstrates the potential of our approach in advancing the field and opens avenues for further exploration. This research contributes to the ongoing efforts in high-energy physics and generative modelling, providing a promising direction for enhanced precision in fast detector simulation.


title: Exact Community Recovery (under Side Information): Optimality of Spectral Algorithms

abstract: In this paper, we study the problem of exact community recovery in general, two-community block models considering both Bernoulli and Gaussian matrix models, capturing the Stochastic Block Model, submatrix localization, and $\mathbb{Z}_2$-synchronization as special cases. We also study the settings where $side$ $information$ about community assignment labels is available, modeled as passing the true labels through a noisy channel: either the binary erasure channel (where some community labels are known while others are erased) or the binary symmetric channel (where some labels are flipped). We provide a unified analysis of the effect of side information on the information-theoretic limits of exact recovery, generalizing prior works and extending to new settings. Additionally, we design a simple but optimal spectral algorithm that incorporates side information (when present) along with the eigenvectors of the matrix observation. Using the powerful tool of entrywise eigenvector analysis [Abbe, Fan, Wang, Zhong 2020], we show that our spectral algorithm can mimic the so called $genie$-$aided$ $estimators$, where the $i^{\mathrm{th}}$ genie-aided estimator optimally computes the estimate of the $i^{\mathrm{th}}$ label, when all remaining labels are revealed by a genie. This perspective provides a unified understanding of the optimality of spectral algorithms for various exact recovery problems in a recent line of work.


title: The interplay between a pseudogap and superconductivity in a two-dimensional Hubbard model

abstract: Strongly correlated electrons systems may exhibit a variety of interesting phenomena, for instance, superconductivity and pseudogap, as is the case of cuprates and pnictides. In strongly correlated electron systems, it is considered essential to understand, not only the nature of the pseudogap, but also the relationship between superconductivity and the pseudogap. In order to address this question, in the present work, we investigated a one-band Hubbard model treated by the Green's function method within an n-pole approximation. In the strongly correlated regime, antiferromagnetic correlations give rise to nearly flat band regions in the nodal points of the quasiparticle bands. As a consequence, a pseudogap emerges at the antinodal points of the Fermi surface. The obtained results indicate that the same antiferromagnetic correlations responsible for a pseudogap, can also favor superconductivity, providing an increase in the superconducting critical temperature Tc.


title: An extension of Gauss's arithmetic-geometric mean (AGM) to three variables iteration scheme

abstract: Gauss's arithmetic-geometric mean (AGM) which is described by two variables iteration $(a_n, b_n)\rightarrow (a_{n+1}, b_{n+1})$ by $a_{n+1}=(a_n+b_n)/2,\ b_{n+1}=\sqrt{a_nb_n}$. We extend it to three variables iteration $(a_n, b_n, c_n)\rightarrow (a_{n+1}, b_{n+1}, c_{n+1})$ which reduces to Gauss's AGM when $c_0=0$. Our iteration starting from $a_0>b_0>c_0>0$ with further restriction $a_0>b_0+c_0$ converges to $a_\infty=b_\infty=M(a_0, b_0, c_0)$ and $c_\infty=0$. The limit $M(a_0, b_0, c_0)$ is expressed by Appell's hyper-geometric function $F_1(1/2, \{1/2, 1/2\}, 1; \kappa, \lambda)$ of two variables $(\kappa, \lambda)$ which are determined by $(a_0, b_0, c_0)$. A relation between two hyper-geometric functions (Gauss's and Appell's) is found as a by-product.


title: A universal bioluminescence tomography system for pre-clinical image-guided radiotherapy research

abstract: CBCT-guided small animal irradiators encounter challenges in localizing soft-tissue targets due to low imaging contrast. Bioluminescence tomography (BLT) offers a promising solution, but they have largely remained in laboratorial development, limiting accessibility for researchers. In this work, we develop a universal, commercial-graded BLT-guided system (MuriGlo) designed to seamlessly integrate with commercial irradiators and empower researchers for translational studies. We demonstrate its capabilities in supporting in vitro and in vivo studies. The MuriGlo comprises detachable mouse bed, thermostatic control, mirrors, filters, and CCD, enabling multi-projection and multi-spectral imaging. We evaluate that the thermostatic control effectively sustains animal temperature at 37{\deg}C throughout imaging, and quantify that the system can detect as few as 61 GL261-AkaLuc cells in vitro. To illustrate how the MuriGlo can be utilized for in vivo image-guided research, we present 3 strategies, BLT-guided 5-arc, 2-field box, and BLI-guided single-beam, ranging from complicated high-conformal to simplest high-throughput plans. The high conformal BLT-guided 5-arc plan fully covers the gross tumor volume (GTV) at prescribed dose with minimal normal tissue exposure (3.9%), while the simplified, high-throughput BLT-guided 2-field box achieves 100% GTV coverage but results in higher normal tissue exposure (13.1%). Moreover, we demonstrate that the localization accuracy of MuriGlo for both widely-used SARRP and SmART irradiators is within1 mm, and the tumor coverage reaches over 97% with 0.75mm margin. The universal BLT-guided system offers seamless integration with commercial irradiators, achieving comparable localization accuracy, expected to supporting high-precision radiation research.


title: Predicting the 21 cm field with a Hybrid Effective Field Theory approach

abstract: A detection of the 21 cm signal can provide a unique window of opportunity for uncovering complex astrophysical phenomena at the epoch of reionization and placing constraints on cosmology at high redshifts, which are usually elusive to large-scale structure surveys. In this work, we provide a theoretical model based on a quadratic bias expansion capable of recovering the 21 cm power spectrum with high accuracy sufficient for upcoming ground-based radio interferometer experiments. In particular, we develop a hybrid effective field theory (HEFT) model in redshift space that leverages the accuracy of $N$-body simulations with the predictive power of analytical bias expansion models, and test it against the Thesan suite of radiative transfer hydrodynamical simulations. We make predictions of the 21 cm brightness temperature field at several distinct redshifts, ranging between $z = 6.5$ and 11, thus probing a large fraction of the reionization history of the Universe ($x_{\rm HI} = 0.3 \sim 0.9$), and compare our model to the `true' 21 cm brightness in terms of the correlation coefficient, power spectrum and modeling error. We find percent-level agreement at large and intermediate scales, $k \lesssim 0.5 h/{\rm Mpc}$, and favorable behavior down to small scales, $k \sim 1 h/{\rm Mpc}$, outperforming pure perturbation-theory-based models. To put our findings into context, we show that even in the absence of any foreground contamination the thermal noise of a futuristic HERA-like experiment is comparable with the theoretical uncertainty in our model in the allowed `wedge' of observations, providing further evidence in support of using HEFT-based models to approximate a range of cosmological observables.


title: An Experimental Characterization of Combined RowHammer and RowPress Read Disturbance in Modern DRAM Chips

abstract: DRAM read disturbance can break memory isolation, a fundamental property to ensure system robustness (i.e., reliability, security, safety). RowHammer and RowPress are two different DRAM read disturbance phenomena. RowHammer induces bitflips in physically adjacent victim DRAM rows by repeatedly opening and closing an aggressor DRAM row, while RowPress induces bitflips by keeping an aggressor DRAM row open for a long period of time. In this study, we characterize a DRAM access pattern that combines RowHammer and RowPress in 84 real DDR4 DRAM chips from all three major DRAM manufacturers. Our key results show that 1) this combined RowHammer and RowPress pattern takes significantly smaller amount of time (up to 46.1% faster) to induce the first bitflip compared to the state-of-the-art RowPress pattern, and 2) at the minimum aggressor row activation count to induce at least one bitflip, the bits that flip are different across RowHammer, RowPress, and the combined patterns. Based on our results, we provide a key hypothesis that the read disturbance effect caused by RowPress from one of the two aggressor rows in a double-sided pattern is much more significant than the other.


title: Class-specific Data Augmentation for Plant Stress Classification

abstract: Data augmentation is a powerful tool for improving deep learning-based image classifiers for plant stress identification and classification. However, selecting an effective set of augmentations from a large pool of candidates remains a key challenge, particularly in imbalanced and confounding datasets. We propose an approach for automated class-specific data augmentation using a genetic algorithm. We demonstrate the utility of our approach on soybean [Glycine max (L.) Merr] stress classification where symptoms are observed on leaves; a particularly challenging problem due to confounding classes in the dataset. Our approach yields substantial performance, achieving a mean-per-class accuracy of 97.61% and an overall accuracy of 98% on the soybean leaf stress dataset. Our method significantly improves the accuracy of the most challenging classes, with notable enhancements from 83.01% to 88.89% and from 85.71% to 94.05%, respectively. A key observation we make in this study is that high-performing augmentation strategies can be identified in a computationally efficient manner. We fine-tune only the linear layer of the baseline model with different augmentations, thereby reducing the computational burden associated with training classifiers from scratch for each augmentation policy while achieving exceptional performance. This research represents an advancement in automated data augmentation strategies for plant stress classification, particularly in the context of confounding datasets. Our findings contribute to the growing body of research in tailored augmentation techniques and their potential impact on disease management strategies, crop yields, and global food security. The proposed approach holds the potential to enhance the accuracy and efficiency of deep learning-based tools for managing plant stresses in agriculture.


title: The Hanbury-Brown and Twiss effect in inflationary cosmological perturbations

abstract: The simplest model of inflation is based around an inflaton field that starts in a coherent false vacuum state with a positive cosmological constant, rolls slowly to the true vacuum and relaxes to it via reheating. We examine whether the scale of the transition from coherence to chaoticity can be examined via the Hanbury-Brown and Twiss (HBT) effect, in parallel with analogous problems of heavy ion physics (the ``pion laser'' and the thermalizing glasma). We develop an ansatz which contains a definition of ''chaoticity'' which parallels that of the usual setups where HBT is used. However, we also discuss the differences between the inflationary setup and more mainstream uses of HBT and conclude that these are more significant than the similarities, making the use of the developed methodology uncertain.


title: Design and Performance of a Magnetic Bottle Electron Spectrometer for High-Energy Photoelectron Spectroscopy

abstract: We describe the design and performance of a magnetic bottle electron spectrometer~(MBES) for high-energy electron spectroscopy. Our design features a ${\sim2}$~m long electron drift tube and electrostatic retardation lens, achieving sub-electronvolt (eV) electron kinetic energy resolution for high energy (several hundred eV) electrons with close to 4$\pi$ collection efficiency. A segmented anode electron detector enables the simultaneous collection of photoelectron spectra in high resolution and high collection efficiency modes. This versatile instrument is installed at the TMO endstation at the LCLS x-ray free-electron laser (XFEL). In this paper, we demonstrate its high resolution, collection efficiency and spatial selectivity in measurements where it is coupled to an XFEL source. These combined characteristics are designed to enable high-resolution time-resolved measurements using x-ray photoelectron, absorption, and Auger-Meitner spectroscopy. We also describe the pervasive artifact in MBES time-of-flight spectra that arises from a periodic modulation in electron detection efficiency, and present a robust analysis procedure for its removal.


title: Why are (almost) all the protostellar outflows aligned in Serpens Main?

abstract: We present deep 1.4-4.8 um JWST-NIRCam imaging of the Serpens Main star-forming region and identify 20 candidate protostellar outflows, most with bipolar structure and identified driving sources. The outflow position angles (PAs) are strongly correlated, and aligned within +/- 24 degrees of the major axis of the Serpens filament. These orientations are further aligned with the angular momentum vectors of the two disk shadows in this region. We estimate that the probability of this number of young stars being co-aligned if sampled from a uniform PA distribution is 10^-4. This in turn suggests that the aligned protostars, which seem to be at similar evolutionary stages based on their outflow dynamics, formed at similar times with a similar spin inherited from a local cloud filament. Further, there is tentative evidence for a systematic change in average position angle between the north-western and south-eastern cluster, as well as increased scatter in the PAs of the south-eastern protostars. SOFIA-HAWC+ archival dust polarization observations of Serpens Main at 154 and 214 um are perpendicular to the dominant jet orientation in NW region in particular. We measure and locate shock knots and edges for all of the outflows and provide an identifying catalog. We suggest that Serpens main is a cluster that formed from an isolated filament, and due to its youth retains its primordial outflow alignment.


title: Ultralow thermal conductance across the [FePt/h-BN/FePt] interface

abstract: Heat transfer in nanocomposite materials has attracted great interest for various applications. Multilayer structures provide an important platform to study interfacial thermal transport and to engineer materials with ultralow thermal conductivity. Here we report on the fabrication and thermal characterization of [h-BN/$L1_0$-FePt]xN multilayers, where hexagonal boron nitride (h-BN) nanosheets (2.5 nm thick) and $L1_0$-FePt layers (6.5 nm thick) alternate periodically. Differential three-omega($3\omega$) measurements reveal an ultralow effective thermal conductivity of $ 0.60 \pm 0.05 W \cdot m^{-1}K^{-1}$ across the multilayer films, and a low thermal boundary conductance (TBC) of $ 67.9 \pm 6.6 MW \cdot m^{-2}K^{-1}$ for the [FePt/h-BN(2.5nm)/FePt] interface at room temperature. We attribute the ultralow thermal conductivity to the weak van der Waals bonding at h-BN/FePt interfaces, which dominates the thermal resistance of the multilayer structure. These findings provide insights into the thermal transport in 2D-material/metal multilayer nanostructures and suggest the [h-BN/FePt] superlattice as a promising material for nanoscale thermal barrier coating. Furthermore, the obtained TBC lays the foundation for analyzing heat transfer in FePt-(h-BN) nanogranular films, a promising magnetic recording media which can potentially provide high thermal gradient for heat-assisted magnetic recording (HAMR). This work advances the understanding of thermal transport in 2D-material/metal nanocomposites and demonstrates interface engineering as an effective approach to achieve materials with ultralow thermal conductivity.


title: NaviSplit: Dynamic Multi-Branch Split DNNs for Efficient Distributed Autonomous Navigation

abstract: Lightweight autonomous unmanned aerial vehicles (UAV) are emerging as a central component of a broad range of applications. However, autonomous navigation necessitates the implementation of perception algorithms, often deep neural networks (DNN), that process the input of sensor observations, such as that from cameras and LiDARs, for control logic. The complexity of such algorithms clashes with the severe constraints of these devices in terms of computing power, energy, memory, and execution time. In this paper, we propose NaviSplit, the first instance of a lightweight navigation framework embedding a distributed and dynamic multi-branched neural model. At its core is a DNN split at a compression point, resulting in two model parts: (1) the head model, that is executed at the vehicle, which partially processes and compacts perception from sensors; and (2) the tail model, that is executed at an interconnected compute-capable device, which processes the remainder of the compacted perception and infers navigation commands. Different from prior work, the NaviSplit framework includes a neural gate that dynamically selects a specific head model to minimize channel usage while efficiently supporting the navigation network. In our implementation, the perception model extracts a 2D depth map from a monocular RGB image captured by the drone using the robust simulator Microsoft AirSim. Our results demonstrate that the NaviSplit depth model achieves an extraction accuracy of 72-81% while transmitting an extremely small amount of data (1.2-18 KB) to the edge server. When using the neural gate, as utilized by NaviSplit, we obtain a slightly higher navigation accuracy as compared to a larger static network by 0.3% while significantly reducing the data rate by 95%. To the best of our knowledge, this is the first exemplar of dynamic multi-branched model based on split DNNs for autonomous navigation.


title: Thermodynamics and entanglement entropy of the non-Hermitian SSH model

abstract: Topological phase transitions are found in a variety of systems and were shown to be deeply related with a thermodynamic description through scaling relations. Here, we investigate the entanglement entropy, which is a quantity that captures the central charge of a critical model and the thermodynamics of the non-reciprocal Su-Schrieffer-Heeger (SSH) model. Although this model has been widely studied, the thermodynamic properties reveal interesting physics not explored so far. In order to analyze the boundary effects of the model, we use Hill's thermodynamics to split the grand potential in two contributions: the extensive one, related to the bulk, and the subdivision one, related to the boundaries. Then, we derive the thermodynamic entropy for both, the edges and the bulk and the heat capacity for the bulk at the topological phase transitions. The latter is related to the central charge when the underlying theory is a conformal field theory, whereas the first reveals the resilience of the topological edge states to finite temperatures. The phase transition between phases that are adiabatically connected with the Hermitian SSH model display the well-known behaviour of systems within the Dirac universality class, but the transition between phases with complex energies shows an unexpected critical behavior, which signals the emergence of an imaginary time crystal.


title: Stratification of Derived Categories of Tate Motives

abstract: We classify the localizing tensor ideals of the derived categories of mixed Tate motives over certain algebraically closed fields. More precisely, we prove that these categories are stratified in the sense of Barthel, Heard and Sanders. A key ingredient in the proof is the development of a new technique for transporting stratification between categories by means of Brown--Adams representability, which may be of independent interest.


title: Uniqueness and CLT for the Ground State of the Disordered Monomer-Dimer Model on $\mathbb{Z}^{d}$

abstract: We prove that the disordered monomer-dimer model does not admit infinite volume incongruent ground states in $\mathbb{Z}^d$ which can be obtained as a limit of finite volume ground states. Furthermore, we also prove that these ground states are stable under perturbation of the weights in a precise sense. As an application, we obtain a CLT for the ground state weight for a growing sequence of tori. Our motivation stems from a similar and long standing open question for the short range Edwards-Anderson spin glass model.


title: Magnetohydrodynamic simulation of the 2012-July-12 CME Event With the Fluxrope-G3DMHD Model

abstract: Coronal mass ejections (CMEs) and their driven shocks are a major source of large geomagnetic storms due to their large and long-lasting, southward component of magnetic field in the sheath and the flux rope (e.g., magnetic cloud). Predicting the strength and arrival time of southward fields accurately thus plays a key role in space weather predictions. To address this problem, we have developed a new model, which combines the global three-dimensional, time-dependent, magnetohydrodynamic (MHD), data-driven model (G3DMHD) and a self-contained magnetic flux-rope model [1]. As a demonstration and validation, here we simulate the evolution of a Sun-Earth-directed CME that erupted on 2012-July-12. The computational domain spans from 2.5 solar radii (Rs) from the surface of the Sun, where the flux rope is injected, to 245 Rs. We compare the time profiles of the simulated MHD parameters (Density, velocity, temperature, and magnetic field) with in situ solar wind observations acquired at ~1 AU by the Wind spacecraft and the result is encouraging. The model successfully reproduces the shock, sheath, and flux rope similar to those observed by Wind.


title: Convergence Analysis of Ensemble Filters for Linear Stochastic Systems with Poisson-Sampled Observations

abstract: For continuous-time linear stochastic dynamical systems driven by Wiener processes, we consider the problem of designing ensemble filters when the observation process is randomly time-sampled. We propose a continuous-discrete McKean--Vlasov type diffusion process with additive Gaussian noise in observation model, which is used to describe the evolution of the individual particles in the ensemble. These particles are coupled through the empirical covariance and require less computations for implementation than the optimal ones based on solving Riccati differential equations. Using appropriate analysis tools, we show that the empirical mean and the sample covariance of the ensemble filter converges to the mean and covariance of the optimal filter if the mean sampling rate of the observation process satisfies certain bounds and as the number of particles tends to infinity.


title: Multilingual Synopses of Movie Narratives: A Dataset for Story Understanding

abstract: Story video-text alignment, a core task in computational story understanding, aims to align video clips with corresponding sentences in their descriptions. However, progress on the task has been held back by the scarcity of manually annotated video-text correspondence and the heavy concentration on English narrations of Hollywood movies. To address these issues, in this paper, we construct a large-scale multilingual video story dataset named Multilingual Synopses of Movie Narratives (M-SYMON), containing 13,166 movie summary videos from 7 languages, as well as manual annotation of fine-grained video-text correspondences for 101.5 hours of video. Training on the human annotated data from SyMoN outperforms the SOTA methods by 15.7 and 16.2 percentage points on Clip Accuracy and Sentence IoU scores, respectively, demonstrating the effectiveness of the annotations. As benchmarks for future research, we create 6 baseline approaches with different multilingual training strategies, compare their performance in both intra-lingual and cross-lingual setups, exemplifying the challenges of multilingual video-text alignment.


title: RITA: A Real-time Interactive Talking Avatars Framework

abstract: RITA presents a high-quality real-time interactive framework built upon generative models, designed with practical applications in mind. Our framework enables the transformation of user-uploaded photos into digital avatars that can engage in real-time dialogue interactions. By leveraging the latest advancements in generative modeling, we have developed a versatile platform that not only enhances the user experience through dynamic conversational avatars but also opens new avenues for applications in virtual reality, online education, and interactive gaming. This work showcases the potential of integrating computer vision and natural language processing technologies to create immersive and interactive digital personas, pushing the boundaries of how we interact with digital content.


title: Exploring and Benchmarking the Planning Capabilities of Large Language Models

abstract: We seek to elevate the planning capabilities of Large Language Models (LLMs)investigating four main directions. First, we construct a comprehensive benchmark suite encompassing both classical planning domains and natural language scenarios. This suite includes algorithms to generate instances with varying levels of difficulty, allowing for rigorous and systematic evaluation of LLM performance. Second, we investigate the use of in-context learning (ICL) to enhance LLM planning, exploring the direct relationship between increased context length and improved planning performance. Third, we demonstrate the positive impact of fine-tuning LLMs on optimal planning paths, as well as the effectiveness of incorporating model-driven search procedures. Finally, we investigate the performance of the proposed methods in out-of-distribution scenarios, assessing the ability to generalize to novel and unseen planning challenges.


title: Explicit formulas for the Grothendieck class of $\overline{\mathcal M}_{0,n}$

abstract: We obtain closed form expressions for the class in the Grothendieck group of varieties of the moduli space of genus $0$ stable curves with $n$ marked points. This information is equivalent to the Poincar\'e polynomial, so it implies explicit expressions for the Betti numbers of the moduli space in terms of Stirling numbers or, alternatively, Bernoulli numbers. The result is proved as a consequence of explicit expressions for the generating function for the Grothendieck class, which we prove by solving a differential equation characterizing this generating function by work of E. Getzler and Y. Manin from the 1990s. Our proof reduces the solution to two combinatorial identities which follow from applications of Lagrange series.


title: Electric field enhances the electronic and diffusion properties of penta-graphene nanoribbons for application in lithium-ion batteries: a first-principles study

abstract: Enhancing the electronic and diffusion properties of lithium-ion batteries is crucial for improving the performance of the fast-growing energy storage devices. Here we use first principles methods with density functional theory and the climbing image-nudged elastic band method to evaluate the impact of an external electric field on the stability, electronic and diffusion properties of penta-graphene nanoribbons upon lithium adsorption. We show that by adsorbing a lithium atom, these semiconductor nanoribbons become metal with a formation energy of -0.22 (eV). The diffusion coefficient of this material is five orders of magnitude higher than that of a common carbon graphite layer. Under a relatively small vertical electric field, these lithium-ion systems are even more stable, and their diffusion coefficient is enhanced significantly of 711 times higher than that of the material in the absence of an applied electric field and 520 times higher than in the case of commercial graphitic carbon layers. Our results highlight the role of an external electric field as a novel switch to improve the efficiency of lithium-ion batteries with penta-graphene nanoribbon electrodes and open a new horizon for the use of more environmentally friendly pentagonal materials as electrode materials in lithium-ion battery industry.


title: Can it be detected? A computational protocol for evaluating MOF-metal oxide chemiresistive sensors for early disease detection

abstract: Human breath contains over 3000 volatile organic compounds, abnormal concentrations of which can indicate the presence of certain diseases. Recently, metal-organic framework (MOF)-metal oxide composite materials have been explored for chemiresistive sensor applications, however their ability to detect breath compounds associated with specific diseases remains unknown. In this work, we present a new high-throughput computational protocol for evaluating the sensing ability of MOF-metal oxide towards small organic compounds. This protocol uses a cluster-based method for accelerated structure relaxation, and a combination of binding energies and density-of-states analysis to evaluate sensing ability, the latter measured using Wasserstein distances. We apply this protocol to the case of the MOF-metal oxide composite material NM125-TiO2 and show that it is consistent with previously reported experimental results for this system. We examine the sensing ability of NM125-TiO2 for over 100 human-breath compounds spanning 13 different diseases. Statistical inference then allows us to identifies ones which subsequent experimental efforts should focus on. Overall, this work provides new tools for computational sensor research, while also illustrating how computational materials science can be integrated into the field of preventative medicine.


title: DLP: towards active defense against backdoor attacks with decoupled learning process

abstract: Deep learning models are well known to be susceptible to backdoor attack, where the attacker only needs to provide a tampered dataset on which the triggers are injected. Models trained on the dataset will passively implant the backdoor, and triggers on the input can mislead the models during testing. Our study shows that the model shows different learning behaviors in clean and poisoned subsets during training. Based on this observation, we propose a general training pipeline to defend against backdoor attacks actively. Benign models can be trained from the unreliable dataset by decoupling the learning process into three stages, i.e., supervised learning, active unlearning, and active semi-supervised fine-tuning. The effectiveness of our approach has been shown in numerous experiments across various backdoor attacks and datasets.


title: Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models

abstract: We present a latent diffusion model over 3D scenes, that can be trained using only 2D image data. To achieve this, we first design an autoencoder that maps multi-view images to 3D Gaussian splats, and simultaneously builds a compressed latent representation of these splats. Then, we train a multi-view diffusion model over the latent space to learn an efficient generative model. This pipeline does not require object masks nor depths, and is suitable for complex scenes with arbitrary camera positions. We conduct careful experiments on two large-scale datasets of complex real-world scenes -- MVImgNet and RealEstate10K. We show that our approach enables generating 3D scenes in as little as 0.2 seconds, either from scratch, from a single input view, or from sparse input views. It produces diverse and high-quality results while running an order of magnitude faster than non-latent diffusion models and earlier NeRF-based generative models


title: Understanding the Influence of Hydrogen on BCC Iron Grain Boundaries using the Kinetic Activation Relaxation technique (k-ART)

abstract: Hydrogen embrittlement (HE) poses a significant challenge in the mechanical integrity of iron and its alloys. This study explores the influence of hydrogen atoms on two distinct grain boundaries (GBs), $\Sigma37$ and $\Sigma3$, in body-centered-cubic (BCC) iron. Using the kinetic activation-relaxation technique (k-ART), an off-lattice kinetic Monte Carlo approach, we examine diffusion barriers and mechanisms associated with these GBs. Our findings reveal distinct behaviors of hydrogen in different GB environments, emphasizing the elastic deformation that arises around the GB in the presence of H that leads to either the predominance of new pathways and diffusion routes or a pinning effect of H atoms. We find that, for these systems, while GB is energetically favorable for H, this element diffuses more slowly at the GBs than in the bulk. Moreover, with detailed information about the evolution landscape around GB, we find that the saturation of a GB with hydrogen both stabilizes the GB by shifting barriers associated with Fe diffusion to higher energies and smooths the energy landscape, reducing the number of diffusion events. This comprehensive analysis enhances our understanding of hydrogen's role in GB behavior, contributing valuable insights for the design and optimization of materials in hydrogen-related applications.


title: On instabilities in neural network-based physics simulators

abstract: When neural networks are trained from data to simulate the dynamics of physical systems, they encounter a persistent challenge: the long-time dynamics they produce are often unphysical or unstable. We analyze the origin of such instabilities when learning linear dynamical systems, focusing on the training dynamics. We make several analytical findings which empirical observations suggest extend to nonlinear dynamical systems. First, the rate of convergence of the training dynamics is uneven and depends on the distribution of energy in the data. As a special case, the dynamics in directions where the data have no energy cannot be learned. Second, in the unlearnable directions, the dynamics produced by the neural network depend on the weight initialization, and common weight initialization schemes can produce unstable dynamics. Third, injecting synthetic noise into the data during training adds damping to the training dynamics and can stabilize the learned simulator, though doing so undesirably biases the learned dynamics. For each contributor to instability, we suggest mitigative strategies. We also highlight important differences between learning discrete-time and continuous-time dynamics, and discuss extensions to nonlinear systems.


title: On the trapped magnetic moment in type-II superconductors

abstract: Measurements of the trapped (remanent) magnetic moment, $M_{trap}\left(H\right)$, when a small magnetic field $H$ is turned off after cooling below the superconducting transition temperature, $T_c$, or ramping a magnetic field up and down after cooling in a zero field, have advantages in difficult cases of small samples and large field-dependent backgrounds, which is relevant for hydrogen-based ultra-high-$T_{c}$ superconductors (UHTS). Until recently, there was no need for a separate paper on the trapped magnetic flux for well-known critical state models due to the simplicity of the physics involved. However, recent publications showed the need for such an analysis. This note summarizes the expectations for the Bean model with constant critical current density and the Kim model with field-dependent critical currents. It is shown that if the trapped moment is fitted to the power law, $M_{trap}\propto H^{\alpha}$, the fixed exponent $\alpha=2$ is exact for the Bean model, while Kim models show a wide interval of possible values, $2\leq\alpha\leq4$. Furthermore, accounting for reversible magnetization expands the range of possible exponents to $1\leq\alpha\leq4$. In addition, demagnetizing factors are essential and make the trapped moment orientation dependent even in isotropic materials. As a concrete application, it is shown that flux trapping experiments on H$_{3}$S UHTS compounds can be described well using this generalized approach, lending further support to the type-II superconducting nature of H$_{3}$S under ultra-high pressure.


title: A Generic Method for Fine-grained Category Discovery in Natural Language Texts

abstract: Fine-grained category discovery using only coarse-grained supervision is a cost-effective yet challenging task. Previous training methods focus on aligning query samples with positive samples and distancing them from negatives. They often neglect intra-category and inter-category semantic similarities of fine-grained categories when navigating sample distributions in the embedding space. Furthermore, some evaluation techniques that rely on pre-collected test samples are inadequate for real-time applications. To address these shortcomings, we introduce a method that successfully detects fine-grained clusters of semantically similar texts guided by a novel objective function. The method uses semantic similarities in a logarithmic space to guide sample distributions in the Euclidean space and to form distinct clusters that represent fine-grained categories. We also propose a centroid inference mechanism to support real-time applications. The efficacy of the method is both theoretically justified and empirically confirmed on three benchmark tasks. The proposed objective function is integrated in multiple contrastive learning based neural models. Its results surpass existing state-of-the-art approaches in terms of Accuracy, Adjusted Rand Index and Normalized Mutual Information of the detected fine-grained categories. Code and data will be available at https://github.com/XX upon publication.


title: On the Origin of Solar Hemispheric Helicity Rules: Rise of 3D Magnetic Flux Concentrations through a Background Magnetic Field

abstract: Sunspots and active regions observed on the solar surface are widely believed to be manifestations of compact predominantly-toroidal magnetic field structures (``flux tubes") that emerge by magnetic buoyancy from the deeper interior of the Sun. Much work has examined the evolution of such magnetic structures, typically considering them as idealized isolated magnetic entities and not as more realistic magnetic concentrations in a volume-filling background magnetic field. Here, we report results that explore the buoyant rise dynamics of magnetic concentrations in a volume-filling field in the full three dimensions. Earlier 2.5D work in this series (arXiv:1805.08806, arXiv:2101.03472, arXiv:2204.13078) established the remarkable fact that the twist orientation of a flux concentration relative to the background field affected it's likelihood to rise and emerge, regardless of whether the buoyant rise took place in the absence or presence of convection. The contrasting dynamics between structures with differing orientations leads to a selection mechanism that reproduces characteristics of the ``solar hemispheric helicity rule(s)" (SHHR) observations strikingly well. Here, we show that this two-dimensional selection mechanism persists in the face of the added complexity of three-dimensional dynamics. Arching of the magnetic structure in the third dimension, as might be expected in the solar application, is introduced. The role of tension force leading to this selection mechanism is elucidated and subtle differences that arise due to the three-dimensional geometry are discussed.


title: A transformer boosted UNet for smoke segmentation in complex backgrounds in multispectral LandSat imagery

abstract: Many studies have been done to detect smokes from satellite imagery. However, these prior methods are not still effective in detecting various smokes in complex backgrounds. Smokes present challenges in detection due to variations in density, color, lighting, and backgrounds such as clouds, haze, and/or mist, as well as the contextual nature of thin smoke. This paper addresses these challenges by proposing a new segmentation model called VTrUNet which consists of a virtual band construction module to capture spectral patterns and a transformer boosted UNet to capture long range contextual features. The model takes imagery of six bands: red, green, blue, near infrared, and two shortwave infrared bands as input. To show the advantages of the proposed model, the paper presents extensive results for various possible model architectures improving UNet and draws interesting conclusions including that adding more modules to a model does not always lead to a better performance. The paper also compares the proposed model with very recently proposed and related models for smoke segmentation and shows that the proposed model performs the best and makes significant improvements on prediction performances


title: Accelerating Complex Disease Treatment through Network Medicine and GenAI: A Case Study on Drug Repurposing for Breast Cancer

abstract: The objective of this research is to introduce a network specialized in predicting drugs that can be repurposed by investigating real-world evidence sources, such as clinical trials and biomedical literature. Specifically, it aims to generate drug combination therapies for complex diseases (e.g., cancer, Alzheimer's). We present a multilayered network medicine approach, empowered by a highly configured ChatGPT prompt engineering system, which is constructed on the fly to extract drug mentions in clinical trials. Additionally, we introduce a novel algorithm that connects real-world evidence with disease-specific signaling pathways (e.g., KEGG database). This sheds light on the repurposability of drugs if they are found to bind with one or more protein constituents of a signaling pathway. To demonstrate, we instantiated the framework for breast cancer and found that, out of 46 breast cancer signaling pathways, the framework identified 38 pathways that were covered by at least two drugs. This evidence signals the potential for combining those drugs. Specifically, the most covered signaling pathway, ID hsa:2064, was covered by 108 drugs, some of which can be combined. Conversely, the signaling pathway ID hsa:1499 was covered by only two drugs, indicating a significant gap for further research. Our network medicine framework, empowered by GenAI, shows promise in identifying drug combinations with a high degree of specificity, knowing the exact signaling pathways and proteins that serve as targets. It is noteworthy that ChatGPT successfully accelerated the process of identifying drug mentions in clinical trials, though further investigations are required to determine the relationships among the drug mentions.


title: Blitzcrank: Fast Semantic Compression for In-memory Online Transaction Processing

abstract: We present BLITZCRANK, a high-speed semantic compressor designed for OLTP databases. Previous solutions are inadequate for compressing row-stores: they suffer from either low compression factor due to a coarse compression granularity or suboptimal performance due to the inefficiency in handling dynamic data sets. To solve these problems, we first propose novel semantic models that support fast inferences and dynamic value set for both discrete and continuous data types. We then introduce a new entropy encoding algorithm, called delayed coding, that achieves significant improvement in the decoding speed compared to modern arithmetic coding implementations. We evaluate BLITZCRANK in both standalone microbenchmarks and a multicore in-memory row-store using the TCPC-C benchmark. Our results show that BLITZCRANK achieves a sub-microsecond latency for decompressing a random tuple while obtaining high compression factors. This leads to an 85% memory reduction in the TPC-C evaluation with a moderate (19%) throughput degradation. For data sets larger than the available physical memory, BLITZCRANK help the database sustain a high throughput for more transactions before the l/O overhead dominates.


title: Distinguishing Martin's axiom from its restrictions

abstract: We introduce an iteration of forcing notions satisfying the countable chain condition with minimal damage to a strong coloring. Applying this method, we prove that Martin's axiom is strictly stronger than its restriction to forcing notions satisfying the countable chain condition in all finite powers. Our method shows also the finer distinction, that Martin's axiom is strictly stronger than its restriction to forcing notions whose squares satisfy the countable chain condition.


title: Non-hermitian Floquet perspective on high harmonic generation and above threshold ionization spectra from Photon statistics

abstract: We present a proof based on non-hermitian Floquet theory that confirms the experimental findings of Tsatrafylis and his colleagues in 2017, demonstrating the coincidence between the high harmonic generation spectra (HGS) and the number of absorbed odd infrared (IR) photons leading to emitted extreme ultraviolet (XUV) radiation. This coincidence is achieved through post-selection of the IR photons, conserving the total energy of the absorbed odd IR photons and the emitted XUV photons. Our derivation is consistent with their results and relies on our ability to compute the HGS in ultra-high-intensity lasers using non-Hermitian quantum mechanics (NHQM), which competes with above-threshold ionization (ATI). Through our NHQM theoretical simulation, we identify the regimes where there is correspondence between the HHG and ATI spectra and annihilated pump photons (with post-selection). Additionally, we demonstrate that the photon statistics in HHG exhibit Wigner-type distributions, which reflect the quantum chaotic dynamics of electrons at the cutoff of the plateau of the HGS. We emphasize that our findings underscore a unified mechanism governing the three distinct measurements of HGS, ATI, and IR photon number distribution, none of which require the quantization of the electromagnetic field.


title: Denjoy-Carleman solvability of Vekua-type periodic operators

abstract: This paper explores the solvability and global hypoellipticity of Vekua-type differential operators on the n-dimensional torus, within the framework of Denjoy-Carleman ultradifferentiability. We provide the necessary and sufficient conditions for achieving these global properties in the case of constant-coefficient operators, along with applications to classical operators. Additionally, we investigate a class of variable coefficients and establish conditions for its solvability.


title: Nonparametric Motion Control in Functional Connectivity Studies in Children with Autism Spectrum Disorder

abstract: Autism Spectrum Disorder (ASD) is a neurodevelopmental condition associated with difficulties with social interactions, communication, and restricted or repetitive behaviors. To characterize ASD, investigators often use functional connectivity derived from resting-state functional magnetic resonance imaging of the brain. However, participants' head motion during the scanning session can induce motion artifacts. Many studies remove scans with excessive motion, which can lead to drastic reductions in sample size and introduce selection bias. To avoid such exclusions, we propose an estimand inspired by causal inference methods that quantifies the difference in average functional connectivity in autistic and non-ASD children while standardizing motion relative to the low motion distribution in scans that pass motion quality control. We introduce a nonparametric estimator for motion control, called MoCo, that uses all participants and flexibly models the impacts of motion and other relevant features using an ensemble of machine learning methods. We establish large-sample efficiency and multiple robustness of our proposed estimator. The framework is applied to estimate the difference in functional connectivity between 132 autistic and 245 non-ASD children, of which 34 and 126 pass motion quality control. MoCo appears to dramatically reduce motion artifacts relative to no participant removal, while more efficiently utilizing participant data and accounting for possible selection biases relative to the na\"ive approach with participant removal.


title: Nutmeg and SPICE: Models and Data for Biomolecular Machine Learning

abstract: We describe version 2 of the SPICE dataset, a collection of quantum chemistry calculations for training machine learning potentials. It expands on the original dataset by adding much more sampling of chemical space and more data on non-covalent interactions. We train a set of potential energy functions called Nutmeg on it. They use a novel mechanism to improve performance on charged and polar molecules, injecting precomputed partial charges into the model to provide a reference for the large scale charge distribution. Evaluation of the new models shows they do an excellent job of reproducing energy differences between conformations, even on highly charged molecules or ones that are significantly larger than the molecules in the training set. They also produce stable molecular dynamics trajectories, and are fast enough to be useful for routine simulation of small molecules.


title: CU-Net: a U-Net architecture for efficient brain-tumor segmentation on BraTS 2019 dataset

abstract: Accurately segmenting brain tumors from MRI scans is important for developing effective treatment plans and improving patient outcomes. This study introduces a new implementation of the Columbia-University-Net (CU-Net) architecture for brain tumor segmentation using the BraTS 2019 dataset. The CU-Net model has a symmetrical U-shaped structure and uses convolutional layers, max pooling, and upsampling operations to achieve high-resolution segmentation. Our CU-Net model achieved a Dice score of 82.41%, surpassing two other state-of-the-art models. This improvement in segmentation accuracy highlights the robustness and effectiveness of the model, which helps to accurately delineate tumor boundaries, which is crucial for surgical planning and radiation therapy, and ultimately has the potential to improve patient outcomes.


title: Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation

abstract: Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of capabilities from larger teacher LLMs to more compact student models. Particularly, sequence-level KD, which distills rationale-based reasoning processes instead of merely final outcomes, shows great potential in enhancing students' reasoning capabilities. However, current methods struggle with sequence level KD under long-tailed data distributions, adversely affecting generalization on sparsely represented domains. We introduce the Multi-Stage Balanced Distillation (BalDistill) framework, which iteratively balances training data within a fixed computational budget. By dynamically selecting representative head domain examples and synthesizing tail domain examples, BalDistill achieves state-of-the-art performance across diverse long-tailed datasets, enhancing both the efficiency and efficacy of the distilled models.


title: Dynamic Walking on Highly Underactuated Point Foot Humanoids: Closing the Loop between HZD and HLIP

abstract: Realizing bipedal locomotion on humanoid robots with point feet is especially challenging due to their highly underactuated nature, high degrees of freedom, and hybrid dynamics resulting from impacts. With the goal of addressing this challenging problem, this paper develops a control framework for realizing dynamic locomotion and implements it on a novel point foot humanoid: ADAM. To this end, we close the loop between Hybrid Zero Dynamics (HZD) and Hybrid linear inverted pendulum (HLIP) based step length regulation. To leverage the full-order hybrid dynamics of the robot, walking gaits are first generated offline by utilizing HZD. These trajectories are stabilized online through the use of a HLIP based regulator. Finally, the planned trajectories are mapped into the full-order system using a task space controller incorporating inverse kinematics. The proposed method is verified through numerical simulations and hardware experiments on the humanoid robot ADAM marking the first humanoid point foot walking. Moreover, we experimentally demonstrate the robustness of the realized walking via the ability to track a desired reference speed, robustness to pushes, and locomotion on uneven terrain.


title: A Lower Bound on Swap Regret in Extensive-Form Games

abstract: Recent simultaneous works by Peng and Rubinstein [2024] and Dagan et al. [2024] have demonstrated the existence of a no-swap-regret learning algorithm that can reach $\epsilon$ average swap regret against an adversary in any extensive-form game within $m^{\tilde{\mathcal O}(1/\epsilon)}$ rounds, where $m$ is the number of nodes in the game tree. However, the question of whether a $\mathrm{poly}(m, 1/\epsilon)$-round algorithm could exist remained open. In this paper, we show a lower bound that precludes the existence of such an algorithm. In particular, we show that achieving average swap regret $\epsilon$ against an oblivious adversary in general extensive-form games requires at least $\mathrm{exp}\left(\Omega\left(\min\left\{m^{1/14}, \epsilon^{-1/6}\right\}\right)\right)$ rounds.


title: State-of-the-Art Review: The Use of Digital Twins to Support Artificial Intelligence-Guided Predictive Maintenance

abstract: In recent years, predictive maintenance (PMx) has gained prominence for its potential to enhance efficiency, automation, accuracy, and cost-effectiveness while reducing human involvement. Importantly, PMx has evolved in tandem with digital advancements, such as Big Data and the Internet of Things (IOT). These technological strides have enabled Artificial Intelligence (AI) to revolutionize PMx processes, with increasing capacities for real-time automation of monitoring, analysis, and prediction tasks. However, PMx still faces challenges such as poor explainability and sample inefficiency in data-driven methods and high complexity in physics-based models, hindering broader adoption. This paper posits that Digital Twins (DTs) can be integrated into PMx to overcome these challenges, paving the way for more automated PMx applications across various stakeholders. Despite their potential, current DTs have not fully matured to bridge existing gaps. Our paper provides a comprehensive roadmap for DT evolution, addressing current limitations to foster large-scale automated PMx progression. We structure our approach in three stages: First, we reference prior work where we identified and defined the Information Requirements (IRs) and Functional Requirements (FRs) for PMx, forming the blueprint for a unified framework. Second, we conduct a literature review to assess current DT applications integrating these IRs and FRs, revealing standardized DT models and tools that support automated PMx. Lastly, we highlight gaps in current DT implementations, particularly those IRs and FRs not fully supported, and outline the necessary components for a comprehensive, automated PMx system. Our paper concludes with research directions aimed at seamlessly integrating DTs into the PMx paradigm to achieve this ambitious vision.


title: Thruster-Assisted Incline Walking

abstract: In this study, our aim is to evaluate the effectiveness of thruster-assisted steep slope walking for the Husky Carbon, a quadrupedal robot equipped with custom-designed actuators and plural electric ducted fans, through simulation prior to conducting experimental trials. Thruster-assisted steep slope walking draws inspiration from wing-assisted incline running (WAIR) observed in birds, and intriguingly incorporates posture manipulation and thrust vectoring, a locomotion technique not previously explored in the animal kingdom. Our approach involves developing a reduced-order model of the Husky robot, followed by the application of an optimization-based controller utilizing collocation methods and dynamics interpolation to determine control actions. Through simulation testing, we demonstrate the feasibility of hardware implementation of our controller.


title: GbHammer: Malicious Inter-process Page Sharing by Hammering Global Bits in Page Table Entries

abstract: RowHammer is a vulnerability inside DRAM chips where an attacker repeatedly accesses a DRAM row to flip bits in the nearby rows without directly accessing them. Several studies have found that flipping bits in the address part inside a page table entry (PTE) leads to serious security risks such as privilege escalation. However, the risk of management bits in a PTE being flipped by RowHammer has not yet been discussed as far as we know. In this paper, we point out a new vulnerability called GbHammer that allows an attacker to maliciously share a physical memory page with a victim by hammering the global bit in a PTE. GbHammer not only creates a shared page but also enables the attacker to (1) make the victim's process execute arbitrary binary and (2) snoop on the victim's secret data through the shared page. We demonstrate the two exploits on a real Linux kernel running on a cycle-accurate CPU simulator. We also discuss possible mitigation measures for GbHammer and the risk of GbHammer in non-x86 ISAs.


title: A different approach to positive traces on generalized q-Weyl algebras

abstract: Positive twisted traces are mathematical objects that could be useful in computing certain parameters of superconformal field theories. The case when $\mathcal{A}$ is a $q$-Weyl algebra and $\rho$ is a certain antilinear automorphism of $\mathcal{A}$ was considered in arXiv:2105.12652. Here we consider more general choices of $\rho$. In particular, we show that for $\rho$ corresponding to a standard Schur index of a four-dimensional gauge theory a positive trace is unique.


title: Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?

abstract: Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases. Leveraging LCLMs' ability to natively ingest and process entire corpora of information offers numerous advantages. It enhances user-friendliness by eliminating the need for specialized knowledge of tools, provides robust end-to-end modeling that minimizes cascading errors in complex pipelines, and allows for the application of sophisticated prompting techniques across the entire system. To assess this paradigm shift, we introduce LOFT, a benchmark of real-world tasks requiring context up to millions of tokens designed to evaluate LCLMs' performance on in-context retrieval and reasoning. Our findings reveal LCLMs' surprising ability to rival state-of-the-art retrieval and RAG systems, despite never having been explicitly trained for these tasks. However, LCLMs still face challenges in areas like compositional reasoning that are required in SQL-like tasks. Notably, prompting strategies significantly influence performance, emphasizing the need for continued research as context lengths grow. Overall, LOFT provides a rigorous testing ground for LCLMs, showcasing their potential to supplant existing paradigms and tackle novel tasks as model capabilities scale.


title: Testing for Underpowered Literatures

abstract: How many experimental studies would have come to different conclusions had they been run on larger samples? I show how to estimate the expected number of statistically significant results that a set of experiments would have reported had their sample sizes all been counterfactually increased by a chosen factor. The estimator is consistent and asymptotically normal. Unlike existing methods, my approach requires no assumptions about the distribution of true effects of the interventions being studied other than continuity. This method includes an adjustment for publication bias in the reported t-scores. An application to randomized controlled trials (RCTs) published in top economics journals finds that doubling every experiment's sample size would only increase the power of two-sided t-tests by 7.2 percentage points on average. This effect is small and is comparable to the effect for systematic replication projects in laboratory psychology where previous studies enabled accurate power calculations ex ante. These effects are both smaller than for non-RCTs. This comparison suggests that RCTs are on average relatively insensitive to sample size increases. The policy implication is that grant givers should generally fund more experiments rather than fewer, larger ones.


title: ViLCo-Bench: VIdeo Language COntinual learning Benchmark

abstract: Video language continual learning involves continuously adapting to information from video and text inputs, enhancing a model's ability to handle new tasks while retaining prior knowledge. This field is a relatively under-explored area, and establishing appropriate datasets is crucial for facilitating communication and research in this field. In this study, we present the first dedicated benchmark, ViLCo-Bench, designed to evaluate continual learning models across a range of video-text tasks. The dataset comprises ten-minute-long videos and corresponding language queries collected from publicly available datasets. Additionally, we introduce a novel memory-efficient framework that incorporates self-supervised learning and mimics long-term and short-term memory effects. This framework addresses challenges including memory complexity from long video clips, natural language complexity from open queries, and text-video misalignment. We posit that ViLCo-Bench, with greater complexity compared to existing continual learning benchmarks, would serve as a critical tool for exploring the video-language domain, extending beyond conventional class-incremental tasks, and addressing complex and limited annotation issues. The curated data, evaluations, and our novel method are available at https://github.com/cruiseresearchgroup/ViLCo .


title: Learning to Generate Answers with Citations via Factual Consistency Models

abstract: Large Language Models (LLMs) frequently hallucinate, impeding their reliability in mission-critical situations. One approach to address this issue is to provide citations to relevant sources alongside generated content, enhancing the verifiability of generations. However, citing passages accurately in answers remains a substantial challenge. This paper proposes a weakly-supervised fine-tuning method leveraging factual consistency models (FCMs). Our approach alternates between generating texts with citations and supervised fine-tuning with FCM-filtered citation data. Focused learning is integrated into the objective, directing the fine-tuning process to emphasise the factual unit tokens, as measured by an FCM. Results on the ALCE few-shot citation benchmark with various instruction-tuned LLMs demonstrate superior performance compared to in-context learning, vanilla supervised fine-tuning, and state-of-the-art methods, with an average improvement of $34.1$, $15.5$, and $10.5$ citation F$_1$ points, respectively. Moreover, in a domain transfer setting we show that the obtained citation generation ability robustly transfers to unseen datasets. Notably, our citation improvements contribute to the lowest factual error rate across baselines.


title: A Unified Framework for Combinatorial Optimization Based on Graph Neural Networks

abstract: Graph neural networks (GNNs) have emerged as a powerful tool for solving combinatorial optimization problems (COPs), exhibiting state-of-the-art performance in both graph-structured and non-graph-structured domains. However, existing approaches lack a unified framework capable of addressing a wide range of COPs. After presenting a summary of representative COPs and a brief review of recent advancements in GNNs for solving COPs, this paper proposes a unified framework for solving COPs based on GNNs, including graph representation of COPs, equivalent conversion of non-graph structured COPs to graph-structured COPs, graph decomposition, and graph simplification. The proposed framework leverages the ability of GNNs to effectively capture the relational information and extract features from the graph representation of COPs, offering a generic solution to COPs that can address the limitations of state-of-the-art in solving non-graph-structured and highly complex graph-structured COPs.


title: Guided Context Gating: Learning to leverage salient lesions in retinal fundus images

abstract: Effectively representing medical images, especially retinal images, presents a considerable challenge due to variations in appearance, size, and contextual information of pathological signs called lesions. Precise discrimination of these lesions is crucial for diagnosing vision-threatening issues such as diabetic retinopathy. While visual attention-based neural networks have been introduced to learn spatial context and channel correlations from retinal images, they often fall short in capturing localized lesion context. Addressing this limitation, we propose a novel attention mechanism called Guided Context Gating, an unique approach that integrates Context Formulation, Channel Correlation, and Guided Gating to learn global context, spatial correlations, and localized lesion context. Our qualitative evaluation against existing attention mechanisms emphasize the superiority of Guided Context Gating in terms of explainability. Notably, experiments on the Zenodo-DR-7 dataset reveal a substantial 2.63% accuracy boost over advanced attention mechanisms & an impressive 6.53% improvement over the state-of-the-art Vision Transformer for assessing the severity grade of retinopathy, even with imbalanced and limited training samples for each class.


title: Oralytics Reinforcement Learning Algorithm

abstract: Dental disease is still one of the most common chronic diseases in the United States. While dental disease is preventable through healthy oral self-care behaviors (OSCB), this basic behavior is not consistently practiced. We have developed Oralytics, an online, reinforcement learning (RL) algorithm that optimizes the delivery of personalized intervention prompts to improve OSCB. In this paper, we offer a full overview of algorithm design decisions made using prior data, domain expertise, and experiments in a simulation test bed. The finalized RL algorithm was deployed in the Oralytics clinical trial, conducted from fall 2023 to summer 2024.


title: A New Approach for Evaluating and Improving the Performance of Segmentation Algorithms on Hard-to-Detect Blood Vessels

abstract: Many studies regarding the vasculature of biological tissues involve the segmentation of the blood vessels in a sample followed by the creation of a graph structure to model the vasculature. The graph is then used to extract relevant vascular properties. Small segmentation errors can lead to largely distinct connectivity patterns and a high degree of variability of the extracted properties. Nevertheless, global metrics such as Dice, precision, and recall are commonly applied for measuring the performance of blood vessel segmentation algorithms. These metrics might conceal important information about the accuracy at specific regions of a sample. To tackle this issue, we propose a local vessel salience (LVS) index to quantify the expected difficulty in segmenting specific blood vessel segments. The LVS index is calculated for each vessel pixel by comparing the local intensity of the vessel with the image background around the pixel. The index is then used for defining a new accuracy metric called low-salience recall (LSRecall), which quantifies the performance of segmentation algorithms on blood vessel segments having low salience. The perspective provided by the LVS index is used to define a data augmentation procedure that can be used to improve the segmentation performance of convolutional neural networks. We show that segmentation algorithms having high Dice and recall values can display very low LSRecall values, which reveals systematic errors of these algorithms for vessels having low salience. The proposed data augmentation procedure is able to improve the LSRecall of some samples by as much as 25%. The developed methodology opens up new possibilities for comparing the performance of segmentation algorithms regarding hard-to-detect blood vessels as well as their capabilities for vascular topology preservation.


title: M3T: Multi-Modal Medical Transformer to bridge Clinical Context with Visual Insights for Retinal Image Medical Description Generation

abstract: Automated retinal image medical description generation is crucial for streamlining medical diagnosis and treatment planning. Existing challenges include the reliance on learned retinal image representations, difficulties in handling multiple imaging modalities, and the lack of clinical context in visual representations. Addressing these issues, we propose the Multi-Modal Medical Transformer (M3T), a novel deep learning architecture that integrates visual representations with diagnostic keywords. Unlike previous studies focusing on specific aspects, our approach efficiently learns contextual information and semantics from both modalities, enabling the generation of precise and coherent medical descriptions for retinal images. Experimental studies on the DeepEyeNet dataset validate the success of M3T in meeting ophthalmologists' standards, demonstrating a substantial 13.5% improvement in BLEU@4 over the best-performing baseline model.


title: Advancing Retail Data Science: Comprehensive Evaluation of Synthetic Data

abstract: The evaluation of synthetic data generation is crucial, especially in the retail sector where data accuracy is paramount. This paper introduces a comprehensive framework for assessing synthetic retail data, focusing on fidelity, utility, and privacy. Our approach differentiates between continuous and discrete data attributes, providing precise evaluation criteria. Fidelity is measured through stability and generalizability. Stability ensures synthetic data accurately replicates known data distributions, while generalizability confirms its robustness in novel scenarios. Utility is demonstrated through the synthetic data's effectiveness in critical retail tasks such as demand forecasting and dynamic pricing, proving its value in predictive analytics and strategic planning. Privacy is safeguarded using Differential Privacy, ensuring synthetic data maintains a perfect balance between resembling training and holdout datasets without compromising security. Our findings validate that this framework provides reliable and scalable evaluation for synthetic retail data. It ensures high fidelity, utility, and privacy, making it an essential tool for advancing retail data science. This framework meets the evolving needs of the retail industry with precision and confidence, paving the way for future advancements in synthetic data methodologies.


title: When Parts are Greater Than Sums: Individual LLM Components Can Outperform Full Models

abstract: This paper studies in-context learning (ICL) by decomposing the output of large language models into the individual contributions of attention heads and MLPs (components). We observe curious components: good-performing ones that individually do well on a classification task, even when the model performs poorly; bad-performing ones that do much worse than chance; and label-biased components that always predict the same label. We find that component accuracies are well-correlated across different demonstration sets and perturbations of prompt templates, even when the full-model accuracy varies greatly. Based on our findings, we propose component reweighting, which learns to linearly re-scale the component activations from a few labeled examples. Given 24 labeled examples, our method improves by an average of 6.0% accuracy points over 24-shot ICL across 8 tasks on Llama-2-7B. Overall, this paper both enriches our understanding of ICL and provides a practical method for improvement by examining model internals.


title: Cosmic slowing down of acceleration with the Chaplygin-Jacobi gas as a dark fluid

abstract: A particular generalization of the Chaplygin inflationary model, using the formalism of Hamilton-Jacobi and elliptic functions, results in a more general non-linear Chaplygin-type equation of state (Chaplygin-Jacobi model). We investigate the implementation of this model as a dark energy (DE) fluid to explain the recent acceleration of the universe. Unlike $\Lambda$CDM and other Chaplygin-like fluids, where the final fate of the universe is an eternal de Sitter (dS) phase, the dynamics of this model allow for the possibility of a decelerating phase in the future, following the current accelerating phase. In other words, a transient acceleration arises, accounting for the recently claimed slowing down phenomenon. This Chaplygin-Jacobi model shows important differences compared to the standard and generalized Chaplygin gas models. Additionally, we perform a Markov Chain Monte Carlo (MCMC) analysis using several datasets, including Type Ia Supernovae (SnIa), Cosmic Chronometers (CC), and Fast Radio Bursts (FRBs), to examine the observational viability of the model. Our results indicate that a transient phase of accelerated expansion is not excluded by current observations.


title: PathoLM: Identifying pathogenicity from the DNA sequence through the Genome Foundation Model

abstract: Pathogen identification is pivotal in diagnosing, treating, and preventing diseases, crucial for controlling infections and safeguarding public health. Traditional alignment-based methods, though widely used, are computationally intense and reliant on extensive reference databases, often failing to detect novel pathogens due to their low sensitivity and specificity. Similarly, conventional machine learning techniques, while promising, require large annotated datasets and extensive feature engineering and are prone to overfitting. Addressing these challenges, we introduce PathoLM, a cutting-edge pathogen language model optimized for the identification of pathogenicity in bacterial and viral sequences. Leveraging the strengths of pre-trained DNA models such as the Nucleotide Transformer, PathoLM requires minimal data for fine-tuning, thereby enhancing pathogen detection capabilities. It effectively captures a broader genomic context, significantly improving the identification of novel and divergent pathogens. We developed a comprehensive data set comprising approximately 30 species of viruses and bacteria, including ESKAPEE pathogens, seven notably virulent bacterial strains resistant to antibiotics. Additionally, we curated a species classification dataset centered specifically on the ESKAPEE group. In comparative assessments, PathoLM dramatically outperforms existing models like DciPatho, demonstrating robust zero-shot and few-shot capabilities. Furthermore, we expanded PathoLM-Sp for ESKAPEE species classification, where it showed superior performance compared to other advanced deep learning methods, despite the complexities of the task.


title: Mode Coupling and Breathing Oscillation in Partially Magnetized Cross-Field Plasmas

abstract: We report on investigations of mode coupling between rotating spokes during the onset of the breathing oscillation. Demonstrating the existence of nonlinear coupling between the sporadic spokes and the breathing oscillation, we suggest the oscillating azimuthal electric field as the energy source for additional ionization within the plasma. Our results indicate that intermittent three-wave coupling is a possible mechanism for triggering low-frequency breathing oscillations in partially magnetized cross-field plasma.


title: Pair creation in electric fields

abstract: Sauter-Schwinger pair creation in electromagnetic fields is a fundamental prediction of QED and one of the motivations for the present efforts in constructing super-strong lasers. I will give a historical review of the subject, and then focus on two recent developments. The first one is the worldline instanton formalism, a sophisticated version of the WKB approximation that makes it possible to calculate the pair creation rate for complicated field configurations. The second one is an adaptation of the Dirac-Heisenberg-Wigner formalism suitable for a detailed study of the formation of real particles in time and space.


title: GVT2RPM: An Empirical Study for General Video Transformer Adaptation to Remote Physiological Measurement

abstract: Remote physiological measurement (RPM) is an essential tool for healthcare monitoring as it enables the measurement of physiological signs, e.g., heart rate, in a remote setting via physical wearables. Recently, with facial videos, we have seen rapid advancements in video-based RPMs. However, adopting facial videos for RPM in the clinical setting largely depends on the accuracy and robustness (work across patient populations). Fortunately, the capability of the state-of-the-art transformer architecture in general (natural) video understanding has resulted in marked improvements and has been translated to facial understanding, including RPM. However, existing RPM methods usually need RPM-specific modules, e.g., temporal difference convolution and handcrafted feature maps. Although these customized modules can increase accuracy, they are not demonstrated for their robustness across datasets. Further, due to their customization of the transformer architecture, they cannot use the advancements made in general video transformers (GVT). In this study, we interrogate the GVT architecture and empirically analyze how the training designs, i.e., data pre-processing and network configurations, affect the model performance applied to RPM. Based on the structure of video transformers, we propose to configure its spatiotemporal hierarchy to align with the dense temporal information needed in RPM for signal feature extraction. We define several practical guidelines and gradually adapt GVTs for RPM without introducing RPM-specific modules. Our experiments demonstrate favorable results to existing RPM-specific module counterparts. We conducted extensive experiments with five datasets using intra-dataset and cross-dataset settings. We highlight that the proposed guidelines GVT2RPM can be generalized to any video transformers and is robust to various datasets.


title: Efficient Sharpness-Aware Minimization for Molecular Graph Transformer Models

abstract: Sharpness-aware minimization (SAM) has received increasing attention in computer vision since it can effectively eliminate the sharp local minima from the training trajectory and mitigate generalization degradation. However, SAM requires two sequential gradient computations during the optimization of each step: one to obtain the perturbation gradient and the other to obtain the updating gradient. Compared with the base optimizer (e.g., Adam), SAM doubles the time overhead due to the additional perturbation gradient. By dissecting the theory of SAM and observing the training gradient of the molecular graph transformer, we propose a new algorithm named GraphSAM, which reduces the training cost of SAM and improves the generalization performance of graph transformer models. There are two key factors that contribute to this result: (i) \textit{gradient approximation}: we use the updating gradient of the previous step to approximate the perturbation gradient at the intermediate steps smoothly (\textbf{increases efficiency}); (ii) \textit{loss landscape approximation}: we theoretically prove that the loss landscape of GraphSAM is limited to a small range centered on the expected loss of SAM (\textbf{guarantees generalization performance}). The extensive experiments on six datasets with different tasks demonstrate the superiority of GraphSAM, especially in optimizing the model update process. The code is in:https://github.com/YL-wang/GraphSAM/tree/graphsam


title: Large Language Models are Biased Because They Are Large Language Models

abstract: This paper's primary goal is to provoke thoughtful discussion about the relationship between bias and fundamental properties of large language models. We do this by seeking to convince the reader that harmful biases are an inevitable consequence arising from the design of any large language model as LLMs are currently formulated. To the extent that this is true, it suggests that the problem of harmful bias cannot be properly addressed without a serious reconsideration of AI driven by LLMs, going back to the foundational assumptions underlying their design.


title: Audio Fingerprinting with Holographic Reduced Representations

abstract: This paper proposes an audio fingerprinting model with holographic reduced representation (HRR). The proposed method reduces the number of stored fingerprints, whereas conventional neural audio fingerprinting requires many fingerprints for each audio track to achieve high accuracy and time resolution. We utilize HRR to aggregate multiple fingerprints into a composite fingerprint via circular convolution and summation, resulting in fewer fingerprints with the same dimensional space as the original. Our search method efficiently finds a combined fingerprint in which a query fingerprint exists. Using HRR's inverse operation, it can recover the relative position within a combined fingerprint, retaining the original time resolution. Experiments show that our method can reduce the number of fingerprints with modest accuracy degradation while maintaining the time resolution, outperforming simple decimation and summation-based aggregation methods.


title: From decision aiding to the massive use of algorithms: where does the responsibility stand?

abstract: In the very large debates on ethics of algorithms, this paper proposes an analysis on human responsibility. On one hand, algorithms are designed by some humans, who bear a part of responsibility in the results and unexpected impacts. Nevertheless, we show how the fact they cannot embrace the full situations of use and consequences lead to an unreachable limit. On the other hand, using technology is never free of responsibility, even if there also exist limits to characterise. Massive uses by unprofessional users introduce additional questions that modify the possibilities to be ethically responsible. The article is structured in such a way as to show how the limits have gradually evolved, leaving unthought of issues and a failure to share responsibility.


title: Implant-to-Wearable Communication through the Human Body: Exploring the Effects of Encapsulated Capacitive and Galvanic Transmitters

abstract: Data transfer using human-body communication (HBC) represents an actively explored alternative solution to address the challenges related to energy-efficiency, tissue absorption, and security of conventional wireless. Although the use of HBC for wearable-to-wearable communication has been well-explored, different configurations for the transmitter (Tx) and receiver (Rx) for implant-to-wearable HBC needs further studies. This paper substantiates the hypothesis that a fully implanted galvanic Tx is more efficient than a capacitive Tx for interaction with a wearable Rx. Given the practical limitations of implanting an ideal capacitive device, we choose a galvanic device with one electrode encapsulated to model the capacitive scenario. We analyze the lumped circuit model for in-body to out-of-body communication, and perform Circuit-based as well as Finite Element Method (FEM) simulations to explore how the encapsulation thickness affects the received signal levels. We demonstrate in-vivo experimental results on live Sprague Dawley rats to validate the hypothesis, and show that compared to the galvanic Tx, the channel loss will be $\approx$ 20 dB higher with each additional mm thickness of capacitive encapsulation, eventually going below the noise floor for ideal capacitive Tx.


title: Optimal pre-train/fine-tune strategies for accurate material property predictions

abstract: Overcoming the challenge of limited data availability within materials science is crucial for the broad-based applicability of machine learning within materials science. One pathway to overcome this limited data availability is to use the framework of transfer learning (TL), where a pre-trained (PT) machine learning model (on a larger dataset) can be fine-tuned (FT) on a target (typically smaller) dataset. Our study systematically explores the effectiveness of various PT/FT strategies to learn and predict material properties with limited data. Specifically, we leverage graph neural networks (GNNs) to PT/FT on seven diverse curated materials datasets, encompassing sizes ranging from 941 to 132,752 datapoints. We consider datasets that cover a spectrum of material properties, ranging from band gaps (electronic) to formation energies (thermodynamic) and shear moduli (mechanical). We study the influence of PT and FT dataset sizes, strategies that can be employed for FT, and other hyperparameters on pair-wise TL among the datasets considered. We find our pair-wise PT-FT models to consistently outperform models trained from scratch on the target datasets. Importantly, we develop a GNN framework that is simultaneously PT on multiple properties (MPT), enabling the construction of generalized GNN models. Our MPT models outperform pair-wise PT-FT models on several datasets considered, and more significantly, on a 2D material band gap dataset that is completely out-of-distribution from the PT datasets. Finally, we expect our PT/FT and MPT frameworks to be generalizable to other GNNs and materials properties, which can accelerate materials design and discovery for various applications.


title: Picturing global substorm dynamics in the magnetotail using low-altitude ELFIN measurements and data mining-based magnetic field reconstructions

abstract: A global reconfiguration of the magnetotail characterizes substorms. Current sheet thinning, intensification, and magnetic field stretching are defining features of the substorm growth phase and their spatial distributions control the timing and location of substorm onset. Presently, sparse in-situ observations cannot resolve these distributions. A promising approach is to use new substorm magnetic field reconstruction methods based on data mining, termed SST19. Here we compare the SST19 reconstructions to low-altitude ELFIN measurements of energetic particle precipitations to probe the radial profile of the equatorial magnetic field curvature during a 19~August 2022 substorm. ELFIN and SST19 yield a consistent dynamical picture of the magnetotail during the growth phase and capture expected features such as the formation of a thin current sheet and its earthward motion. Furthermore, they resolve a V-like pattern of isotropic electron precipitation boundaries in the time-energy plane, consistent with earlier observations but now over a broad energy range.


title: DialSim: A Real-Time Simulator for Evaluating Long-Term Dialogue Understanding of Conversational Agents

abstract: Recent advancements in Large Language Models (LLMs) have significantly enhanced the capabilities of conversational agents, making them applicable to various fields (e.g., education). Despite their progress, the evaluation of the agents often overlooks the complexities of real-world conversations, such as real-time interactions, multi-party dialogues, and extended contextual dependencies. To bridge this gap, we introduce DialSim, a real-time dialogue simulator. In this simulator, an agent is assigned the role of a character from popular TV shows, requiring it to respond to spontaneous questions using past dialogue information and to distinguish between known and unknown information. Key features of DialSim include evaluating the agent's ability to respond within a reasonable time limit, handling long-term multi-party dialogues, and managing adversarial settings (e.g., swap character names) to challenge the agent's reliance on pre-trained knowledge. We utilized this simulator to evaluate the latest conversational agents and analyze their limitations. Our experiments highlight both the strengths and weaknesses of these agents, providing valuable insights for future improvements in the field of conversational AI. DialSim is available at https://github.com/jiho283/Simulator.


title: Constructing and Evaluating Digital Twins: An Intelligent Framework for DT Development

abstract: The development of Digital Twins (DTs) represents a transformative advance for simulating and optimizing complex systems in a controlled digital space. Despite their potential, the challenge of constructing DTs that accurately replicate and predict the dynamics of real-world systems remains substantial. This paper introduces an intelligent framework for the construction and evaluation of DTs, specifically designed to enhance the accuracy and utility of DTs in testing algorithmic performance. We propose a novel construction methodology that integrates deep learning-based policy gradient techniques to dynamically tune the DT parameters, ensuring high fidelity in the digital replication of physical systems. Moreover, the Mean STate Error (MSTE) is proposed as a robust metric for evaluating the performance of algorithms within these digital space. The efficacy of our framework is demonstrated through extensive simulations that show our DT not only accurately mirrors the physical reality but also provides a reliable platform for algorithm evaluation. This work lays a foundation for future research into DT technologies, highlighting pathways for both theoretical enhancements and practical implementations in various industries.


title: Adiabatic Mass Loss In Binary Stars. IV. Low and Intermediate Mass Helium Binary Stars

abstract: The unstable mass transfer situation in binary systems will asymptotically cause the adiabatic expansion of the donor star and finally lead to the common envelope phase. This process could happen in helium binary systems once the helium donor star fills its Roche-lobe. We have calculated the adiabatic mass loss model of naked helium stars with a mass range of 0.35\,$M_{\odot}$ to 10\,$M_{\odot}$, and every mass sequence evolved from the He-ZAMS to the cooling track of white dwarf or carbon ignition. In consideration of the influence of stellar wind, massive helium stars are not considered in this paper. Comparing stellar radius with the evolution of the Roche-lobe under the assumption of conservative mass transfer, we give the critical mass ratio $q_{\textrm{crit}}=M_{\textrm{He}}/M_{\textrm{accretor}}$ as the binary stability criteria of low and intermediate-mass helium binary stars. On He-MS, the result shows $1.0<q_{\textrm{crit}}<2.6$, which is more unstable than the classical result of polytropic model $q_{\textrm{crit}}=3$. After early He-HG, the $q_{\textrm{crit}}$ quickly increases even larger than 10 (more stable compared with widely used result $q_{\textrm{crit}}=4$), which is dominated by the expansion of radiative envelope. Our result could be useful for these quick mass transfer binary systems such as AM CVns, UCXBs, and helium novae, and it could guide the binary population synthesis for the formation of special objects such as SNe Ia and GW sources.


title: A Simulation Environment for the Neuroevolution of Ant Colony Dynamics

abstract: We introduce a simulation environment to facilitate research into emergent collective behaviour, with a focus on replicating the dynamics of ant colonies. By leveraging real-world data, the environment simulates a target ant trail that a controllable agent must learn to replicate, using sensory data observed by the target ant. This work aims to contribute to the neuroevolution of models for collective behaviour, focusing on evolving neural architectures that encode domain-specific behaviours in the network topology. By evolving models that can be modified and studied in a controlled environment, we can uncover the necessary conditions required for collective behaviours to emerge. We hope this environment will be useful to those studying the role of interactions in emergent behaviour within collective systems.


title: Data Value in Distribution System Operations

abstract: The rise of advanced data technologies in electric power distribution systems enables operators to optimize operations but raises concerns about data security and consumer privacy. Resulting data protection mechanisms that alter or obfuscate datasets may invalidate the efficacy of data-driven decision-support tools and impact the value of these datasets to the decision-maker. This paper derives tools for distribution system operators to enrich data-driven operative decisions with information on data quality and, simultaneously, assess data usefulness in the context of this decision. To this end, we derive an AC optimal power flow model for radial distribution systems with data-informed stochastic parameters that internalize a data quality metric. We derive a tractable reformulation and discuss the marginal sensitivity of the optimal solution as a proxy for data value. Our model can capture clustered data provision, e.g., from resource aggregators, and internalize individual data quality information from each data provider. We use the IEEE 33-bus test system, examining scenarios with varying photovoltaic penetration, to demonstrate the application of our approach and discuss the relationship between data quality and its value.


title: High-Fidelity Facial Albedo Estimation via Texture Quantization

abstract: Recent 3D face reconstruction methods have made significant progress in shape estimation, but high-fidelity facial albedo reconstruction remains challenging. Existing methods depend on expensive light-stage captured data to learn facial albedo maps. However, a lack of diversity in subjects limits their ability to recover high-fidelity results. In this paper, we present a novel facial albedo reconstruction model, HiFiAlbedo, which recovers the albedo map directly from a single image without the need for captured albedo data. Our key insight is that the albedo map is the illumination invariant texture map, which enables us to use inexpensive texture data to derive an albedo estimation by eliminating illumination. To achieve this, we first collect large-scale ultra-high-resolution facial images and train a high-fidelity facial texture codebook. By using the FFHQ dataset and limited UV textures, we then fine-tune the encoder for texture reconstruction from the input image with adversarial supervision in both image and UV space. Finally, we train a cross-attention module and utilize group identity loss to learn the adaptation from facial texture to the albedo domain. Extensive experimentation has demonstrated that our method exhibits excellent generalizability and is capable of achieving high-fidelity results for in-the-wild facial albedo recovery. Our code, pre-trained weights, and training data will be made publicly available at https://hifialbedo.github.io/.