title: The extended reverse ultra log-concavity of transposed Boros-Moll sequences

abstract: The Boros-Moll sequences $\{d_\ell(m)\}_{\ell=0}^m$ arise in the study of evaluation of a quartic integral. After the infinite log-concavity conjecture of the sequence $\{d_\ell(m)\}_{\ell=0}^m$ was proposed by Boros and Moll, a lot of interesting inequalities on $d_\ell(m)$ were obtained, although the conjecture is still open. Since $d_\ell(m)$ has two parameters, it is natural to consider the properties for the sequences $\{d_\ell(m)\}_{m\ge \ell}$, which are called the \emph{transposed Boros-Moll sequences} here. In this paper, we mainly prove the extended reverse ultra log-concavity of the transposed Boros-Moll sequences $\{d_\ell(m)\}_{m\ge \ell}$, and hence give an upper bound for the ratio ${d_\ell^2(m)}/{(d_\ell(m-1)d_\ell(m+1))}$. A lower bound for this ratio is also established which implies a result stronger than the log-concavity of the sequences $\{d_\ell(m)\}_{m\ge \ell}$. As a consequence, we also show that the transposed Boros-Moll sequences possess a stronger log-concave property than the Boros-Moll sequences do. At last, we propose some conjectures on the Boros-Moll sequences and their transposes.


title: IoT-Based Preventive Mental Health Using Knowledge Graphs and Standards for Better Well-Being

abstract: Sustainable Development Goals (SDGs) give the UN a road map for development with Agenda 2030 as a target. SDG3 "Good Health and Well-Being" ensures healthy lives and promotes well-being for all ages. Digital technologies can support SDG3. Burnout and even depression could be reduced by encouraging better preventive health. Due to the lack of patient knowledge and focus to take care of their health, it is necessary to help patients before it is too late. New trends such as positive psychology and mindfulness are highly encouraged in the USA. Digital Twin (DT) can help with the continuous monitoring of emotion using physiological signals (e.g., collected via wearables). Digital twins facilitate monitoring and provide constant health insight to improve quality of life and well-being with better personalization. Healthcare DT challenges are standardizing data formats, communication protocols, and data exchange mechanisms. To achieve those data integration and knowledge challenges, we designed the Mental Health Knowledge Graph (ontology and dataset) to boost mental health. The Knowledge Graph (KG) acquires knowledge from ontology-based mental health projects classified within the LOV4IoT ontology catalog (Emotion, Depression, and Mental Health). Furthermore, the KG is mapped to standards (e.g., ontologies) when possible. Standards from ETSI SmartM2M, ITU/WHO, ISO, W3C, NIST, and IEEE are relevant to mental health.


title: Holographic real and imaginary potentials of heavy quarkonium in Yang-Mills-dilaton black holes

abstract: Within the methods of the real and the imaginary potential for investigating the melting of a heavy quarkonium in the AdS/CFT correspondence, we study the effects of the dynamical exponent, the hyperscaling violation parameter, and the Yang-Mills charge on both methods in the hyperscaling violated Yang-Mills-dilaton metric background. In the real part of the potential, we find out that the dynamical exponent, the hyperscaling violation parameter, and the Yang-Mills charge increase the real potential and decrease the dissociation length, and hence the quarkonium dissociates easily. In the imaginary part of the potential, we show that the dynamical exponent, the hyperscaling violation parameter, and the Yang-Mills charge tend to decrease the thermal width, thus strengthening the suppression of the heavy quarkonium, and making the melting process easier. Also, we show that the obtained results from the real and imaginary potential methods are compatible and complementary.


title: Exploring the Optimal Time Window for Predicting Cognitive Load Using Physiological Sensor Data

abstract: Learning analytics has begun to use physiological signals because these have been linked with learners' cognitive and affective states. These signals, when interpreted through machine learning techniques, offer a nuanced understanding of the temporal dynamics of student learning experiences and processes. However, there is a lack of clear guidance on the optimal time window to use for analyzing physiological signals within predictive models. We conducted an empirical investigation of different time windows (ranging from 60 to 210 seconds) when analysing multichannel physiological sensor data for predicting cognitive load. Our results demonstrate a preference for longer time windows, with optimal window length typically exceeding 90 seconds. These findings challenge the conventional focus on immediate physiological responses, suggesting that a broader temporal scope could provide a more comprehensive understanding of cognitive processes. In addition, the variation in which time windows best supported prediction across classifiers underscores the complexity of integrating physiological measures. Our findings provide new insights for developing educational technologies that more accurately reflect and respond to the dynamic nature of learner cognitive load in complex learning environments.


title: Adaptive Curves for Optimally Efficient Market Making

abstract: Automated Market Makers (AMMs) are essential in Decentralized Finance (DeFi) as they match liquidity supply with demand. They function through liquidity providers (LPs) who deposit assets into liquidity pools. However, the asset trading prices in these pools often trail behind those in more dynamic, centralized exchanges, leading to potential arbitrage losses for LPs. This issue is tackled by adapting market maker bonding curves to trader behavior, based on the classical market microstructure model of Glosten and Milgrom. Our approach ensures a zero-profit condition for the market maker's prices. We derive the differential equation that an optimal adaptive curve should follow to minimize arbitrage losses while remaining competitive. Solutions to this optimality equation are obtained for standard Gaussian and Lognormal price models using Kalman filtering. A key feature of our method is its ability to estimate the external market price without relying on price or loss oracles. We also provide an equivalent differential equation for the implied dynamics of canonical static bonding curves and establish conditions for their optimality. Our algorithms demonstrate robustness to changing market conditions and adversarial perturbations, and we offer an on-chain implementation using Uniswap v4 alongside off-chain AI co-processors.


title: Perspective: Interactions mediated by atoms, photons, electrons, and excitons

abstract: Interactions between quasiparticles mediated by a surrounding environment are ubiquitous and lead to a range of important effects from collective modes of low temperature quantum gases, superconductivity, to the interaction between elementary particles at high energies. This perspective article is motivated by experimental progress in the fields of quantum degenerate atomic gases, cavity QED, and two-dimensional (2D) semi-conductors, which enable a systematic exploration of mediated interactions in new settings and regimes. We first describe how to microscopically calculate the quasiparticle interaction using perturbation theory, diagrammatics, and the path integral, highlighting the key role played by the quantum statistics of the quasiparticles. Recent theoretical and experimental insights into quasiparticle and mediated interactions in general obtained from atomic gases are then discussed, after which we focus on hybrid light-atom systems where a remarkable long range photon mediated interaction can be realised. Next, we describe new and puzzling results regarding the interaction between quasiparticles in 2D semiconductors. We then discuss how mediated interactions open up ways to realise new quantum phases in atomic and hybrid atom-photon systems as well as 2D semiconductors, and the perspective ends by posing some open questions and outlook.


title: NeRF-Feat: 6D Object Pose Estimation using Feature Rendering

abstract: Object Pose Estimation is a crucial component in robotic grasping and augmented reality. Learning based approaches typically require training data from a highly accurate CAD model or labeled training data acquired using a complex setup. We address this by learning to estimate pose from weakly labeled data without a known CAD model. We propose to use a NeRF to learn object shape implicitly which is later used to learn view-invariant features in conjunction with CNN using a contrastive loss. While NeRF helps in learning features that are view-consistent, CNN ensures that the learned features respect symmetry. During inference, CNN is used to predict view-invariant features which can be used to establish correspondences with the implicit 3d model in NeRF. The correspondences are then used to estimate the pose in the reference frame of NeRF. Our approach can also handle symmetric objects unlike other approaches using a similar training setup. Specifically, we learn viewpoint invariant, discriminative features using NeRF which are later used for pose estimation. We evaluated our approach on LM, LM-Occlusion, and T-Less dataset and achieved benchmark accuracy despite using weakly labeled data.


title: Quantum automata and languages of finite index

abstract: This paper is a continuation of a previous study on the so-called measure once finite quantum automata model introduced by Moore and Crutchfield in 2000. We investigate conditions assuring that, given a language recognized by such a device and a language generated by a context-free grammar of finite index or by a matrix context-free grammar, it is recursively decidable whether or not they have a nonempty intersection.


title: Aubin Property and Strong Regularity Are Equivalent for Nonlinear Second-Order Cone Programming

abstract: This paper solves a fundamental open problem in variational analysis on the equivalence between the Aubin property and the strong regularity for nonlinear second-order cone programming (SOCP) at a locally optimal solution. We achieve this by introducing a reduction approach to the Aubin property characterized by the Mordukhovich criterion and a lemma of alternative choices on cones to replace the S-lemma used in Outrata and Ram\'irez [SIAM J. Optim. 21 (2011) 789-823] and Opazo, Outrata, and Ram\'irez [SIAM J. Optim. 27 (2017) 2141-2151], where the same SOCP was considered under the strict complementarity condition except for possibly only one block of constraints. As a byproduct, we also offer a new approach to the well-known result of Dontchev and Rockafellar [SIAM J. Optim. 6 (1996) 1087-1105] on the equivalence of the two concepts in conventional nonlinear programming.


title: Observation of Electronic Viscous Dissipation in Graphene Magneto-thermal Transport

abstract: Hydrodynamic transport effectively describes the collective dynamics of fluids with well-defined thermodynamic quantities. With enhanced electron-electron interactions at elevated temperatures, the collective behavior of electrons in graphene with minimal impurities can be depicted as a hydrodynamic flow of charges. In this new regime, the well-known rules of Ohmic transport based on a single electron picture no longer apply, necessitating the consideration of collective electron dynamics. In particular, the hydrodynamic analogues of Joule heating and thermal transport require consideration of the viscous motion of the electron fluid, which has a direct impact on energy dissipation and heat generation by the fluidic motion of charge. In this work, we probe graphene hydrodynamics with thermal transport and find two distinct, qualitative signatures: thermal conductivity suppression below the Wiedemann-Franz value and viscous heating leading to magnetically-induced redistribution of temperature. We find these two effects are coincident in temperature and density, providing robust qualitative signatures of hydrodynamics, despite arising from two distinct aspects of this new regime: microscopic momentum conservation due to electron-electron scattering, and geometry-dependent viscous dissipation. Our results mark the first observation of viscous electronic heating in an electron fluid, providing insight for thermal management in electronic hydrodynamic devices and offering a new methodology for identifying hydrodynamic states in other systems.


title: A Graph Model and a Layout Algorithm for Knitting Patterns

abstract: Knitting, an ancient fiber art, creates a structured fabric consisting of loops or stitches. Publishing hand knitting patterns involves lengthy testing periods and numerous knitters. Modeling knitting patterns with graphs can help expedite error detection and pattern validation. In this paper, we describe how to model simple knitting patterns as planar graphs. We then design, implement, and evaluate a layout algorithm to visualize knitting patterns. Knitting patterns correspond to graphs with pre-specified edge lengths (e.g., uniform lengths, two lengths, etc.). This yields a natural graph layout optimization problem: realize a planar graph with pre-specified edge lengths, while ensuring there are no edge crossings. We quantitatively evaluate our algorithm using real knitting patterns of various sizes against three others; one created for knitting patterns, one that maintains planarity and optimizes edge lengths, and a popular force-directed algorithm.


title: A Census of the Deep Radio Sky with the VLA I: 10GHz Survey of the GOODS-N field

abstract: We present the first high-resolution, high-frequency radio continuum survey that fully maps an extragalactic deep field: the 10GHz survey of the Great Observatories Origins Deep Survey-North (GOODS-N) field. This is a Large Program of the Karl G. Jansky Very Large Array that allocated 380 hours of observations using the X-band ($8-12$GHz) receivers, leading to a 10GHz mosaic of the GOODS-field with an average rms noise $\sigma_{\rm n}=671\,\rm nJy\,beam^{-1}$ and angular resolution $\theta_{1/2}=0.22$arcsec across 297$\rm arcmin^2$. To maximize the brightness sensitivity we also produce a low-resolution mosaic with $\theta_{1/2}=1.0$arcsec and $\sigma_{\rm n}=968\,\rm nJy\,beam^{-1}$, from which we derive our master catalog containing 256 radio sources detected with peak signal-to-noise ratio $\geq 5$. Radio source size and flux density estimates from the high-resolution mosaic are provided in the master catalog as well. The total fraction of spurious sources in the catalog is 0.75%. Monte Carlo simulations are performed to derive completeness corrections of the catalog. We find that the 10GHz radio source counts in the GOODS-N field agree, in general, with predictions from numerical simulations/models and expectations from 1.4 and 3GHz radio counts.


title: Sextactic and type-9 points on the Fermat cubic and associated objects

abstract: In this note we study line and conic arrangements associated to sextactic and type 9 points on the Fermat cubic $F$ and we provide explicit coordinates for each of the 72 type 9 points on $F$.


title: Semantic Structure-Mapping in LLM and Human Analogical Reasoning

abstract: Analogical reasoning is considered core to human learning and cognition. Recent studies have compared the analogical reasoning abilities of human subjects and Large Language Models (LLMs) on abstract symbol manipulation tasks, such as letter string analogies. However, these studies largely neglect analogical reasoning over semantically meaningful symbols, such as natural language words. This ability to draw analogies that link language to non-linguistic domains, which we term semantic structure-mapping, is thought to play a crucial role in language acquisition and broader cognitive development. We test human subjects and LLMs on analogical reasoning tasks that require the transfer of semantic structure and content from one domain to another. Advanced LLMs match human performance across many task variations. However, humans and LLMs respond differently to certain task variations and semantic distractors. Overall, our data suggest that LLMs are approaching human-level performance on these important cognitive tasks, but are not yet entirely human like.


title: Elasticity and acoustic velocities of $\delta$-AlOOH at extreme conditions: a methodology assessment

abstract: Hydrous phases play a fundamental role in the deep-water cycle on Earth. Understanding their stability and thermoelastic properties is essential for constraining their abundance using seismic tomography. However, determining their elastic properties at extreme conditions is notoriously challenging. The challenges stem from the complex behavior of hydrogen bonds under high pressures and temperatures (P,Ts). In this study, we evaluate how advanced molecular dynamics simulation techniques can address these challenges by investigating the adiabatic elasticity and acoustic velocities of $\delta$-AlOOH, a critical and prototypical high-pressure hydrous phase. We compared the performances of three methods to assess their viability and accuracy. The thermoelastic tensor was computed up to 140 GPa and temperatures up to 2,700 K using molecular dynamics with a DeePMD machine-learning interatomic potential based on the SCAN meta-GGA functional. The excellent agreement with ambient condition single-crystal ultrasound measurements and the correct description of velocity changes induced by H-bond disorder-symmetrization transition observed at 10 GPa in Brillouin scattering measurements underscores the accuracy and efficacy of our approach.


title: WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia

abstract: Retrieval-augmented generation (RAG) has emerged as a promising solution to mitigate the limitations of large language models (LLMs), such as hallucinations and outdated information. However, it remains unclear how LLMs handle knowledge conflicts arising from different augmented retrieved passages, especially when these passages originate from the same source and have equal trustworthiness. In this work, we conduct a comprehensive evaluation of LLM-generated answers to questions that have varying answers based on contradictory passages from Wikipedia, a dataset widely regarded as a high-quality pre-training resource for most LLMs. Specifically, we introduce WikiContradict, a benchmark consisting of 253 high-quality, human-annotated instances designed to assess LLM performance when augmented with retrieved passages containing real-world knowledge conflicts. We benchmark a diverse range of both closed and open-source LLMs under different QA scenarios, including RAG with a single passage, and RAG with 2 contradictory passages. Through rigorous human evaluations on a subset of WikiContradict instances involving 5 LLMs and over 3,500 judgements, we shed light on the behaviour and limitations of these models. For instance, when provided with two passages containing contradictory facts, all models struggle to generate answers that accurately reflect the conflicting nature of the context, especially for implicit conflicts requiring reasoning. Since human evaluation is costly, we also introduce an automated model that estimates LLM performance using a strong open-source language model, achieving an F-score of 0.8. Using this automated metric, we evaluate more than 1,500 answers from seven LLMs across all WikiContradict instances. To facilitate future work, we release WikiContradict on: https://ibm.biz/wikicontradict.


title: First detection of coherent elastic neutrino-nucleus scattering on germanium

abstract: We report the first detection of coherent elastic neutrino-nucleus scattering (CEvNS) on germanium, measured at the Spallation Neutron Source at Oak Ridge National Laboratory. The Ge-Mini detector of the COHERENT collaboration employs large-mass, low-noise, high-purity germanium spectrometers, enabling excellent energy resolution, and an analysis threshold of 1.5 keV electron-equivalent ionization energy. We observe a on-beam excess of 20.6$_{+7.1}^{-6.3}$ counts with a total exposure of 10.22 GWhkg and we reject the no-CEvNS hypothesis with 3.9 sigma significance. The result agrees with the predicted standard model of particle physics signal rate within 2 sigma.


title: AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding

abstract: AI personal assistants deployed via robots or wearables require embodied understanding to collaborate with humans effectively. However, current Vision-Language Models (VLMs) primarily focus on third-person view videos, neglecting the richness of egocentric perceptual experience. To address this gap, we propose three key contributions. First, we introduce the Egocentric Video Understanding Dataset (EVUD) for training VLMs on video captioning and question answering tasks specific to egocentric videos. Second, we present AlanaVLM, a 7B parameter VLM trained using parameter-efficient methods on EVUD. Finally, we evaluate AlanaVLM's capabilities on OpenEQA, a challenging benchmark for embodied video question answering. Our model achieves state-of-the-art performance, outperforming open-source models including strong Socratic models using GPT-4 as a planner by 3.6%. Additionally, we outperform Claude 3 and Gemini Pro Vision 1.0 and showcase competitive results compared to Gemini Pro 1.5 and GPT-4V, even surpassing the latter in spatial reasoning. This research paves the way for building efficient VLMs that can be deployed in robots or wearables, leveraging embodied video understanding to collaborate seamlessly with humans in everyday tasks, contributing to the next generation of Embodied AI.


title: Can Low-Rank Knowledge Distillation in LLMs be Useful for Microelectronic Reasoning?

abstract: In this work, we present empirical results regarding the feasibility of using offline large language models (LLMs) in the context of electronic design automation (EDA). The goal is to investigate and evaluate a contemporary language model's (Llama-2-7B) ability to function as a microelectronic Q & A expert as well as its reasoning, and generation capabilities in solving microelectronic-related problems. Llama-2-7B was tested across a variety of adaptation methods, including introducing a novel low-rank knowledge distillation (LoRA-KD) scheme. Our experiments produce both qualitative and quantitative results.


title: Towards Holistic Language-video Representation: the language model-enhanced MSR-Video to Text Dataset

abstract: A more robust and holistic language-video representation is the key to pushing video understanding forward. Despite the improvement in training strategies, the quality of the language-video dataset is less attention to. The current plain and simple text descriptions and the visual-only focus for the language-video tasks result in a limited capacity in real-world natural language video retrieval tasks where queries are much more complex. This paper introduces a method to automatically enhance video-language datasets, making them more modality and context-aware for more sophisticated representation learning needs, hence helping all downstream tasks. Our multifaceted video captioning method captures entities, actions, speech transcripts, aesthetics, and emotional cues, providing detailed and correlating information from the text side to the video side for training. We also develop an agent-like strategy using language models to generate high-quality, factual textual descriptions, reducing human intervention and enabling scalability. The method's effectiveness in improving language-video representation is evaluated through text-video retrieval using the MSR-VTT dataset and several multi-modal retrieval models.


title: Harvesting Deformation Modes for Micromorphic Homogenization from Experiments on Mechanical Metamaterials

abstract: A micromorphic computational homogenization framework has recently been developed to deal with materials showing long-range correlated interactions, i.e. displaying patterning modes. Typical examples of such materials are elastomeric mechanical metamaterials, in which patterning emerges from local buckling of the underlying microstructure. Because pattern transformations significantly influence the resulting effective behaviour, it is vital to distinguish them from the overall deformation. To this end, the following kinematic decomposition into three parts was introduced in the micromorphic scheme: (i) a smooth mean displacement field, corresponding to the slowly varying deformation at the macro-scale, (ii) a long-range correlated fluctuation field, related to the buckling pattern at the meso-scale, and (iii) the remaining uncorrelated local microfluctuation field at the micro-scale. The micromorphic framework has proven to be capable of predicting relevant mechanical behaviour, including size effects and spatial as well as temporal mixing of patterns in elastomeric metamaterials, making it a powerful tool to design metamaterials for engineering applications. The long-range correlated fluctuation fields need to be, however, provided a priori as input parameters. The main goal of this study is experimental identification of the decomposed kinematics in cellular metamaterials based on the three-part ansatz. To this end, a full-field micromorphic Integrated Digital Image Correlation (IDIC) technique has been developed. The methodology is formulated for finite-size cellular elastomeric metamaterial specimens deformed in (i) virtually generated images and (ii) experimental images attained during in-situ compression of specimens with millimetre sized microstructure using optical microscopy.


title: Seasonal footprints on ecological time series and jumps in dynamic states of protein configurations from a non-linear forecasting method characterization

abstract: We have analyzed phenology data and jumps in protein configurations with the non-linear forecasting method proposed by May and Sugihara \cite{MS90}. Full plots of prediction quality as a function of dimensionality and forecasting time give fast and valuable information about Complex Systems dynamics.


title: Single-shot quantum machine learning

abstract: Quantum machine learning aims to improve learning methods through the use of quantum computers. If it is to ever realize its potential, many obstacles need to be overcome. A particularly pressing one arises at the prediction stage because the outputs of quantum learning models are inherently random. This creates an often considerable overhead, as many executions of a quantum learning model have to be aggregated to obtain an actual prediction. In this work, we analyze when quantum learning models can evade this issue and produce predictions in a near-deterministic way -- paving the way to single-shot quantum machine learning. We give a rigorous definition of single-shotness in quantum classifiers and show that the degree to which a quantum learning model is near-deterministic is constrained by the distinguishability of the embedded quantum states used in the model. Opening the black box of the embedding, we show that if the embedding is realized by quantum circuits, a certain depth is necessary for single-shotness to be even possible. We conclude by showing that quantum learning models cannot be single-shot in a generic way and trainable at the same time.


title: The Efficacy of Conversational Artificial Intelligence in Rectifying the Theory of Mind and Autonomy Biases: Comparative Analysis

abstract: The study evaluates the efficacy of Conversational Artificial Intelligence (CAI) in rectifying cognitive biases and recognizing affect in human-AI interactions, which is crucial for digital mental health interventions. Cognitive biases (systematic deviations from normative thinking) affect mental health, intensifying conditions like depression and anxiety. Therapeutic chatbots can make cognitive-behavioral therapy (CBT) more accessible and affordable, offering scalable and immediate support. The research employs a structured methodology with clinical-based virtual case scenarios simulating typical user-bot interactions. Performance and affect recognition were assessed across two categories of cognitive biases: theory of mind biases (anthropomorphization of AI, overtrust in AI, attribution to AI) and autonomy biases (illusion of control, fundamental attribution error, just-world hypothesis). A qualitative feedback mechanism was used with an ordinal scale to quantify responses based on accuracy, therapeutic quality, and adherence to CBT principles. Therapeutic bots (Wysa, Youper) and general-use LLMs (GTP 3.5, GTP 4, Gemini Pro) were evaluated through scripted interactions, double-reviewed by cognitive scientists and a clinical psychologist. Statistical analysis showed therapeutic bots were consistently outperformed by non-therapeutic bots in bias rectification and in 4 out of 6 biases in affect recognition. The data suggests that non-therapeutic chatbots are more effective in addressing some cognitive biases.


title: Evaluation of Missing Data Analytical Techniques in Longitudinal Research: Traditional and Machine Learning Approaches

abstract: Missing Not at Random (MNAR) and nonnormal data are challenging to handle. Traditional missing data analytical techniques such as full information maximum likelihood estimation (FIML) may fail with nonnormal data as they are built on normal distribution assumptions. Two-Stage Robust Estimation (TSRE) does manage nonnormal data, but both FIML and TSRE are less explored in longitudinal studies under MNAR conditions with nonnormal distributions. Unlike traditional statistical approaches, machine learning approaches do not require distributional assumptions about the data. More importantly, they have shown promise for MNAR data; however, their application in longitudinal studies, addressing both Missing at Random (MAR) and MNAR scenarios, is also underexplored. This study utilizes Monte Carlo simulations to assess and compare the effectiveness of six analytical techniques for missing data within the growth curve modeling framework. These techniques include traditional approaches like FIML and TSRE, machine learning approaches by single imputation (K-Nearest Neighbors and missForest), and machine learning approaches by multiple imputation (micecart and miceForest). We investigate the influence of sample size, missing data rate, missing data mechanism, and data distribution on the accuracy and efficiency of model estimation. Our findings indicate that FIML is most effective for MNAR data among the tested approaches. TSRE excels in handling MAR data, while missForest is only advantageous in limited conditions with a combination of very skewed distributions, very large sample sizes (e.g., n larger than 1000), and low missing data rates.


title: IG-CFAT: An Improved GAN-Based Framework for Effectively Exploiting Transformers in Real-World Image Super-Resolution

abstract: In the field of single image super-resolution (SISR), transformer-based models, have demonstrated significant advancements. However, the potential and efficiency of these models in applied fields such as real-world image super-resolution are less noticed and there are substantial opportunities for improvement. Recently, composite fusion attention transformer (CFAT), outperformed previous state-of-the-art (SOTA) models in classic image super-resolution. This paper extends the CFAT model to an improved GAN-based model called IG-CFAT to effectively exploit the performance of transformers in real-world image super-resolution. IG-CFAT incorporates a semantic-aware discriminator to reconstruct image details more accurately, significantly improving perceptual quality. Moreover, our model utilizes an adaptive degradation model to better simulate real-world degradations. Our methodology adds wavelet losses to conventional loss functions of GAN-based super-resolution models to reconstruct high-frequency details more efficiently. Empirical results demonstrate that IG-CFAT sets new benchmarks in real-world image super-resolution, outperforming SOTA models in both quantitative and qualitative metrics.


title: The Dangerous Allure of Low Fertility

abstract: Stochastic population and wealth trajectories for societies as functions of fertility are modeled with a minimal, endogenous model of a simple foraging economy. The model is scaled to match human lifespans and overall death rates. Stochastic population instability at both the high and low ends of fertility are considered. Lower population levels, caused by low fertility, generate concerns on economic growth, military security, and international political power; while also seen by some as reducing ecological and environmental damage. The model shows that increasingly low fertility leads to both higher wealth and lower population levels. As society is encouraged by increasing per capita wealth to continue to decrease fertility, dangerous population regimes are reached where stochastic extinction becomes more and more likely.


title: SkyGrid: Energy-Flow Optimization at Harmonized Aerial Intersections

abstract: The rapid evolution of urban air mobility (UAM) is reshaping the future of transportation by integrating aerial vehicles into urban transit systems. The design of aerial intersections plays a critical role in the phased development of UAM systems to ensure safe and efficient operations in air corridors. This work adapts the concept of rhythmic control of connected and automated vehicles (CAVs) at unsignalized intersections to address complex traffic control problems. This control framework assigns UAM vehicles to different movement groups and significantly reduces the computation of routing strategies to avoid conflicts. In contrast to ground traffic, the objective is to balance three measures: minimizing energy utilization, maximizing intersection flow (throughput), and maintaining safety distances. This optimization method dynamically directs traffic with various demands, considering path assignment distributions and segment-level trajectory coefficients for straight and curved paths as control variables. To the best of our knowledge, this is the first work to consider a multi-objective optimization approach for unsignalized intersection control in the air and to propose such optimization in a rhythmic control setting with time arrival and UAM operational constraints. A sensitivity analysis with respect to inter-platoon safety and straight/left demand balance demonstrates the effectiveness of our method in handling traffic under various scenarios.


title: Effective theory tower for $\mu\rightarrow e$ conversion

abstract: We present theoretical predictions for $\mu \rightarrow e$ conversion rates using a tower of effective field theories connecting the UV to nuclear physics scales. The interactions in nuclei are described using a recently developed nonrelativistic effective theory (NRET) that organizes contributions according to bound nucleon and muon velocities, $\vec{v}_N$ and $\vec{v}_\mu$, with $|\vec{v}_N| > |\vec{v}_\mu|$. To facilitate the top-down matching, we enlarge the set of Lorentz covariant nucleon-level interactions mapped onto the NRET operators to include those mediated by tensor interactions, in addition to the scalar and vector interactions already considered previously, and then match NRET nonperturbatively onto the Weak Effective Theory (WET). At the scale $\mu \approx 2$ GeV WET is formulated in terms of $u$, $d$, $s$ quarks, gluons and photons as the light degrees of freedom, along with the flavor-violating leptonic current. We retain contributions from WET operators up to dimension 7, which requires the full set of 26 NRET operators. The results are encoded in the open-source Python- and Mathematica-based software suite MuonBridge, which we make available to the theoretical and experimental communities interested in $\mu \rightarrow e$ conversion.


title: Magnetochiral vortex ratchet effect in two-dimensional arrays of $\varphi_0$-Josephson junctions

abstract: We demonstrate transport in 2D arrays of multiterminal $\varphi_0$-junctions. When applying an in-plane magnetic field we observe nonreciprocal vortex depinning currents, induced by a ratchet-like pinning potential. The ratchet effect is explained as a consequence of spontaneous supercurrents that arise in the presence of next-nearest neighbor Josephson couplings. Tuning the density of vortices to commensurate values of the frustration parameter results in an enhancement of the ratchet effect. In addition, we find a surprising sign reversal of the ratchet effect near frustration 1/3.


title: Framing Social Movements on Social Media: Unpacking Diagnostic, Prognostic, and Motivational Strategies

abstract: Social media enables activists to directly communicate with the public and provides a space for movement leaders, participants, bystanders, and opponents to collectively construct and contest narratives. Focusing on Twitter messages from social movements surrounding three issues in 2018-2019 (guns, immigration, and LGBTQ rights), we create a codebook, annotated dataset, and computational models to detect diagnostic (problem identification and attribution), prognostic (proposed solutions and tactics), and motivational (calls to action) framing strategies. We conduct an in-depth unsupervised linguistic analysis of each framing strategy, and uncover cross-movement similarities in associations between framing and linguistic features such as pronouns and deontic modal verbs. Finally, we compare framing strategies across issues and other social, cultural, and interactional contexts. For example, we show that diagnostic framing is more common in replies than original broadcast posts, and that social movement organizations focus much more on prognostic and motivational framing than journalists and ordinary citizens.


title: Multi-wavelength observations of the Luminous Fast Blue Optical Transient AT2023fhn

abstract: Luminous Fast Blue Optical Transients (LFBOTs) are a class of extragalactic transients notable for their rapid rise and fade times, blue colour and accompanying luminous X-ray and radio emission. Only a handful have been studied in detail since the prototypical example AT2018cow. Their origins are currently unknown, but ongoing observations of previous and new events are placing ever stronger constraints on their progenitors. We aim to put further constraints on the LFBOT AT2023fhn, and LFBOTs as a class, using information from the multi-wavelength transient light-curve, its host galaxy and local environment. Our primary results are obtained by fitting galaxy models to the spectral energy distribution of AT2023fhn's host and local environment, and by modelling the radio light-curve of AT2023fhn as due to synchrotron self-absorbed emission from an expanding blast-wave in the circumstellar medium. We find that the neither the host galaxy nor circumstellar environment of AT2023fhn are unusual compared with previous LFBOTs, but that AT2023fhn has a much lower X-ray to ultraviolet luminosity ratio than previous events. We argue that the variety in ultraviolet-optical to X-ray luminosity ratios among LFBOTs is likely due to viewing angle differences, and that the diffuse, yet young local environment of AT2023fhn - combined with a similar circumstellar medium to previous events - favours a progenitor system containing a massive star with strong winds. Plausible progenitor models in this interpretation therefore include black hole/Wolf-Rayet mergers or failed supernovae.


title: Association of neighborhood disadvantage with cognitive function and cortical disorganization in an unimpaired cohort

abstract: Neighborhood disadvantage is associated with worse health and cognitive outcomes. Morphological similarity network (MSN) is a promising approach to elucidate cortical network patterns underlying complex cognitive functions. We hypothesized that MSNs could capture changes in cortical patterns related to neighborhood disadvantage and cognitive function. This cross-sectional study included cognitively unimpaired participants from two large Alzheimers studies at University of Wisconsin-Madison. Neighborhood disadvantage status was obtained using the Area Deprivation Index (ADI). Cognitive performance was assessed on memory, processing speed and executive function. Morphological Similarity Networks (MSN) were constructed for each participant based on the similarity in distribution of cortical thickness of brain regions, followed by computation of local and global network features. Association of ADI with cognitive scores and MSN features were examined using linear regression and mediation analysis. ADI showed negative association with category fluency,implicit learning speed, story recall and modified pre-clinical Alzheimers cognitive composite scores, indicating worse cognitive function among those living in more disadvantaged neighborhoods. Local network features of frontal and temporal regions differed based on ADI status. Centrality of left lateral orbitofrontal region showed a partial mediating effect between association of neighborhood disadvantage and story recall performance. Our preliminary findings suggest differences in local cortical organization by neighborhood disadvantage, which partially mediated the relationship between ADI and cognitive performance, providing a possible network-based mechanism to, in-part, explain the risk for poor cognitive functioning associated with disadvantaged neighborhoods.


title: Inevitable Negativity: Additivity Commands Negative Quantum Channel Entropy

abstract: Quantum channels represent a broad spectrum of operations crucial to quantum information theory, encompassing everything from the transmission of quantum information to the manipulation of various resources. In the domain of states, the concept of majorization serves as a fundamental tool for comparing the uncertainty inherent in both classical and quantum systems. This paper establishes a rigorous framework for assessing the uncertainty in both classical and quantum channels. By employing a specific class of superchannels, we introduce and elucidate three distinct approaches to channel majorization: constructive, axiomatic, and operational. Intriguingly, these methodologies converge to a consistent ordering. This convergence not only provides a robust basis for defining entropy functions for channels but also clarifies the interpretation of entropy in this broader context. Most notably, our findings reveal that any viable entropy function for quantum channels must assume negative values, thereby challenging traditional notions of entropy.


title: Symmetrically Fair Allocations of Indivisible Goods

abstract: We consider allocating indivisible goods with provable fairness guarantees that are satisfied regardless of which bundle of items each agent receives. Symmetrical allocations of this type are known to exist for divisible resources, such as consensus splitting of a cake into parts, each having equal value for all agents, ensuring that in any allocation of the cake slices, no agent would envy another. For indivisible goods, one analogous concept relaxes envy freeness to guarantee the existence of an allocation in which any bundle is worth as much as any other, up to the value of a bounded number of items from the other bundle. Previous work has studied the number of items that need to be removed. In this paper, we improve upon these bounds for the specific setting in which the number of bundles equals the number of agents. Concretely, we develop the theory of symmetrically envy free up to one good, or symEF1, allocations. We prove that a symEF1 allocation exists if the vertices of a related graph can be partitioned (colored) into as many independent sets as there are agents. This sufficient condition always holds for two agents, and for agents that have identical, disjoint, or binary valuations. We further prove conditions under which exponentially-many distinct symEF1 allocations exist. Finally, we perform computational experiments to study the incidence of symEF1 allocations as a function of the number of agents and items when valuations are drawn uniformly at random.


title: Low frequency noise in nanoparticle-molecule networks and implications for in-materio reservoir computing

abstract: We study the low-frequency noise (LFN), i.e. flicker noise, also referred to as 1/f noise, in 2D networks of molecularly functionalized gold nanoparticles (NMN: nanoparticle-molecule network). We examine the noise behaviors of the NMN hosting alkyl chains (octanethiol), fatty acid oleic acids (oleylamine), redox molecule switches (polyoxometalate derivatives) or photo-isomerizable molecules (azobenzene derivatives) and we compare their 1/f noise behaviors. These noise metrics are used to evaluate which molecules are the best candidates to build in-materio reservoir computing molecular devices based on NMNs.


title: Testing identification in mediation and dynamic treatment models

abstract: We propose a test for the identification of causal effects in mediation and dynamic treatment models that is based on two sets of observed variables, namely covariates to be controlled for and suspected instruments, building on the test by Huber and Kueck (2022) for single treatment models. We consider models with a sequential assignment of a treatment and a mediator to assess the direct treatment effect (net of the mediator), the indirect treatment effect (via the mediator), or the joint effect of both treatment and mediator. We establish testable conditions for identifying such effects in observational data. These conditions jointly imply (1) the exogeneity of the treatment and the mediator conditional on covariates and (2) the validity of distinct instruments for the treatment and the mediator, meaning that the instruments do not directly affect the outcome (other than through the treatment or mediator) and are unconfounded given the covariates. Our framework extends to post-treatment sample selection or attrition problems when replacing the mediator by a selection indicator for observing the outcome, enabling joint testing of the selectivity of treatment and attrition. We propose a machine learning-based test to control for covariates in a data-driven manner and analyze its finite sample performance in a simulation study. Additionally, we apply our method to Slovak labor market data and find that our testable implications are not rejected for a sequence of training programs typically considered in dynamic treatment evaluations.


title: Fine-Tuning BERTs for Definition Extraction from Mathematical Text

abstract: In this paper, we fine-tuned three pre-trained BERT models on the task of "definition extraction" from mathematical English written in LaTeX. This is presented as a binary classification problem, where either a sentence contains a definition of a mathematical term or it does not. We used two original data sets, "Chicago" and "TAC," to fine-tune and test these models. We also tested on WFMALL, a dataset presented by Vanetik and Litvak in 2021 and compared the performance of our models to theirs. We found that a high-performance Sentence-BERT transformer model performed best based on overall accuracy, recall, and precision metrics, achieving comparable results to the earlier models with less computational effort.


title: Neuro-symbolic Training for Reasoning over Spatial Language

abstract: Recent research shows that more data and larger models can provide more accurate solutions to natural language problems requiring reasoning. However, models can easily fail to provide solutions in unobserved complex input compositions due to not achieving the level of abstraction required for generalizability. To alleviate this issue, we propose training the language models with neuro-symbolic techniques that can exploit the logical rules of reasoning as constraints and provide additional supervision sources to the model. Training models to adhere to the regulations of reasoning pushes them to make more effective abstractions needed for generalizability and transfer learning. We focus on a challenging problem of spatial reasoning over text. Our results on various benchmarks using multiple language models confirm our hypothesis of effective domain transfer based on neuro-symbolic training.


title: Group-Control Motion Planning Framework for Microrobot Swarms in a Global Field

abstract: This paper investigates how group-control can be effectively used for motion planning for microrobot swarms in a global field. We prove that Small-Time Local Controllability (STLC) in robot positions is achievable through group-control, with the minimum number of groups required for STLC being $\log_2(n + 2) + 1$ for $n$ robots. We then discuss the complexity trade-offs between control and motion planning. We show how motion planning can be simplified if appropriate primitives can be achieved through more complex control actions. We identify motion planning problems that balance the number of robot groups and motion primitives with planning complexity. Various instantiations of these motion planning problems are explored, with simulations to demonstrate the effectiveness of group-control.


title: Quantum spin systems: toroidal classification and geometric duality

abstract: Toroidal classification and geometric duality in quantum spin systems is presented. Through our classification and duality, we reveal that various bipartite quantum features in magnon-systems can manifest equivalently in both bipartite ferromagnetic and antiferromagnetic materials, based upon the availability of relevant Hamiltonian parameters. Additionally, the results highlight the antiferromagnetic regime as an ultra-fast dual counterpart to the ferromagnetic regime, both exhibiting identical capabilities for quantum spintronics and technological applications. Concrete illustrations are provided, demonstrating how splitting and squeezing types of two-mode magnon quantum correlations can be realized across ferro- and antiferromagnetic regimes.


title: A Comprehensive Overview of GPU Accelerated Databases

abstract: Over the past decade, the landscape of data analytics has seen a notable shift towards heterogeneous architectures, particularly the integration of GPUs to enhance overall performance. In the realm of in-memory analytics, which often grapples with memory bandwidth constraints, the adoption of GPUs has proven advantageous, thanks to their superior bandwidth capabilities. The parallel processing prowess of GPUs stands out, providing exceptional efficiency for data-intensive workloads and outpacing traditional CPUs in terms of data processing speed. While GPU databases capitalize on these strengths, there remains a scarcity of comparative studies across different GPU systems. In light of this emerging interest in GPU databases for data analytics, this paper proposes a survey encompassing multiple GPU database systems. The focus will be on elucidating the underlying mechanisms employed to deliver results and key performance metrics, utilizing benchmarks such as SSB and TPCH. This undertaking aims to shed light on new avenues for research within the realm of GPU databases.


title: Poiseuille flow for a simplified pseduoplastic rheology

abstract: Poiseuille flow in cylindrical and planar geometries with a simplified, pseudoplastic (shear thinning) rheology characterized by constant viscosity plateaus above and below a transition strain rate is considered. Analytical, steady state solutions for velocity profile and volume flux are formulated. Transient flow development is addressed numerically and compared to the theory in the steady state limit. Stationary flow is approached after the momentum diffusion timescale based on the spatially dominant kinematic viscosity. For large viscosity ratio and shear thinning region confined near the domain boundary, velocity distributions are quasi-plug like with large boundary to interior strain rate ratio.


title: Cluster Quilting: Spectral Clustering for Patchwork Learning

abstract: Patchwork learning arises as a new and challenging data collection paradigm where both samples and features are observed in fragmented subsets. Due to technological limits, measurement expense, or multimodal data integration, such patchwork data structures are frequently seen in neuroscience, healthcare, and genomics, among others. Instead of analyzing each data patch separately, it is highly desirable to extract comprehensive knowledge from the whole data set. In this work, we focus on the clustering problem in patchwork learning, aiming at discovering clusters amongst all samples even when some are never jointly observed for any feature. We propose a novel spectral clustering method called Cluster Quilting, consisting of (i) patch ordering that exploits the overlapping structure amongst all patches, (ii) patchwise SVD, (iii) sequential linear mapping of top singular vectors for patch overlaps, followed by (iv) k-means on the combined and weighted singular vectors. Under a sub-Gaussian mixture model, we establish theoretical guarantees via a non-asymptotic misclustering rate bound that reflects both properties of the patch-wise observation regime as well as the clustering signal and noise dependencies. We also validate our Cluster Quilting algorithm through extensive empirical studies on both simulated and real data sets in neuroscience and genomics, where it discovers more accurate and scientifically more plausible clusters than other approaches.


title: Optimizing Wireless Discontinuous Reception via MAC Signaling Learning

abstract: We present a Reinforcement Learning (RL) approach to the problem of controlling the Discontinuous Reception (DRX) policy from a Base Transceiver Station (BTS) in a cellular network. We do so by means of optimally timing the transmission of fast Layer-2 signaling messages (a.k.a. Medium Access Layer (MAC) Control Elements (CEs) as specified in 5G New Radio). Unlike more conventional approaches to DRX optimization, which rely on fine-tuning the values of DRX timers, we assess the gains that can be obtained solely by means of this MAC CE signalling. For the simulation part, we concentrate on traffic types typically encountered in Extended Reality (XR) applications, where the need for battery drain minimization and overheating mitigation are particularly pressing. Both 3GPP 5G New Radio (5G NR) compliant and non-compliant ("beyond 5G") MAC CEs are considered. Our simulation results show that our proposed technique strikes an improved trade-off between latency and energy savings as compared to conventional timer-based approaches that are characteristic of most current implementations. Specifically, our RL-based policy can nearly halve the active time for a single User Equipment (UE) with respect to a na\"ive MAC CE transmission policy, and still achieve near 20% active time reduction for 9 simultaneously served UEs.


title: Bundling in Oligopoly: Revenue Maximization with Single-Item Competitors

abstract: We consider a principal seller with $m$ heterogeneous products to sell to an additive buyer over independent items. The principal can offer an arbitrary menu of product bundles, but faces competition from smaller and more agile single-item sellers. The single-item sellers choose their prices after the principal commits to a menu, potentially under-cutting the principal's offerings. We explore to what extent the principal can leverage the ability to bundle product together to extract revenue. Any choice of menu by the principal induces an oligopoly pricing game between the single-item sellers, which may have multiple equilibria. When there is only a single item this model reduces to Bertrand competition, for which the principal's revenue is $0$ at any equilibrium, so we assume that no single item's value is too dominant. We establish an upper bound on the principal's optimal revenue at every equilibrium: the expected welfare after truncating each item's value to its revenue-maximizing price. Under a technical condition on the value distributions -- that the monopolist's revenue is sufficiently sensitive to price -- we show that the principal seller can simply price the grand-bundle and ensure (in any equilibrium) a constant approximation to this bound (and hence to the optimal revenue). We also show that for some value distributions violating our conditions, grand-bundle pricing does not yield a constant approximation to the optimal revenue in any equilibrium.


title: Mastering Rare Event Analysis: Optimal Subsample Size in Logistic and Cox Regressions

abstract: In the realm of contemporary data analysis, the use of massive datasets has taken on heightened significance, albeit often entailing considerable demands on computational time and memory. While a multitude of existing works offer optimal subsampling methods for conducting analyses on subsamples with minimized efficiency loss, they notably lack tools for judiciously selecting the optimal subsample size. To bridge this gap, our work introduces tools designed for choosing the optimal subsample size. We focus on three settings: the Cox regression model for survival data with rare events and logistic regression for both balanced and imbalanced datasets. Additionally, we present a novel optimal subsampling procedure tailored for logistic regression with imbalanced data. The efficacy of these tools and procedures is demonstrated through an extensive simulation study and meticulous analyses of two sizable datasets.


title: U-shaped disks in Stokes flow: Chiral sedimentation of a non-chiral particle

abstract: We study the sedimentation of U-shaped circular disks in the Stokes limit of vanishing inertia. We simulate the flow past such disks using a finite-element-based solution of the 3D Stokes equations, accounting for the integrable singularities that develop along their edges. We show that the purely vertical sedimentation of such disks in their upright- [upside-down-] U orientation is unstable to perturbations about their pitching [rolling] axes. The instability is found to depend only weakly on the size of the container in which the disks sediment, allowing us to analyse their behaviour based on the resistance matrix which governs the evolution of the disk's six rigid-body degrees of freedom in an unbounded fluid. We show that the governing equations can be reduced to two ODEs which describe the disk's inclination against the direction of gravity. A phase-plane analysis, results of which are in good agreement with experiments, reveals that the two instabilities generally cause the disk to sediment along complex spiral trajectories while it alternates between pitching- and rolling-dominated motions. The chirality of the trajectories is set by the initial conditions rather than the (non-chiral) shape of the disk. For certain initial orientations, the disk retains its inclination and sediments along a perfectly helical path. The observed behaviour is fundamentally different from that displayed by flat circular disks which sediment without any reorientation. We therefore study the effect of variations in the disk's curvature to show how in the limit of vanishing curvature the behaviour of a flat disk is recovered.


title: Potential Flow Formulation of Parker's Unsteady Solar Wind Model and Nonlinear Stability Aspects Near the Parker Sonic Critical Point

abstract: The purpose of this paper is to present the first ever systematic theoretical formulation to address the long-standing issue of regularization of the singularity associated with the Parker sonic critical point in the linear perturbation problem for Parker's unsteady solar wind model. This is predicated on the necessity to go outside the framework of the linear perturbation problem and incorporate the dominant nonlinearities in this dynamical system. For this purpose, a whole new theoretical formulation of Parker's unsteady solar wind model based on the potential flow theory in ideal gas dynamics is given, which provides an appropriate optimal theoretical framework to accomplish this task. The stability of Parker's steady solar wind solution is shown to extend also to the neighborhood of the Parker sonic critical point by going to the concomitant nonlinear problem.


title: RNA-FrameFlow: Flow Matching for de novo 3D RNA Backbone Design

abstract: We introduce RNA-FrameFlow, the first generative model for 3D RNA backbone design. We build upon SE(3) flow matching for protein backbone generation and establish protocols for data preparation and evaluation to address unique challenges posed by RNA modeling. We formulate RNA structures as a set of rigid-body frames and associated loss functions which account for larger, more conformationally flexible RNA backbones (13 atoms per nucleotide) vs. proteins (4 atoms per residue). Toward tackling the lack of diversity in 3D RNA datasets, we explore training with structural clustering and cropping augmentations. Additionally, we define a suite of evaluation metrics to measure whether the generated RNA structures are globally self-consistent (via inverse folding followed by forward folding) and locally recover RNA-specific structural descriptors. The most performant version of RNA-FrameFlow generates locally realistic RNA backbones of 40-150 nucleotides, over 40% of which pass our validity criteria as measured by a self-consistency TM-score >= 0.45, at which two RNAs have the same global fold. Open-source code: https://github.com/rish-16/rna-backbone-design


title: StackRAG Agent: Improving Developer Answers with Retrieval-Augmented Generation

abstract: Developers spend much time finding information that is relevant to their questions. Stack Overflow has been the leading resource, and with the advent of Large Language Models (LLMs), generative models such as ChatGPT are used frequently. However, there is a catch in using each one separately. Searching for answers is time-consuming and tedious, as shown by the many tools developed by researchers to address this issue. On the other, using LLMs is not reliable, as they might produce irrelevant or unreliable answers (i.e., hallucination). In this work, we present StackRAG, a retrieval-augmented Multiagent generation tool based on LLMs that combines the two worlds: aggregating the knowledge from SO to enhance the reliability of the generated answers. Initial evaluations show that the generated answers are correct, accurate, relevant, and useful.


title: Kac-Moody algebras in Deligne's Category

abstract: We generalize the notion of a Kac-Moody Lie algebra to the setting of Deligne Categories. Then we derive the Kac-Weyl formula for the category $\mathcal{O}$ integrable representations for such an algebra. This paper generalizes results of A. Pakharev \cite{AP}.


title: Joint vs Sequential Speaker-Role Detection and Automatic Speech Recognition for Air-traffic Control

abstract: Utilizing air-traffic control (ATC) data for downstream natural-language processing tasks requires preprocessing steps. Key steps are the transcription of the data via automatic speech recognition (ASR) and speaker diarization, respectively speaker role detection (SRD) to divide the transcripts into pilot and air-traffic controller (ATCO) transcripts. While traditional approaches take on these tasks separately, we propose a transformer-based joint ASR-SRD system that solves both tasks jointly while relying on a standard ASR architecture. We compare this joint system against two cascaded approaches for ASR and SRD on multiple ATC datasets. Our study shows in which cases our joint system can outperform the two traditional approaches and in which cases the other architectures are preferable. We additionally evaluate how acoustic and lexical differences influence all architectures and show how to overcome them for our joint architecture.


title: Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data

abstract: Generative, multimodal artificial intelligence (GenAI) offers transformative potential across industries, but its misuse poses significant risks. Prior research has shed light on the potential of advanced AI systems to be exploited for malicious purposes. However, we still lack a concrete understanding of how GenAI models are specifically exploited or abused in practice, including the tactics employed to inflict harm. In this paper, we present a taxonomy of GenAI misuse tactics, informed by existing academic literature and a qualitative analysis of approximately 200 observed incidents of misuse reported between January 2023 and March 2024. Through this analysis, we illuminate key and novel patterns in misuse during this time period, including potential motivations, strategies, and how attackers leverage and abuse system capabilities across modalities (e.g. image, text, audio, video) in the wild.


title: MAMA-MIA: A Large-Scale Multi-Center Breast Cancer DCE-MRI Benchmark Dataset with Expert Segmentations

abstract: Current research in breast cancer Magnetic Resonance Imaging (MRI), especially with Artificial Intelligence (AI), faces challenges due to the lack of expert segmentations. To address this, we introduce the MAMA-MIA dataset, comprising 1506 multi-center dynamic contrast-enhanced MRI cases with expert segmentations of primary tumors and non-mass enhancement areas. These cases were sourced from four publicly available collections in The Cancer Imaging Archive (TCIA). Initially, we trained a deep learning model to automatically segment the cases, generating preliminary segmentations that significantly reduced expert segmentation time. Sixteen experts, averaging 9 years of experience in breast cancer, then corrected these segmentations, resulting in the final expert segmentations. Additionally, two radiologists conducted a visual inspection of the automatic segmentations to support future quality control studies. Alongside the expert segmentations, we provide 49 harmonized demographic and clinical variables and the pretrained weights of the well-known nnUNet architecture trained using the DCE-MRI full-images and expert segmentations. This dataset aims to accelerate the development and benchmarking of deep learning models and foster innovation in breast cancer diagnostics and treatment planning.


title: Effects of quantum corrections to Lorentzian vacuum transitions in the presence of gravity

abstract: We present a study of the vacuum transition probabilities taking into account quantum corrections. We first introduce a general method that expand previous works employing the Lorentzian formalism of the Wheeler-De Witt equation by considering higher order terms in the semiclassical expansion. The method presented is applicable in principle to any model in the superspace and up to any desired order in the quantum correction terms. Then, we apply this method to obtain analytical solutions for the probabilities up to second quantum corrections for homogeneous isotropic and anisotropic universes. We use the Friedmann-Lemaitre-Robertson-Walker with positive and zero curvature for the isotropic case and the Bianchi III and Kantwowski-Sachs metrics for the anisotropic case. Interpreting the results as distribution probabilities of creating universes by vacuum decay with a given size, we found that the general behaviour is that considering up to the second quantum correction leads to an avoidance of the initial singularity. However, we show that this result can only be achieved for the isotropic universe. Furthermore, we also study the effect of anisotropy on the transition probabilities.


title: Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learning

abstract: Recent research has explored how Language Models (LMs) can be used for feature representation and prediction in tabular machine learning tasks. This involves employing text serialization and supervised fine-tuning (SFT) techniques. Despite the simplicity of these techniques, significant gaps remain in our understanding of the applicability and reliability of LMs in this context. Our study assesses how emerging LM technologies compare with traditional paradigms in tabular machine learning and evaluates the feasibility of adopting similar approaches with these advanced technologies. At the data level, we investigate various methods of data representation and curation of serialized tabular data, exploring their impact on prediction performance. At the classification level, we examine whether text serialization combined with LMs enhances performance on tabular datasets (e.g. class imbalance, distribution shift, biases, and high dimensionality), and assess whether this method represents a state-of-the-art (SOTA) approach for addressing tabular machine learning challenges. Our findings reveal current pre-trained models should not replace conventional approaches.


title: Locating and measuring marine aquaculture production from space: a computer vision approach in the French Mediterranean

abstract: Aquaculture production -- the cultivation of aquatic plants and animals -- has grown rapidly since the 1990s, but sparse, self-reported and aggregate production data limits the effective understanding and monitoring of the industry's trends and potential risks. Building on a manual survey of aquaculture production from remote sensing imagery, we train a computer vision model to identify marine aquaculture cages from aerial and satellite imagery, and generate a spatially explicit dataset of finfish production locations in the French Mediterranean from 2000-2021 that includes 4,010 cages (69m2 average cage area). We demonstrate the value of our method as an easily adaptable, cost-effective approach that can improve the speed and reliability of aquaculture surveys, and enables downstream analyses relevant to researchers and regulators. We illustrate its use to compute independent estimates of production, and develop a flexible framework to quantify uncertainty in these estimates. Overall, our study presents an efficient, scalable and highly adaptable method for monitoring aquaculture production from remote sensing imagery.


title: Answers to questions about medial layer graphs of self-dual regular and chiral polytopes

abstract: An abstract $n$-polytope $\mathcal{P}$ is a partially-ordered set which captures important properties of a geometric polytope, for any dimension $n$. For even $n \ge 2$, the incidences between elements in the middle two layers of the Hasse diagram of $\mathcal{P}$ give rise to the medial layer graph of $\mathcal{P}$, denoted by $\mathcal{G} = \mathcal{G}(\mathcal{P})$. If $n=4$, and $\mathcal{P}$ is both highly symmetric and self-dual of type $\{p,q,p\}$, then a Cayley graph $\mathcal{C}$ covering $\mathcal{G}$ can be constructed on a group of polarities of $\mathcal{P}$. In this paper we address some open questions about the relationship between $\mathcal{G}$ and $\mathcal{C}$ that were raised in a 2008 paper by Monson and Weiss, and describe some interesting examples of these graphs. In particular, we give the first known examples of improperly self-dual chiral polytopes of type $\{3,q,3\}$, which are also among the very few known examples of highly symmetric self-dual finite polytopes that do not admit a polarity. Also we show that if $p=3$ then $\mathcal{C}$ cannot have a higher degree of $s$-arc-transitivity than $\mathcal{G}$, and we present a family of regular $4$-polytopes of type $\{6,q,6\}$ for which the vertex-stabilisers in the automorphism group of $\mathcal{C}$ are larger than those for $\mathcal{G}$.


title: Comparison of Nested Geometry Treatments within GPU-Based Monte Carlo Neutron Transport Simulations of Fission Reactors

abstract: Monte Carlo (MC) neutron transport provides detailed estimates of radiological quantities within fission reactors. This method involves tracking individual neutrons through a computational geometry. CPU-based MC codes use multiple polymorphic tracker types with different tracking algorithms to exploit the repeated configurations of reactors, but virtual function calls have high overhead on the GPU. The Shift MC code was modified to support GPU-based tracking with three strategies: (1) dynamic polymorphism (DP) with virtual functions, (2) static polymorphism (SP), and (3) a single tracker (ST) type with tree-based acceleration. Results on the Frontier supercomputer show that the DP, SP, and ST methods achieve 77.8%, 91.2%, and 83.4% of the practical maximum tracking rate in the worst case, indicating that any of these methods can be used without incurring a significant performance penalty. The flexibility of the ST method is highlighted with a hexagonal-grid microreactor problem, performed without hexagonal-grid-specific tracking routines.


title: Quasi-Dirac Heavy Neutral Leptons in the Left-Right Symmetric Model

abstract: We discuss the phenomenology of a pair of degenerate GeV-scale Heavy Neutral Leptons within the Left-Right Symmetric Model (LRSM) framework, with the third fermion serving as a dark matter candidate. We highlight the potential of the recently approved SHiP experiment to test the existence of the light DM species, and the signatures of lepton number violation as a possible experimental probe of the model in various experiments. Our findings include concrete predictions, in some part of the model's parameter space, for the effective right-handed couplings $(V^{R}_{e})^2:(V^{R}_{\mu})^2:(V^{R}_{\tau})^2 = 0.16:0.47:0.38$ (normal neutrino hierarchy), $0.489 : 0.22 : 0.30$ (inverted hierarchy) of the degenerate pair.


title: Optimizing Quantile-based Trading Strategies in Electricity Arbitrage

abstract: Efficiently integrating renewable resources into electricity markets is vital for addressing the challenges of matching real-time supply and demand while reducing the significant energy wastage resulting from curtailments. To address this challenge effectively, the incorporation of storage devices can enhance the reliability and efficiency of the grid, improving market liquidity and reducing price volatility. In short-term electricity markets, participants navigate numerous options, each presenting unique challenges and opportunities, underscoring the critical role of the trading strategy in maximizing profits. This study delves into the optimization of day-ahead and balancing market trading, leveraging quantile-based forecasts. Employing three trading approaches with practical constraints, our research enhances forecast assessment, increases trading frequency, and employs flexible timestamp orders. Our findings underscore the profit potential of simultaneous participation in both day-ahead and balancing markets, especially with larger battery storage systems; despite increased costs and narrower profit margins associated with higher-volume trading, the implementation of high-frequency strategies plays a significant role in maximizing profits and addressing market challenges. Finally, we modelled four commercial battery storage systems and evaluated their economic viability through a scenario analysis, with larger batteries showing a shorter return on investment.


title: On the Dual-Phase-Lag thermal response in the Pulsed Photoacoustic effect: 1D approach

abstract: The Photoacoustic (PA) effect is the mechanism to convert non-ionizing electromagnetic energy into mechanical one; its main application is PA imaging in biomedicine. In this work, and in order to consider the heat flux non-heuristically, we obtained exact solutions of a 1D boundary value problem of the Dual-Phase-Lag (DPL) heat conduction equation for a three-layer system in the frequency domain; once the thermal boundary problem was solved via the DPL model, the second derivative of temperature solutions were considered as the PA source in the respective 1D boundary value problem for the pressures, via the PA wave equation. Temperature and pressure solutions were explored by assuming two considerations; being the first one, that the characteristic thermal lag response time $\tau_{_T}$ related with the DPL heat conduction model, is a free parameter on this effective model. The second one is that for the sake of simplicity, the whole is system is assumed to have the same value for the $\tau_{_T}$, i.e., the three-layer system relax thermally in the same way. Both assumptions are made, since up to our knowledge, there are not first-principles proposals for the values of this parameter, nor experimental measurements available in the literature. By varying $\tau_{_T}$, theoretical solutions for pressure can be adjusted to reproduce experimental results accurately; we have found that under this assumption if $\tau_{_T}$ is close to the laser pulse time $\tau_p$, acoustic multiple reflections are accurately reproduced in the frequency domain and, via Fast Fourier transforms, PA pulses are also reproduced accurately in the time domain.


title: AltGeoViz: Facilitating Accessible Geovisualization

abstract: Geovisualizations are powerful tools for exploratory spatial analysis, enabling sighted users to discern patterns, trends, and relationships within geographic data. However, these visual tools have remained largely inaccessible to screen-reader users. We present AltGeoViz, a new system we designed to facilitate geovisualization exploration for these users. AltGeoViz dynamically generates alt-text descriptions based on the user's current map view, providing summaries of spatial patterns and descriptive statistics. In a study of five screen-reader users, we found that AltGeoViz enabled them to interact with geovisualizations in previously infeasible ways. Participants demonstrated a clear understanding of data summaries and their location context, and they could synthesize spatial understandings of their explorations. Moreover, we identified key areas for improvement, such as the addition of intuitive spatial navigation controls and comparative analysis features.


title: Overview of the Optical Design of the CMB-S4 Large Aperture Telescopes and Camera Optics

abstract: CMB-S4, the next-generation CMB observatory, will deploy hundreds of thousands of detectors to enable mapping the millimeter-wavelength sky with unprecedented speed. The large aperture telescopes for CMB-S4 consist of six-meter diameter crossed Dragone designs and a five-meter diameter three-mirror anastigmat. The two-mirror crossed Dragone design requires astigmatism corrections in the refractive optics to achieve diffraction-limited performance. We present biconic lens corrections for the CMB-S4 crossed Dragone camera optics and compare these designs to the camera optics for the three mirror anastigmat, as the optical designs of the cameras for these telescopes are being prototyped.


title: Advancing Blockchain Scalability: An Introduction to Layer 1 and Layer 2 Solutions

abstract: Bitcoin rise has put blockchain technology into the mainstream, amplifying its potential and broad utility. While Bitcoin has become incredibly famous, its transaction rate has not match such a corresponding increase. It still takes approximately 10 minutes to mine a block and add it to the chain. This limitation highlights the importance of seeking scale-up solutions that solve the low throughput transaction rates. Blockchain's consensus mechanisms make peer-to-peer transactions becomes feasible and effectively eliminate the need for centralized control. However, the decentralized systems also causes a lower speed and throughput compared to centralized networks as we mentioned Bitcoin's block creation rates. Two mainstreams scale-up solutions, Layer 1 scale-up and Layer 2 scale-up have been implemented to address these issues. Layer 1 level scalability enhancements happen at where traditional blockchain operates. This paper provides a deep examination of the components of the Layer 1 protocol and the scale-up methods that directly improve the lower level blockchain. We also address that Layer 1 solutions encounter inherent limitations although improvements were applied due to layer 1 storage costs and latency are high. In addition, we discuss layer 2 protocols, advanced scalability techniques, that elevate blockchain performance by handling transactions off the mainnet. Our findings indicate that Layer 2 protocols, with their various implementations such as rollups and channels, significantly outperform Layer 1 solutions in terms of transaction throughput and efficiency. This paper discusses these Layer 2 scaling methods in detail, aiming to provide readers with a comprehensive understanding of these protocols and the underlying logic that drives their effectiveness.


title: Kishu: Time-Traveling for Computational Notebooks

abstract: Computational notebooks (e.g., Jupyter, Google Colab) are widely used by data scientists. A key feature of notebooks is the interactive computing model of iteratively executing cells (i.e., a set of statements) and observing the result (e.g., model or plot). Unfortunately, existing notebook systems do not offer time-traveling to past states: when the user executes a cell, the notebook session state consisting of user-defined variables can be irreversibly modified - e.g., the user cannot 'un-drop' a dataframe column. This is because, unlike DBMS, existing notebook systems do not keep track of the session state. Existing techniques for checkpointing and restoring session states, such as OS-level memory snapshot or application-level session dump, are insufficient: checkpointing can incur prohibitive storage costs and may fail, while restoration can only be inefficiently performed from scratch by fully loading checkpoint files. In this paper, we introduce a new notebook system, Kishu, that offers time-traveling to and from arbitrary notebook states using an efficient and fault-tolerant incremental checkpoint and checkout mechanism. Kishu creates incremental checkpoints that are small and correctly preserve complex inter-variable dependencies at a novel Co-variable granularity. Then, to return to a previous state, Kishu accurately identifies the state difference between the current and target states to perform incremental checkout at sub-second latency with minimal data loading. Kishu is compatible with 146 object classes from popular data science libraries (e.g., Ray, Spark, PyTorch), and reduces checkpoint size and checkout time by up to 4.55x and 9.02x, respectively, on a variety of notebooks.


title: Martian Exploration of Lava Tubes (MELT) with ReachBot: Scientific Investigation and Concept of Operations

abstract: As natural access points to the subsurface, lava tubes and other caves have become premier targets of planetary missions for astrobiological analyses. Few existing robotic paradigms, however, are able to explore such challenging environments. ReachBot is a robot that enables navigation in planetary caves by using extendable and retractable limbs to locomote. This paper outlines the potential science return and mission operations for a notional mission that deploys ReachBot to a martian lava tube. In this work, the motivating science goals and science traceability matrix are provided to guide payload selection. A Concept of Operations (ConOps) is also developed for ReachBot, providing a framework for deployment and activities on Mars, analyzing mission risks, and developing mitigation strategies


title: Distributional reasoning in LLMs: Parallel reasoning processes in multi-hop reasoning

abstract: Large language models (LLMs) have shown an impressive ability to perform tasks believed to require thought processes. When the model does not document an explicit thought process, it becomes difficult to understand the processes occurring within its hidden layers and to determine if these processes can be referred to as reasoning. We introduce a novel and interpretable analysis of internal multi-hop reasoning processes in LLMs. We demonstrate that the prediction process for compositional reasoning questions can be modeled using a simple linear transformation between two semantic category spaces. We show that during inference, the middle layers of the network generate highly interpretable embeddings that represent a set of potential intermediate answers for the multi-hop question. We use statistical analyses to show that a corresponding subset of tokens is activated in the model's output, implying the existence of parallel reasoning paths. These observations hold true even when the model lacks the necessary knowledge to solve the task. Our findings can help uncover the strategies that LLMs use to solve reasoning tasks, offering insights into the types of thought processes that can emerge from artificial intelligence. Finally, we also discuss the implication of cognitive modeling of these results.


title: Room-temperature Ferroelectric Control of 2D Layered Magnetism

abstract: Electrical tuning of magnetism is crucial for developing fast, compact, ultra-low power electronic devices. Multiferroics offer significant potential due to their ability to control magnetic via an electric field through magnetoelectric coupling, especially in layered ferroelectric/ferromagnet heterostructures. A key challenge is achieving reversible and stable switching between distinct magnetic states using a voltage control. In this work, we present ferroelectric tuning of room-temperature magnetism in a 2D layered ferromagnet. The energy-efficient control consumes less than 1 fJ per operation which is normally in the order of several aJ, resulting in a ~43% change in magnetization. This tunable multiferroic interface and associated devices provide promising opportunities for next-generation reconfigurable communication systems, spintronics, sensors and memories.


title: Liveness Detection in Computer Vision: Transformer-based Self-Supervised Learning for Face Anti-Spoofing

abstract: Face recognition systems are increasingly used in biometric security for convenience and effectiveness. However, they remain vulnerable to spoofing attacks, where attackers use photos, videos, or masks to impersonate legitimate users. This research addresses these vulnerabilities by exploring the Vision Transformer (ViT) architecture, fine-tuned with the DINO framework. The DINO framework facilitates self-supervised learning, enabling the model to learn distinguishing features from unlabeled data. We compared the performance of the proposed fine-tuned ViT model using the DINO framework against a traditional CNN model, EfficientNet b2, on the face anti-spoofing task. Numerous tests on standard datasets show that the ViT model performs better than the CNN model in terms of accuracy and resistance to different spoofing methods. Additionally, we collected our own dataset from a biometric application to validate our findings further. This study highlights the superior performance of transformer-based architecture in identifying complex spoofing cues, leading to significant advancements in biometric security.


title: Skew circuits and circumference in a binary matroid

abstract: Let C_1 and C_2 be skew circuits in a binary matroid having circumference c. For any positive integer k there is a constant a_k such that if min { |A| ; C_1 \subset A \subset E-A} > a_k, then |C_1| + |C_2| < 2c -k.


title: Knowledge Graph-Enhanced Large Language Models via Path Selection

abstract: Large Language Models (LLMs) have shown unprecedented performance in various real-world applications. However, they are known to generate factually inaccurate outputs, a.k.a. the hallucination problem. In recent years, incorporating external knowledge extracted from Knowledge Graphs (KGs) has become a promising strategy to improve the factual accuracy of LLM-generated outputs. Nevertheless, most existing explorations rely on LLMs themselves to perform KG knowledge extraction, which is highly inflexible as LLMs can only provide binary judgment on whether a certain knowledge (e.g., a knowledge path in KG) should be used. In addition, LLMs tend to pick only knowledge with direct semantic relationship with the input text, while potentially useful knowledge with indirect semantics can be ignored. In this work, we propose a principled framework KELP with three stages to handle the above problems. Specifically, KELP is able to achieve finer granularity of flexible knowledge extraction by generating scores for knowledge paths with input texts via latent semantic matching. Meanwhile, knowledge paths with indirect semantic relationships with the input text can also be considered via trained encoding between the selected paths in KG and the input text. Experiments on real-world datasets validate the effectiveness of KELP.


title: Revealing initial state properties through ultra-central symmetric heavy-ion collisions

abstract: Heavy-ion experiments provide a new opportunity to gain a deeper understanding of the structure of nuclei. To achieve this, it is crucial to identify observables under circumstances that are minimally affected by the process that leads to the initial state of heavy-ion collisions from nuclear wavefunction. In this study, we demonstrate that when assuming scale-invariance, the effect of this stage on the initial energy or entropy density moments in ultra-central symmetric collisions is negligible for nucleon sizes of approximately 0.7 fm or larger for large nuclei. By borrowing cluster expansion method from statistical physics and using scale-invariance assumption, we calculate the average ellipticity of initial density at the presence of short-range correlation. We compare our calculations to Monte Carlo studies and assess the accuracy of various methods of short-range correlation sampling. Additionally, we find that the isobar ratio can constrain the initial state parameters, in addition to deformation. Our study indicates that the isobar ratios in ultra-central collisions are especially sensitive to the fluctuation in the weight of the nuclei constituents and the two-body correlation among nucleons. This insight is crucial for drawing conclusions about nuclear deformations based on isobar ratios.


title: Evaluating representation learning on the protein structure universe

abstract: We introduce ProteinWorkshop, a comprehensive benchmark suite for representation learning on protein structures with Geometric Graph Neural Networks. We consider large-scale pre-training and downstream tasks on both experimental and predicted structures to enable the systematic evaluation of the quality of the learned structural representation and their usefulness in capturing functional relationships for downstream tasks. We find that: (1) large-scale pretraining on AlphaFold structures and auxiliary tasks consistently improve the performance of both rotation-invariant and equivariant GNNs, and (2) more expressive equivariant GNNs benefit from pretraining to a greater extent compared to invariant models. We aim to establish a common ground for the machine learning and computational biology communities to rigorously compare and advance protein structure representation learning. Our open-source codebase reduces the barrier to entry for working with large protein structure datasets by providing: (1) storage-efficient dataloaders for large-scale structural databases including AlphaFoldDB and ESM Atlas, as well as (2) utilities for constructing new tasks from the entire PDB. ProteinWorkshop is available at: github.com/a-r-j/ProteinWorkshop.


title: SurgicAI: A Fine-grained Platform for Data Collection and Benchmarking in Surgical Policy Learning

abstract: Despite advancements in robotic-assisted surgery, automating complex tasks like suturing remain challenging due to the need for adaptability and precision. Learning-based approaches, particularly reinforcement learning (RL) and imitation learning (IL), require realistic simulation environments for efficient data collection. However, current platforms often include only relatively simple, non-dexterous manipulations and lack the flexibility required for effective learning and generalization. We introduce SurgicAI, a novel platform for development and benchmarking addressing these challenges by providing the flexibility to accommodate both modular subtasks and more importantly task decomposition in RL-based surgical robotics. Compatible with the da Vinci Surgical System, SurgicAI offers a standardized pipeline for collecting and utilizing expert demonstrations. It supports deployment of multiple RL and IL approaches, and the training of both singular and compositional subtasks in suturing scenarios, featuring high dexterity and modularization. Meanwhile, SurgicAI sets clear metrics and benchmarks for the assessment of learned policies. We implemented and evaluated multiple RL and IL algorithms on SurgicAI. Our detailed benchmark analysis underscores SurgicAI's potential to advance policy learning in surgical robotics. Details: \url{https://github.com/surgical-robotics-ai/SurgicAI


title: Finite group actions on dg categories and Hochschild homology

abstract: We prove a decomposition of the Hochschild homology groups of the equivariant dg category $\mathscr{C}^G$ associated to a small dg category $\mathscr{C}$ with direct sums on which a finite group $G$ acts. When the ground field is $\mathbb{C}$ this decomposition is related to a categorical action of $\text{Rep}(G)$ on $\mathscr{C}^G$ and the resulting action of the representation ring $R_\mathbb{C}(G)$ on $HH_\bullet(\mathscr{C}^G)$.


title: Error-Correcting Graph Codes

abstract: In this paper, we define, study, and construct {\em Error-Correcting Graph Codes}. An error-correcting graph code of distance $\delta$ is a family $C$ of graphs, on a common vertex set of size $n$, such that if we start with any graph in $C$, we would have to modify the neighborhoods of at least $\delta n$ vertices in order to reach some other graph in $C$. This is a natural graph generalization of the standard Hamming distance error-correcting codes for binary strings. We show: 1. Combinatorial results determining the optimal rate vs distance tradeoff nonconstructively. 2. A connection to rank-metric codes, enabling some simple and some involved constructions achieving certain positive rates and distances. 3. Graph code analogues of Reed-Solomon codes and code concatenation, leading to positive distance codes for all rates and positive rate codes for all distances. 4. Graph code analogues of dual-BCH codes, yielding large codes with distance $\delta = 1-o(1)$. This gives an explicit "graph code of Ramsey graphs". Several recent works, starting with the paper of Alon, Gujgiczer, K\"orner, Milojevi\'c, and Simonyi, have studied more general graph codes; where the symmetric difference between any two graphs in the code is required to have a desired property. Error-correcting graph codes are a particularly interesting instantiation of this concept.


title: SDQ: Sparse Decomposed Quantization for LLM Inference

abstract: Recently, large language models (LLMs) have shown surprising performance in task-specific workloads as well as general tasks with the given prompts. However, to achieve unprecedented performance, recent LLMs use billions to trillions of parameters, which hinder the wide adaptation of those models due to their extremely large compute and memory requirements. To resolve the issue, various model compression methods are being actively investigated. In this work, we propose SDQ (Sparse Decomposed Quantization) to exploit both structured sparsity and quantization to achieve both high compute and memory efficiency. From our evaluations, we observe that SDQ can achieve 4x effective compute throughput with <1% quality drop.


title: Global Human-guided Counterfactual Explanations for Molecular Properties via Reinforcement Learning

abstract: Counterfactual explanations of Graph Neural Networks (GNNs) offer a powerful way to understand data that can naturally be represented by a graph structure. Furthermore, in many domains, it is highly desirable to derive data-driven global explanations or rules that can better explain the high-level properties of the models and data in question. However, evaluating global counterfactual explanations is hard in real-world datasets due to a lack of human-annotated ground truth, which limits their use in areas like molecular sciences. Additionally, the increasing scale of these datasets provides a challenge for random search-based methods. In this paper, we develop a novel global explanation model RLHEX for molecular property prediction. It aligns the counterfactual explanations with human-defined principles, making the explanations more interpretable and easy for experts to evaluate. RLHEX includes a VAE-based graph generator to generate global explanations and an adapter to adjust the latent representation space to human-defined principles. Optimized by Proximal Policy Optimization (PPO), the global explanations produced by RLHEX cover 4.12% more input graphs and reduce the distance between the counterfactual explanation set and the input set by 0.47% on average across three molecular datasets. RLHEX provides a flexible framework to incorporate different human-designed principles into the counterfactual explanation generation process, aligning these explanations with domain expertise. The code and data are released at https://github.com/dqwang122/RLHEX.


title: Splatter a Video: Video Gaussian Representation for Versatile Processing

abstract: Video representation is a long-standing problem that is crucial for various down-stream tasks, such as tracking,depth prediction,segmentation,view synthesis,and editing. However, current methods either struggle to model complex motions due to the absence of 3D structure or rely on implicit 3D representations that are ill-suited for manipulation tasks. To address these challenges, we introduce a novel explicit 3D representation-video Gaussian representation -- that embeds a video into 3D Gaussians. Our proposed representation models video appearance in a 3D canonical space using explicit Gaussians as proxies and associates each Gaussian with 3D motions for video motion. This approach offers a more intrinsic and explicit representation than layered atlas or volumetric pixel matrices. To obtain such a representation, we distill 2D priors, such as optical flow and depth, from foundation models to regularize learning in this ill-posed setting. Extensive applications demonstrate the versatility of our new video representation. It has been proven effective in numerous video processing tasks, including tracking, consistent video depth and feature refinement, motion and appearance editing, and stereoscopic video generation. Project page: https://sunyangtian.github.io/spatter_a_video_web/